🍋 SEO Tools

Robots.txt Analyzer

Parse and test robots.txt rules against URLs

Free 브라우저 전용 No sign-up

입력

chars words sentences lines

두 번째 입력

분석 옵션

테스트 URL 경로

{# seo-og-debug, seo-headings, seo-readability, seo-links, seo-canonical, seo-structured-data, seo-word-count have no user-facing options — panel omitted #} {# ═══════════════════════════════════════════════════════════════ MATH TOOL OPTIONS (math-* engines) ═══════════════════════════════════════════════════════════════ #}

결과

Robots.txt Analyzer 소개

Paste your robots.txt content and test whether specific URLs are allowed or blocked for different user agents. Identify syntax errors and common configuration mistakes.

작동 방식

The tool parses robots.txt according to the Robots Exclusion Protocol. It groups rules by user-agent, resolves wildcards and $ anchors, and tests URLs against the most specific matching rule.

단계별 사용법

1 [
2 '
3 P
4 a
5 s
6 t
7 e
8
9 y
10 o
11 u
12 r
13
14 r
15 o
16 b
17 o
18 t
19 s
20 .
21 t
22 x
23 t
24
25 c
26 o
27 n
28 t
29 e
30 n
31 t
32
33 i
34 n
35 t
36 o
37
38 t
39 h
40 e
41
42 i
43 n
44 p
45 u
46 t
47
48 a
49 r
50 e
51 a
52 '
53 ,
54
55 '
56 E
57 n
58 t
59 e
60 r
61
62 a
63
64 U
65 R
66 L
67
68 t
69 o
70
71 t
72 e
73 s
74 t
75
76 i
77 n
78
79 t
80 h
81 e
82
83 o
84 p
85 t
86 i
87 o
88 n
89 s
90
91 p
92 a
93 n
94 e
95 l
96 '
97 ,
98
99 '
100 C
101 l
102 i
103 c
104 k
105
106 A
107 n
108 a
109 l
110 y
111 z
112 e
113
114 t
115 o
116
117 s
118 e
119 e
120
121 p
122 a
123 r
124 s
125 e
126 d
127
128 r
129 u
130 l
131 e
132 s
133
134 a
135 n
136 d
137
138 t
139 e
140 s
141 t
142
143 r
144 e
145 s
146 u
147 l
148 t
149 s
150 '
151 ]

팁

[
'
A
l
w
a
y
s
i
n
c
l
u
d
e
a
S
i
t
e
m
a
p
d
i
r
e
c
t
i
v
e
p
o
i
n
t
i
n
g
t
o
y
o
u
r
s
i
t
e
m
a
p
.
x
m
l
'
,
"
U
s
e
'
U
s
e
r
-
a
g
e
n
t
:
*
'
f
o
r
r
u
l
e
s
t
h
a
t
a
p
p
l
y
t
o
a
l
l
c
r
a
w
l
e
r
s
"
,
'
B
e
c
a
r
e
f
u
l
w
i
t
h
D
i
s
a
l
l
o
w
:
/
—
i
t
b
l
o
c
k
s
y
o
u
r
e
n
t
i
r
e
s
i
t
e
'
,
'
T
e
s
t
c
r
i
t
i
c
a
l
p
a
g
e
s
l
i
k
e
/
b
l
o
g
/
a
n
d
/
p
r
o
d
u
c
t
s
/
i
n
d
i
v
i
d
u
a
l
l
y
'
]

Categories

Robots.txt Analyzer

분석 옵션

결과

Robots.txt Analyzer 소개

작동 방식

단계별 사용법

팁

자주 묻는 질문