로봇.txt 사용 분포 그리스에서

상위 로봇.txt 사용 분포 그리스에서

기술	웹사이트	%
Googlebot Disallow	9,212	9.29
Google AdsBot Disallow	8,188	8.25
Google AdsBot Mobile Disallow	6,359	6.41
Robots Disallow	5,311	5.35
Ahrefs Bot Disallow	4,841	4.88
Baidu Bot Disallow	3,898	3.93
Sogou Bot Disallow	3,648	3.68
Yandex Bot Disallow	3,582	3.61
Common Crawl Bot Disallow	3,341	3.37
GPTBot Disallow	3,277	3.3
Semrush Bot Disallow	3,098	3.12
Soso Bot Disallow	2,972	3
Majestic Bot Disallow	2,945	2.97
Yahoo Slurp Disallow	2,934	2.96
Microsoft BingBot Disallow	2,888	2.91
Anthropic Claude Bot Disallow	2,758	2.78
Alexa Bot Disallow	2,722	2.74
AppleBot Disallow	2,263	2.28
Google Bard Disallow	2,250	2.27
Facebook Bot Disallow	2,224	2.24
Apple AI Bot Disallow	2,095	2.11
Cohere AI Disallow	2,047	2.06
Perplexity	2,035	2.05
Some Robots Disallow	2,026	2.04
ByteDance Bytespider Disallow	1,512	1.52
Exalead Bot Disallow	1,363	1.37
YOU Disallow	1,314	1.32
360 Bot Disallow	1,143	1.15
Webz Omgili Disallow	1,129	1.14
Google AdsBot Mobile Apps Disallow	1,062	1.07
Google Media Partners Disallow	1,049 *	1.06
Microsoft MSNBot Disallow	981	0.99
Diffbot Disallow	929	0.94
BuiltWithBot Disallow	676	0.68
Google Image Bot Disallow	410	0.41
DuckDuckGo Bot Disallow	253	0.26
Google News Bot Disallow	95	0.1
Google Video Bot Disallow	95	0.1
Google Favicon Disallow	83	0.08
Google API Bot Disallow	72	0.07
Google DuplexWeb Disallow	67	0.07
Pipl Disallow	34	0.03
Youdao Bot Disallow	14	0.01
Google Read Aloud Disallow	3	0
Google FeedFetcher Disallow	3	0
LLMS Text	1	0

99,202 탐지

~의 로봇.txt 그리스에서. 마지막 업데이트 13th 5 2025.

Googlebot Disallow 현재 이 범주에서 가장 인기 있는 기술입니다.