Robots.txt Répartition des utilisations au Timor oriental

Distribution pour les sites Web utilisant Robots.txt technologies

Technologie	Sites Web	%
Robots Disallow	44	11,7
Googlebot Disallow	33	8,78
Google Media Partners Disallow	32 ^*	8,51
Baidu Bot Disallow	30	7,98
Sogou Bot Disallow	26	6,91
Some Robots Disallow	20	5,32
Yahoo Slurp Disallow	19	5,05
Yandex Bot Disallow	17	4,52
Microsoft BingBot Disallow	16	4,26
Alexa Bot Disallow	16	21,33
Soso Bot Disallow	14	3,72
Ahrefs Bot Disallow	9	2,39
GPTBot Disallow	8	10,67
AppleBot Disallow	8	2,13
Common Crawl Bot Disallow	8	10,67
Anthropic Claude Bot Disallow	7	9,33
Google Bard Disallow	7	9,33
Facebook Bot Disallow	7	9,33
Google AdsBot Mobile Apps Disallow	6	1,6
Cohere AI Disallow	5	6,67
Apple AI Bot Disallow	5	6,67
Perplexity	5	6,67
Majestic Bot Disallow	5	1,33
Semrush Bot Disallow	4	1,06
Microsoft MSNBot Disallow	3	0,8
Webz Omgili Disallow	3	4
Google Image Bot Disallow	3	0,8
DuckDuckGo Bot Disallow	2	0,53
Google News Bot Disallow	2	0,53
Google Video Bot Disallow	2	0,53
Google Favicon Disallow	2	0,53
Google API Bot Disallow	2	0,53
Google DuplexWeb Disallow	2	0,53
ByteDance Bytespider Disallow	1	1,33
Exalead Bot Disallow	1	0,27
360 Bot Disallow	1	0,27
BuiltWithBot Disallow	1	0,27