Robots.txt Usage Distribution in Nicaragua

Distribution for websites using Robots.txt technologies

Technology	Websites	%
Googlebot Disallow	172	9.4
Robots Disallow	137 ^*	7.49
AppleBot Disallow	114	6.23
GPTBot Disallow	95	5.19
Anthropic Claude Bot Disallow	92	5.03
Common Crawl Bot Disallow	90	4.92
Google Bard Disallow	90	4.92
Facebook Bot Disallow	89	4.87
Cohere AI Disallow	89	4.87
Apple AI Bot Disallow	89	4.87
Perplexity	89	4.87
Baidu Bot Disallow	73	3.99
Yahoo Slurp Disallow	71	3.88
Google AdsBot Mobile Apps Disallow	65	3.55
Alexa Bot Disallow	60	3.28
Some Robots Disallow	56	3.06
Microsoft BingBot Disallow	53	2.9
Google Media Partners Disallow	53 ^*	2.9
Yandex Bot Disallow	51	2.79
Ahrefs Bot Disallow	33	1.8
Soso Bot Disallow	32	1.75
Microsoft MSNBot Disallow	31	1.69
Majestic Bot Disallow	27	1.48
Google Image Bot Disallow	27	1.48
Semrush Bot Disallow	12	0.66
ByteDance Bytespider Disallow	8	0.44
Exalead Bot Disallow	7	0.38
Diffbot Disallow	4	0.22
Google Video Bot Disallow	4	0.22
Google News Bot Disallow	4	0.22
Google Favicon Disallow	4	0.22
Webz Omgili Disallow	3	0.16
YOU Disallow	2	0.11
360 Bot Disallow	1	0.05
DuckDuckGo Bot Disallow	1	0.05
Google API Bot Disallow	1	0.05
Google DuplexWeb Disallow	1	0.05