Robots.txt Usage Distribution in Mongolia

Distribution for websites using Robots.txt technologies

Technology	Websites	%
Googlebot Disallow	328	18.62
Robots Disallow	190	10.78
Yandex Bot Disallow	145	8.23
Baidu Bot Disallow	140	7.95
Microsoft BingBot Disallow	135	7.66
Yahoo Slurp Disallow	126	7.15
Soso Bot Disallow	106	6.02
Sogou Bot Disallow	105	5.96
Some Robots Disallow	100	5.68
Ahrefs Bot Disallow	70	3.97
GPTBot Disallow	64	3.63
Google AdsBot Mobile Apps Disallow	44	2.5
Alexa Bot Disallow	43	2.44
Google Media Partners Disallow	40	2.27
Majestic Bot Disallow	39	2.21
Semrush Bot Disallow	33	1.87
360 Bot Disallow	15	0.85
Microsoft MSNBot Disallow	8	0.45
Google Image Bot Disallow	8	0.45
Google News Bot Disallow	4	0.23
Google Video Bot Disallow	4	0.23
Exalead Bot Disallow	3	0.17
Google Favicon Disallow	3	0.17
DuckDuckGo Bot Disallow	3	0.17
Youdao Bot Disallow	2	0.11
Google API Bot Disallow	2	0.11
Google DuplexWeb Disallow	2	0.11