Robot.txt Distribuzione dell'utilizzo nel Sudan

Distribuzione per siti web che utilizzano Robot.txt tecnologie

Tecnologia	Siti web	%
Robots Disallow	88	30,34
Google Media Partners Disallow	16 ^*	5,52
Yahoo Slurp Disallow	13	4,48
Ahrefs Bot Disallow	13	4,48
GPTBot Disallow	13	11,93
Google Bard Disallow	11	10,09
Facebook Bot Disallow	11	10,09
AppleBot Disallow	10	3,45
Common Crawl Bot Disallow	10	9,17
Anthropic Claude Bot Disallow	10	9,17
Alexa Bot Disallow	9	8,26
Cohere AI Disallow	9	8,26
Apple AI Bot Disallow	9	8,26
Semrush Bot Disallow	9	3,1
Perplexity	8	7,34
Google AdsBot Mobile Apps Disallow	8	2,76
Soso Bot Disallow	6	2,07
Majestic Bot Disallow	5	1,72
ByteDance Bytespider Disallow	4	3,67
Microsoft MSNBot Disallow	4	1,38
Webz Omgili Disallow	4	3,67
Diffbot Disallow	3	2,75
Google Image Bot Disallow	2	0,69
DuckDuckGo Bot Disallow	2	0,69
YOU Disallow	2	1,83
Google News Bot Disallow	2	0,69
Google Video Bot Disallow	2	0,69
Google Favicon Disallow	2	0,69
Google API Bot Disallow	2	0,69
Google DuplexWeb Disallow	2	0,69
Youdao Bot Disallow	1	0,34