AI Bot Usage Distribution on the Entire Internet

Top In AI Bot Usage Distribution on the Entire Internet

Technology	Websites	%
Alexa Bot Disallow	5,217,515	14.29
GPTBot Disallow	3,819,558	10.46
Common Crawl Bot Disallow	3,722,656	10.2
Anthropic Claude Bot Disallow	3,591,156	9.84
Google Bard Disallow	3,430,304	9.39
Facebook Bot Disallow	3,384,465	9.27
Apple AI Bot Disallow	3,293,219	9.02
Cohere AI Disallow	3,282,715	8.99
Perplexity	3,229,070	8.84
AmazonBot Disallow	2,039,981	5.59
ByteDance Bytespider Disallow	673,782	1.85
Webz Omgili Disallow	392,093	1.07
Diffbot Disallow	268,227	0.73
YOU Disallow	164,979	0.45
Anthropic Claude User Bot Disallow	3,763	0.01

36,513,483 Detections

of AI Bot on the Entire Internet. Last updated 01st Jul 2025.

Alexa Bot Disallow is currently the most popular technology in this category.