AI Bot Usage Distribution on the Entire Internet

Top In AI Bot Usage Distribution on the Entire Internet

Technology	Websites	%
Alexa Bot Disallow	5,502,757	15.52
GPTBot Disallow	3,819,787	10.78
Common Crawl Bot Disallow	3,689,029	10.41
Anthropic Claude Bot Disallow	3,542,190	9.99
Google Bard Disallow	3,382,611	9.54
Facebook Bot Disallow	3,340,030	9.42
Cohere AI Disallow	3,236,580	9.13
Apple AI Bot Disallow	3,225,055	9.1
Perplexity	3,161,273	8.92
AmazonBot Disallow	981,982	2.77
ByteDance Bytespider Disallow	734,933	2.07
Webz Omgili Disallow	417,754	1.18
Diffbot Disallow	257,932	0.73
YOU Disallow	155,792	0.44

35,447,705 Detections

of AI Bot on the Entire Internet. Last updated 07th Jun 2025.

Alexa Bot Disallow is currently the most popular technology in this category.