AI Bot Usage Distribution on the Entire Internet

Top In AI Bot Usage Distribution on the Entire Internet

Technology	Websites	%
Alexa Bot Disallow	5,029,184	14.06
GPTBot Disallow	3,751,266	10.49
Common Crawl Bot Disallow	3,681,953	10.29
Anthropic Claude Bot Disallow	3,551,800	9.93
Google Bard Disallow	3,391,288	9.48
Facebook Bot Disallow	3,347,039	9.36
Apple AI Bot Disallow	3,256,425	9.1
Cohere AI Disallow	3,248,417	9.08
Perplexity	3,192,806	8.93
AmazonBot Disallow	1,841,069	5.15
ByteDance Bytespider Disallow	665,525	1.86
Webz Omgili Disallow	386,711	1.08
Diffbot Disallow	262,940	0.74
YOU Disallow	160,638	0.45
Anthropic Claude User Bot Disallow	1,653	0

35,768,714 Detections

of AI Bot on the Entire Internet. Last updated 07th Jun 2025.

Alexa Bot Disallow is currently the most popular technology in this category.