AI Bot Usage Distribution on the Entire Internet

Top In AI Bot Usage Distribution on the Entire Internet

Technology	Websites	%
Alexa Bot Disallow	4,883,371	18.48
GPTBot Disallow	2,727,265	10.32
Common Crawl Bot Disallow	2,682,292	10.15
Anthropic Claude Bot Disallow	2,548,782	9.64
Google Bard Disallow	2,421,613	9.16
Facebook Bot Disallow	2,391,535	9.05
Cohere AI Disallow	2,305,690	8.72
Apple AI Bot Disallow	2,273,964	8.6
Perplexity	2,230,267	8.44
AmazonBot Disallow	688,703	2.61
ByteDance Bytespider Disallow	641,870	2.43
Webz Omgili Disallow	347,921	1.32
Diffbot Disallow	179,949	0.68
YOU Disallow	105,454	0.4

26,428,676 Detections

of AI Bot on the Entire Internet. Last updated 21st Apr 2025.

Alexa Bot Disallow is currently the most popular technology in this category.