Robots.txt Usage Distribution in Djibouti

Top In Robots.txt Usage Distribution in Djibouti

Technology	Websites	%
Some Robots Disallow	103	22.49
Robots Disallow	59	12.88
Soso Bot Disallow	24	5.24
Microsoft BingBot Disallow	23	5.02
Alexa Bot Disallow	21	4.59
Yahoo Slurp Disallow	21	4.59
Yandex Bot Disallow	19	4.15
Google Bard Disallow	17	3.71
Common Crawl Bot Disallow	16	3.49
Facebook Bot Disallow	16	3.49
GPTBot Disallow	15	3.28
Anthropic Claude Bot Disallow	15	3.28
Cohere AI Disallow	13	2.84
AppleBot Disallow	10	2.18
Apple AI Bot Disallow	10	2.18
Webz Omgili Disallow	10	2.18
Perplexity	8	1.75
Majestic Bot Disallow	8	1.75
Semrush Bot Disallow	8	1.75
Ahrefs Bot Disallow	7	1.53
ByteDance Bytespider Disallow	7	1.53
Google AdsBot Mobile Apps Disallow	6	1.31
Exalead Bot Disallow	6	1.31
360 Bot Disallow	5	1.09
BuiltWithBot Disallow	5	1.09
Microsoft MSNBot Disallow	2	0.44
Diffbot Disallow	2	0.44
YOU Disallow	2	0.44

458 Detections

of Robots.txt in Djibouti. Last updated 07th Mar 2025.

Some Robots Disallow is currently the most popular technology in this category.