Robots.txt Usage Distribution in Mauritania

Top In Robots.txt Usage Distribution in Mauritania

Technology	Websites	%
Robots Disallow	34	27.2
Yandex Bot Disallow	12	9.6
Alexa Bot Disallow	9	26.47
Ahrefs Bot Disallow	8	6.4
Microsoft BingBot Disallow	7	5.6
Yahoo Slurp Disallow	7	5.6
Soso Bot Disallow	7	5.6
Majestic Bot Disallow	6	4.8
Semrush Bot Disallow	5	4
GPTBot Disallow	4	11.76
Common Crawl Bot Disallow	3	8.82
AppleBot Disallow	3	2.4
Anthropic Claude Bot Disallow	3	8.82
Google Bard Disallow	3	8.82
Facebook Bot Disallow	3	8.82
Perplexity	3	8.82
Google AdsBot Mobile Apps Disallow	3	2.4
Cohere AI Disallow	2	5.88
Apple AI Bot Disallow	2	5.88
ByteDance Bytespider Disallow	1	2.94

125 Detections

of Robots.txt in Mauritania. Last updated 21st Apr 2025.

Robots Disallow is currently the most popular technology in this category.