Robots.txt Usage Distribution in Burundi

Distribution for websites using Robots.txt technologies

Technology	Websites	%
Robots Disallow	42	18.42
Yandex Bot Disallow	20	8.77
Microsoft BingBot Disallow	19	8.33
Sogou Bot Disallow	19	8.33
Alexa Bot Disallow	18	27.69
Yahoo Slurp Disallow	18	7.89
Soso Bot Disallow	18	7.89
GPTBot Disallow	9	13.85
Ahrefs Bot Disallow	8	3.51
Common Crawl Bot Disallow	6	9.23
Google Bard Disallow	6	9.23
Majestic Bot Disallow	6	2.63
AppleBot Disallow	5	2.19
Anthropic Claude Bot Disallow	5	7.69
Facebook Bot Disallow	5	7.69
Google AdsBot Mobile Apps Disallow	5	2.19
Apple AI Bot Disallow	5	7.69
Cohere AI Disallow	5	7.69
Perplexity	5	7.69
Semrush Bot Disallow	4	1.75