Robots.txt Usage Distribution in Suriname

Distribution for websites using Robots.txt technologies

Technology	Websites	%
Robots Disallow	84	23.27
Yandex Bot Disallow	21	5.82
Microsoft BingBot Disallow	19	5.26
Ahrefs Bot Disallow	17	4.71
Yahoo Slurp Disallow	17	4.71
Anthropic Claude Bot Disallow	16	12.12
Alexa Bot Disallow	15	11.36
Sogou Bot Disallow	15	4.16
GPTBot Disallow	15	11.36
Common Crawl Bot Disallow	15	11.36
Google Bard Disallow	15	11.36
Soso Bot Disallow	14	3.88
AppleBot Disallow	14	3.88
Facebook Bot Disallow	13	9.85
Apple AI Bot Disallow	13	9.85
Perplexity	12	9.09
Google AdsBot Mobile Apps Disallow	11	3.05
Cohere AI Disallow	11	8.33
Majestic Bot Disallow	5	1.39
Semrush Bot Disallow	5	1.39
Microsoft MSNBot Disallow	4	1.11
ByteDance Bytespider Disallow	2	1.52
Google Image Bot Disallow	2	0.55
Webz Omgili Disallow	2	1.52
Exalead Bot Disallow	1	0.28
Google News Bot Disallow	1	0.28
Google Video Bot Disallow	1	0.28
DuckDuckGo Bot Disallow	1	0.28