Robots.txt Usage Distribution in Saint Vincent and the Grenadines

Distribution for websites using Robots.txt technologies

Technology	Websites	%
Googlebot Disallow	2,254	17.21
Baidu Bot Disallow	1,938	14.79
Some Robots Disallow	1,579	12.05
Sogou Bot Disallow	1,419	10.83
Google AdsBot Disallow	574	4.38
Google AdsBot Mobile Disallow	564	4.31
Alexa Bot Disallow	405	3.09
Microsoft BingBot Disallow	403	3.08
Yandex Bot Disallow	402	3.07
Yahoo Slurp Disallow	395	3.02
Soso Bot Disallow	394	3.01
Robots Disallow	291	2.22
GPTBot Disallow	230	1.76
Google Bard Disallow	221	1.69
Common Crawl Bot Disallow	216	1.65
AppleBot Disallow	216	1.65
Anthropic Claude Bot Disallow	216	1.65
Facebook Bot Disallow	216	1.65
Apple AI Bot Disallow	214	1.63
Cohere AI Disallow	207	1.58
Perplexity	206	1.57
Google AdsBot Mobile Apps Disallow	201	1.53
Google Media Partners Disallow	190 ^*	1.45
Majestic Bot Disallow	38	0.29
Semrush Bot Disallow	36	0.27
Ahrefs Bot Disallow	30	0.23
Webz Omgili Disallow	15	0.11
ByteDance Bytespider Disallow	8	0.06
Diffbot Disallow	5	0.04
YOU Disallow	5	0.04
Exalead Bot Disallow	3	0.02
360 Bot Disallow	3	0.02
Microsoft MSNBot Disallow	1	0.01
Google Image Bot Disallow	1	0.01
BuiltWithBot Disallow	1	0.01
Google News Bot Disallow	1	0.01
DuckDuckGo Bot Disallow	1	0.01
Pipl Disallow	1	0.01