Robots.txt Distribución de uso en Maldivas

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Google AdsBot Disallow	283	17,46
Google AdsBot Mobile Disallow	196	12,09
Googlebot Disallow	169	10,43
Robots Disallow	136	8,39
Ahrefs Bot Disallow	99	6,11
Common Crawl Bot Disallow	62	3,82
GPTBot Disallow	60	3,7
Google AdsBot Mobile Apps Disallow	57	3,52
Anthropic Claude Bot Disallow	55	3,39
Google Bard Disallow	54	3,33
Facebook Bot Disallow	54	3,33
Cohere AI Disallow	53	3,27
AppleBot Disallow	52	3,21
Apple AI Bot Disallow	52	3,21
Perplexity	51	3,15
Some Robots Disallow	38	2,34
Baidu Bot Disallow	25	1,54
Yandex Bot Disallow	19	1,17
Microsoft BingBot Disallow	16	0,99
Alexa Bot Disallow	14	0,86
Yahoo Slurp Disallow	14	0,86
Sogou Bot Disallow	13	0,8
Soso Bot Disallow	13	0,8
Majestic Bot Disallow	8	0,49
Semrush Bot Disallow	8	0,49
Microsoft MSNBot Disallow	6	0,37
ByteDance Bytespider Disallow	3	0,19
Google Image Bot Disallow	3	0,19
Exalead Bot Disallow	2	0,12
360 Bot Disallow	2	0,12
Webz Omgili Disallow	2	0,12
BuiltWithBot Disallow	1	0,06
Diffbot Disallow	1	0,06