Robots.txt Distribución de uso en El Salvador

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Google AdsBot Disallow	477	14,61
Googlebot Disallow	343	10,5
Google AdsBot Mobile Disallow	343	10,5
Robots Disallow	179	5,48
Ahrefs Bot Disallow	164	5,02
GPTBot Disallow	119	12,54
Common Crawl Bot Disallow	116	12,22
AppleBot Disallow	113	3,46
Anthropic Claude Bot Disallow	109	11,49
Google AdsBot Mobile Apps Disallow	109	3,34
Google Bard Disallow	108	11,38
Facebook Bot Disallow	108	11,38
Apple AI Bot Disallow	108	11,38
Perplexity	108	11,38
Cohere AI Disallow	106	11,17
Baidu Bot Disallow	85	2,6
Yandex Bot Disallow	68	2,08
Google Media Partners Disallow	65 ^*	1,99
Some Robots Disallow	64	1,96
Microsoft BingBot Disallow	59	1,81
Alexa Bot Disallow	54	5,69
Yahoo Slurp Disallow	54	1,65
Soso Bot Disallow	49	1,5
Sogou Bot Disallow	48	1,47
Majestic Bot Disallow	33	1,01
Semrush Bot Disallow	32	0,98
Microsoft MSNBot Disallow	17	0,52
Exalead Bot Disallow	6	0,18
Google Image Bot Disallow	5	0,15
ByteDance Bytespider Disallow	4	0,42
360 Bot Disallow	3	0,09
Webz Omgili Disallow	3	0,32
BuiltWithBot Disallow	2	0,06
Google News Bot Disallow	1	0,03
Google Video Bot Disallow	1	0,03
Diffbot Disallow	1	0,11
Youdao Bot Disallow	1	0,03
Pipl Disallow	1	0,03