Robots.txt Distribución de uso en Antártida

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Robots Disallow	4	16
Some Robots Disallow	2	8
Baidu Bot Disallow	2	8
Anthropic Claude Bot Disallow	2	8
Yandex Bot Disallow	1	4
Microsoft BingBot Disallow	1	4
Alexa Bot Disallow	1	4
Yahoo Slurp Disallow	1	4
Soso Bot Disallow	1	4
Ahrefs Bot Disallow	1	4
Common Crawl Bot Disallow	1	4
GPTBot Disallow	1	4
AppleBot Disallow	1	4
Google Bard Disallow	1	4
Facebook Bot Disallow	1	4
Apple AI Bot Disallow	1	4
Cohere AI Disallow	1	4
Perplexity	1	4
Google AdsBot Mobile Apps Disallow	1	4