Robots.txt Distribución de uso en Guayana Francesa

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Googlebot Disallow	167	22,18
Google AdsBot Disallow	150	19,92
Google AdsBot Mobile Disallow	128	17
Robots Disallow	37	4,91
Baidu Bot Disallow	30	3,98
Ahrefs Bot Disallow	29	3,85
Yandex Bot Disallow	18	2,39
Google Media Partners Disallow	16 ^*	2,12
Yahoo Slurp Disallow	16	2,12
Microsoft BingBot Disallow	15	1,99
Alexa Bot Disallow	15	21,43
Sogou Bot Disallow	15	1,99
Soso Bot Disallow	14	1,86
GPTBot Disallow	11	15,71
Common Crawl Bot Disallow	9	12,86
Google Bard Disallow	7	10
Majestic Bot Disallow	7	0,93
Google AdsBot Mobile Apps Disallow	6	0,8
Google Image Bot Disallow	6	0,8
AppleBot Disallow	5	0,66
Anthropic Claude Bot Disallow	5	7,14
Facebook Bot Disallow	5	7,14
Apple AI Bot Disallow	5	7,14
Perplexity	5	7,14
Semrush Bot Disallow	5	0,66
Cohere AI Disallow	4	5,71
Exalead Bot Disallow	4	0,53
Microsoft MSNBot Disallow	3	0,4
Google Video Bot Disallow	3	0,4
Google News Bot Disallow	2	0,27
DuckDuckGo Bot Disallow	2	0,27
Google Favicon Disallow	2	0,27
Google API Bot Disallow	2	0,27
Google DuplexWeb Disallow	2	0,27
ByteDance Bytespider Disallow	1	1,43
Webz Omgili Disallow	1	1,43
YOU Disallow	1	1,43