Robots.txt Distribución de uso en Yibuti

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Some Robots Disallow	102	20,24
Robots Disallow	62	12,3
Soso Bot Disallow	28	5,56
Microsoft BingBot Disallow	27	5,36
Yahoo Slurp Disallow	25	4,96
Alexa Bot Disallow	24	13,71
Yandex Bot Disallow	22	4,37
Google Bard Disallow	19	10,86
Common Crawl Bot Disallow	18	10,29
Facebook Bot Disallow	18	10,29
GPTBot Disallow	17	9,71
Anthropic Claude Bot Disallow	17	9,71
Cohere AI Disallow	15	8,57
AppleBot Disallow	11	2,18
Apple AI Bot Disallow	11	6,29
Webz Omgili Disallow	11	6,29
Ahrefs Bot Disallow	9	1,79
Perplexity	9	5,14
Majestic Bot Disallow	9	1,79
Semrush Bot Disallow	9	1,79
ByteDance Bytespider Disallow	8	4,57
Google AdsBot Mobile Apps Disallow	7	1,39
Exalead Bot Disallow	7	1,39
360 Bot Disallow	6	1,19
BuiltWithBot Disallow	6	1,19
Microsoft MSNBot Disallow	3	0,6
Diffbot Disallow	2	1,14
YOU Disallow	2	1,14