Robots.txt Distribución de uso en Argelia

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Google Media Partners Disallow	406 ^*	12,93
Robots Disallow	389	12,39
Googlebot Disallow	283	9,02
Google AdsBot Disallow	269	8,57
Ahrefs Bot Disallow	211	6,72
Baidu Bot Disallow	151	4,81
Google AdsBot Mobile Disallow	145	4,62
Yandex Bot Disallow	125	3,98
Yahoo Slurp Disallow	104	3,31
Microsoft BingBot Disallow	97	3,09
Sogou Bot Disallow	96	3,06
Alexa Bot Disallow	87	2,77
Some Robots Disallow	86	2,74
Soso Bot Disallow	85	2,71
Majestic Bot Disallow	53	1,69
GPTBot Disallow	50	1,59
Semrush Bot Disallow	48	1,53
Common Crawl Bot Disallow	46	1,47
Google Bard Disallow	40	1,27
AppleBot Disallow	33	1,05
Anthropic Claude Bot Disallow	32	1,02
Microsoft MSNBot Disallow	30	0,96
Google AdsBot Mobile Apps Disallow	29	0,92
Facebook Bot Disallow	26	0,83
Perplexity	26	0,83
Apple AI Bot Disallow	25	0,8
Cohere AI Disallow	23	0,73
ByteDance Bytespider Disallow	18	0,57
Google Image Bot Disallow	15	0,48
Exalead Bot Disallow	11	0,35
Google News Bot Disallow	11	0,35
Google Video Bot Disallow	11	0,35
DuckDuckGo Bot Disallow	11	0,35
Google Favicon Disallow	11	0,35
Google API Bot Disallow	11	0,35
Google DuplexWeb Disallow	11	0,35
Webz Omgili Disallow	9	0,29
360 Bot Disallow	7	0,22
Diffbot Disallow	5	0,16
YOU Disallow	5	0,16
BuiltWithBot Disallow	4	0,13
Youdao Bot Disallow	3	0,1
Pipl Disallow	1	0,03