Robots.txt Répartition de l'utilisation dans Algérie

Distribution pour les sites Web utilisant Robots.txt les technologies

Technologie	Sites Internet	%
Robots Disallow	333	13,36
Google Media Partners Disallow	291 ^*	11,68
Googlebot Disallow	265	10,63
Google AdsBot Disallow	262	10,51
Ahrefs Bot Disallow	166	6,66
Baidu Bot Disallow	133	5,34
Yandex Bot Disallow	104	4,17
Yahoo Slurp Disallow	86	3,45
Microsoft BingBot Disallow	80	3,21
Some Robots Disallow	75	3,01
Alexa Bot Disallow	68	2,73
Soso Bot Disallow	67	2,69
Sogou Bot Disallow	64	2,57
Majestic Bot Disallow	56	2,25
Semrush Bot Disallow	47	1,89
GPTBot Disallow	44	1,77
Common Crawl Bot Disallow	34	1,36
Microsoft MSNBot Disallow	30	1,2
Google Bard Disallow	27	1,08
Google AdsBot Mobile Apps Disallow	27	1,08
AppleBot Disallow	24	0,96
Anthropic Claude Bot Disallow	24	0,96
Facebook Bot Disallow	18	0,72
Apple AI Bot Disallow	17	0,68
Perplexity	17	0,68
Cohere AI Disallow	16	0,64
Google Image Bot Disallow	16	0,64
ByteDance Bytespider Disallow	11	0,44
Exalead Bot Disallow	11	0,44
Google News Bot Disallow	11	0,44
Google Video Bot Disallow	11	0,44
DuckDuckGo Bot Disallow	9	0,36
Google Favicon Disallow	9	0,36
Google API Bot Disallow	9	0,36
Google DuplexWeb Disallow	9	0,36
360 Bot Disallow	7	0,28
Youdao Bot Disallow	5	0,2
Webz Omgili Disallow	4	0,16
BuiltWithBot Disallow	4	0,16
Pipl Disallow	1	0,04