Robots.txt Répartition de l'utilisation dans Irak

Distribution pour les sites Web utilisant Robots.txt les technologies

Technologie	Sites Internet	%
Googlebot Disallow	305	18,35
Google AdsBot Disallow	295	17,75
Robots Disallow	139	8,36
Yandex Bot Disallow	117	7,04
Majestic Bot Disallow	102	6,14
Ahrefs Bot Disallow	74	4,45
Some Robots Disallow	65	3,91
Microsoft BingBot Disallow	43	2,59
Alexa Bot Disallow	42	14,19
Yahoo Slurp Disallow	37	2,23
Soso Bot Disallow	36	2,17
Sogou Bot Disallow	34	2,05
GPTBot Disallow	33	11,15
AppleBot Disallow	32	1,93
Common Crawl Bot Disallow	31	10,47
Anthropic Claude Bot Disallow	31	10,47
Google Bard Disallow	30	10,14
Facebook Bot Disallow	30	10,14
Apple AI Bot Disallow	30	10,14
Perplexity	29	9,8
Google AdsBot Mobile Apps Disallow	28	1,68
Cohere AI Disallow	27	9,12
Semrush Bot Disallow	23	1,38
Microsoft MSNBot Disallow	10	0,6
Google Image Bot Disallow	10	0,6
Exalead Bot Disallow	7	0,42
Google News Bot Disallow	4	0,24
Google Video Bot Disallow	4	0,24
360 Bot Disallow	3	0,18
Webz Omgili Disallow	3	1,01
ByteDance Bytespider Disallow	2	0,68
BuiltWithBot Disallow	1	0,06
DuckDuckGo Bot Disallow	1	0,06
Google Favicon Disallow	1	0,06
Youdao Bot Disallow	1	0,06
Google API Bot Disallow	1	0,06
Google DuplexWeb Disallow	1	0,06