Robots.txt Répartition de l'utilisation dans Birmanie

Distribution pour les sites Web utilisant Robots.txt les technologies

Technologie	Sites Internet	%
Google AdsBot Disallow	192	11,83
Googlebot Disallow	168	10,35
Robots Disallow	164	10,1
Google AdsBot Mobile Disallow	158	9,74
AppleBot Disallow	64	3,94
Ahrefs Bot Disallow	62	3,82
Common Crawl Bot Disallow	62	3,82
GPTBot Disallow	58	3,57
Anthropic Claude Bot Disallow	57	3,51
Google Bard Disallow	57	3,51
Facebook Bot Disallow	57	3,51
Apple AI Bot Disallow	57	3,51
Perplexity	56	3,45
Cohere AI Disallow	54	3,33
Google AdsBot Mobile Apps Disallow	52	3,2
Some Robots Disallow	43	2,65
Yandex Bot Disallow	39	2,4
Microsoft BingBot Disallow	36	2,22
Yahoo Slurp Disallow	32	1,97
Majestic Bot Disallow	28	1,73
Alexa Bot Disallow	27	1,66
Soso Bot Disallow	27	1,66
Semrush Bot Disallow	25	1,54
ByteDance Bytespider Disallow	10	0,62
Exalead Bot Disallow	7	0,43
360 Bot Disallow	6	0,37
Webz Omgili Disallow	5	0,31
DuckDuckGo Bot Disallow	5	0,31
Microsoft MSNBot Disallow	4	0,25
Google Image Bot Disallow	3	0,18
Diffbot Disallow	3	0,18
BuiltWithBot Disallow	2	0,12
YOU Disallow	2	0,12
Youdao Bot Disallow	1	0,06