Robots.txt Répartition des utilisations au Kirghizistan

Distribution pour les sites Web utilisant Robots.txt technologies

Technologie	Sites Web	%
Robots Disallow	279	21,99
Yandex Bot Disallow	251	19,78
Googlebot Disallow	206	16,23
Alexa Bot Disallow	43	3,39
Microsoft BingBot Disallow	41	3,23
Ahrefs Bot Disallow	41	3,23
Baidu Bot Disallow	36	2,84
Majestic Bot Disallow	36	2,84
Google AdsBot Disallow	35	2,76
Yahoo Slurp Disallow	34	2,68
Sogou Bot Disallow	30	2,36
Semrush Bot Disallow	30	2,36
Google Media Partners Disallow	29 ^*	2,29
Soso Bot Disallow	29	2,29
Some Robots Disallow	28	2,21
Google AdsBot Mobile Disallow	26	2,05
Microsoft MSNBot Disallow	17	1,34
GPTBot Disallow	13	1,02
Common Crawl Bot Disallow	8	0,63
Anthropic Claude Bot Disallow	7	0,55
AppleBot Disallow	6	0,47
Google Bard Disallow	5	0,39
Facebook Bot Disallow	5	0,39
Google AdsBot Mobile Apps Disallow	4	0,32
ByteDance Bytespider Disallow	4	0,32
Cohere AI Disallow	3	0,24
Apple AI Bot Disallow	3	0,24
Perplexity	3	0,24
360 Bot Disallow	3	0,24
Google Image Bot Disallow	3	0,24
Exalead Bot Disallow	2	0,16
BuiltWithBot Disallow	2	0,16
YOU Disallow	2	0,16
Google Read Aloud Disallow	2	0,16
DuckDuckGo Bot Disallow	1	0,08
Google Favicon Disallow	1	0,08
Google FeedFetcher Disallow	1	0,08