Robots.txt Répartition des utilisations en Lettonie

Distribution pour les sites Web utilisant Robots.txt technologies

Technologie	Sites Web	%
Googlebot Disallow	4 447	13,92
Google AdsBot Disallow	4 187	13,1
Google AdsBot Mobile Disallow	2 882	9,02
Robots Disallow	1 946	6,09
Baidu Bot Disallow	1 663	5,2
Yandex Bot Disallow	1 615	5,05
Ahrefs Bot Disallow	1 580	4,94
Sogou Bot Disallow	1 504	4,71
Alexa Bot Disallow	1 215	3,8
Soso Bot Disallow	1 156	3,62
Microsoft BingBot Disallow	1 152	3,61
Yahoo Slurp Disallow	1 108	3,47
Some Robots Disallow	959	3
Majestic Bot Disallow	707	2,21
Semrush Bot Disallow	585	1,83
Common Crawl Bot Disallow	503	1,57
Google Media Partners Disallow	468 ^*	1,46
GPTBot Disallow	422	1,32
Anthropic Claude Bot Disallow	403	1,26
Google Bard Disallow	384	1,2
AppleBot Disallow	383	1,2
Facebook Bot Disallow	379	1,19
Apple AI Bot Disallow	348	1,09
Google AdsBot Mobile Apps Disallow	336	1,05
Cohere AI Disallow	328	1,03
Perplexity	327	1,02
Exalead Bot Disallow	191	0,6
ByteDance Bytespider Disallow	136	0,43
Microsoft MSNBot Disallow	113	0,35
360 Bot Disallow	93	0,29
Google Image Bot Disallow	84	0,26
BuiltWithBot Disallow	79	0,25
Webz Omgili Disallow	57	0,18
DuckDuckGo Bot Disallow	35	0,11
Google Video Bot Disallow	31	0,1
Google News Bot Disallow	29	0,09
Google Favicon Disallow	28	0,09
Google API Bot Disallow	27	0,08
Google DuplexWeb Disallow	27	0,08
Diffbot Disallow	19	0,06
YOU Disallow	10	0,03
Pipl Disallow	6	0,02
Youdao Bot Disallow	2	0,01
Google Read Aloud Disallow	1	0