Robots.txt Répartition des utilisations aux Bahamas

Distribution pour les sites Web utilisant Robots.txt technologies

Technologie	Sites Web	%
Google AdsBot Disallow	225	8,42
Google AdsBot Mobile Disallow	188	7,04
Googlebot Disallow	171	6,4
GPTBot Disallow	129	4,83
Common Crawl Bot Disallow	122	4,57
Robots Disallow	119	4,46
Google Bard Disallow	118	4,42
AppleBot Disallow	116	4,34
Anthropic Claude Bot Disallow	116	4,34
Facebook Bot Disallow	113	4,23
Perplexity	112	4,19
Apple AI Bot Disallow	108	4,04
Cohere AI Disallow	107	4,01
Google AdsBot Mobile Apps Disallow	107	4,01
Ahrefs Bot Disallow	90	3,37
Baidu Bot Disallow	86	3,22
Sogou Bot Disallow	73	2,73
Yandex Bot Disallow	63	2,36
Microsoft BingBot Disallow	61	2,28
Yahoo Slurp Disallow	56	2,1
Alexa Bot Disallow	54	2,02
Soso Bot Disallow	51	1,91
Majestic Bot Disallow	46	1,72
Some Robots Disallow	43	1,61
Semrush Bot Disallow	31	1,16
Google Media Partners Disallow	27 ^*	1,01
ByteDance Bytespider Disallow	20	0,75
Exalead Bot Disallow	17	0,64
Microsoft MSNBot Disallow	15	0,56
Webz Omgili Disallow	11	0,41
Google Image Bot Disallow	11	0,41
360 Bot Disallow	10	0,37
BuiltWithBot Disallow	9	0,34
Diffbot Disallow	8	0,3
YOU Disallow	8	0,3
Google News Bot Disallow	5	0,19
Google Video Bot Disallow	5	0,19
DuckDuckGo Bot Disallow	5	0,19
Google Favicon Disallow	5	0,19
Google API Bot Disallow	4	0,15
Google DuplexWeb Disallow	4	0,15
Youdao Bot Disallow	1	0,04
Pipl Disallow	1	0,04