Robots.txt Répartition de l'utilisation dans République dominicaine

Distribution pour les sites Web utilisant Robots.txt les technologies

Technologie	Sites Internet	%
Google AdsBot Disallow	1 679	12,33
Googlebot Disallow	1 325	9,73
Google AdsBot Mobile Disallow	934	6,86
Ahrefs Bot Disallow	729	5,36
Baidu Bot Disallow	670	4,92
AppleBot Disallow	659	4,84
Yandex Bot Disallow	590	4,33
Microsoft BingBot Disallow	566	4,16
Yahoo Slurp Disallow	558	4,1
Robots Disallow	548	4,03
GPTBot Disallow	544	4
Google Image Bot Disallow	365	2,68
Common Crawl Bot Disallow	337	2,48
ByteDance Bytespider Disallow	333	2,45
Semrush Bot Disallow	319	2,34
Google AdsBot Mobile Apps Disallow	314	2,31
Google Bard Disallow	311	2,28
Anthropic Claude Bot Disallow	305	2,24
Facebook Bot Disallow	304	2,23
Apple AI Bot Disallow	300	2,2
Perplexity	288	2,12
Cohere AI Disallow	286	2,1
Majestic Bot Disallow	272	2
Alexa Bot Disallow	227	1,67
Sogou Bot Disallow	205	1,51
Soso Bot Disallow	204	1,5
Some Robots Disallow	160	1,18
Google Media Partners Disallow	113 ^*	0,83
Microsoft MSNBot Disallow	46	0,34
Webz Omgili Disallow	25	0,18
Exalead Bot Disallow	20	0,15
DuckDuckGo Bot Disallow	12	0,09
Google News Bot Disallow	10	0,07
Google Video Bot Disallow	10	0,07
360 Bot Disallow	8	0,06
Google Favicon Disallow	8	0,06
Google API Bot Disallow	8	0,06
Google DuplexWeb Disallow	8	0,06
Pipl Disallow	6	0,04
Youdao Bot Disallow	3	0,02
Diffbot Disallow	2	0,01
BuiltWithBot Disallow	1	0,01
YOU Disallow	1	0,01