Robots.txt Répartition de l'utilisation dans Nicaragua

Distribution pour les sites Web utilisant Robots.txt les technologies

Technologie	Sites Internet	%
Google AdsBot Disallow	258	12,32
Googlebot Disallow	219	10,46
AppleBot Disallow	107	5,11
Robots Disallow	104	4,97
GPTBot Disallow	93	12,03
Common Crawl Bot Disallow	92	11,9
Anthropic Claude Bot Disallow	89	11,51
Google Bard Disallow	89	11,51
Facebook Bot Disallow	89	11,51
Google AdsBot Mobile Apps Disallow	89	4,25
Cohere AI Disallow	88	11,38
Apple AI Bot Disallow	87	11,25
Perplexity	86	11,13
Baidu Bot Disallow	70	3,34
Yahoo Slurp Disallow	58	2,77
Microsoft BingBot Disallow	56	2,67
Alexa Bot Disallow	56	7,24
Yandex Bot Disallow	55	2,63
Some Robots Disallow	49	2,34
Google Media Partners Disallow	48 ^*	2,29
Ahrefs Bot Disallow	35	1,67
Sogou Bot Disallow	33	1,58
Soso Bot Disallow	32	1,53
Microsoft MSNBot Disallow	31	1,48
Google Image Bot Disallow	27	1,29
Majestic Bot Disallow	25	1,19
Semrush Bot Disallow	10	0,48
Exalead Bot Disallow	5	0,24
Google News Bot Disallow	3	0,14
Google Video Bot Disallow	3	0,14
Google Favicon Disallow	3	0,14
ByteDance Bytespider Disallow	2	0,26
360 Bot Disallow	1	0,05
Webz Omgili Disallow	1	0,13
DuckDuckGo Bot Disallow	1	0,05