Robots.txt Distribución de uso en Ucrania

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Yandex Bot Disallow	28.655	28,64
Robots Disallow	13.740	13,73
Googlebot Disallow	13.588	13,58
Google AdsBot Disallow	5.070	5,07
Google AdsBot Mobile Disallow	4.271	4,27
Ahrefs Bot Disallow	3.456	3,45
Majestic Bot Disallow	2.723	2,72
Baidu Bot Disallow	2.718	2,72
Alexa Bot Disallow	2.592	28,04
Microsoft BingBot Disallow	2.507	2,51
Yahoo Slurp Disallow	2.279	2,28
Sogou Bot Disallow	2.020	2,02
Semrush Bot Disallow	1.897	1,9
Some Robots Disallow	1.752	1,75
Soso Bot Disallow	1.677	1,68
Google Media Partners Disallow	1.664 ^*	1,66
GPTBot Disallow	1.062	11,49
Common Crawl Bot Disallow	1.051	11,37
Microsoft MSNBot Disallow	997	1
Exalead Bot Disallow	727	0,73
Google Image Bot Disallow	620	0,62
360 Bot Disallow	535	0,53
Anthropic Claude Bot Disallow	523	5,66
Google Bard Disallow	449	4,86
AppleBot Disallow	412	0,41
Facebook Bot Disallow	363	3,93
Youdao Bot Disallow	333	0,33
Apple AI Bot Disallow	310	3,35
Cohere AI Disallow	288	3,12
Google AdsBot Mobile Apps Disallow	276	0,28
Perplexity	266	2,88
ByteDance Bytespider Disallow	233	2,52
Webz Omgili Disallow	180	1,95
YOU Disallow	175	1,89
BuiltWithBot Disallow	131	0,13
DuckDuckGo Bot Disallow	97	0,1
Google News Bot Disallow	96	0,1
Google Video Bot Disallow	79	0,08
Diffbot Disallow	68	0,74
Google API Bot Disallow	51	0,05
Google Favicon Disallow	47	0,05
Google DuplexWeb Disallow	46	0,05
Pipl Disallow	13	0,01
Google FeedFetcher Disallow	2	0
Google Read Aloud Disallow	1	0