Robots.txt Distribución de uso en República Checa

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Googlebot Disallow	39.106	12,07
Baidu Bot Disallow	24.999	7,72
Yandex Bot Disallow	24.221	7,48
Microsoft BingBot Disallow	22.976	7,09
Alexa Bot Disallow	21.214	6,55
Yahoo Slurp Disallow	21.078	6,51
Soso Bot Disallow	19.792	6,11
Sogou Bot Disallow	19.750	6,1
Google AdsBot Disallow	18.086	5,58
Robots Disallow	17.994	5,56
Google AdsBot Mobile Disallow	15.793	4,88
Ahrefs Bot Disallow	10.486	3,24
Semrush Bot Disallow	8.677	2,68
Majestic Bot Disallow	8.257	2,55
Webz Omgili Disallow	5.205	1,61
GPTBot Disallow	4.923	1,52
Common Crawl Bot Disallow	4.103	1,27
Anthropic Claude Bot Disallow	4.078	1,26
Some Robots Disallow	3.560	1,1
AppleBot Disallow	3.030	0,94
Google Bard Disallow	2.591	0,8
Facebook Bot Disallow	2.555	0,79
Apple AI Bot Disallow	2.300	0,71
Microsoft MSNBot Disallow	2.225	0,69
ByteDance Bytespider Disallow	2.146	0,66
Cohere AI Disallow	2.135	0,66
Perplexity	2.066	0,64
Google AdsBot Mobile Apps Disallow	1.675	0,52
Google Media Partners Disallow	1.556 ^*	0,48
Exalead Bot Disallow	1.451	0,45
Diffbot Disallow	961	0,3
Google Image Bot Disallow	860	0,27
YOU Disallow	840	0,26
Google News Bot Disallow	451	0,14
Google Video Bot Disallow	449	0,14
DuckDuckGo Bot Disallow	444	0,14
Google Favicon Disallow	443	0,14
Google API Bot Disallow	418	0,13
Google DuplexWeb Disallow	417	0,13
360 Bot Disallow	394	0,12
BuiltWithBot Disallow	154	0,05
Pipl Disallow	28	0,01
Youdao Bot Disallow	26	0,01
Google Read Aloud Disallow	5	0
Google FeedFetcher Disallow	3	0