Robots.txt Distribución de uso en Austria

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Googlebot Disallow	52.212	14,48
Google AdsBot Disallow	43.233	11,99
Google AdsBot Mobile Disallow	36.908	10,24
Baidu Bot Disallow	22.221	6,16
Robots Disallow	17.437	4,84
Ahrefs Bot Disallow	14.108	3,91
Some Robots Disallow	12.304	3,41
Yandex Bot Disallow	11.356	3,15
Microsoft BingBot Disallow	10.453	2,9
Yahoo Slurp Disallow	9.873	2,74
Alexa Bot Disallow	9.799	14,39
GPTBot Disallow	8.411	12,35
Sogou Bot Disallow	8.102	2,25
Soso Bot Disallow	8.028	2,23
Google AdsBot Mobile Apps Disallow	8.011	2,22
Common Crawl Bot Disallow	7.539	11,07
Anthropic Claude Bot Disallow	7.023	10,31
Google Bard Disallow	6.557	9,63
Facebook Bot Disallow	6.397	9,39
AppleBot Disallow	6.295	1,75
Apple AI Bot Disallow	6.069	8,91
Cohere AI Disallow	6.066	8,91
Majestic Bot Disallow	6.041	1,68
Perplexity	5.949	8,74
Semrush Bot Disallow	5.416	1,5
Google Media Partners Disallow	2.843 ^*	0,79
Google Image Bot Disallow	2.832	0,79
Microsoft MSNBot Disallow	2.510	0,7
ByteDance Bytespider Disallow	2.287	3,36
Google News Bot Disallow	2.001	0,56
Google Video Bot Disallow	1.937	0,54
DuckDuckGo Bot Disallow	1.924	0,53
Google Favicon Disallow	1.882	0,52
Google API Bot Disallow	1.852	0,51
Google DuplexWeb Disallow	1.849	0,51
Exalead Bot Disallow	1.083	0,3
360 Bot Disallow	567	0,16
Webz Omgili Disallow	559	0,82
BuiltWithBot Disallow	298	0,08
Diffbot Disallow	136	0,2
YOU Disallow	82	0,12
Pipl Disallow	39	0,01
Youdao Bot Disallow	18	0
Google FeedFetcher Disallow	2	0
Google Read Aloud Disallow	1	0
Google BIG Bench Disallow	1	0