Robots.txt Nutzungsverteilung in Paraguay

Verteilung für Websites mit Robots.txt Technologien

Technologie	Websites	%
Google AdsBot Disallow	562	17,32
Googlebot Disallow	477	14,7
Robots Disallow	425	13,1
Google AdsBot Mobile Disallow	419	12,91
Ahrefs Bot Disallow	182	5,61
GPTBot Disallow	71	13,87
Google Media Partners Disallow	66 ^*	2,03
Anthropic Claude Bot Disallow	60	11,72
Semrush Bot Disallow	60	1,85
Baidu Bot Disallow	58	1,79
Some Robots Disallow	57	1,76
Yandex Bot Disallow	57	1,76
Google Bard Disallow	57	11,13
Common Crawl Bot Disallow	55	10,74
AppleBot Disallow	51	1,57
Facebook Bot Disallow	49	9,57
Majestic Bot Disallow	49	1,51
Microsoft BingBot Disallow	47	1,45
Cohere AI Disallow	47	9,18
Apple AI Bot Disallow	47	9,18
Perplexity	45	8,79
Google AdsBot Mobile Apps Disallow	45	1,39
Sogou Bot Disallow	44	1,36
Yahoo Slurp Disallow	44	1,36
Alexa Bot Disallow	35	6,84
Soso Bot Disallow	33	1,02
Microsoft MSNBot Disallow	19	0,59
Google Image Bot Disallow	13	0,4
Exalead Bot Disallow	12	0,37
ByteDance Bytespider Disallow	11	2,15
Webz Omgili Disallow	7	1,37
360 Bot Disallow	5	0,15
BuiltWithBot Disallow	4	0,12
YOU Disallow	4	0,78
Google News Bot Disallow	4	0,12
Google Video Bot Disallow	4	0,12
DuckDuckGo Bot Disallow	4	0,12
Google Favicon Disallow	4	0,12
Diffbot Disallow	3	0,59
Youdao Bot Disallow	3	0,09
Google API Bot Disallow	3	0,09
Google DuplexWeb Disallow	3	0,09