Robots.txt Nutzungsverteilung in Usbekistan

Verteilung für Websites mit Robots.txt Technologien

Technologie	Websites	%
Robots Disallow	1.774	30,59
Googlebot Disallow	779	13,43
Yandex Bot Disallow	534	9,21
Ahrefs Bot Disallow	440	7,59
Semrush Bot Disallow	410	7,07
Majestic Bot Disallow	397	6,85
Microsoft MSNBot Disallow	341	5,88
Google AdsBot Disallow	176	3,04
Some Robots Disallow	172	2,97
Google AdsBot Mobile Disallow	124	2,14
Baidu Bot Disallow	82	1,41
Alexa Bot Disallow	71	1,22
Microsoft BingBot Disallow	64	1,1
Sogou Bot Disallow	59	1,02
Yahoo Slurp Disallow	58	1
Soso Bot Disallow	43	0,74
GPTBot Disallow	33	0,57
Google Image Bot Disallow	28	0,48
Common Crawl Bot Disallow	20	0,34
Exalead Bot Disallow	20	0,34
ByteDance Bytespider Disallow	19	0,33
Anthropic Claude Bot Disallow	18	0,31
Google Bard Disallow	18	0,31
360 Bot Disallow	14	0,24
Google Media Partners Disallow	13 ^*	0,22
AppleBot Disallow	11	0,19
Facebook Bot Disallow	10	0,17
Google AdsBot Mobile Apps Disallow	9	0,16
Apple AI Bot Disallow	8	0,14
Perplexity	8	0,14
Webz Omgili Disallow	8	0,14
Cohere AI Disallow	7	0,12
BuiltWithBot Disallow	4	0,07
Google News Bot Disallow	4	0,07
Google Video Bot Disallow	4	0,07
DuckDuckGo Bot Disallow	4	0,07
Google Favicon Disallow	4	0,07
Google API Bot Disallow	4	0,07
Google DuplexWeb Disallow	4	0,07
Diffbot Disallow	2	0,03
YOU Disallow	1	0,02