Robots.txt Nutzungsverteilung In Rumänien

Verteilung für Websites mit Robots.txt Technologien

Technologie	Websites	%
Googlebot Disallow	24.122	9,88
Baidu Bot Disallow	21.785	8,92
Microsoft BingBot Disallow	21.685	8,88
Yandex Bot Disallow	21.518	8,81
Sogou Bot Disallow	19.800	8,11
Alexa Bot Disallow	18.189	7,45
Yahoo Slurp Disallow	17.897	7,33
Soso Bot Disallow	17.631	7,22
Ahrefs Bot Disallow	13.559	5,55
Google AdsBot Disallow	10.806	4,42
Robots Disallow	8.024	3,29
Majestic Bot Disallow	7.707	3,16
Google AdsBot Mobile Disallow	5.020	2,06
Anthropic Claude Bot Disallow	4.383	1,79
Facebook Bot Disallow	4.186	1,71
ByteDance Bytespider Disallow	3.707	1,52
Common Crawl Bot Disallow	3.504	1,43
Some Robots Disallow	3.123	1,28
Exalead Bot Disallow	2.811	1,15
Semrush Bot Disallow	2.447	1
GPTBot Disallow	1.572	0,64
AppleBot Disallow	1.376	0,56
Google Media Partners Disallow	1.268 ^*	0,52
Google Bard Disallow	1.116	0,46
Cohere AI Disallow	943	0,39
Perplexity	928	0,38
Apple AI Bot Disallow	903	0,37
Microsoft MSNBot Disallow	863	0,35
Google AdsBot Mobile Apps Disallow	832	0,34
Google Image Bot Disallow	425	0,17
360 Bot Disallow	414	0,17
Webz Omgili Disallow	360	0,15
BuiltWithBot Disallow	227	0,09
Google News Bot Disallow	177	0,07
Google Video Bot Disallow	159	0,07
Google Favicon Disallow	148	0,06
DuckDuckGo Bot Disallow	135	0,06
YOU Disallow	124	0,05
Diffbot Disallow	112	0,05
Google API Bot Disallow	97	0,04
Google DuplexWeb Disallow	94	0,04
Pipl Disallow	31	0,01
Youdao Bot Disallow	13	0,01
Google FeedFetcher Disallow	2	0
Google Read Aloud Disallow	2	0
Google Web Light Disallow	1	0