Robots.txt Nutzungsverteilung in Sint Maarten

Verteilung für Websites mit Robots.txt Technologien

Technologie	Websites	%
Googlebot Disallow	214	12,25
Baidu Bot Disallow	201	11,51
Sogou Bot Disallow	193	11,05
Microsoft BingBot Disallow	172	9,85
Yandex Bot Disallow	171	9,79
Alexa Bot Disallow	167	86,53
Yahoo Slurp Disallow	166	9,5
Soso Bot Disallow	164	9,39
Robots Disallow	146	8,36
Google Media Partners Disallow	53 ^*	3,03
Some Robots Disallow	46	2,63
GPTBot Disallow	8	4,15
Semrush Bot Disallow	7	0,4
Majestic Bot Disallow	6	0,34
Ahrefs Bot Disallow	5	0,29
Anthropic Claude Bot Disallow	3	1,55
Google Bard Disallow	3	1,55
Cohere AI Disallow	3	1,55
Perplexity	3	1,55
Google AdsBot Mobile Apps Disallow	2	0,11
Microsoft MSNBot Disallow	2	0,11
Common Crawl Bot Disallow	1	0,52
AppleBot Disallow	1	0,06
Facebook Bot Disallow	1	0,52
Apple AI Bot Disallow	1	0,52
360 Bot Disallow	1	0,06
Google Image Bot Disallow	1	0,06
Google News Bot Disallow	1	0,06
Google Video Bot Disallow	1	0,06
DuckDuckGo Bot Disallow	1	0,06
Google Favicon Disallow	1	0,06
Google API Bot Disallow	1	0,06
Google DuplexWeb Disallow	1	0,06