Robots.txt Distribuzione dell'utilizzo In Taiwan

Distribuzione per i siti Web che utilizzano Robots.txt tecnologie

Tecnologia	Siti web	%
Robots Disallow	16.793	13,25
Googlebot Disallow	12.898	10,17
Baidu Bot Disallow	9.660	7,62
Yandex Bot Disallow	8.943	7,05
Google AdsBot Disallow	7.839	6,18
Sogou Bot Disallow	7.436	5,87
Microsoft BingBot Disallow	6.745	5,32
Yahoo Slurp Disallow	6.722	5,3
Soso Bot Disallow	6.539	5,16
Alexa Bot Disallow	6.491	5,12
Majestic Bot Disallow	6.491	5,12
Ahrefs Bot Disallow	6.237	4,92
Semrush Bot Disallow	4.291	3,38
Google AdsBot Mobile Disallow	3.949	3,12
Some Robots Disallow	2.833	2,23
Common Crawl Bot Disallow	1.961	1,55
Google Image Bot Disallow	1.664	1,31
GPTBot Disallow	1.516	1,2
Google AdsBot Mobile Apps Disallow	896	0,71
Anthropic Claude Bot Disallow	875	0,69
Google Bard Disallow	598	0,47
Facebook Bot Disallow	575	0,45
360 Bot Disallow	571	0,45
AppleBot Disallow	527	0,42
Cohere AI Disallow	509	0,4
Microsoft MSNBot Disallow	454	0,36
ByteDance Bytespider Disallow	433	0,34
Apple AI Bot Disallow	388	0,31
Exalead Bot Disallow	372	0,29
Google Media Partners Disallow	355 ^*	0,28
Perplexity	341	0,27
Youdao Bot Disallow	242	0,19
Webz Omgili Disallow	156	0,12
Google Video Bot Disallow	95	0,07
Google News Bot Disallow	74	0,06
Google API Bot Disallow	65	0,05
DuckDuckGo Bot Disallow	61	0,05
Google Favicon Disallow	56	0,04
Google DuplexWeb Disallow	44	0,03
BuiltWithBot Disallow	37	0,03
YOU Disallow	16	0,01
Diffbot Disallow	9	0,01
Google FeedFetcher Disallow	8	0,01
Pipl Disallow	7	0,01
Google Read Aloud Disallow	1	0