Robots.txt Distribuzione dell'utilizzo In Cina

Distribuzione per i siti Web che utilizzano Robots.txt tecnologie

Tecnologia	Siti web	%
Googlebot Disallow	73.197	10,15
Ahrefs Bot Disallow	59.472	8,24
Microsoft BingBot Disallow	52.414	7,26
Semrush Bot Disallow	48.901	6,78
Some Robots Disallow	41.371	5,73
Baidu Bot Disallow	39.532	5,48
Yahoo Slurp Disallow	39.290	5,45
Alexa Bot Disallow	38.595	5,35
Majestic Bot Disallow	38.330	5,31
Yandex Bot Disallow	37.043	5,13
Robots Disallow	34.746	4,82
Google AdsBot Disallow	32.235	4,47
Sogou Bot Disallow	25.705	3,56
Soso Bot Disallow	25.547	3,54
Google AdsBot Mobile Disallow	22.147	3,07
AppleBot Disallow	21.252	2,95
Microsoft MSNBot Disallow	19.773	2,74
Google Image Bot Disallow	14.104	1,95
GPTBot Disallow	8.989	1,25
Anthropic Claude Bot Disallow	8.080	1,12
ByteDance Bytespider Disallow	4.923	0,68
360 Bot Disallow	4.098	0,57
Common Crawl Bot Disallow	3.773	0,52
Exalead Bot Disallow	3.501	0,49
Youdao Bot Disallow	3.382	0,47
Facebook Bot Disallow	2.946	0,41
Google Bard Disallow	2.925	0,41
Google Media Partners Disallow	2.464 ^*	0,34
Apple AI Bot Disallow	2.339	0,32
Cohere AI Disallow	2.332	0,32
Google AdsBot Mobile Apps Disallow	2.193	0,3
Perplexity	2.177	0,3
Webz Omgili Disallow	616	0,09
DuckDuckGo Bot Disallow	482	0,07
Diffbot Disallow	442	0,06
Google News Bot Disallow	324	0,04
Google Video Bot Disallow	320	0,04
BuiltWithBot Disallow	312	0,04
Google Favicon Disallow	285	0,04
Google API Bot Disallow	282	0,04
Google DuplexWeb Disallow	281	0,04
Google FeedFetcher Disallow	224	0,03
YOU Disallow	92	0,01
Pipl Disallow	17	0
Google Read Aloud Disallow	5	0
Google Web Light Disallow	2	0