Robots.txt 使用分布 在缅甸

排名靠前 Robots.txt 使用分布 在缅甸

技术	网站	%
Robots Disallow	191	15.38
Google AdsBot Disallow	132	10.63
Googlebot Disallow	120	9.66
Google AdsBot Mobile Disallow	106	8.53
AppleBot Disallow	49	3.95
Ahrefs Bot Disallow	48	3.86
Common Crawl Bot Disallow	43	3.46
GPTBot Disallow	42	3.38
Anthropic Claude Bot Disallow	41	3.3
Google Bard Disallow	41	3.3
Facebook Bot Disallow	41	3.3
Apple AI Bot Disallow	40	3.22
Perplexity	39	3.14
Cohere AI Disallow	38	3.06
Some Robots Disallow	37	2.98
Google AdsBot Mobile Apps Disallow	36	2.9
Yandex Bot Disallow	30	2.42
Microsoft BingBot Disallow	29	2.33
Yahoo Slurp Disallow	26	2.09
Alexa Bot Disallow	22	1.77
Soso Bot Disallow	19	1.53
Semrush Bot Disallow	19	1.53
Majestic Bot Disallow	18	1.45
ByteDance Bytespider Disallow	9	0.72
Webz Omgili Disallow	5	0.4
Exalead Bot Disallow	4	0.32
360 Bot Disallow	3	0.24
Google Image Bot Disallow	3	0.24
DuckDuckGo Bot Disallow	3	0.24
Microsoft MSNBot Disallow	2	0.16
Diffbot Disallow	2	0.16
YOU Disallow	2	0.16
BuiltWithBot Disallow	1	0.08
Youdao Bot Disallow	1	0.08

1,242 检测

的 Robots.txt 在缅甸. 上次更新 21st 4月 2025.

Robots Disallow 是目前该类别中最流行的技术。