Robots.txt Distribución de uso en Bielorrusia

Distribución para sitios web que utilizan Robots.txt tecnologías

Tecnología	Sitios web	%
Yandex Bot Disallow	6.642	34,56
Googlebot Disallow	2.426	12,62
Robots Disallow	2.379	12,38
Semrush Bot Disallow	747	3,89
Microsoft BingBot Disallow	621	3,23
Ahrefs Bot Disallow	554	2,88
Alexa Bot Disallow	521	2,71
Majestic Bot Disallow	519	2,7
Some Robots Disallow	446	2,32
Common Crawl Bot Disallow	406	2,11
Google Media Partners Disallow	405 ^*	2,11
GPTBot Disallow	404	2,1
Anthropic Claude Bot Disallow	347	1,81
Google Bard Disallow	335	1,74
Yahoo Slurp Disallow	312	1,62
Microsoft MSNBot Disallow	312	1,62
Webz Omgili Disallow	309	1,61
Baidu Bot Disallow	298	1,55
Sogou Bot Disallow	232	1,21
Soso Bot Disallow	214	1,11
Google AdsBot Disallow	130	0,68
Google AdsBot Mobile Disallow	102	0,53
Exalead Bot Disallow	102	0,53
Google Image Bot Disallow	89	0,46
AppleBot Disallow	48	0,25
Facebook Bot Disallow	40	0,21
Apple AI Bot Disallow	34	0,18
Google AdsBot Mobile Apps Disallow	33	0,17
360 Bot Disallow	29	0,15
Cohere AI Disallow	26	0,14
Perplexity	24	0,12
DuckDuckGo Bot Disallow	19	0,1
Google News Bot Disallow	18	0,09
ByteDance Bytespider Disallow	17	0,09
Google Video Bot Disallow	16	0,08
Google API Bot Disallow	14	0,07
Google Favicon Disallow	13	0,07
Google DuplexWeb Disallow	13	0,07
BuiltWithBot Disallow	11	0,06
Diffbot Disallow	5	0,03
YOU Disallow	3	0,02
Pipl Disallow	3	0,02
Google FeedFetcher Disallow	2	0,01
Youdao Bot Disallow	1	0,01