Robots.txt Distribuzione dell'utilizzo In Kirghizistan

Distribuzione per i siti Web che utilizzano Robots.txt tecnologie

Tecnologia	Siti web	%
Yandex Bot Disallow	268	21,42
Robots Disallow	239	19,1
Googlebot Disallow	212	16,95
Ahrefs Bot Disallow	45	3,6
Alexa Bot Disallow	42	3,36
Google AdsBot Disallow	40	3,2
Majestic Bot Disallow	39	3,12
Microsoft BingBot Disallow	36	2,88
Semrush Bot Disallow	34	2,72
Baidu Bot Disallow	33	2,64
Google Media Partners Disallow	32 ^*	2,56
Google AdsBot Mobile Disallow	32	2,56
Yahoo Slurp Disallow	27	2,16
Some Robots Disallow	24	1,92
Sogou Bot Disallow	22	1,76
Soso Bot Disallow	22	1,76
GPTBot Disallow	17	1,36
Microsoft MSNBot Disallow	17	1,36
Common Crawl Bot Disallow	10	0,8
Anthropic Claude Bot Disallow	8	0,64
Google Bard Disallow	8	0,64
AppleBot Disallow	6	0,48
Facebook Bot Disallow	5	0,4
Google AdsBot Mobile Apps Disallow	5	0,4
Cohere AI Disallow	4	0,32
ByteDance Bytespider Disallow	4	0,32
Apple AI Bot Disallow	3	0,24
Perplexity	3	0,24
Webz Omgili Disallow	3	0,24
Exalead Bot Disallow	2	0,16
Google Image Bot Disallow	2	0,16
DuckDuckGo Bot Disallow	2	0,16
360 Bot Disallow	1	0,08
BuiltWithBot Disallow	1	0,08
Diffbot Disallow	1	0,08
Google FeedFetcher Disallow	1	0,08
Google Read Aloud Disallow	1	0,08