Robots.txt Distribuzione dell'utilizzo In Nepal

Distribuzione per i siti Web che utilizzano Robots.txt tecnologie

Tecnologia	Siti web	%
Robots Disallow	1.201	22,1
Googlebot Disallow	603	11,09
Google AdsBot Disallow	340	6,26
GPTBot Disallow	339	6,24
Baidu Bot Disallow	306	5,63
Some Robots Disallow	251	4,62
Yandex Bot Disallow	185	3,4
Ahrefs Bot Disallow	181	3,33
Alexa Bot Disallow	147	2,7
Microsoft BingBot Disallow	146	2,69
Yahoo Slurp Disallow	144	2,65
Common Crawl Bot Disallow	123	2,26
Sogou Bot Disallow	121	2,23
Soso Bot Disallow	119	2,19
Google Bard Disallow	116	2,13
Google Media Partners Disallow	113 ^*	2,08
Facebook Bot Disallow	110	2,02
Anthropic Claude Bot Disallow	108	1,99
AppleBot Disallow	106	1,95
Apple AI Bot Disallow	100	1,84
Majestic Bot Disallow	96	1,77
Semrush Bot Disallow	88	1,62
Google AdsBot Mobile Apps Disallow	83	1,53
Cohere AI Disallow	80	1,47
Perplexity	79	1,45
Webz Omgili Disallow	29	0,53
Microsoft MSNBot Disallow	26	0,48
Google Image Bot Disallow	24	0,44
Exalead Bot Disallow	18	0,33
ByteDance Bytespider Disallow	12	0,22
DuckDuckGo Bot Disallow	10	0,18
Youdao Bot Disallow	7	0,13
360 Bot Disallow	5	0,09
BuiltWithBot Disallow	4	0,07
Google News Bot Disallow	3	0,06
Diffbot Disallow	3	0,06
Google Video Bot Disallow	2	0,04
Google API Bot Disallow	2	0,04
Google Favicon Disallow	1	0,02
Google DuplexWeb Disallow	1	0,02
YOU Disallow	1	0,02
Pipl Disallow	1	0,02
Google FeedFetcher Disallow	1	0,02