Robots.txt Distribuzione dell'utilizzo In Bulgaria

Distribuzione per i siti Web che utilizzano Robots.txt tecnologie

Tecnologia	Siti web	%
Ahrefs Bot Disallow	4.131	11,02
Googlebot Disallow	3.695	9,86
Google AdsBot Disallow	3.215	8,58
Robots Disallow	2.386	6,37
Majestic Bot Disallow	2.283	6,09
Yandex Bot Disallow	2.039	5,44
Google AdsBot Mobile Disallow	1.950	5,2
Baidu Bot Disallow	1.805	4,82
Microsoft BingBot Disallow	1.736	4,63
Sogou Bot Disallow	1.573	4,2
Alexa Bot Disallow	1.503	4,01
Semrush Bot Disallow	1.372	3,66
Yahoo Slurp Disallow	1.316	3,51
Soso Bot Disallow	1.281	3,42
Common Crawl Bot Disallow	712	1,9
Some Robots Disallow	630	1,68
GPTBot Disallow	585	1,56
Google Media Partners Disallow	551 ^*	1,47
Anthropic Claude Bot Disallow	484	1,29
Google Bard Disallow	387	1,03
AppleBot Disallow	380	1,01
Facebook Bot Disallow	375	1
Google AdsBot Mobile Apps Disallow	351	0,94
Exalead Bot Disallow	342	0,91
Cohere AI Disallow	329	0,88
Perplexity	329	0,88
Apple AI Bot Disallow	326	0,87
Microsoft MSNBot Disallow	248	0,66
Google Image Bot Disallow	170	0,45
ByteDance Bytespider Disallow	162	0,43
360 Bot Disallow	151	0,4
BuiltWithBot Disallow	90	0,24
YOU Disallow	89	0,24
Webz Omgili Disallow	76	0,2
Google News Bot Disallow	68	0,18
Google Video Bot Disallow	67	0,18
DuckDuckGo Bot Disallow	64	0,17
Google Favicon Disallow	59	0,16
Google API Bot Disallow	57	0,15
Google DuplexWeb Disallow	56	0,15
Diffbot Disallow	40	0,11
Pipl Disallow	12	0,03
Youdao Bot Disallow	10	0,03
Google FeedFetcher Disallow	1	0