Robot.txt Distribuzione dell'utilizzo in Bulgaria

Distribuzione per siti web che utilizzano Robot.txt tecnologie

Tecnologia	Siti web	%
Ahrefs Bot Disallow	3.115	10,21
Robots Disallow	3.059	10,02
Googlebot Disallow	2.933	9,61
Google AdsBot Disallow	2.458	8,05
Yandex Bot Disallow	1.665	5,45
Majestic Bot Disallow	1.646	5,39
Baidu Bot Disallow	1.526	5
Google AdsBot Mobile Disallow	1.459	4,78
Microsoft BingBot Disallow	1.417	4,64
Sogou Bot Disallow	1.370	4,49
Alexa Bot Disallow	1.266	4,15
Yahoo Slurp Disallow	1.132	3,71
Soso Bot Disallow	1.094	3,58
Semrush Bot Disallow	1.023	3,35
Some Robots Disallow	514	1,68
Common Crawl Bot Disallow	512	1,68
Google Media Partners Disallow	451 ^*	1,48
GPTBot Disallow	450	1,47
Anthropic Claude Bot Disallow	371	1,22
Google Bard Disallow	283	0,93
Facebook Bot Disallow	268	0,88
AppleBot Disallow	267	0,87
Google AdsBot Mobile Apps Disallow	245	0,8
Perplexity	240	0,79
Exalead Bot Disallow	237	0,78
Cohere AI Disallow	232	0,76
Apple AI Bot Disallow	230	0,75
Microsoft MSNBot Disallow	149	0,49
ByteDance Bytespider Disallow	140	0,46
Google Image Bot Disallow	135	0,44
360 Bot Disallow	97	0,32
Webz Omgili Disallow	68	0,22
YOU Disallow	59	0,19
Google News Bot Disallow	54	0,18
Google Video Bot Disallow	53	0,17
DuckDuckGo Bot Disallow	52	0,17
BuiltWithBot Disallow	50	0,16
Google API Bot Disallow	49	0,16
Google Favicon Disallow	48	0,16
Google DuplexWeb Disallow	48	0,16
Diffbot Disallow	40	0,13
Pipl Disallow	10	0,03
Youdao Bot Disallow	4	0,01
LLMS Text	3	0,01
Google FeedFetcher Disallow	1	0