Robots.txt Répartition de l'utilisation dans Bulgarie

Distribution pour les sites Web utilisant Robots.txt les technologies

Technologie	Sites Internet	%
Ahrefs Bot Disallow	4 162	10,88
Googlebot Disallow	3 695	9,66
Google AdsBot Disallow	3 215	8,4
Robots Disallow	2 854	7,46
Majestic Bot Disallow	2 294	6
Yandex Bot Disallow	2 066	5,4
Google AdsBot Mobile Disallow	1 950	5,1
Baidu Bot Disallow	1 805	4,72
Microsoft BingBot Disallow	1 763	4,61
Sogou Bot Disallow	1 573	4,11
Alexa Bot Disallow	1 525	3,99
Semrush Bot Disallow	1 386	3,62
Yahoo Slurp Disallow	1 338	3,5
Soso Bot Disallow	1 301	3,4
Common Crawl Bot Disallow	719	1,88
Some Robots Disallow	630	1,65
Google Media Partners Disallow	609 ^*	1,59
GPTBot Disallow	599	1,57
Anthropic Claude Bot Disallow	491	1,28
Google Bard Disallow	392	1,02
AppleBot Disallow	385	1,01
Facebook Bot Disallow	380	0,99
Google AdsBot Mobile Apps Disallow	356	0,93
Exalead Bot Disallow	344	0,9
Cohere AI Disallow	334	0,87
Perplexity	333	0,87
Apple AI Bot Disallow	330	0,86
Microsoft MSNBot Disallow	251	0,66
Google Image Bot Disallow	171	0,45
ByteDance Bytespider Disallow	165	0,43
360 Bot Disallow	151	0,39
BuiltWithBot Disallow	90	0,24
YOU Disallow	89	0,23
Webz Omgili Disallow	76	0,2
Google News Bot Disallow	69	0,18
Google Video Bot Disallow	68	0,18
DuckDuckGo Bot Disallow	65	0,17
Google Favicon Disallow	60	0,16
Google API Bot Disallow	58	0,15
Google DuplexWeb Disallow	57	0,15
Diffbot Disallow	40	0,1
Pipl Disallow	12	0,03
Youdao Bot Disallow	10	0,03
Google FeedFetcher Disallow	1	0