Robots.txt Distribuzione dell'utilizzo In Slovenia

Distribuzione per i siti Web che utilizzano Robots.txt tecnologie

Tecnologia	Siti web	%
Googlebot Disallow	3.478	9,91
Google AdsBot Disallow	3.131	8,92
Google AdsBot Mobile Disallow	2.170	6,18
Robots Disallow	2.145	6,11
Baidu Bot Disallow	1.826	5,2
Ahrefs Bot Disallow	1.824	5,2
Sogou Bot Disallow	1.285	3,66
Yandex Bot Disallow	1.271	3,62
Yahoo Slurp Disallow	1.062	3,03
Majestic Bot Disallow	1.033	2,94
Microsoft BingBot Disallow	1.002	2,86
GPTBot Disallow	976	2,78
Some Robots Disallow	972	2,77
Common Crawl Bot Disallow	971	2,77
Alexa Bot Disallow	949	2,7
Anthropic Claude Bot Disallow	850	2,42
AppleBot Disallow	829	2,36
Google Bard Disallow	804	2,29
Soso Bot Disallow	801	2,28
Facebook Bot Disallow	793	2,26
Apple AI Bot Disallow	764	2,18
Semrush Bot Disallow	748	2,13
Cohere AI Disallow	740	2,11
Perplexity	724	2,06
Google Media Partners Disallow	609 ^*	1,74
Google AdsBot Mobile Apps Disallow	608	1,73
Webz Omgili Disallow	387	1,1
Microsoft MSNBot Disallow	357	1,02
YOU Disallow	316	0,9
ByteDance Bytespider Disallow	300	0,86
Diffbot Disallow	212	0,6
Google Image Bot Disallow	177	0,5
360 Bot Disallow	167	0,48
Exalead Bot Disallow	151	0,43
Google News Bot Disallow	106	0,3
Google Video Bot Disallow	106	0,3
DuckDuckGo Bot Disallow	101	0,29
Google API Bot Disallow	96	0,27
Google Favicon Disallow	87	0,25
Google DuplexWeb Disallow	80	0,23
BuiltWithBot Disallow	39	0,11
Google FeedFetcher Disallow	16	0,05
Youdao Bot Disallow	12	0,03
Pipl Disallow	6	0,02
Google Read Aloud Disallow	4	0,01