Robots.txt Distribuzione dell'utilizzo In Serbia

Distribuzione per i siti Web che utilizzano Robots.txt tecnologie

Tecnologia	Siti web	%
Googlebot Disallow	2.377	12,16
Robots Disallow	1.818	9,3
Google AdsBot Disallow	1.645	8,42
Baidu Bot Disallow	1.259	6,44
Ahrefs Bot Disallow	1.228	6,28
Yandex Bot Disallow	1.141	5,84
Google AdsBot Mobile Disallow	1.120	5,73
Sogou Bot Disallow	954	4,88
Alexa Bot Disallow	828	29,4
Microsoft BingBot Disallow	827	4,23
Yahoo Slurp Disallow	810	4,14
Soso Bot Disallow	809	4,14
Majestic Bot Disallow	563	2,88
Some Robots Disallow	529	2,71
Common Crawl Bot Disallow	409	14,52
Semrush Bot Disallow	372	1,9
Exalead Bot Disallow	294	1,5
GPTBot Disallow	262	9,3
Google Media Partners Disallow	210 ^*	1,07
Anthropic Claude Bot Disallow	207	7,35
AppleBot Disallow	192	0,98
Google Bard Disallow	177	6,29
Google AdsBot Mobile Apps Disallow	171	0,87
Facebook Bot Disallow	163	5,79
Apple AI Bot Disallow	143	5,08
Perplexity	142	5,04
Cohere AI Disallow	141	5,01
Google Image Bot Disallow	124	0,63
Microsoft MSNBot Disallow	104	0,53
360 Bot Disallow	100	0,51
BuiltWithBot Disallow	81	0,41
Google News Bot Disallow	48	0,25
Google Video Bot Disallow	45	0,23
ByteDance Bytespider Disallow	39	1,38
Webz Omgili Disallow	36	1,28
DuckDuckGo Bot Disallow	35	0,18
Google API Bot Disallow	31	0,16
Google DuplexWeb Disallow	29	0,15
Google Favicon Disallow	28	0,14
YOU Disallow	27	0,96
Diffbot Disallow	18	0,64
Pipl Disallow	7	0,04
Youdao Bot Disallow	4	0,02