Robots.txt Distribuzione dell'utilizzo In Cuba

Distribuzione per i siti Web che utilizzano Robots.txt tecnologie

Tecnologia	Siti web	%
Google AdsBot Disallow	45	8,59
Google AdsBot Mobile Disallow	43	8,21
Googlebot Disallow	39	7,44
Robots Disallow	28	5,34
Common Crawl Bot Disallow	23	4,39
Google AdsBot Mobile Apps Disallow	23	4,39
GPTBot Disallow	21	4,01
Baidu Bot Disallow	19	3,63
AppleBot Disallow	19	3,63
Anthropic Claude Bot Disallow	19	3,63
Google Bard Disallow	19	3,63
Facebook Bot Disallow	19	3,63
Apple AI Bot Disallow	19	3,63
Cohere AI Disallow	19	3,63
Perplexity	19	3,63
Google Media Partners Disallow	16 ^*	3,05
Yandex Bot Disallow	16	3,05
Yahoo Slurp Disallow	16	3,05
Microsoft BingBot Disallow	12	2,29
Alexa Bot Disallow	12	2,29
Majestic Bot Disallow	12	2,29
Ahrefs Bot Disallow	11	2,1
Sogou Bot Disallow	11	2,1
Soso Bot Disallow	10	1,91
Semrush Bot Disallow	9	1,72
Microsoft MSNBot Disallow	6	1,15
Exalead Bot Disallow	2	0,38
Google Image Bot Disallow	2	0,38
Google News Bot Disallow	2	0,38
Google Video Bot Disallow	2	0,38
DuckDuckGo Bot Disallow	2	0,38
Google Favicon Disallow	2	0,38
Google API Bot Disallow	2	0,38
Google DuplexWeb Disallow	2	0,38
360 Bot Disallow	1	0,19
BuiltWithBot Disallow	1	0,19
Youdao Bot Disallow	1	0,19