Robots.txt Distribuzione dell'utilizzo In Cuba

Distribuzione per i siti Web che utilizzano Robots.txt tecnologie

Tecnologia	Siti web	%
Google AdsBot Disallow	46	7,69
Googlebot Disallow	45	7,53
Google AdsBot Mobile Disallow	44	7,36
Google Media Partners Disallow	32 ^*	5,35
Robots Disallow	28	4,68
Google AdsBot Mobile Apps Disallow	24	4,01
Common Crawl Bot Disallow	23	3,85
Baidu Bot Disallow	22	3,68
GPTBot Disallow	22	3,68
AppleBot Disallow	21	3,51
Anthropic Claude Bot Disallow	21	3,51
Google Bard Disallow	21	3,51
Facebook Bot Disallow	21	3,51
Apple AI Bot Disallow	21	3,51
Cohere AI Disallow	21	3,51
Perplexity	21	3,51
Yahoo Slurp Disallow	20	3,34
Yandex Bot Disallow	19	3,18
Sogou Bot Disallow	15	2,51
Microsoft BingBot Disallow	15	2,51
Alexa Bot Disallow	14	2,34
Ahrefs Bot Disallow	14	2,34
Majestic Bot Disallow	13	2,17
Soso Bot Disallow	12	2,01
Semrush Bot Disallow	9	1,51
Microsoft MSNBot Disallow	8	1,34
Google Image Bot Disallow	3	0,5
Google News Bot Disallow	3	0,5
Google Video Bot Disallow	3	0,5
DuckDuckGo Bot Disallow	3	0,5
Google Favicon Disallow	3	0,5
Google API Bot Disallow	3	0,5
Google DuplexWeb Disallow	3	0,5
Exalead Bot Disallow	2	0,33
360 Bot Disallow	1	0,17
BuiltWithBot Disallow	1	0,17
Youdao Bot Disallow	1	0,17