Robots.txt Distribuzione dell'utilizzo In Burkina Faso

Distribuzione per i siti Web che utilizzano Robots.txt tecnologie

Tecnologia	Siti web	%
Robots Disallow	163	25,51
Googlebot Disallow	60	9,39
Google AdsBot Disallow	46	7,2
Google AdsBot Mobile Disallow	35	5,48
Baidu Bot Disallow	33	5,16
Ahrefs Bot Disallow	29	4,54
Microsoft MSNBot Disallow	18	2,82
Google Media Partners Disallow	16 ^*	2,5
Yandex Bot Disallow	16	2,5
Alexa Bot Disallow	15	2,35
Majestic Bot Disallow	15	2,35
Microsoft BingBot Disallow	14	2,19
Semrush Bot Disallow	14	2,19
Soso Bot Disallow	13	2,03
GPTBot Disallow	13	2,03
Yahoo Slurp Disallow	12	1,88
Sogou Bot Disallow	11	1,72
Common Crawl Bot Disallow	11	1,72
Anthropic Claude Bot Disallow	10	1,56
AppleBot Disallow	8	1,25
Facebook Bot Disallow	8	1,25
Google AdsBot Mobile Apps Disallow	8	1,25
Apple AI Bot Disallow	8	1,25
Cohere AI Disallow	8	1,25
Perplexity	8	1,25
Google Bard Disallow	6	0,94
Google Image Bot Disallow	6	0,94
ByteDance Bytespider Disallow	4	0,63
Webz Omgili Disallow	4	0,63
Google News Bot Disallow	4	0,63
Google Video Bot Disallow	4	0,63
DuckDuckGo Bot Disallow	3	0,47
Diffbot Disallow	3	0,47
Google Favicon Disallow	3	0,47
Google API Bot Disallow	3	0,47
Google DuplexWeb Disallow	3	0,47
Exalead Bot Disallow	2	0,31
360 Bot Disallow	1	0,16
Youdao Bot Disallow	1	0,16