Robots.txt Usage Distribution in Congo

Distribution for websites using Robots.txt technologies

Technology	Websites	%
Googlebot Disallow	202	14.99
Robots Disallow	202	14.99
Google AdsBot Disallow	183	13.58
Common Crawl Bot Disallow	45	3.34
Yandex Bot Disallow	42	3.12
Alexa Bot Disallow	41	3.04
Sogou Bot Disallow	41	3.04
Ahrefs Bot Disallow	40	2.97
Yahoo Slurp Disallow	40	2.97
Soso Bot Disallow	40	2.97
GPTBot Disallow	40	2.97
Microsoft BingBot Disallow	38	2.82
Google Bard Disallow	36	2.67
Google AdsBot Mobile Apps Disallow	36	2.67
Some Robots Disallow	35	2.6
Anthropic Claude Bot Disallow	35	2.6
Facebook Bot Disallow	35	2.6
AppleBot Disallow	33	2.45
Apple AI Bot Disallow	33	2.45
Cohere AI Disallow	32	2.37
Perplexity	31	2.3
Majestic Bot Disallow	23	1.71
Semrush Bot Disallow	23	1.71
Exalead Bot Disallow	7	0.52
360 Bot Disallow	6	0.45
ByteDance Bytespider Disallow	4	0.3
Microsoft MSNBot Disallow	4	0.3
Webz Omgili Disallow	3	0.22
BuiltWithBot Disallow	3	0.22
Google Image Bot Disallow	2	0.15
Google News Bot Disallow	2	0.15
Google Video Bot Disallow	2	0.15
DuckDuckGo Bot Disallow	2	0.15
Google Favicon Disallow	2	0.15
Google API Bot Disallow	2	0.15
Google DuplexWeb Disallow	2	0.15
Youdao Bot Disallow	1	0.07