Robots.txt Usage Distribution

Distribution for websites using Robots.txt technologies

Top In Robots.txt Usage Distribution

Technology	Websites	%

0 Detections

of Robots.txt . Last updated 14th Nov 2024.

Top 1m Top 1,000,000 sites by traffic: 870,756
Top 100k Top 100,000 sites by traffic: 155,828
Top 10k Top 10,000 sites by traffic: 22,443
Entire Internet: 181,836,258
Canada: 2,192,600
United States: 51,449,962
Germany: 7,320,724
United Kingdom: 4,745,675
Russia: 4,021,848
Australia: 3,071,917
Italy: 1,818,697
France: 1,318,355
Brazil: 1,228,331
.co: 1,094,249
Netherlands: 1,026,836
Spain: 922,136
Japan: 903,337
India: 799,080
Switzerland: 793,080
China: 606,587
New Zealand: 482,853
Poland: 476,756
Belgium: 460,967
Sweden: 417,700
.me: 375,089
Austria: 360,511
Norway: 323,209
Mexico: 307,633
Czech Republic: 302,675
Denmark: 297,563
South Africa: 271,807
South Korea: 250,334
Ireland: 245,513
Turkey: 231,135
Romania: 228,510
.io: 225,409
Cocos Islands: 209,891
Finland: 203,791
Indonesia: 200,001
Philippines: 167,936
Portugal: 149,268
Singapore: 137,469
Taiwan: 132,381
Argentina: 124,703
Thailand: 119,356
Chile: 114,862
Hungary: 106,300
.tv: 105,858
Hong Kong: 105,657
Greece: 100,422
Ukraine: 100,040
Vietnam: 96,899
Israel: 85,999
Anguilla: 77,732
UAE: 76,837
Slovakia: 69,944
British Virgin Islands: 67,532
Malaysia: 66,738
Luxembourg: 57,720
Saudi Arabia: 43,868
Pakistan: 41,139
Samoa: 40,723
Iran: 38,238
Lithuania: 37,455
Bulgaria: 36,585
Estonia: 34,795
Iceland: 33,150
Latvia: 33,037
Peru: 32,677
Cameroon: 32,440
Slovenia: 30,243
Croatia: 23,943
Niue: 21,927
Puerto Rico: 21,377
Costa Rica: 20,939
Serbia: 19,547
Belarus: 18,806
Ecuador: 18,606
Nigeria: 17,240
Kenya: 17,083
Uruguay: 16,596
Palau: 16,454
Isle of Man: 16,357
Kazakhstan: 13,862
Liechtenstein: 13,644
Dominican Republic: 13,613
Reunion: 13,384
Tonga: 12,999
Malta: 12,664
Guernsey: 11,762
Bangladesh: 11,607
Morocco: 11,592
Guatemala: 11,097
Egypt: 10,479
Saint Vincent and the Grenadines: 10,205
Saint Helena: 9,893
Panama: 8,943
Lebanon: 8,688
Georgia: 8,409
Sri Lanka: 8,351
Cyprus: 8,015
Venezuela: 7,761
Albania: 7,590
Qatar: 6,944
Ghana: 6,650
Armenia: 6,510
Uganda: 6,438
Uzbekistan: 6,336
Somalia: 6,201
Belize: 6,105
Tanzania: 5,979
Kuwait: 5,778
Micronesia: 5,734
Nepal: 5,435
Jordan: 4,814
Macedonia: 4,630
Honduras: 4,518
Moldova: 4,453
Christmas Island: 4,128
Paraguay: 3,924
Mauritius: 3,723
Tunisia: 3,647
Bahamas: 3,367
El Salvador: 3,266
Bolivia: 3,151
Monaco: 3,116
Azerbaijan: 3,111
Bermuda: 2,991
Mongolia: 2,936
Bosnia and Herzegovina: 2,902
Namibia: 2,891
Antigua and Barbuda: 2,824
United States Virgin Islands: 2,815
Rwanda: 2,713
Bahrain: 2,671
Zimbabwe: 2,609
Oman: 2,542
Cambodia: 2,537
Cayman Islands: 2,499
Algeria: 2,492
Trinidad and Tobago: 2,429
Sao Tome and Principe: 2,404
Jersey: 2,206
Zambia: 2,185
Nicaragua: 2,094
Guadeloupe: 2,081
Afghanistan: 2,030
Ethiopia: 1,999
Seychelles: 1,957
Jamaica: 1,845
Myanmar: 1,729
Iraq: 1,662
Faroe Islands: 1,654
Mozambique: 1,638
New Caledonia: 1,631
Maldives: 1,621
Andorra: 1,574
Montserrat: 1,564
Saint Pierre and Miquelon: 1,540
Cote d'Ivoire: 1,537
Angola: 1,511
Mayotte: 1,450
Barbados: 1,439
Fiji: 1,381
Gibraltar: 1,361
Congo: 1,348
Martinique: 1,334
Sint Maarten: 1,309
Botswana: 1,307
Saint Lucia: 1,290
Senegal: 1,267
Turks and Caicos Islands: 1,263
Kyrgyzstan: 1,251
Greenland: 1,226
American Samoa: 1,187
Madagascar: 1,055
Haiti: 939
Aruba: 933
Mali: 917
Palestine: 916
Guyana: 770
Grenada: 762
French Guiana: 753
Vanuatu: 687
South Georgia and the South Sandwich Islands: 658
Malawi: 653
Burkina Faso: 639
Togo: 628
Wallis and Futuna: 588
Gambia: 556
Tajikistan: 543
Cuba: 524
Papua New Guinea: 496
Guam: 462
Sierra Leone: 404
Benin: 392
Djibouti: 386
Brunei: 370
East Timor: 367
Suriname: 361
Solomon Islands: 310
Yemen: 287
Åland Islands: 286
Liberia: 286
Lao People's Democratic Republic: 282
French Polynesia: 281
Sudan: 272
Heard Island and McDonald Islands: 248
Niger: 244
San Marino: 239
Burundi: 228
Cook Islands: 225
Bhutan: 212
Syria: 199
Swaziland: 193
Libya: 191
Curacao: 190
Northern Mariana Islands: 175
Saint Kitts and Nevis: 172
Gabon: 158
Turkmenistan: 158
Lesotho: 154
Dominica: 150
Mauritania: 139
Macao: 134
United States Minor Outlying Islands: 105
Svalbard and Jan Mayen: 98
Cabo Verde: 83
Norfolk Island: 79
Congo: 72
Guinea: 67
Kiribati: 64
Chad: 64
Marshall Islands: 58
South Sudan: 55
Saint Barthélemy: 50
Guinea-Bissau: 49
Falkland Islands: 45
Vatican City: 43
Pitcairn: 34
Nauru: 30
Bonaire: 20
Antarctica: 16
Eritrea: 16
Equatorial Guinea: 13

Robots.txt Usage Distribution

Distribution for websites using Robots.txt technologies

Top In Robots.txt Usage Distribution

0 Detections

Categories