Robots Disallow Usage Statistics

Robots Disallow

A robots disallow all directive with no other options.

https://robotstxt.org

Robots.txt

Robots Disallow Customers

We know of 8,014,950 live websites using Robots Disallow.

We know of at least 8,014,950 live websites using Robots Disallow.

Site Totals

Total Live
8,014,950
2,726,994 additional website redirects?.
USA Live Sites
855,459
Estimated
Top 1m
15.47%
154,655
Top 100k
29.4%
29,400
Top 10k
35.49%
3,549

Countries

United States
855,458*
Russia
147,005*
Germany
102,259*
United Kingdom
95,068*
France
60,925*
Netherlands
45,101*
Brazil
43,784*
Australia
42,479*
Canada
40,418*
Italy
35,655*
Japan
33,319*
India
31,212*
Spain
30,182*
Poland
25,464*
Switzerland
23,758*
China
21,514*
Sweden
19,567*
South Korea
15,812*
.io
15,594*
Indonesia
15,308*
Belgium
15,251*
Austria
14,690*
Turkey
14,071*
Denmark
13,946*
FI Finland
12,514*
CZ Czech Republic
12,411*
NO Norway
11,495*
UA Ukraine
11,392*
PT Portugal
10,545*
CO .co
9,411*
TW Taiwan
8,587*
SG Singapore
8,335*
RO Romania
8,026*
VN Vietnam
7,671*
MX Mexico
7,499*
AR Argentina
7,362*
ZA South Africa
7,362*
HU Hungary
7,350*
NZ New Zealand
7,327*
TH Thailand
5,759*
MY Malaysia
5,209*
IE Ireland
4,992*
HK Hong Kong
4,934*
CL Chile
4,877*
GR Greece
4,831*
ME .me
4,522*
BG Bulgaria
4,385*
SK Slovakia
4,247*
AE UAE
4,133*
IL Israel
3,652*
PH Philippines
3,331*
CC Cocos Islands
2,908*
LT Lithuania
2,851*
BD Bangladesh
2,816*
HR Croatia
2,782*
EE Estonia
2,610*
AI Anguilla
2,530*
KZ Kazakhstan
2,507*
PK Pakistan
2,450*
TV .tv
2,438*
SI Slovenia
2,393*
SA Saudi Arabia
2,393*
PE Peru
2,347*
LV Latvia
2,312*
LU Luxembourg
2,026*
RS Serbia
2,026*
BY Belarus
1,957*
CY Cyprus
1,912*
IR Iran
1,797*
UZ Uzbekistan
1,751*
KE Kenya
1,465*
NG Nigeria
1,419*
MT Malta
1,316*
UY Uruguay
1,225*
PW Palau
1,064*
EC Ecuador
1,041*
NP Nepal
1,030*
EG Egypt
938*
MA Morocco
938*
IS Iceland
927*
LK Sri Lanka
915*
AM Armenia
870*
GE Georgia
801*
TO Tonga
778*
MD Moldova
755*
GG Guernsey
732*
CR Costa Rica
709*
RE Reunion
664*
BO Bolivia
641*
AZ Azerbaijan
618*
MK Macedonia
606*
SH Saint Helena
572*
QA Qatar
561*
KW Kuwait
538*
LI Liechtenstein
515*
DO Dominican Republic
503*
PY Paraguay
492*
AL Albania
480*
VE Venezuela
469*
KH Cambodia
469*
JO Jordan
458*
TN Tunisia
446*
WS Samoa
446*
TZ Tanzania
446*
DZ Algeria
446*
GH Ghana
400*
GT Guatemala
366*
BZ Belize
354*
BA Bosnia
354*
PA Panama
354*
FM Micronesia
343*
IM Isle of Man
332*
NU Niue
332*
KG Kyrgyzstan
320*
LB Lebanon
320*
UG Uganda
309*
MU Mauritius
286*
OM Oman
286*
PR Puerto Rico
274*
AF Afghanistan
274*
SO Somalia
263*
SV El Salvador
251*
ET Ethiopia
251*
IQ Iraq
251*
BS Bahamas
251*
ST Sao Tome
229*
ZW Zimbabwe
229*
BH Bahrain
229*
CX Christmas Island
217*
MZ Mozambique
217*
RW Rwanda
217*
PS Palestine
217*
MN Mongolia
217*
VC Saint Vincent
206*
MM Myanmar
206*
CI Cote d'Ivoire
206*
SC Seychelles
194*
HN Honduras
194*
NA Namibia
183*
AO Angola
171*
MC Monaco
160*
BM Bermuda
160*
NC New Caledonia
160*
AG Antigua
148*
ZM Zambia
148*
AD Andorra
148*
MS Montserrat
137*
TT Trinidad
137*
SN Senegal
137*
BW Botswana
137*
GL Greenland
125*
TJ Tajikistan
125*
NI Nicaragua
125*
CD Congo
114*
CM Cameroon
114*
PM Saint Pierre
114*
TM Turkmenistan
103*
GI Gibraltar
103*
JM Jamaica
103*
MG Madagascar
103*
BJ Benin
103*
VI Virgin Islands
91*
MV Maldives
91*
BT Bhutan
91*
MO Macao
91*
TC Turks
91*
GP Guadeloupe
80*
GS South Georgia
80*
FO Faroe Islands
80*
BF Burkina Faso
80*
GM Gambia
68*
SX Sint Maarten
68*
FJ Fiji
68*
GF French Guiana
68*
SM San Marino
68*
LS Lesotho
68*
AW Aruba
57*
MQ Martinique
57*
GY Guyana
57*
HT Haiti
57*
PG Papua New Guinea
57*
BB Barbados
57*
KY Cayman Islands
57*
TL East Timor
57*
MW Malawi
57*
SL Sierra Leone
57*
SB Solomon Islands
57*

Financial

AMER AMER
963,190
ANZ ANZ
49,807
ANZUK ANZUK
144,875
APAC APAC
226,227
ASEAN3 ASEAN+3
116,972
ASEAN5 ASEAN+5
176,477
ASEAN6 ASEAN+6
197,992
FOURASIANTIGERS ASIAN TIGERS
50,597
AUKUS AUKUS
993,006
BASIC BASIC
103,873
BRIC BRIC
243,517
BRICS BRICS
250,879
CANZUK CANZUK
185,294
CIVETS CIVETS
47,826
CLMV CLMV
8,358
EMEA EMEA
800,601
FRIT FRIT
96,580
FRITES FRITES
126,762
IMEA IMEA
81,592
LATAM LATAM
75,271
LATCAR LATCAR
79,657
MART MART
197,385
MEA MEA
50,379
MENA MENA
33,708
MEP MEP
34,246
MIKTA MIKTA
95,171
MINT MINT
38,300
PIGS PIGS
81,214
SEA SEA
46,383
TIGERCUB Tiger Cub Economies
37,280
VISTA VISTA
51,776

Group

AFRICANUNION African Union
20,598
ARABLEAGUE Arab League
12,560
APEC Asia-Pacific Economic Cooperation
1,237,279
AER Assembly of European Regions
592,842
ACS Association of Caribbean State Members
14,495
ASEAN Association of Southeast Asian Nations
46,326
BIMSTEC Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
42,032
CARICOM Caribbean Community Members
1,671
CARIFTA Caribbean Free Trade Association
1,316
CAIS Central American Integration System
2,862
CEFTA Central European Free Trade Agreement Members
4,259
PARISCLUB Club de Paris
1,667,338
CIS Commonwealth of Independent States Members
155,913
COMMONWEALTH Commonwealth of Nations
255,699
CPLP Community of Portuguese Language Countries
55,028
COE Council of Europe
761,717
DAC Development Assistance Committee
1,550,423
EAC East African Community
2,622
EAP Eastern Partnership
466,950
INNERSIX EC Inner Six
261,218
OUTERSEVEN EC Outer Seven
189,072
ECO Economic Cooperation Organization
24,021
EAEU Eurasian Economic Union
152,661
EURONEST Euronest Parliamentary Assembly
464,374
EEA European Economic Area
463,493
EFTA European Free Trade Association
36,697
EU European Union
450,554
EUEEACH European Union, European Economic Area and Switzerland
487,251
FEAS Federation of Euro-Asian Stock Exchanges
49,291
G2 G2 Nations
876,972
G20 G20 Nations
1,578,910
G7 G7 Nations
1,223,104
3G Global Governance Group
89,618
G77 Group of 77
207,896
GUAM GUAM Organization for Democracy and Economic Development
13,568
GCC Gulf Cooperation Council
8,140
IBSA IBSA Dialogue Forum
82,359
ISA International Solar Alliance
1,353,564
IAO Interparliamentary Assembly on Orthodoxy
249,402
DACH Majority German-speaking states of Central Europe
140,708
NATO North Atlantic Treaty Organization
1,414,123
OECD Organisation for Economic Co-operation and Development
1,591,482
OECS Organisation of Eastern Caribbean States
3,309
OIC Organisation of Islamic Cooperation
63,512
OAS Organization of American States
972,133
OEI Organization of Ibero-American States
115,884
BSEC Organization of the Black Sea Economic Cooperation
193,240
OPEC Organization of the Petroleum Exporting Countries
11,656
TURKIC Organization of Turkic States
19,270
PACIFICALLIANCE Pacific Alliance
17,197
SCO Shanghai Cooperation Organisation
206,888
SAARC South Asian Association for Regional Cooperation
38,883
SADC Southern African Development Community
9,755
MERCOSUR Southern Common Market
52,864
NORAM Sovereign states and dependent territories of North America
911,150
USAN Union of South American Nations
1,213
V4 Visegrad Group
49,475

Region

AFRICA Africa
19,522
BALKANS Balkan States
39,994
BALTICS Baltic States
7,774
BENELUX Benelux Union
62,379
CENTRALAFRICA Central Africa
915
CENTRALAMERICA Central America
2,358
CENTRALASIA Central Asia
4,808
CENTRALEUROPE Central Europe
193,091
CHAPS CHAPS
64,165
EASTAFRICA East Africa
4,339
EASTASIA East Asia
84,477
EUROPE Europe
766,206
LEVANT Levant Narrow
20,655
MIDDLEEAST Middle East
31,796
NORDICS Nordics
58,692
CUSA North America
895,876
NORTHAFRICA Northern Africa
2,851
NORTHERNEUROPE Northern Europe
71,218
SCANDINAVIA Scandinavia
45,009
SOUTHAMERICA South America
65,310
SOUTHASIA South Asia
38,883
SOUTHERNAFRICA Southern Africa
7,785
SOUTHERNCONE Southern Cone
13,957
SOUTHERNEUROPE Southern Europe
91,530
SUBSAHARA Sub-Saharan Africa
16,407
WESTAFRICA Western Africa
2,667
WESTASIA Western Asia
34,086
WESTERNEUROPE Western Europe
364,897
Browse Technology Groups