Robots Disallow Usage Statistics

Robots Disallow

A robots disallow all directive with no other options.

https://robotstxt.org

Robots.txt

Robots Disallow Customers

We know of 9,099,895 live websites using Robots Disallow.

We know of at least 9,099,895 live websites using Robots Disallow.

Site Totals

Total Live
9,099,895
2,796,005 additional website redirects?.
USA Live Sites
1,016,523
Estimated
Top 1m
15.86%
158,577
Top 100k
29.72%
29,716
Top 10k
35.79%
3,579

Countries

United States
1,016,523*
Russia
173,600*
Germany
117,843*
United Kingdom
110,589*
France
70,914*
Netherlands
52,480*
Brazil
50,959*
Australia
49,503*
Canada
46,929*
Italy
41,599*
Japan
38,739*
India
37,634*
Spain
35,320*
Poland
29,184*
Switzerland
27,403*
China
25,063*
Sweden
22,645*
South Korea
18,368*
.io
18,095*
Indonesia
17,965*
Belgium
17,679*
Austria
16,821*
Turkey
16,691*
Denmark
16,054*
CZ Czech Republic
14,416*
FI Finland
14,377*
UA Ukraine
13,298*
NO Norway
13,129*
PT Portugal
12,479*
CO .co
11,543*
TW Taiwan
9,801*
SG Singapore
9,736*
RO Romania
9,489*
VN Vietnam
9,138*
MX Mexico
8,761*
AR Argentina
8,618*
HU Hungary
8,579*
ZA South Africa
8,514*
NZ New Zealand
8,501*
TH Thailand
6,733*
MY Malaysia
6,148*
ME .me
5,940*
IE Ireland
5,784*
GR Greece
5,784*
HK Hong Kong
5,745*
CL Chile
5,693*
BG Bulgaria
5,082*
SK Slovakia
4,926*
AE UAE
4,861*
IL Israel
4,237*
CC Cocos Islands
3,938*
PH Philippines
3,925*
HR Croatia
3,405*
BD Bangladesh
3,379*
LT Lithuania
3,288*
TV .tv
2,963*
EE Estonia
2,937*
PK Pakistan
2,937*
KZ Kazakhstan
2,885*
SI Slovenia
2,833*
AI Anguilla
2,820*
LV Latvia
2,755*
SA Saudi Arabia
2,755*
PE Peru
2,742*
RS Serbia
2,404*
LU Luxembourg
2,391*
IR Iran
2,274*
BY Belarus
2,274*
UZ Uzbekistan
2,001*
KE Kenya
1,663*
NG Nigeria
1,663*
CY Cyprus
1,637*
MT Malta
1,520*
UY Uruguay
1,442*
NP Nepal
1,286*
PW Palau
1,234*
EC Ecuador
1,221*
EG Egypt
1,130*
MA Morocco
1,130*
LK Sri Lanka
1,091*
IS Iceland
1,078*
AM Armenia
1,013*
GE Georgia
935*
TO Tonga
883*
MD Moldova
857*
CR Costa Rica
818*
GG Guernsey
805*
BO Bolivia
740*
AZ Azerbaijan
740*
RE Reunion
727*
MK Macedonia
714*
QA Qatar
649*
SH Saint Helena
649*
KW Kuwait
623*
WS Samoa
610*
DO Dominican Republic
597*
LI Liechtenstein
597*
AL Albania
584*
VE Venezuela
558*
PY Paraguay
558*
DZ Algeria
545*
JO Jordan
532*
KH Cambodia
532*
TN Tunisia
519*
TZ Tanzania
519*
GH Ghana
480*
BA Bosnia
429*
PA Panama
429*
BZ Belize
416*
IM Isle of Man
416*
GT Guatemala
416*
UG Uganda
403*
FM Micronesia
390*
NU Niue
377*
KG Kyrgyzstan
364*
LB Lebanon
364*
AF Afghanistan
351*
PR Puerto Rico
338*
MU Mauritius
325*
OM Oman
325*
SV El Salvador
312*
SO Somalia
312*
ET Ethiopia
312*
BH Bahrain
286*
IQ Iraq
286*
BS Bahamas
286*
ZW Zimbabwe
273*
ST Sao Tome
260*
MZ Mozambique
260*
MM Myanmar
260*
PS Palestine
260*
CX Christmas Island
247*
VC Saint Vincent
247*
RW Rwanda
247*
MN Mongolia
247*
CI Cote d'Ivoire
247*
HN Honduras
234*
NA Namibia
221*
MC Monaco
208*
SC Seychelles
208*
AO Angola
195*
BM Bermuda
182*
NC New Caledonia
182*
ZM Zambia
182*
AG Antigua
169*
MS Montserrat
156*
TT Trinidad
156*
SN Senegal
156*
AD Andorra
156*
BW Botswana
156*
GL Greenland
143*
TJ Tajikistan
143*
NI Nicaragua
143*
CD Congo
130*
JM Jamaica
130*
CM Cameroon
130*
PM Saint Pierre
130*
TM Turkmenistan
117*
GI Gibraltar
117*
MV Maldives
117*
MG Madagascar
117*
BJ Benin
117*
VI Virgin Islands
104*
BT Bhutan
104*
MO Macao
104*
TC Turks
104*
GP Guadeloupe
91*
GS South Georgia
91*
GF French Guiana
91*
SX Sint Maarten
91*
FJ Fiji
91*
FO Faroe Islands
91*
BF Burkina Faso
91*
GM Gambia
78*
GY Guyana
78*
SM San Marino
78*
ML Mali
78*
LS Lesotho
78*
AW Aruba
65*
LC Saint Lucia
65*
HT Haiti
65*
PG Papua New Guinea
65*
BB Barbados
65*
KY Cayman Islands
65*
TL East Timor
65*
MW Malawi
65*
SL Sierra Leone
65*
SB Solomon Islands
65*

Financial

AMER AMER
1,141,906
ANZ ANZ
58,005
ANZUK ANZUK
168,595
APAC APAC
265,885
ASEAN3 ASEAN+3
136,654
ASEAN5 ASEAN+5
207,230
ASEAN6 ASEAN+6
232,294
FOURASIANTIGERS ASIAN TIGERS
58,915
AUKUS AUKUS
1,176,616
BASIC BASIC
122,172
BRIC BRIC
287,257
BRICS BRICS
295,772
CANZUK CANZUK
215,524
CIVETS CIVETS
56,302
CLMV CLMV
9,944
EMEA EMEA
932,271
FRIT FRIT
112,513
FRITES FRITES
147,834
IMEA IMEA
96,237
LATAM LATAM
87,761
LATCAR LATCAR
92,740
MART MART
232,203
MEA MEA
58,603
MENA MENA
39,272
MEP MEP
39,909
MIKTA MIKTA
111,291
MINT MINT
45,083
PIGS PIGS
95,184
SEA SEA
54,547
TIGERCUB Tiger Cub Economies
43,913
VISTA VISTA
60,930

Group

AFRICANUNION African Union
24,062
ARABLEAGUE Arab League
14,754
APEC Asia-Pacific Economic Cooperation
1,463,718
AER Assembly of European Regions
691,813
ACS Association of Caribbean State Members
16,951
ASEAN Association of Southeast Asian Nations
54,482
BIMSTEC Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
50,491
CARICOM Caribbean Community Members
1,962
CARIFTA Caribbean Free Trade Association
1,559
CAIS Central American Integration System
3,366
CEFTA Central European Free Trade Agreement Members
5,043
PARISCLUB Club de Paris
1,961,508
CIS Commonwealth of Independent States Members
183,882
COMMONWEALTH Commonwealth of Nations
298,567
CPLP Community of Portuguese Language Countries
64,245
COE Council of Europe
886,810
DAC Development Assistance Committee
1,822,890
EAC East African Community
3,041
EAP Eastern Partnership
541,365
INNERSIX EC Inner Six
302,909
OUTERSEVEN EC Outer Seven
219,125
ECO Economic Cooperation Organization
28,508
EAEU Eurasian Economic Union
180,138
EURONEST Euronest Parliamentary Assembly
538,349
EEA European Economic Area
537,049
EFTA European Free Trade Association
42,210
EU European Union
522,242
EUEEACH European Union, European Economic Area and Switzerland
564,453
FEAS Federation of Euro-Asian Stock Exchanges
57,563
G2 G2 Nations
1,041,586
G20 G20 Nations
1,861,578
G7 G7 Nations
1,443,139
3G Global Governance Group
104,427
G77 Group of 77
244,722
GUAM GUAM Organization for Democracy and Economic Development
15,833
GCC Gulf Cooperation Council
9,502
IBSA IBSA Dialogue Forum
97,108
ISA International Solar Alliance
1,597,915
IAO Interparliamentary Assembly on Orthodoxy
291,794
DACH Majority German-speaking states of Central Europe
162,069
NATO North Atlantic Treaty Organization
1,665,748
OECD Organisation for Economic Co-operation and Development
1,870,938
OECS Organisation of Eastern Caribbean States
3,717
OIC Organisation of Islamic Cooperation
75,074
OAS Organization of American States
1,152,371
OEI Organization of Ibero-American States
135,419
BSEC Organization of the Black Sea Economic Cooperation
228,082
OPEC Organization of the Petroleum Exporting Countries
13,818
TURKIC Organization of Turkic States
22,684
PACIFICALLIANCE Pacific Alliance
20,058
SCO Shanghai Cooperation Organisation
244,631
SAARC South Asian Association for Regional Cooperation
46,903
SADC Southern African Development Community
11,283
MERCOSUR Southern Common Market
61,580
NORAM Sovereign states and dependent territories of North America
1,081,158
USAN Union of South American Nations
1,429
V4 Visegrad Group
57,108

Region

AFRICA Africa
22,762
BALKANS Balkan States
47,475
BALTICS Baltic States
8,982
BENELUX Benelux Union
72,552
CENTRALAFRICA Central Africa
1,039
CENTRALAMERICA Central America
2,768
CENTRALASIA Central Asia
5,511
CENTRALEUROPE Central Europe
222,609
CHAPS CHAPS
73,930
EASTAFRICA East Africa
5,056
EASTASIA East Asia
98,070
EUROPE Europe
891,997
LEVANT Levant Narrow
23,763
MIDDLEEAST Middle East
36,971
NORDICS Nordics
67,560
CUSA North America
1,063,452
NORTHAFRICA Northern Africa
3,431
NORTHERNEUROPE Northern Europe
82,055
SCANDINAVIA Scandinavia
51,830
SOUTHAMERICA South America
76,114
SOUTHASIA South Asia
46,903
SOUTHERNAFRICA Southern Africa
9,008
SOUTHERNCONE Southern Cone
16,314
SOUTHERNEUROPE Southern Europe
107,482
SUBSAHARA Sub-Saharan Africa
19,018
WESTAFRICA Western Africa
3,158
WESTASIA Western Asia
39,662
WESTERNEUROPE Western Europe
422,872
Browse Technology Groups