Googlebot Disallow Usage Statistics

Googlebot Disallow

The website has disallow rules for Google Search Bot.

https://developers.google.com/search/reference/robots_txt

Robots.txt

Googlebot Disallow Customers

Get access to data on 25,926,521 websites that are Googlebot Disallow Customers. We know of 15,747,562 live websites using Googlebot Disallow and an additional 10,178,959 sites that used Googlebot Disallow historically and 592,317 websites in the United States.

Get a list of 25,926,521 websites using Googlebot Disallow which includes location information, hosting data, contact details, 15,747,562 currently live websites and an additional 657,232 domains that redirect to sites in this list. 10,178,959 sites that used this technology previously and 592,317 websites in the United States currently using Googlebot Disallow.

Site Totals

Total Live
15,747,562
657,232 additional website redirects?.
USA Live Sites
592,317
Live and Historical
25,926,521
Top 1m
6.35%
63,464
Top 100k
8.33%
8,330
Top 10k
12.64%
1,264

Countries

Germany
856,267
United States
592,317
United Kingdom
320,019
Italy
213,610
.co
182,209
Russia
173,016
China
152,302
.me
116,888
India
110,830
France
104,302
Australia
94,599
Netherlands
91,142
Canada
64,510
Poland
59,678
Spain
57,423
Cocos Islands
52,244
.io
47,324
Switzerland
43,644
Japan
30,631
.tv
29,901
Belgium
29,716
Brazil
29,675
Austria
27,773
South Africa
23,942
KR South Korea
23,644
SE Sweden
19,801
CZ Czech Republic
19,456
ID Indonesia
18,285
RO Romania
16,566
MX Mexico
15,462
DK Denmark
12,888
PW Palau
12,643
NO Norway
12,458
TW Taiwan
11,300
TR Turkey
11,052
IE Ireland
11,024
VN Vietnam
10,158
UA Ukraine
9,526
CM Cameroon
8,692
AR Argentina
8,586
CL Chile
8,517
VG British Virgin Islands
8,082
FI Finland
7,588
PT Portugal
7,378
NZ New Zealand
6,497
TO Tonga
6,025
MY Malaysia
5,616
GR Greece
4,187
TH Thailand
4,136
WS Samoa
3,936
LU Luxembourg
3,891
HU Hungary
3,822
SK Slovakia
3,734
PH Philippines
3,672
IM Isle of Man
3,663
HK Hong Kong
2,992
IR Iran
2,953
SG Singapore
2,866
BY Belarus
2,605
PE Peru
2,493
SH Saint Helena
2,349
BG Bulgaria
2,262
LI Liechtenstein
2,225
BD Bangladesh
2,193
VC Saint Vincent
2,175
LV Latvia
1,996
GG Guernsey
1,930
AI Anguilla
1,888
PK Pakistan
1,875
NU Niue
1,872
NG Nigeria
1,810
IL Israel
1,775
RE Reunion
1,740
LT Lithuania
1,713
AE UAE
1,691
KZ Kazakhstan
1,594
RS Serbia
1,550
SO Somalia
1,528
SI Slovenia
1,420
EE Estonia
1,345
HR Croatia
1,124
BZ Belize
1,122
FM Micronesia
908
KE Kenya
761
AM Armenia
736
SA Saudi Arabia
732
IS Iceland
723
UZ Uzbekistan
681
UY Uruguay
666
MA Morocco
642
AL Albania
593
EG Egypt
587
VE Venezuela
585
EC Ecuador
538
DO Dominican Republic
467
MD Moldova
465
CX Christmas Island
449
CR Costa Rica
441
MT Malta
415
GE Georgia
401
AG Antigua
394
MK Macedonia
373
ST Sao Tome
364
AZ Azerbaijan
355
LK Sri Lanka
349
NP Nepal
344
MS Montserrat
331
PR Puerto Rico
319
SC Seychelles
301
YT Mayotte
294
PA Panama
292
PM Saint Pierre
287
QA Qatar
271
MN Mongolia
269
GP Guadeloupe
266
LC Saint Lucia
249
CY Cyprus
246
TN Tunisia
241
GT Guatemala
231
SX Sint Maarten
228
GH Ghana
201
UG Uganda
201
MQ Martinique
199
LB Lebanon
192
BA Bosnia
186
BO Bolivia
184
GD Grenada
177
KG Kyrgyzstan
172
DZ Algeria
168
TZ Tanzania
161
PY Paraguay
152
GY Guyana
152
BS Bahamas
149
TC Turks
148
JO Jordan
136
HN Honduras
129
GL Greenland
128
KH Cambodia
124
SV El Salvador
123
FO Faroe Islands
123
NA Namibia
110
SN Senegal
109
KW Kuwait
108
DJ Djibouti
107
WF Wallis
105
JM Jamaica
99
TT Trinidad
88
MU Mauritius
87
ET Ethiopia
76
MC Monaco
75
ML Mali
73
AS American Samoa
66
GF French Guiana
62
ZW Zimbabwe
61
CD Congo
61
PS Palestine
59
VI Virgin Islands
56
OM Oman
54
YE Yemen
50
BH Bahrain
49
MG Madagascar
48
MM Myanmar
43
KY Cayman Islands
43
BB Barbados
41
GI Gibraltar
37
RW Rwanda
37
MZ Mozambique
31
MV Maldives
27
BJ Benin
25
BW Botswana
22
AO Angola
22
CU Cuba
20
MW Malawi
20
PF French Polynesia
20
NF Norfolk Island
18
LS Lesotho
15
FJ Fiji
13
KN Saint Kitts
13
BT Bhutan
11
BN Brunei
10
MO Macao
8
MP Northern Mariana Islands
6

Financial

AMER AMER
893,096
ANZ ANZ
101,096
ANZUK ANZUK
421,115
APAC APAC
638,713
ASEAN3 ASEAN+3
251,487
ASEAN5 ASEAN+5
311,111
ASEAN6 ASEAN+6
463,413
FOURASIANTIGERS ASIAN TIGERS
181,804
AUKUS AUKUS
1,006,935
BASIC BASIC
316,749
BRIC BRIC
465,823
BRICS BRICS
489,765
CANZUK CANZUK
485,625
CIVETS CIVETS
246,233
CLMV CLMV
10,325
EMEA EMEA
2,312,861
FRIT FRIT
317,912
FRITES FRITES
375,335
IMEA IMEA
175,693
LATAM LATAM
251,743
LATCAR LATCAR
266,835
MART MART
237,879
MEA MEA
64,863
MENA MENA
21,124
MEP MEP
21,910
MIKTA MIKTA
163,042
MINT MINT
46,609
PIGS PIGS
282,598
SEA SEA
44,978
TIGERCUB Tiger Cub Economies
41,867
VISTA VISTA
72,023

Group

AFRICANUNION African Union
223,175
ARABLEAGUE Arab League
6,720
APEC Asia-Pacific Economic Cooperation
1,223,031
AER Assembly of European Regions
1,295,706
ACS Association of Caribbean State Members
204,784
ASEAN Association of Southeast Asian Nations
44,910
BIMSTEC Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
117,906
CARICOM Caribbean Community Members
5,097
CARIFTA Caribbean Free Trade Association
4,854
CAIS Central American Integration System
2,864
CEFTA Central European Free Trade Agreement Members
120,058
PARISCLUB Club de Paris
2,817,822
CIS Commonwealth of Independent States Members
179,719
COMMONWEALTH Commonwealth of Nations
691,103
CPLP Community of Portuguese Language Countries
37,544
COE Council of Europe
2,255,096
DAC Development Assistance Committee
2,724,142
EAC East African Community
1,270
EAP Eastern Partnership
1,574,855
INNERSIX EC Inner Six
1,298,928
OUTERSEVEN EC Outer Seven
443,961
ECO Economic Cooperation Organization
19,010
EAEU Eurasian Economic Union
178,123
EURONEST Euronest Parliamentary Assembly
1,571,895
EEA European Economic Area
1,576,173
EFTA European Free Trade Association
59,050
EU European Union
1,560,767
EUEEACH European Union, European Economic Area and Switzerland
1,619,817
FEAS Federation of Euro-Asian Stock Exchanges
42,841
G2 G2 Nations
744,619
G20 G20 Nations
2,843,781
G7 G7 Nations
2,181,656
3G Global Governance Group
219,774
G77 Group of 77
612,335
GUAM GUAM Organization for Democracy and Economic Development
10,747
GCC Gulf Cooperation Council
2,905
IBSA IBSA Dialogue Forum
164,447
ISA International Solar Alliance
1,774,702
IAO Interparliamentary Assembly on Orthodoxy
426,145
DACH Majority German-speaking states of Central Europe
927,684
NATO North Atlantic Treaty Organization
2,612,853
OECD Organisation for Economic Co-operation and Development
2,948,652
OECS Organisation of Eastern Caribbean States
13,787
OIC Organisation of Islamic Cooperation
63,959
OAS Organization of American States
912,402
OEI Organization of Ibero-American States
315,985
BSEC Organization of the Black Sea Economic Cooperation
219,159
OPEC Organization of the Petroleum Exporting Countries
8,149
TURKIC Organization of Turkic States
13,854
PACIFICALLIANCE Pacific Alliance
208,681
SCO Shanghai Cooperation Organisation
440,565
SAARC South Asian Association for Regional Cooperation
115,771
SADC Southern African Development Community
24,925
MERCOSUR Southern Common Market
39,079
NORAM Sovereign states and dependent territories of North America
690,461
USAN Union of South American Nations
948
V4 Visegrad Group
86,690

Region

AFRICA Africa
45,415
BALKANS Balkan States
156,204
BALTICS Baltic States
5,054
BENELUX Benelux Union
124,749
CENTRALAFRICA Central Africa
9,246
CENTRALAMERICA Central America
2,397
CENTRALASIA Central Asia
2,633
CENTRALEUROPE Central Europe
1,018,019
CHAPS CHAPS
114,463
EASTAFRICA East Africa
3,526
EASTASIA East Asia
221,146
EUROPE Europe
2,259,296
LEVANT Levant Narrow
13,473
MIDDLEEAST Middle East
20,035
NORDICS Nordics
53,714
CUSA North America
656,827
NORTHAFRICA Northern Africa
1,676
NORTHERNEUROPE Northern Europe
69,536
SCANDINAVIA Scandinavia
45,147
SOUTHAMERICA South America
234,164
SOUTHASIA South Asia
115,771
SOUTHERNAFRICA Southern Africa
24,095
SOUTHERNCONE Southern Cone
17,921
SOUTHERNEUROPE Southern Europe
405,228
SUBSAHARA Sub-Saharan Africa
42,227
WESTAFRICA Western Africa
2,610
WESTASIA Western Asia
21,527
WESTERNEUROPE Western Europe
1,490,114
Browse Technology Groups