Googlebot Disallow Usage Statistics

Googlebot Disallow

The website has disallow rules for Google Search Bot.

https://developers.google.com/search/reference/robots_txt

Robots.txt

Googlebot Disallow Customers

Get access to data on 37,099,052 websites that are Googlebot Disallow Customers. We know of 17,828,157 live websites using Googlebot Disallow and an additional 19,270,895 sites that used Googlebot Disallow historically and 1,406,106 websites in the United States.

Get a list of 37,099,052 websites using Googlebot Disallow which includes location information, hosting data, contact details, 17,828,157 currently live websites and an additional 920,815 domains that redirect to sites in this list. 19,270,895 sites that used this technology previouslyand 1,406,106 websites in the United States currently using Googlebot Disallow.

Site Totals

Total Live
17,828,157
920,815 additional website redirects?.
USA Live Sites
1,406,106
Live and Historical
37,099,052
Top 1m
5.53%
55,267
Top 100k
9.95%
9,948
Top 10k
14.39%
1,439

Countries

United States
1,406,106
Germany
1,021,292
United Kingdom
532,651
Australia
218,072
Canada
191,558
France
187,970
Brazil
178,425
Japan
159,206
Russia
148,365
Italy
138,394
Netherlands
127,892
India
122,408
Switzerland
121,190
.co
105,340
China
101,963
Spain
74,238
Cocos Islands
72,398
Belgium
64,384
Austria
59,183
Poland
49,312
Turkey
48,109
.io
44,406
Mexico
41,843
.me
39,176
CZ Czech Republic
38,677
ZA South Africa
37,003
SE Sweden
34,251
KR South Korea
33,770
AI Anguilla
28,843
NO Norway
27,704
NZ New Zealand
25,544
RO Romania
23,844
IE Ireland
23,171
ID Indonesia
22,107
PT Portugal
19,642
DK Denmark
18,835
CL Chile
18,737
IL Israel
17,780
TV .tv
16,910
FI Finland
16,525
SG Singapore
14,448
PH Philippines
12,765
HK Hong Kong
12,699
MY Malaysia
12,226
AR Argentina
12,117
UA Ukraine
11,663
GR Greece
10,740
TH Thailand
10,582
VG British Virgin Islands
9,166
HU Hungary
8,936
LU Luxembourg
8,876
AE UAE
8,854
VN Vietnam
8,537
TW Taiwan
7,427
WS Samoa
7,327
SK Slovakia
5,466
LV Latvia
4,350
LT Lithuania
4,307
EE Estonia
4,219
PE Peru
4,082
CM Cameroon
3,919
SI Slovenia
3,905
IS Iceland
3,614
BG Bulgaria
3,452
CY Cyprus
3,396
HR Croatia
3,074
PK Pakistan
2,878
IM Isle of Man
2,848
RE Reunion
2,821
UY Uruguay
2,567
GG Guernsey
2,555
VC Saint Vincent
2,495
SH Saint Helena
2,471
PW Palau
2,380
PR Puerto Rico
2,259
RS Serbia
2,179
NG Nigeria
2,162
TO Tonga
2,159
NU Niue
2,088
EC Ecuador
2,036
KZ Kazakhstan
1,900
LI Liechtenstein
1,894
BY Belarus
1,874
KE Kenya
1,858
CR Costa Rica
1,850
SA Saudi Arabia
1,756
SO Somalia
1,606
AM Armenia
1,539
BD Bangladesh
1,508
IR Iran
1,505
MT Malta
1,490
GE Georgia
1,273
DO Dominican Republic
1,174
PM Saint Pierre
1,133
BZ Belize
1,115
GT Guatemala
1,105
MA Morocco
1,100
EG Egypt
1,041
LK Sri Lanka
990
QA Qatar
955
CX Christmas Island
932
FM Micronesia
904
VE Venezuela
889
UG Uganda
885
PA Panama
871
GP Guadeloupe
805
UZ Uzbekistan
797
GH Ghana
775
AL Albania
764
TZ Tanzania
676
NP Nepal
657
MD Moldova
650
AZ Azerbaijan
638
PY Paraguay
594
MQ Martinique
587
MU Mauritius
556
MK Macedonia
545
AD Andorra
531
NA Namibia
523
MN Mongolia
497
JO Jordan
477
ET Ethiopia
467
KW Kuwait
464
AG Antigua
455
HN Honduras
443
BO Bolivia
394
OM Oman
390
ZW Zimbabwe
372
ST Sao Tome
353
LB Lebanon
353
MC Monaco
352
KH Cambodia
351
SV El Salvador
336
BH Bahrain
333
TN Tunisia
325
SC Seychelles
325
IQ Iraq
312
RW Rwanda
287
DZ Algeria
282
BM Bermuda
279
NC New Caledonia
271
BA Bosnia
266
MS Montserrat
265
SX Sint Maarten
239
KY Cayman Islands
232
AO Angola
232
ZM Zambia
230
CD Congo
215
AW Aruba
214
SN Senegal
214
FO Faroe Islands
213
MZ Mozambique
210
KG Kyrgyzstan
209
NI Nicaragua
204
AF Afghanistan
201
CI Cote d'Ivoire
200
YT Mayotte
194
LC Saint Lucia
190
BS Bahamas
189
GY Guyana
185
AS American Samoa
174
BW Botswana
163
GD Grenada
160
MV Maldives
156
JM Jamaica
152
GI Gibraltar
150
MM Myanmar
150
DJ Djibouti
148
MG Madagascar
139
JE Jersey
135
TT Trinidad
130
TJ Tajikistan
118
FJ Fiji
116
PG Papua New Guinea
113
MW Malawi
102
PS Palestine
100
GL Greenland
97
GS South Georgia
92
SL Sierra Leone
83
TG Togo
81
GM Gambia
79
WF Wallis
67
TC Turks
64
BJ Benin
57
ML Mali
53
VU Vanuatu
52
BF Burkina Faso
50
YE Yemen
48
CU Cuba
47
TL East Timor
38
LY Libya
36
SY Syria
33
TM Turkmenistan
32
SM San Marino
29
BN Brunei
26
SB Solomon Islands
16
KN Saint Kitts
14
SJ Svalbard
11
NF Norfolk Island
9
PN Pitcairn
5

Financial

AMER AMER
1,929,159
ANZ ANZ
243,616
ANZUK ANZUK
776,267
APAC APAC
919,871
ASEAN3 ASEAN+3
376,147
ASEAN5 ASEAN+5
640,208
ASEAN6 ASEAN+6
742,171
FOURASIANTIGERS ASIAN TIGERS
162,880
AUKUS AUKUS
2,156,829
BASIC BASIC
439,799
BRIC BRIC
551,161
BRICS BRICS
588,164
CANZUK CANZUK
967,825
CIVETS CIVETS
222,137
CLMV CLMV
9,054
EMEA EMEA
3,002,776
FRIT FRIT
326,364
FRITES FRITES
400,602
IMEA IMEA
269,960
LATAM LATAM
376,990
LATCAR LATCAR
421,088
MART MART
295,917
MEA MEA
147,552
MENA MENA
87,717
MEP MEP
88,784
MIKTA MIKTA
363,901
MINT MINT
114,221
PIGS PIGS
243,014
SEA SEA
81,246
TIGERCUB Tiger Cub Economies
66,217
VISTA VISTA
127,873

Group

AFRICANUNION African Union
162,322
ARABLEAGUE Arab League
18,651
APEC Asia-Pacific Economic Cooperation
2,450,176
AER Assembly of European Regions
1,742,253
ACS Association of Caribbean State Members
159,475
ASEAN Association of Southeast Asian Nations
81,208
BIMSTEC Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
136,342
CARICOM Caribbean Community Members
5,638
CARIFTA Caribbean Free Trade Association
5,243
CAIS Central American Integration System
7,098
CEFTA Central European Free Trade Agreement Members
43,595
PARISCLUB Club de Paris
4,800,962
CIS Commonwealth of Independent States Members
156,090
COMMONWEALTH Commonwealth of Nations
1,209,105
CPLP Community of Portuguese Language Countries
198,942
COE Council of Europe
2,902,953
DAC Development Assistance Committee
4,631,104
EAC East African Community
3,979
EAP Eastern Partnership
1,977,458
INNERSIX EC Inner Six
1,548,808
OUTERSEVEN EC Outer Seven
813,456
ECO Economic Cooperation Organization
56,387
EAEU Eurasian Economic Union
153,887
EURONEST Euronest Parliamentary Assembly
1,974,946
EEA European Economic Area
1,993,033
EFTA European Free Trade Association
154,402
EU European Union
1,959,821
EUEEACH European Union, European Economic Area and Switzerland
2,114,223
FEAS Federation of Euro-Asian Stock Exchanges
92,016
G2 G2 Nations
1,508,069
G20 G20 Nations
4,603,115
G7 G7 Nations
3,637,177
3G Global Governance Group
306,383
G77 Group of 77
733,410
GUAM GUAM Organization for Democracy and Economic Development
14,224
GCC Gulf Cooperation Council
12,752
IBSA IBSA Dialogue Forum
337,836
ISA International Solar Alliance
3,368,436
IAO Interparliamentary Assembly on Orthodoxy
373,671
DACH Majority German-speaking states of Central Europe
1,201,665
NATO North Atlantic Treaty Organization
4,072,032
OECD Organisation for Economic Co-operation and Development
4,877,639
OECS Organisation of Eastern Caribbean States
42,995
OIC Organisation of Islamic Cooperation
120,191
OAS Organization of American States
1,976,044
OEI Organization of Ibero-American States
469,730
BSEC Organization of the Black Sea Economic Cooperation
251,037
OPEC Organization of the Petroleum Exporting Countries
16,542
TURKIC Organization of Turkic States
51,653
PACIFICALLIANCE Pacific Alliance
170,002
SCO Shanghai Cooperation Organisation
378,638
SAARC South Asian Association for Regional Cooperation
128,845
SADC Southern African Development Community
40,798
MERCOSUR Southern Common Market
193,703
NORAM Sovereign states and dependent territories of North America
1,694,927
USAN Union of South American Nations
1,543
V4 Visegrad Group
102,391

Region

AFRICA Africa
62,687
BALKANS Balkan States
136,069
BALTICS Baltic States
12,876
BENELUX Benelux Union
201,152
CENTRALAFRICA Central Africa
5,122
CENTRALAMERICA Central America
5,924
CENTRALASIA Central Asia
3,056
CENTRALEUROPE Central Europe
1,309,855
CHAPS CHAPS
161,574
EASTAFRICA East Africa
7,962
EASTASIA East Asia
315,588
EUROPE Europe
2,906,729
LEVANT Levant Narrow
70,248
MIDDLEEAST Middle East
85,906
NORDICS Nordics
101,321
CUSA North America
1,597,664
NORTHAFRICA Northern Africa
2,852
NORTHERNEUROPE Northern Europe
136,976
SCANDINAVIA Scandinavia
80,790
SOUTHAMERICA South America
326,442
SOUTHASIA South Asia
128,845
SOUTHERNAFRICA Southern Africa
37,738
SOUTHERNCONE Southern Cone
34,015
SOUTHERNEUROPE Southern Europe
295,123
SUBSAHARA Sub-Saharan Africa
58,254
WESTAFRICA Western Africa
3,936
WESTASIA Western Asia
89,356
WESTERNEUROPE Western Europe
2,149,386
Browse Technology Groups