Googlebot Disallow Usage Statistics

Googlebot Disallow

The website has disallow rules for Google Search Bot.

https://developers.google.com/search/reference/robots_txt

Robots.txt

Googlebot Disallow Customers

Get access to data on 36,059,843 websites Googlebot Disallow Customers. We know of 17,974,541 live websites using Googlebot Disallow and an additional 18,085,302 sites that used Googlebot Disallow historically and 1,441,905 websites in the United States.

Get a list of 36,059,843 websites using Googlebot Disallow which includes location information, hosting data, contact details, 17,974,541 currently live websites and an additional 877,322 domains that redirect to sites in this list. 18,085,302 sites that used this technology previouslyand 1,441,905 websites in the United States currently using Googlebot Disallow.

Site Totals

Total Live
17,974,541
877,322 additional website redirects?.
United States Live Sites
1,441,905
Live and Historical
36,059,843
Top 1m
5.84%
58,357
Top 100k
9.59%
9,595
Top 10k
13.23%
1,323

Countries

United States
1,441,905
Germany
993,636
United Kingdom
541,245
Australia
246,323
Italy
220,741
France
199,554
Brazil
194,621
Canada
190,473
Russia
178,490
Japan
172,564
India
121,375
.co
120,138
Netherlands
113,368
Switzerland
111,877
China
82,822
Spain
74,548
Belgium
67,070
Poland
54,698
Turkey
53,347
Austria
52,453
.me
43,960
Mexico
41,903
Cocos Islands
41,643
.io
40,217
CZ Czech Republic
39,868
ZA South Africa
38,299
KR South Korea
38,172
SE Sweden
35,938
NZ New Zealand
29,490
NO Norway
28,231
ID Indonesia
25,433
RO Romania
24,122
DK Denmark
23,442
IE Ireland
21,912
CL Chile
20,126
PT Portugal
19,508
IL Israel
18,896
AI Anguilla
18,828
AR Argentina
17,833
FI Finland
16,545
TV .tv
15,861
SG Singapore
15,646
TW Taiwan
15,446
UA Ukraine
13,658
HK Hong Kong
13,120
MY Malaysia
11,710
GR Greece
11,615
TH Thailand
11,479
PH Philippines
11,218
VN Vietnam
10,057
HU Hungary
9,631
AE UAE
9,398
LU Luxembourg
8,913
VG British Virgin Islands
8,888
SK Slovakia
5,691
WS Samoa
5,592
CM Cameroon
4,503
LV Latvia
4,447
LT Lithuania
4,220
EE Estonia
4,213
PE Peru
3,872
BG Bulgaria
3,681
IS Iceland
3,485
SI Slovenia
3,478
HR Croatia
3,229
RE Reunion
2,928
PK Pakistan
2,843
UY Uruguay
2,686
PW Palau
2,606
PR Puerto Rico
2,443
BY Belarus
2,432
IM Isle of Man
2,394
RS Serbia
2,359
NG Nigeria
2,315
VC Saint Vincent
2,254
NU Niue
2,214
KZ Kazakhstan
2,128
EC Ecuador
2,110
TO Tonga
2,090
GG Guernsey
2,040
SH Saint Helena
1,973
CR Costa Rica
1,961
KE Kenya
1,937
SA Saudi Arabia
1,917
LI Liechtenstein
1,869
BD Bangladesh
1,583
IR Iran
1,575
MT Malta
1,519
GE Georgia
1,371
DO Dominican Republic
1,353
SO Somalia
1,298
AM Armenia
1,266
MA Morocco
1,244
EG Egypt
1,162
GT Guatemala
1,133
LK Sri Lanka
1,082
BZ Belize
1,079
PM Saint Pierre
1,006
UZ Uzbekistan
943
VE Venezuela
900
PA Panama
894
CY Cyprus
858
QA Qatar
849
GP Guadeloupe
844
GH Ghana
833
UG Uganda
826
FM Micronesia
825
CX Christmas Island
815
TZ Tanzania
754
AL Albania
712
AZ Azerbaijan
689
MD Moldova
675
MQ Martinique
669
PY Paraguay
611
NP Nepal
587
MK Macedonia
579
MU Mauritius
563
JO Jordan
530
KW Kuwait
527
NA Namibia
498
MN Mongolia
491
HN Honduras
485
AG Antigua
415
OM Oman
405
BO Bolivia
382
ZW Zimbabwe
374
BH Bahrain
369
KH Cambodia
356
TN Tunisia
351
SV El Salvador
350
LB Lebanon
347
MC Monaco
345
VI Virgin Islands
327
ET Ethiopia
324
NC New Caledonia
313
SC Seychelles
304
IQ Iraq
303
ST Sao Tome
291
DZ Algeria
289
BA Bosnia
274
MS Montserrat
256
ZM Zambia
251
AO Angola
245
KY Cayman Islands
244
SX Sint Maarten
242
FO Faroe Islands
239
AD Andorra
236
AW Aruba
227
YT Mayotte
218
CD Congo
217
SN Senegal
215
BS Bahamas
214
NI Nicaragua
212
CI Cote d'Ivoire
208
MZ Mozambique
207
KG Kyrgyzstan
206
AF Afghanistan
200
GY Guyana
199
RW Rwanda
189
JM Jamaica
181
MV Maldives
175
BW Botswana
172
MM Myanmar
171
LC Saint Lucia
164
GF French Guiana
164
JE Jersey
157
GI Gibraltar
152
TT Trinidad
150
AS American Samoa
146
MG Madagascar
138
FJ Fiji
131
TJ Tajikistan
120
GD Grenada
119
GL Greenland
105
TC Turks
104
GS South Georgia
104
MW Malawi
95
NE Niger
93
TG Togo
92
SL Sierra Leone
88
PS Palestine
87
GM Gambia
81
WF Wallis
69
ML Mali
65
VU Vanuatu
63
CK Cook Islands
63
BJ Benin
56
BF Burkina Faso
56
CU Cuba
46
HM Heard Island
46
BT Bhutan
44
TL East Timor
41
SY Syria
40
TM Turkmenistan
32
SM San Marino
27
BN Brunei
26
SB Solomon Islands
20
SJ Svalbard
14
KN Saint Kitts
12
NF Norfolk Island
9

Financial

AMER AMER
2,002,196
ANZ ANZ
275,813
ANZUK ANZUK
817,058
APAC APAC
925,472
ASEAN3 ASEAN+3
379,665
ASEAN5 ASEAN+5
694,031
ASEAN6 ASEAN+6
776,853
FOURASIANTIGERS ASIAN TIGERS
149,760
AUKUS AUKUS
2,229,473
BASIC BASIC
437,117
BRIC BRIC
577,308
BRICS BRICS
615,607
CANZUK CANZUK
1,007,531
CIVETS CIVETS
248,436
CLMV CLMV
10,595
EMEA EMEA
3,107,760
FRIT FRIT
420,295
FRITES FRITES
494,843
IMEA IMEA
275,184
LATAM LATAM
415,865
LATCAR LATCAR
449,449
MART MART
332,299
MEA MEA
153,809
MENA MENA
92,662
MEP MEP
93,511
MIKTA MIKTA
405,178
MINT MINT
122,998
PIGS PIGS
326,412
SEA SEA
86,148
TIGERCUB Tiger Cub Economies
69,897
VISTA VISTA
144,969

Group

AFRICANUNION African Union
179,099
ARABLEAGUE Arab League
19,386
APEC Asia-Pacific Economic Cooperation
2,560,379
AER Assembly of European Regions
1,862,913
ACS Association of Caribbean State Members
174,459
ASEAN Association of Southeast Asian Nations
86,107
BIMSTEC Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
136,321
CARICOM Caribbean Community Members
5,340
CARIFTA Caribbean Free Trade Association
4,922
CAIS Central American Integration System
7,467
CEFTA Central European Free Trade Agreement Members
48,574
PARISCLUB Club de Paris
4,982,004
CIS Commonwealth of Independent States Members
186,949
COMMONWEALTH Commonwealth of Nations
1,245,066
CPLP Community of Portuguese Language Countries
214,956
COE Council of Europe
3,003,593
DAC Development Assistance Committee
4,776,374
EAC East African Community
3,987
EAP Eastern Partnership
2,038,989
INNERSIX EC Inner Six
1,603,282
OUTERSEVEN EC Outer Seven
812,694
ECO Economic Cooperation Organization
62,083
EAEU Eurasian Economic Union
184,522
EURONEST Euronest Parliamentary Assembly
2,035,868
EEA European Economic Area
2,052,483
EFTA European Free Trade Association
145,462
EU European Union
2,018,898
EUEEACH European Union, European Economic Area and Switzerland
2,164,360
FEAS Federation of Euro-Asian Stock Exchanges
93,537
G2 G2 Nations
1,524,727
G20 G20 Nations
4,800,653
G7 G7 Nations
3,760,118
3G Global Governance Group
308,024
G77 Group of 77
757,413
GUAM GUAM Organization for Democracy and Economic Development
16,393
GCC Gulf Cooperation Council
13,465
IBSA IBSA Dialogue Forum
354,295
ISA International Solar Alliance
3,556,803
IAO Interparliamentary Assembly on Orthodoxy
417,009
DACH Majority German-speaking states of Central Europe
1,157,966
NATO North Atlantic Treaty Organization
4,193,610
OECD Organisation for Economic Co-operation and Development
5,045,625
OECS Organisation of Eastern Caribbean States
32,465
OIC Organisation of Islamic Cooperation
130,260
OAS Organization of American States
2,049,032
OEI Organization of Ibero-American States
508,356
BSEC Organization of the Black Sea Economic Cooperation
289,626
OPEC Organization of the Petroleum Exporting Countries
17,551
TURKIC Organization of Turkic States
57,313
PACIFICALLIANCE Pacific Alliance
186,039
SCO Shanghai Cooperation Organisation
388,927
SAARC South Asian Association for Regional Cooperation
127,889
SADC Southern African Development Community
42,174
MERCOSUR Southern Common Market
215,751
NORAM Sovereign states and dependent territories of North America
1,719,773
USAN Union of South American Nations
1,557
V4 Visegrad Group
109,888

Region

AFRICA Africa
64,303
BALKANS Balkan States
147,371
BALTICS Baltic States
12,880
BENELUX Benelux Union
189,351
CENTRALAFRICA Central Africa
5,564
CENTRALAMERICA Central America
6,114
CENTRALASIA Central Asia
3,429
CENTRALEUROPE Central Europe
1,273,201
CHAPS CHAPS
162,341
EASTAFRICA East Africa
7,514
EASTASIA East Asia
322,642
EUROPE Europe
3,008,156
LEVANT Levant Narrow
74,105
MIDDLEEAST Middle East
90,668
NORDICS Nordics
108,076
CUSA North America
1,632,378
NORTHAFRICA Northern Africa
3,156
NORTHERNEUROPE Northern Europe
142,433
SCANDINAVIA Scandinavia
87,611
SOUTHAMERICA South America
364,598
SOUTHASIA South Asia
127,889
SOUTHERNAFRICA Southern Africa
39,024
SOUTHERNCONE Southern Cone
41,256
SOUTHERNEUROPE Southern Europe
382,937
SUBSAHARA Sub-Saharan Africa
59,873
WESTAFRICA Western Africa
4,249
WESTASIA Western Asia
93,994
WESTERNEUROPE Western Europe
2,112,478
Browse Technology Groups