Googlebot Disallow Usage Statistics

Googlebot Disallow

The website has disallow rules for Google Search Bot.

https://developers.google.com/search/reference/robots_txt

Robots.txt

Googlebot Disallow Customers

Get access to data on 38,261,134 websites that are Googlebot Disallow Customers. We know of 18,777,473 live websites using Googlebot Disallow and an additional 19,483,661 sites that used Googlebot Disallow historically and 1,487,916 websites in the United States.

Get a list of 38,261,134 websites using Googlebot Disallow which includes location information, hosting data, contact details, 18,777,473 currently live websites and an additional 959,994 domains that redirect to sites in this list. 19,483,661 sites that used this technology previouslyand 1,487,916 websites in the United States currently using Googlebot Disallow.

Site Totals

Total Live
18,777,473
959,994 additional website redirects?.
USA Live Sites
1,487,916
Live and Historical
38,261,134
Top 1m
5.83%
58,251
Top 100k
10.37%
10,367
Top 10k
14.68%
1,468

Countries

United States
1,487,916
Germany
1,010,815
United Kingdom
562,827
Australia
230,680
Canada
201,284
France
195,778
Brazil
184,862
Japan
168,507
Russia
155,866
Italy
143,973
India
131,605
Netherlands
126,023
Switzerland
121,953
China
111,440
.co
110,758
Spain
76,859
Cocos Islands
75,623
Belgium
66,239
Austria
59,565
Poland
51,827
Turkey
50,881
.io
45,651
Mexico
43,542
.me
41,245
CZ Czech Republic
39,436
ZA South Africa
38,436
SE Sweden
35,272
KR South Korea
35,197
NO Norway
28,664
AI Anguilla
28,370
NZ New Zealand
27,758
RO Romania
24,291
ID Indonesia
24,167
IE Ireland
23,941
PT Portugal
20,498
DK Denmark
19,670
CL Chile
19,249
IL Israel
18,625
TV .tv
17,720
FI Finland
16,434
SG Singapore
15,645
PH Philippines
13,533
HK Hong Kong
13,299
MY Malaysia
12,949
AR Argentina
12,765
UA Ukraine
12,261
TH Thailand
12,017
GR Greece
11,502
VN Vietnam
9,740
AE UAE
9,524
HU Hungary
9,291
VG British Virgin Islands
9,128
LU Luxembourg
9,090
TW Taiwan
7,937
WS Samoa
7,375
SK Slovakia
5,662
LV Latvia
4,546
EE Estonia
4,481
LT Lithuania
4,469
PE Peru
4,186
SI Slovenia
4,032
CM Cameroon
4,011
IS Iceland
3,746
BG Bulgaria
3,641
CY Cyprus
3,308
HR Croatia
3,195
PK Pakistan
3,120
IM Isle of Man
3,047
RE Reunion
2,898
PW Palau
2,697
UY Uruguay
2,654
GG Guernsey
2,588
VC Saint Vincent
2,548
SH Saint Helena
2,524
NG Nigeria
2,376
PR Puerto Rico
2,332
RS Serbia
2,259
TO Tonga
2,215
NU Niue
2,179
EC Ecuador
2,131
KE Kenya
2,054
KZ Kazakhstan
2,017
CR Costa Rica
1,975
LI Liechtenstein
1,974
BY Belarus
1,967
SA Saudi Arabia
1,925
BD Bangladesh
1,714
IR Iran
1,651
SO Somalia
1,647
AM Armenia
1,591
MT Malta
1,559
GE Georgia
1,366
DO Dominican Republic
1,230
MA Morocco
1,217
BZ Belize
1,189
PM Saint Pierre
1,184
GT Guatemala
1,166
EG Egypt
1,143
LK Sri Lanka
1,068
QA Qatar
1,002
UG Uganda
966
CX Christmas Island
950
FM Micronesia
950
VE Venezuela
920
PA Panama
914
GH Ghana
839
UZ Uzbekistan
834
GP Guadeloupe
832
AL Albania
795
TZ Tanzania
759
NP Nepal
699
AZ Azerbaijan
687
MD Moldova
668
PY Paraguay
636
MQ Martinique
622
MU Mauritius
592
MK Macedonia
580
MN Mongolia
539
NA Namibia
535
ET Ethiopia
531
KW Kuwait
511
JO Jordan
510
AD Andorra
508
AG Antigua
491
HN Honduras
477
OM Oman
422
ZW Zimbabwe
410
BO Bolivia
399
ST Sao Tome
391
LB Lebanon
371
KH Cambodia
370
MC Monaco
368
SC Seychelles
358
BH Bahrain
357
SV El Salvador
354
TN Tunisia
350
IQ Iraq
322
RW Rwanda
306
DZ Algeria
303
BM Bermuda
289
NC New Caledonia
281
BA Bosnia
274
MS Montserrat
269
SX Sint Maarten
256
KY Cayman Islands
251
ZM Zambia
246
AO Angola
239
FO Faroe Islands
237
CD Congo
231
AW Aruba
222
MZ Mozambique
217
KG Kyrgyzstan
217
CI Cote d'Ivoire
217
GY Guyana
215
SN Senegal
215
AF Afghanistan
214
NI Nicaragua
214
BS Bahamas
204
YT Mayotte
203
LC Saint Lucia
201
BW Botswana
183
AS American Samoa
183
GD Grenada
178
JM Jamaica
172
MM Myanmar
167
MV Maldives
164
GF French Guiana
159
GI Gibraltar
157
DJ Djibouti
147
MG Madagascar
145
TT Trinidad
144
JE Jersey
143
FJ Fiji
131
TJ Tajikistan
122
PG Papua New Guinea
115
MW Malawi
109
GL Greenland
106
PS Palestine
100
TC Turks
94
GS South Georgia
92
SL Sierra Leone
91
TG Togo
85
GM Gambia
83
ML Mali
78
WF Wallis
77
BJ Benin
61
YE Yemen
57
VU Vanuatu
56
BF Burkina Faso
53
CU Cuba
49
HM Heard Island
49
TL East Timor
42
LY Libya
39
SY Syria
38
TM Turkmenistan
36
SM San Marino
29
BN Brunei
26
SB Solomon Islands
18
KN Saint Kitts
14
SJ Svalbard
11
NF Norfolk Island
9
PN Pitcairn
5

Financial

AMER AMER
2,034,484
ANZ ANZ
258,438
ANZUK ANZUK
821,265
APAC APAC
979,188
ASEAN3 ASEAN+3
403,775
ASEAN5 ASEAN+5
682,378
ASEAN6 ASEAN+6
793,818
FOURASIANTIGERS ASIAN TIGERS
175,581
AUKUS AUKUS
2,281,423
BASIC BASIC
466,343
BRIC BRIC
583,773
BRICS BRICS
622,209
CANZUK CANZUK
1,022,549
CIVETS CIVETS
235,125
CLMV CLMV
10,294
EMEA EMEA
3,069,065
FRIT FRIT
339,751
FRITES FRITES
416,610
IMEA IMEA
286,933
LATAM LATAM
392,564
LATCAR LATCAR
436,469
MART MART
311,194
MEA MEA
155,328
MENA MENA
92,738
MEP MEP
93,867
MIKTA MIKTA
384,467
MINT MINT
120,966
PIGS PIGS
252,832
SEA SEA
88,673
TIGERCUB Tiger Cub Economies
72,406
VISTA VISTA
135,989

Group

AFRICANUNION African Union
170,620
ARABLEAGUE Arab League
20,032
APEC Asia-Pacific Economic Cooperation
2,595,053
AER Assembly of European Regions
1,808,077
ACS Association of Caribbean State Members
167,253
ASEAN Association of Southeast Asian Nations
88,631
BIMSTEC Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
147,320
CARICOM Caribbean Community Members
5,923
CARIFTA Caribbean Free Trade Association
5,506
CAIS Central American Integration System
7,519
CEFTA Central European Free Trade Agreement Members
45,838
PARISCLUB Club de Paris
4,970,950
CIS Commonwealth of Independent States Members
163,969
COMMONWEALTH Commonwealth of Nations
1,279,003
CPLP Community of Portuguese Language Countries
206,294
COE Council of Europe
2,963,939
DAC Development Assistance Committee
4,794,439
EAC East African Community
4,376
EAP Eastern Partnership
1,993,937
INNERSIX EC Inner Six
1,551,918
OUTERSEVEN EC Outer Seven
848,449
ECO Economic Cooperation Organization
59,779
EAEU Eurasian Economic Union
161,658
EURONEST Euronest Parliamentary Assembly
1,991,283
EEA European Economic Area
2,009,781
EFTA European Free Trade Association
156,337
EU European Union
1,975,397
EUEEACH European Union, European Economic Area and Switzerland
2,131,734
FEAS Federation of Euro-Asian Stock Exchanges
96,098
G2 G2 Nations
1,599,356
G20 G20 Nations
4,792,466
G7 G7 Nations
3,771,100
3G Global Governance Group
317,464
G77 Group of 77
778,489
GUAM GUAM Organization for Democracy and Economic Development
14,982
GCC Gulf Cooperation Council
13,741
IBSA IBSA Dialogue Forum
354,903
ISA International Solar Alliance
3,541,713
IAO Interparliamentary Assembly on Orthodoxy
389,632
DACH Majority German-speaking states of Central Europe
1,192,333
NATO North Atlantic Treaty Organization
4,213,256
OECD Organisation for Economic Co-operation and Development
5,052,965
OECS Organisation of Eastern Caribbean States
42,668
OIC Organisation of Islamic Cooperation
128,493
OAS Organization of American States
2,083,286
OEI Organization of Ibero-American States
488,685
BSEC Organization of the Black Sea Economic Cooperation
263,549
OPEC Organization of the Petroleum Exporting Countries
17,862
TURKIC Organization of Turkic States
54,636
PACIFICALLIANCE Pacific Alliance
177,735
SCO Shanghai Cooperation Organisation
405,221
SAARC South Asian Association for Regional Cooperation
138,634
SADC Southern African Development Community
42,518
MERCOSUR Southern Common Market
200,917
NORAM Sovereign states and dependent territories of North America
1,788,529
USAN Union of South American Nations
1,610
V4 Visegrad Group
106,216

Region

AFRICA Africa
65,724
BALKANS Balkan States
142,712
BALTICS Baltic States
13,496
BENELUX Benelux Union
201,352
CENTRALAFRICA Central Africa
5,299
CENTRALAMERICA Central America
6,289
CENTRALASIA Central Asia
3,226
CENTRALEUROPE Central Europe
1,304,555
CHAPS CHAPS
165,781
EASTAFRICA East Africa
8,602
EASTASIA East Asia
336,947
EUROPE Europe
2,967,926
LEVANT Levant Narrow
73,833
MIDDLEEAST Middle East
90,747
NORDICS Nordics
104,215
CUSA North America
1,689,200
NORTHAFRICA Northern Africa
3,134
NORTHERNEUROPE Northern Europe
141,223
SCANDINAVIA Scandinavia
83,606
SOUTHAMERICA South America
339,909
SOUTHASIA South Asia
138,634
SOUTHERNAFRICA Southern Africa
39,209
SOUTHERNCONE Southern Cone
35,304
SOUTHERNEUROPE Southern Europe
307,465
SUBSAHARA Sub-Saharan Africa
60,972
WESTAFRICA Western Africa
4,299
WESTASIA Western Asia
94,391
WESTERNEUROPE Western Europe
2,179,081
Browse Technology Groups