Googlebot Disallow Usage Statistics

Googlebot Disallow

The website has disallow rules for Google Search Bot.

https://developers.google.com/search/reference/robots_txt

Robots.txt

Googlebot Disallow Customers

Get access to data on 29,401,594 websites Googlebot Disallow Customers. We know of 12,577,731 live websites using Googlebot Disallow and an additional 16,823,863 sites that used Googlebot Disallow historically and 1,264,706 websites in the United States.

Get a list of 29,401,594 websites using Googlebot Disallow which includes location information, hosting data, contact details, 12,577,731 currently live websites and an additional 600,181 domains that redirect to sites in this list. 16,823,863 sites that used this technology previouslyand 1,264,706 websites in the United States currently using Googlebot Disallow.

Site Totals

Total Live
12,577,731
600,181 additional website redirects?.
United States Live Sites
1,264,706
Live and Historical
29,401,594
Top 1m
5.03%
50,287
Top 100k
7.59%
7,587
Top 10k
10.4%
1,040

Countries

United States
1,264,706
Germany
668,408
United Kingdom
462,499
Italy
229,353
Australia
190,675
Japan
173,782
Russia
170,806
France
168,219
Canada
164,360
Brazil
163,444
India
127,694
.co
104,857
Switzerland
96,527
Netherlands
75,842
China
66,487
.me
62,056
Spain
55,498
Belgium
54,130
Turkey
50,819
Poland
49,930
Mexico
39,428
South Korea
38,095
Austria
37,066
Sweden
32,386
CC Cocos Islands
31,758
CZ Czech Republic
31,092
ZA South Africa
28,391
NZ New Zealand
27,027
NO Norway
25,593
IO .io
23,205
DK Denmark
22,555
RO Romania
20,039
TV .tv
19,561
IE Ireland
18,461
ID Indonesia
18,329
IL Israel
18,076
PT Portugal
17,474
SG Singapore
16,054
CL Chile
15,922
FI Finland
15,260
HK Hong Kong
13,306
AR Argentina
12,786
MY Malaysia
11,344
UA Ukraine
11,249
TW Taiwan
10,797
TH Thailand
10,587
GR Greece
10,360
PH Philippines
10,346
VN Vietnam
10,144
HU Hungary
8,400
VG British Virgin Islands
8,396
AE UAE
8,156
LU Luxembourg
6,095
SK Slovakia
5,398
WS Samoa
5,125
CM Cameroon
3,930
LT Lithuania
3,790
PW Palau
3,667
LV Latvia
3,629
AI Anguilla
3,397
PE Peru
3,387
BG Bulgaria
3,284
EE Estonia
2,887
HR Croatia
2,754
IS Iceland
2,729
PK Pakistan
2,609
SI Slovenia
2,530
NG Nigeria
2,484
UY Uruguay
2,357
PR Puerto Rico
2,340
RS Serbia
2,053
BD Bangladesh
1,881
BY Belarus
1,856
EC Ecuador
1,842
RE Reunion
1,777
CR Costa Rica
1,746
SA Saudi Arabia
1,718
KE Kenya
1,538
LC Saint Lucia
1,535
KZ Kazakhstan
1,506
NU Niue
1,479
GG Guernsey
1,406
MT Malta
1,355
IM Isle of Man
1,301
LI Liechtenstein
1,202
TO Tonga
1,144
IR Iran
1,106
GE Georgia
1,091
SH Saint Helena
1,070
SO Somalia
1,063
LK Sri Lanka
1,045
MA Morocco
1,034
GT Guatemala
1,024
EG Egypt
1,024
VC Saint Vincent
993
UG Uganda
960
GH Ghana
952
DO Dominican Republic
840
GP Guadeloupe
806
PA Panama
803
UZ Uzbekistan
779
QA Qatar
766
BZ Belize
748
VE Venezuela
742
MQ Martinique
686
TZ Tanzania
670
AM Armenia
658
NP Nepal
633
CY Cyprus
624
AZ Azerbaijan
585
PY Paraguay
575
JO Jordan
546
FM Micronesia
524
AL Albania
515
MK Macedonia
509
KW Kuwait
502
MU Mauritius
502
MD Moldova
493
NA Namibia
454
OM Oman
409
HN Honduras
405
ZW Zimbabwe
367
KH Cambodia
366
BO Bolivia
358
MN Mongolia
354
BH Bahrain
353
LB Lebanon
346
MC Monaco
321
VI Virgin Islands
317
TN Tunisia
305
NC New Caledonia
288
CX Christmas Island
286
SV El Salvador
284
IQ Iraq
272
BM Bermuda
262
SC Seychelles
259
ET Ethiopia
255
ZM Zambia
249
AG Antigua
237
AF Afghanistan
231
SX Sint Maarten
227
ST Sao Tome
224
BA Bosnia
224
AO Angola
213
CD Congo
207
BS Bahamas
204
CI Cote d'Ivoire
198
YT Mayotte
196
MZ Mozambique
194
AW Aruba
194
NI Nicaragua
192
KG Kyrgyzstan
181
RW Rwanda
171
BW Botswana
170
MM Myanmar
168
PM Saint Pierre
167
MV Maldives
160
TT Trinidad
155
MS Montserrat
154
GF French Guiana
148
GI Gibraltar
145
JM Jamaica
132
FJ Fiji
124
MW Malawi
123
MG Madagascar
116
AS American Samoa
114
GY Guyana
106
TG Togo
94
GL Greenland
93
GM Gambia
92
GD Grenada
86
PS Palestine
86
TC Turks
78
LR Liberia
72
BT Bhutan
66
BF Burkina Faso
64
SR Suriname
63
CK Cook Islands
62
WF Wallis
60
TJ Tajikistan
51
CU Cuba
47
HM Heard Island
32
TM Turkmenistan
30
BN Brunei
24
NF Norfolk Island
9
MH Marshall Islands
8
SS South Sudan
5

Financial

AMER AMER
1,740,862
ANZ ANZ
217,702
ANZUK ANZUK
680,201
APAC APAC
820,053
ASEAN3 ASEAN+3
355,737
ASEAN5 ASEAN+5
634,646
ASEAN6 ASEAN+6
701,133
FOURASIANTIGERS ASIAN TIGERS
133,942
AUKUS AUKUS
1,917,880
BASIC BASIC
386,016
BRIC BRIC
528,431
BRICS BRICS
556,822
CANZUK CANZUK
844,561
CIVETS CIVETS
213,564
CLMV CLMV
10,689
EMEA EMEA
2,523,256
FRIT FRIT
397,572
FRITES FRITES
453,070
IMEA IMEA
262,068
LATAM LATAM
355,149
LATCAR LATCAR
372,116
MART MART
305,180
MEA MEA
134,374
MENA MENA
86,587
MEP MEP
87,503
MIKTA MIKTA
337,346
MINT MINT
111,060
PIGS PIGS
312,685
SEA SEA
77,401
TIGERCUB Tiger Cub Economies
60,750
VISTA VISTA
120,469

Group

AFRICANUNION African Union
152,107
ARABLEAGUE Arab League
17,032
APEC Asia-Pacific Economic Cooperation
2,255,706
AER Assembly of European Regions
1,644,457
ACS Association of Caribbean State Members
154,844
ASEAN Association of Southeast Asian Nations
77,373
BIMSTEC Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
142,074
CARICOM Caribbean Community Members
4,630
CARIFTA Caribbean Free Trade Association
4,233
CAIS Central American Integration System
6,042
CEFTA Central European Free Trade Agreement Members
65,863
PARISCLUB Club de Paris
4,145,741
CIS Commonwealth of Independent States Members
176,915
COMMONWEALTH Commonwealth of Nations
1,079,058
CPLP Community of Portuguese Language Countries
181,615
COE Council of Europe
2,436,961
DAC Development Assistance Committee
3,954,450
EAC East African Community
3,594
EAP Eastern Partnership
1,562,751
INNERSIX EC Inner Six
1,202,047
OUTERSEVEN EC Outer Seven
694,100
ECO Economic Cooperation Organization
57,897
EAEU Eurasian Economic Union
175,007
EURONEST Euronest Parliamentary Assembly
1,560,310
EEA European Economic Area
1,576,343
EFTA European Free Trade Association
126,051
EU European Union
1,546,819
EUEEACH European Union, European Economic Area and Switzerland
1,672,870
FEAS Federation of Euro-Asian Stock Exchanges
80,225
G2 G2 Nations
1,331,193
G20 G20 Nations
4,039,999
G7 G7 Nations
3,131,327
3G Global Governance Group
294,937
G77 Group of 77
664,245
GUAM GUAM Organization for Democracy and Economic Development
13,418
GCC Gulf Cooperation Council
11,904
IBSA IBSA Dialogue Forum
319,529
ISA International Solar Alliance
3,126,900
IAO Interparliamentary Assembly on Orthodoxy
398,576
DACH Majority German-speaking states of Central Europe
802,001
NATO North Atlantic Treaty Organization
3,475,453
OECD Organisation for Economic Co-operation and Development
4,195,604
OECS Organisation of Eastern Caribbean States
16,313
OIC Organisation of Islamic Cooperation
115,925
OAS Organization of American States
1,784,534
OEI Organization of Ibero-American States
426,537
BSEC Organization of the Black Sea Economic Cooperation
269,899
OPEC Organization of the Petroleum Exporting Countries
15,530
TURKIC Organization of Turkic States
53,870
PACIFICALLIANCE Pacific Alliance
163,594
SCO Shanghai Cooperation Organisation
370,113
SAARC South Asian Association for Regional Cooperation
134,319
SADC Southern African Development Community
31,963
MERCOSUR Southern Common Market
179,162
NORAM Sovereign states and dependent territories of North America
1,495,286
USAN Union of South American Nations
1,269
V4 Visegrad Group
94,820

Region

AFRICA Africa
50,504
BALKANS Balkan States
155,156
BALTICS Baltic States
10,306
BENELUX Benelux Union
136,067
CENTRALAFRICA Central Africa
4,844
CENTRALAMERICA Central America
5,202
CENTRALASIA Central Asia
2,547
CENTRALEUROPE Central Europe
900,553
CHAPS CHAPS
131,886
EASTAFRICA East Africa
6,601
EASTASIA East Asia
302,842
EUROPE Europe
2,440,325
LEVANT Levant Narrow
70,533
MIDDLEEAST Middle East
84,894
NORDICS Nordics
98,874
CUSA North America
1,429,066
NORTHAFRICA Northern Africa
2,717
NORTHERNEUROPE Northern Europe
127,290
SCANDINAVIA Scandinavia
80,534
SOUTHAMERICA South America
307,397
SOUTHASIA South Asia
134,319
SOUTHERNAFRICA Southern Africa
29,060
SOUTHERNCONE Southern Cone
31,640
SOUTHERNEUROPE Southern Europe
385,039
SUBSAHARA Sub-Saharan Africa
46,743
WESTAFRICA Western Africa
4,519
WESTASIA Western Asia
87,228
WESTERNEUROPE Western Europe
1,588,952
Browse Technology Groups