Googlebot Disallow Usage Statistics

Googlebot Disallow

The website has disallow rules for Google Search Bot.

https://developers.google.com/search/reference/robots_txt

Robots.txt

Googlebot Disallow Customers

Get access to data on 28,848,173 websites Googlebot Disallow Customers. We know of 10,521,556 live websites using Googlebot Disallow and an additional 18,326,617 sites that used Googlebot Disallow historically and 1,208,017 websites in the United States.

Get a list of 28,848,173 websites using Googlebot Disallow which includes location information, hosting data, contact details, 10,521,556 currently live websites and an additional 535,052 domains that redirect to sites in this list. 18,326,617 sites that used this technology previouslyand 1,208,017 websites in the United States currently using Googlebot Disallow.

Site Totals

Total Live
10,521,556
535,052 additional website redirects?.
United States Live Sites
1,208,017
Live and Historical
28,848,173
Top 1m
4.52%
45,235
Top 100k
7.37%
7,374
Top 10k
10.26%
1,026

Countries

United States
1,208,017
Germany
625,793
United Kingdom
437,769
Italy
214,528
Australia
187,930
Japan
174,974
Brazil
165,517
France
165,177
Canada
161,582
Russia
161,218
India
103,643
Switzerland
98,535
.co
79,044
Netherlands
71,398
Belgium
54,017
Spain
52,558
China
51,744
Turkey
49,576
Poland
47,075
Austria
36,760
South Korea
35,789
Mexico
35,489
Sweden
31,326
Czech Republic
30,550
ME .me
30,535
ZA South Africa
27,810
NZ New Zealand
26,828
NO Norway
25,581
DK Denmark
22,319
RO Romania
20,166
IL Israel
18,137
IE Ireland
18,037
PT Portugal
17,349
CL Chile
17,145
ID Indonesia
16,686
SG Singapore
15,921
CC Cocos Islands
15,398
IO .io
15,370
FI Finland
15,099
HK Hong Kong
13,199
AR Argentina
12,463
MY Malaysia
10,865
UA Ukraine
10,836
TV .tv
10,707
TW Taiwan
10,397
GR Greece
10,357
TH Thailand
9,996
PH Philippines
9,869
HU Hungary
8,326
VG British Virgin Islands
8,295
VN Vietnam
8,099
AE UAE
8,020
LU Luxembourg
5,948
SK Slovakia
5,274
WS Samoa
4,586
CM Cameroon
3,844
LT Lithuania
3,663
LV Latvia
3,558
AI Anguilla
3,435
PE Peru
3,215
BG Bulgaria
3,187
EE Estonia
2,773
HR Croatia
2,748
IS Iceland
2,632
SI Slovenia
2,554
PR Puerto Rico
2,552
UY Uruguay
2,379
BY Belarus
2,092
RS Serbia
1,969
PK Pakistan
1,887
NG Nigeria
1,884
EC Ecuador
1,817
CR Costa Rica
1,758
RE Reunion
1,693
SA Saudi Arabia
1,682
PW Palau
1,436
KE Kenya
1,378
KZ Kazakhstan
1,373
MT Malta
1,351
NU Niue
1,347
BD Bangladesh
1,223
LI Liechtenstein
1,156
GE Georgia
1,096
GT Guatemala
1,025
MA Morocco
994
DO Dominican Republic
991
IM Isle of Man
964
TO Tonga
960
EG Egypt
927
LK Sri Lanka
905
IR Iran
855
GG Guernsey
840
GP Guadeloupe
829
PA Panama
790
UZ Uzbekistan
761
GH Ghana
757
QA Qatar
740
UG Uganda
710
VE Venezuela
691
MQ Martinique
687
VC Saint Vincent
678
TZ Tanzania
644
AM Armenia
641
CY Cyprus
633
PY Paraguay
566
SH Saint Helena
561
BZ Belize
559
AZ Azerbaijan
549
JO Jordan
527
MD Moldova
498
KW Kuwait
497
NP Nepal
491
MK Macedonia
490
AL Albania
478
NA Namibia
466
SO Somalia
437
HN Honduras
407
OM Oman
389
FM Micronesia
360
ZW Zimbabwe
344
BH Bahrain
335
BO Bolivia
330
VI Virgin Islands
329
MC Monaco
324
LB Lebanon
320
MN Mongolia
310
KH Cambodia
309
SV El Salvador
298
TN Tunisia
289
NC New Caledonia
289
IQ Iraq
271
BM Bermuda
264
ZM Zambia
249
CX Christmas Island
239
SC Seychelles
235
DZ Algeria
235
BA Bosnia
226
AO Angola
216
AF Afghanistan
211
CD Congo
199
ST Sao Tome
197
MZ Mozambique
194
AW Aruba
193
NI Nicaragua
193
CI Cote d'Ivoire
190
AG Antigua
182
ET Ethiopia
181
BS Bahamas
181
AD Andorra
180
LC Saint Lucia
177
KG Kyrgyzstan
174
BW Botswana
171
RW Rwanda
162
MV Maldives
162
GF French Guiana
149
GI Gibraltar
148
PM Saint Pierre
144
SX Sint Maarten
139
TT Trinidad
138
MS Montserrat
136
JM Jamaica
117
FJ Fiji
115
MG Madagascar
110
MW Malawi
106
GY Guyana
101
AS American Samoa
99
TG Togo
91
GL Greenland
88
GM Gambia
86
PS Palestine
80
TC Turks
69
CK Cook Islands
67
LR Liberia
67
BT Bhutan
62
BJ Benin
58
BF Burkina Faso
57
MP Northern Mariana Islands
54
WF Wallis
53
ML Mali
53
YE Yemen
50
TJ Tajikistan
49
CU Cuba
42
HM Heard Island
31
TM Turkmenistan
27
BN Brunei
23
KN Saint Kitts
11
NF Norfolk Island
9
MH Marshall Islands
7

Financial

AMER AMER
1,658,091
ANZ ANZ
214,758
ANZUK ANZUK
652,527
APAC APAC
733,161
ASEAN3 ASEAN+3
334,455
ASEAN5 ASEAN+5
601,112
ASEAN6 ASEAN+6
652,856
FOURASIANTIGERS ASIAN TIGERS
116,653
AUKUS AUKUS
1,833,716
BASIC BASIC
348,714
BRIC BRIC
482,122
BRICS BRICS
509,932
CANZUK CANZUK
814,109
CIVETS CIVETS
182,142
CLMV CLMV
8,588
EMEA EMEA
2,379,076
FRIT FRIT
379,705
FRITES FRITES
432,263
IMEA IMEA
232,616
LATAM LATAM
328,503
LATCAR LATCAR
343,402
MART MART
290,191
MEA MEA
128,973
MENA MENA
84,671
MEP MEP
84,952
MIKTA MIKTA
325,470
MINT MINT
103,635
PIGS PIGS
294,792
SEA SEA
71,975
TIGERCUB Tiger Cub Economies
55,515
VISTA VISTA
114,634

Group

AFRICANUNION African Union
123,322
ARABLEAGUE Arab League
15,920
APEC Asia-Pacific Economic Cooperation
2,159,082
AER Assembly of European Regions
1,551,229
ACS Association of Caribbean State Members
123,195
ASEAN Association of Southeast Asian Nations
71,948
BIMSTEC Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
116,490
CARICOM Caribbean Community Members
2,603
CARIFTA Caribbean Free Trade Association
2,240
CAIS Central American Integration System
6,021
CEFTA Central European Free Trade Agreement Members
34,202
PARISCLUB Club de Paris
3,982,061
CIS Commonwealth of Independent States Members
167,355
COMMONWEALTH Commonwealth of Nations
1,008,858
CPLP Community of Portuguese Language Countries
183,540
COE Council of Europe
2,296,844
DAC Development Assistance Committee
3,794,082
EAC East African Community
3,139
EAP Eastern Partnership
1,488,236
INNERSIX EC Inner Six
1,136,861
OUTERSEVEN EC Outer Seven
669,639
ECO Economic Cooperation Organization
55,462
EAEU Eurasian Economic Union
165,498
EURONEST Euronest Parliamentary Assembly
1,485,595
EEA European Economic Area
1,501,893
EFTA European Free Trade Association
127,904
EU European Union
1,472,524
EUEEACH European Union, European Economic Area and Switzerland
1,600,428
FEAS Federation of Euro-Asian Stock Exchanges
79,670
G2 G2 Nations
1,259,761
G20 G20 Nations
3,837,387
G7 G7 Nations
2,987,840
3G Global Governance Group
262,585
G77 Group of 77
588,857
GUAM GUAM Organization for Democracy and Economic Development
12,979
GCC Gulf Cooperation Council
11,663
IBSA IBSA Dialogue Forum
296,970
ISA International Solar Alliance
2,981,931
IAO Interparliamentary Assembly on Orthodoxy
353,071
DACH Majority German-speaking states of Central Europe
761,088
NATO North Atlantic Treaty Organization
3,285,978
OECD Organisation for Economic Co-operation and Development
4,005,225
OECS Organisation of Eastern Caribbean States
14,512
OIC Organisation of Islamic Cooperation
108,540
OAS Organization of American States
1,696,184
OEI Organization of Ibero-American States
396,802
BSEC Organization of the Black Sea Economic Cooperation
258,602
OPEC Organization of the Petroleum Exporting Countries
14,439
TURKIC Organization of Turkic States
52,433
PACIFICALLIANCE Pacific Alliance
134,893
SCO Shanghai Cooperation Organisation
320,849
SAARC South Asian Association for Regional Cooperation
108,584
SADC Southern African Development Community
31,275
MERCOSUR Southern Common Market
180,925
NORAM Sovereign states and dependent territories of North America
1,430,181
USAN Union of South American Nations
1,178
V4 Visegrad Group
91,225

Region

AFRICA Africa
46,835
BALKANS Balkan States
122,292
BALTICS Baltic States
9,994
BENELUX Benelux Union
131,363
CENTRALAFRICA Central Africa
4,712
CENTRALAMERICA Central America
5,030
CENTRALASIA Central Asia
2,384
CENTRALEUROPE Central Europe
856,023
CHAPS CHAPS
127,985
EASTAFRICA East Africa
5,352
EASTASIA East Asia
286,441
EUROPE Europe
2,300,312
LEVANT Levant Narrow
69,299
MIDDLEEAST Middle East
83,065
NORDICS Nordics
97,302
CUSA North America
1,369,599
NORTHAFRICA Northern Africa
2,533
NORTHERNEUROPE Northern Europe
124,988
SCANDINAVIA Scandinavia
79,226
SOUTHAMERICA South America
284,252
SOUTHASIA South Asia
108,584
SOUTHERNAFRICA Southern Africa
28,488
SOUTHERNCONE Southern Cone
32,553
SOUTHERNEUROPE Southern Europe
335,502
SUBSAHARA Sub-Saharan Africa
43,880
WESTAFRICA Western Africa
3,646
WESTASIA Western Asia
85,351
WESTERNEUROPE Western Europe
1,515,094
Browse Technology Groups