Googlebot Disallow Usage Statistics

The website has disallow rules for Google Search Bot.

https://developers.google.com/search/reference/robots_txt

Robots.txt

Googlebot Disallow Customers

Get access to data on 1,156,329 websites that are Googlebot Disallow Customers. We know of 1,100,035 live websites using Googlebot Disallow and an additional 56,294 sites that used Googlebot Disallow historically and 673,485 websites in the United States.

Get a list of 1,156,329 websites using Googlebot Disallow which includes location information, hosting data, contact details, 1,100,035 currently live websites and an additional 1,569,755 domains that redirect to sites in this list. 56,294 sites that used this technology previously and 673,485 websites in the United States currently using Googlebot Disallow.

Site Totals

Total Live
1,100,035
1,569,755 additional website redirects?.
USA Live Sites
673,485
Live and Historical
1,156,329
Top 1m
3.95%
39,540
Top 100k
9.14%
9,140
Top 10k
12.82%
1,282
United States
673,485
Russia
77,189
Germany
33,860
United Kingdom
21,470
China
20,382
Brazil
19,290
France
16,799
Italy
16,443
Netherlands
12,317
Australia
10,165
Canada
9,842
Spain
9,474
Ukraine
5,570
India
4,516
Switzerland
4,509
Poland
4,379
.co
3,859
Argentina
3,469
Cocos Islands
3,262
Chile
2,754
South Africa
2,556
Belgium
2,534
Taiwan
2,433
Mexico
2,393
Czech Republic
2,270
Belarus
2,141
Denmark
2,067
Iran
2,046
Austria
2,012
Turkey
1,945
Japan
1,855
Sweden
1,843
Norway
1,740
New Zealand
1,708
Romania
1,536
South Korea
1,508
.me
1,508
Hungary
1,372
Greece
1,365
Vietnam
1,217
Indonesia
1,126
Finland
1,117
Portugal
1,041
Kazakhstan
941
Mali
904
Israel
843
Malaysia
798
Slovakia
746
.tv
734
Hong Kong
724
Ireland
687
.io
686
British Virgin Islands
638
Peru
586
Philippines
550
Singapore
468
Slovenia
459
Bulgaria
391
Lithuania
384
UAE
356
Croatia
323
Estonia
305
Pakistan
283
Latvia
281
Thailand
253
Niue
228
Serbia
206
Palau
204
Moldova
200
Bangladesh
197
Nigeria
182
Ecuador
176
Samoa
172
Egypt
157
Uruguay
144
Morocco
131
Saudi Arabia
128
Luxembourg
126
Uzbekistan
122
Costa Rica
114
Venezuela
112
Cyprus
106
Liechtenstein
106
Panama
103
Armenia
100
Dominican Republic
93
Kenya
93
Sri Lanka
91
Cayman Islands
84
Azerbaijan
76
Kyrgyzstan
74
Paraguay
72
Anguilla
72
Tanzania
67
Iceland
63
Georgia
62
Jordan
62
Nepal
62
Bosnia and Herzegovina
59
Belize
55
Guatemala
53
Isle of Man
52
Tonga
51
Tunisia
51
Qatar
48
Reunion
47
Macedonia
45
Bolivia
45
Saint Helena
45
Albania
45
New Caledonia
43
Afghanistan
39
Faroe Islands
39
Malta
38
Cameroon
37
Trinidad and Tobago
34
Lebanon
34
Puerto Rico
33
Namibia
27
Antigua and Barbuda
25
Jamaica
24
Saint Vincent and the Grenadines
23
Kuwait
23
Saint Kitts and Nevis
22
Oman
21
Micronesia
21
Myanmar
21
Honduras
20
Guernsey
20
El Salvador
20
Mauritius
20
Ghana
19
Uganda
19
United States Virgin Islands
18
Palestine
18
Mongolia
17
Senegal
16
Christmas Island
14
Bahamas
14
Andorra
13
Sao Tome and Principe
13
American Samoa
13
Cambodia
13
Bermuda
13
Bahrain
13
Turks and Caicos Islands
13
Greenland
13
Iraq
13
Montserrat
12
Nicaragua
12
French Polynesia
12
Tajikistan
12
Zimbabwe
12
Algeria
10
Haiti
9
Cote d'Ivoire
9
Angola
9
Cuba
8
Ethiopia
8
Zambia
8
Mozambique
8
Seychelles
8
Guyana
7
Rwanda
7
Somalia
7
Malawi
7
Barbados
7
Maldives
7
Yemen
7
Madagascar
7
Congo
7
Gibraltar
7
Grenada
6
Botswana
6
Saint Pierre and Miquelon
5
South Georgia and the South Sandwich Islands
5
Fiji
5
San Marino
5
Browse Technology Groups