Log In · Signup for Free
EN  DE  FR  ES  IT  Pусский  한국어  日本語  简体中文  عربي

DuckDuckGo Bot Disallow Usage Statistics

D DuckDuckGo Bot Disallow

The website has disallow rules for DuckDuckGo bot.

https://help.duckduckgo.com/duckduckgo-help-pages/results/duckduckbot/

Robots.txt

DuckDuckGo Bot Disallow · Customers

Get access to data on 426,129 websites that are DuckDuckGo Bot Disallow Customers. We know of 282,085 live websites using DuckDuckGo Bot Disallow and an additional 144,044 sites that used DuckDuckGo Bot Disallow historically and 47,460 websites in the United States

Download Lead List
Technology Awards
12th Most popular technology in Germany 🇩🇪 under Robots.txt.
16th Most popular technology in New Caledonia 🇳🇨 under Robots.txt.
20th Most popular technology in Curacao 🇨🇼 under Robots.txt.
21st Most popular technology in the Netherlands 🇳🇱 under Robots.txt.
21st Most popular technology in Austria 🇦🇹 under Robots.txt.
23rd Most popular technology in South Africa 🇿🇦 under Robots.txt.
Investor Center
Competitors and Similar Technologies
Microsoft MSNBot Disallow favicon
Microsoft MSNBot Disallow

286,264 live sites

Exalead Bot Disallow favicon
Exalead Bot Disallow

299,521 live sites

Google Image Bot Disallow favicon
Google Image Bot Disallow

261,289 live sites

Webz Omgili Disallow favicon
Webz Omgili Disallow

244,088 live sites

Diffbot Disallow favicon
Diffbot Disallow

227,966 live sites

Youdao Bot Disallow favicon
Youdao Bot Disallow

177,669 live sites

YOU Disallow favicon
YOU Disallow

152,431 live sites

LLMS Text favicon
LLMS Text

781,685 live sites

360 Bot Disallow favicon
360 Bot Disallow

80,615 live sites

Majestic Bot Disallow favicon
Majestic Bot Disallow

1,335,258 live sites

Semrush Bot Disallow favicon
Semrush Bot Disallow

1,336,985 live sites

Anthropic Claude User Bot Disallow favicon
Anthropic Claude User Bot Disallow

56,015 live sites

Google Video Bot Disallow favicon
Google Video Bot Disallow

52,415 live sites

ByteDance Bytespider Disallow favicon
ByteDance Bytespider Disallow

1,709,582 live sites

Google News Bot Disallow favicon
Google News Bot Disallow

50,146 live sites

Ahrefs Bot Disallow favicon
Ahrefs Bot Disallow

1,856,245 live sites

Google Favicon Disallow favicon
Google Favicon Disallow

36,135 live sites

Anthropic Claude Search Bot Disallow favicon
Anthropic Claude Search Bot Disallow

28,766 live sites

BuiltWithBot Disallow favicon
BuiltWithBot Disallow

24,028 live sites

Perplexity favicon
Perplexity

3,403,165 live sites

Cohere AI Disallow favicon
Cohere AI Disallow

3,411,375 live sites

Facebook Bot Disallow favicon
Facebook Bot Disallow

3,453,950 live sites

Pipl Disallow favicon
Pipl Disallow

22,451 live sites

Soso Bot Disallow favicon
Soso Bot Disallow

4,299,023 live sites

Apple AI Bot Disallow favicon
Apple AI Bot Disallow

4,632,227 live sites

Alexa Bot Disallow favicon
Alexa Bot Disallow

4,719,358 live sites

Google Bard Disallow favicon
Google Bard Disallow

4,721,680 live sites

Anthropic Claude Bot Disallow favicon
Anthropic Claude Bot Disallow

4,819,381 live sites

Common Crawl Bot Disallow favicon
Common Crawl Bot Disallow

4,888,403 live sites

AppleBot Disallow favicon
AppleBot Disallow

4,956,653 live sites

Download Lead List

Get a list of 303,200 websites using DuckDuckGo Bot Disallow which includes location information, hosting data and contact details. The list includes 282,085 live websites and 21,115 websites redirecting to those sites. 47,460 of these sites are in the United States.

We also know of 144,044 sites that have used DuckDuckGo Bot Disallow previously.

Site Totals
Total Live
282,085
21,115 additional website redirects?.
Expired
144,044
🇺🇸 American Live Sites
47,460
Live and Expired
426,129
Expired
144,044
Traffic
Top 1m
2,328
Top 100k
518
Top 10k
80
Top 1000
16
Outside Top 1m
279,196
Technology Spend
$100+
65,036
$500+
9,423
$1000+
7,186
$5k+
1,933
$10k+
1,046
Social Followers
10+
8,812
100+
7,452
500+
4,272
1000+
2,924
5000+
980
10k+
643
100k+
111
Sales Revenue
$100
2,711
$500
2,549
$1000
2,445
$5000
2,030
$10k
1,393
$100k
480
$1m
155
$10m
56
$100m
26
SKU Products
10+
594
50+
321
500+
162
100+
120
5000+
43
10k+
27
Live Country Totals
🇺🇸 United States
47,460
🇩🇪 Germany
164,639
🇳🇱 Netherlands
21,384
🇧🇾 Belarus
19,111
🇧🇼 Botswana
16,597
🇨🇭 Switzerland
14,073
🇳🇮 Nicaragua
11,606
🇧🇪 Belgium
7,668
🇦🇹 Austria
6,439
🇨🇦 Canada
5,729
🇸🇭 Saint Helena
4,892
🇸🇳 Senegal
4,368
🇧🇧 Barbados
3,063
🇫🇷 France
2,986
🇪🇸 Spain
2,666
🇹🇭 Thailand
2,278
🇸🇹 Sao Tome and Principe
2,044
🇲🇻 Maldives
1,898
🇪🇺 European Union
1,835
🇿🇦 South Africa
1,821
🇸🇪 Sweden
1,699
🇸🇱 Sierra Leone
1,201
🇲🇽 Mexico
1,177
🇬🇧 United Kingdom
1,007
🇧🇪 Belgium
975
🇸🇬 Singapore
829
🇦🇬 Antigua and Barbuda
747
🇫🇮 Finland
724
🇧🇷 Brazil
711
🇰🇷 South Korea
619
🇨🇳 China
615
🇧🇪 Belgium
511
🇮🇹 Italy
501
🇦🇺 Australia
461
🇱🇹 Lithuania
431
🇱🇺 Luxembourg
414
🇵🇱 Poland
394
🇹🇬 Togo
387
🇲🇩 Moldova
360
🇩🇰 Denmark
307
🇳🇴 Norway
299
🇮🇱 Israel
297
🇵🇦 Panama
291
🇸🇿 Swaziland
283
🇧🇱 Saint Barthélemy
275
🇨🇦 Canada
270
🇮🇳 India
266
🇸🇴 Somalia
253
🇬🇷 Greece
233
🇬🇷 Greece
216
🇨🇴 .co
204
🇬🇦 Gabon
165
🇵🇹 Portugal
164
🇨🇨 Cocos Islands
158
🇷🇺 Russia
158
🇧🇸 Bahamas
157
🇲🇪 .me
155
🇲🇦 Morocco
155
🇳🇨 New Caledonia
155
🇻🇦 Vatican City
151
🇦🇱 Albania
144
🇮🇴 .io
137
🇻🇨 Saint Vincent and the Grenadines
135
🇱🇺 Luxembourg
130
🇯🇵 Japan
121
🇦🇿 Azerbaijan
121
🇱🇮 Liechtenstein
116
🇲🇹 Malta
116
🇲🇩 Moldova
115
🇹🇳 Tunisia
107
🇫🇷 France
104
🇲🇳 Mongolia
101
🇸🇭 Saint Helena
99
🇨🇴 .co
88
🇦🇷 Argentina
86
🇳🇿 New Zealand
86
🇮🇳 India
85
🇭🇰 Hong Kong
84
🇦🇮 .ai
83
🇲🇴 Macao
81
🇸🇮 Slovenia
79
🇮🇪 Ireland
78
🇨🇿 Czech Republic
78
🇦🇱 Albania
77
🇷🇴 Romania
75
🇬🇱 Greenland
73
🇻🇳 Vietnam
73
🇹🇷 Turkey
69
🇱🇦 Lao People's Democratic Republic
69
🇰🇾 Cayman Islands
64
🇱🇺 Luxembourg
63
🇨🇱 Chile
61
🇨🇳 China
61
🇸🇨 Seychelles
58
🇹🇻 .tv
56
🇷🇪 Reunion
54
🇹🇹 Trinidad and Tobago
54
🇭🇺 Hungary
54
🇳🇺 Niue
53
🇸🇰 Slovakia
50
🇨🇲 Cameroon
46
🇮🇩 Indonesia
46
🇦🇷 Argentina
45
🇦🇷 Argentina
42
🇭🇷 Croatia
41
🇩🇪 Germany
41
🇹🇼 Taiwan
39
🇷🇪 Reunion
36
🇬🇦 Gabon
36
🇦🇷 Argentina
35
🇳🇪 Niger
35
🇲🇸 Montserrat
34
🇦🇪 UAE
33
🇬🇪 Georgia
32
🇲🇪 .me
30
🇺🇦 Ukraine
30
🇮🇩 Indonesia
30
🇹🇭 Thailand
28
🇲🇨 Monaco
28
🇦🇸 American Samoa
27
🇨🇱 Chile
25
🇼🇸 Samoa
24
🇬🇭 Ghana
22
🇨🇾 Cyprus
22
🇪🇪 Estonia
21
🇸🇬 Singapore
21
🇵🇭 Philippines
20
🇲🇦 Morocco
19
🇲🇾 Malaysia
19
🇪🇷 Eritrea
18
🇮🇱 Israel
17
🇧🇬 Bulgaria
17
🇦🇮 .ai
17
🇲🇹 Malta
16
🇹🇨 Turks and Caicos Islands
16
🇳🇦 Namibia
16
🇳🇨 New Caledonia
16
🇬🇵 Guadeloupe
15
🇧🇿 Belize
15
🇸🇦 Saudi Arabia
15
🇸🇩 Sudan
15
🇳🇪 Niger
15
🇲🇭 Marshall Islands
14
🇮🇷 Iran
13
🇬🇵 Guadeloupe
13
🇱🇻 Latvia
12
🇻🇳 Vietnam
11
🇬🇵 Guadeloupe
11
🇸🇩 Sudan
11
🇧🇼 Botswana
11
🇧🇩 Bangladesh
11
🇰🇪 Kenya
10
🇹🇳 Tunisia
10
🇪🇨 Ecuador
10
🇬🇷 Greece
10
🇨🇦 Canada
10
🇪🇬 Egypt
9
🇲🇭 Marshall Islands
9
🇲🇪 .me
9
🇷🇸 Serbia
9
🇵🇲 Saint Pierre and Miquelon
9
🇬🇬 Guernsey
8
🇺🇬 Uganda
8
🇸🇭 Saint Helena
8
🇳🇨 New Caledonia
8
🇱🇰 Sri Lanka
8
🇮🇲 Isle of Man
8
🇱🇮 Liechtenstein
8
🇬🇪 Georgia
7
🇬🇪 Georgia
7
🇨🇷 Costa Rica
7
🇳🇵 Nepal
7
🇩🇿 Algeria
7
🇧🇯 Benin
7
🇦🇬 Antigua and Barbuda
6
🇹🇿 Tanzania
6
🇸🇦 Saudi Arabia
6
🇲🇶 Martinique
6
🇮🇸 Iceland
6
🇧🇾 Belarus
6
🇸🇬 Singapore
5
🇲🇬 Madagascar
5
🇸🇷 Suriname
5
🇪🇨 Ecuador
5
🇸🇨 Seychelles
5
🇬🇩 Grenada
5
🇲🇺 Mauritius
5
🇲🇺 Mauritius
5
🇵🇰 Pakistan
5
🇧🇩 Bangladesh
5
🇹🇳 Tunisia
5
🇭🇹 Haiti
5
🇻🇪 Venezuela
4
🇵🇪 Peru
4
🇧🇱 Saint Barthélemy
4
🇨🇦 Canada
4
🇳🇬 Nigeria
4
🇭🇷 Croatia
4
🇦🇴 Angola
4
🇰🇼 Kuwait
4
🇿🇼 Zimbabwe
4
🇧🇾 Belarus
4
🇫🇷 France
4
🇺🇾 Uruguay
4
🇲🇶 Martinique
4
🇸🇴 Somalia
3
🇪🇸 Spain
3
🇧🇿 Belize
3
🇯🇴 Jordan
3
🇹🇴 Tonga
3
🇦🇿 Azerbaijan
3
🇺🇿 Uzbekistan
3
🇱🇦 Lao People's Democratic Republic
3
🇦🇼 Aruba
3
🇵🇼 Palau
3
🇲🇲 Myanmar
3
🇨🇽 Christmas Island
3
🇺🇲 United States Minor Outlying Islands
3
🇨🇲 Cameroon
3
🇳🇦 Namibia
3
🇨🇮 Cote d'Ivoire
3
🇬🇷 Greece
3
🇵🇾 Paraguay
3
🇻🇪 Venezuela
2
🇵🇷 Puerto Rico
2
🇬🇱 Greenland
2
🇭🇰 Hong Kong
2
🇸🇰 Slovakia
2
🇿🇦 South Africa
2
🇸🇭 Saint Helena
2
🇰🇭 Cambodia
2
🇱🇨 Saint Lucia
2
🇻🇨 Saint Vincent and the Grenadines
2
🇸🇨 Seychelles
2
🇧🇪 Belgium
2
🇲🇻 Maldives
2
🇫🇴 Faroe Islands
2
🇩🇴 Dominican Republic
2
🇳🇮 Nicaragua
2
🇭🇳 Honduras
2
🇧🇼 Botswana
2
🇲🇰 Macedonia
2
🇴🇲 Oman
2
🇿🇲 Zambia
2
🇦🇸 American Samoa
2
🇲🇩 Moldova
2
🇳🇮 Nicaragua
2
🇸🇭 Saint Helena
2
🇬🇹 Guatemala
2
🇸🇹 Sao Tome and Principe
2
🇨🇻 Cabo Verde
2
🇸🇻 El Salvador
2
🇹🇴 Tonga
1
🇲🇬 Madagascar
1
🇱🇦 Lao People's Democratic Republic
1
🇸🇦 Saudi Arabia
1
🇨🇦 Canada
1
🇻🇦 Vatican City
1
🇬🇦 Gabon
1
🇰🇬 Kyrgyzstan
1
🇨🇦 Canada
1
🇲🇷 Mauritania
1
🇳🇨 New Caledonia
1
🇳🇨 New Caledonia
1
🇨🇦 Canada
1
🇹🇨 Turks and Caicos Islands
1
🇵🇦 Panama
1
🇨🇦 Canada
1
🇻🇦 Vatican City
1
🇧🇦 Bosnia and Herzegovina
1
🇹🇬 Togo
1
🇵🇷 Puerto Rico
1
🇲🇨 Monaco
1
🇹🇨 Turks and Caicos Islands
1
🇧🇼 Botswana
1
🇸🇿 Swaziland
1
🇸🇭 Saint Helena
1
🇨🇦 Canada
1
🇸🇹 Sao Tome and Principe
1
🇧🇷 Brazil
1
🇧🇴 Bolivia
1
🇸🇴 Somalia
1
🇰🇿 Kazakhstan
1
🇸🇿 Swaziland
1
🇨🇺 Cuba
1
🇨🇦 Canada
1
🇳🇨 New Caledonia
1
🇸🇽 Sint Maarten
1
🇸🇳 Senegal
1
🇧🇾 Belarus
1
🇵🇦 Panama
1
🇨🇼 Curacao
1
🇲🇼 Malawi
1
🇷🇼 Rwanda
1
🇷🇸 Serbia
1
🇸🇬 Singapore
1
🇪🇸 Spain
1
🇲🇴 Macao
1
🇧🇫 Burkina Faso
1
🇦🇫 Afghanistan
1
🇨🇦 Canada
1
🇻🇦 Vatican City
1
🇸🇳 Senegal
1
🇸🇬 Singapore
1
🇨🇲 Cameroon
1
🇧🇼 Botswana
1
🇦🇲 Armenia
1
🇵🇲 Saint Pierre and Miquelon
1
🇧🇸 Bahamas
1
🇲🇱 Mali
1
🇨🇳 China
1
🇲🇦 Morocco
1
🇧🇼 Botswana
1
🇬🇮 Gibraltar
1
🇨🇩 Congo
1
🇦🇩 Andorra
1
🇮🇲 Isle of Man
1
🇰🇮 Kiribati
1
🇸🇨 Seychelles
1
🇭🇳 Honduras
1
🇸🇳 Senegal
1
🇰🇭 Cambodia
1
🇸🇦 Saudi Arabia
1
🇰🇾 Cayman Islands
1
🇪🇹 Ethiopia
1
🇹🇹 Trinidad and Tobago
1
🇪🇺 European Union
1
🇬🇷 Greece
1
🇦🇬 Antigua and Barbuda
1
🇲🇩 Moldova
1
🇸🇨 Seychelles
1
🇫🇯 Fiji
1
🇩🇪 Germany
1
🇨🇦 Canada
1
🇲🇻 Maldives
1
Live Region Totals
Europe
219,924
Western Europe
211,365
Central Europe
185,922
North America
47,730
B Benelux Union
22,025
Europe
13,554
Central Europe
11,522
Western Europe
10,224
North America
7,202
CHAPS
7,015
Southern Europe
4,095
Northern Europe
3,577
CHAPS
3,286
N Nordics
3,039
Scandinavia
2,305
Africa
2,027
Sub-Saharan Africa
1,986
Southern Africa
1,840
East Asia
1,478
B Benelux Union
996
South America
897
Balkan States
807
Baltic States
464
South Asia
293
Northern Europe
286
Southern Europe
280
N Nordics
225
Western Asia
189
Scandinavia
184
Middle East
178
Levant Narrow
111
Southern Cone
77
East Asia
48
East Africa
46
South Asia
41
Northern Africa
41
Western Africa
31
Western Asia
30
Balkan States
28
Central America
28
South America
20
Middle East
18
Africa
17
Sub-Saharan Africa
17
Levant Narrow
16
Southern Africa
15
Southern Cone
12
Live Financial Totals
EMEA
222,029
AUKUS
48,928
AMER
48,654
EMEA
13,576
AUKUS
7,294
AMER
7,222
FRITES
6,153
B BRICS
3,571
PIGS
3,547
FRIT
3,487
BASIC
3,413
APAC
2,980
IMEA
2,462
ASEAN+6
2,383
M MIKTA
2,372
MART
2,354
LATCAR
2,223
MEA
2,196
LATAM
2,107
CIVETS
2,106
VISTA
2,054
CANZUK
1,824
ASEAN+5
1,768
BRIC
1,750
ASEAN+3
1,570
ANZUK
1,554
ASIAN TIGERS
1,339
MINT
1,296
ANZ
547
FRITES
464
CANZUK
352
FRIT
312
PIGS
252
ANZUK
225
SEA
215
MENA
210
Tiger Cub Economies
186
MEP
183
APAC
156
ASEAN+6
103
ASEAN+5
99
CLMV
81
IMEA
69
B BRICS
67
BASIC
60
M MIKTA
60
BRIC
53
ANZ
43
MART
42
VISTA
36
MEA
35
CIVETS
27
LATCAR
27
LATAM
26
ASEAN+3
26
MEP
21
ASIAN TIGERS
18
MENA
18
MINT
18
SEA
15
Live Group Totals
O Organisation for Economic Co-operation and Development
269,348
D Development Assistance Committee
267,501
Club de Paris
267,130
N North Atlantic Treaty Organization
244,168
G G20 Nations
222,978
C Council of Europe
219,917
E European Union, European Economic Area and Switzerland
218,328
G7 Nations
216,984
E European Economic Area
204,255
E Eastern Partnership
203,883
E Euronest Parliamentary Assembly
203,874
E European Union
203,834
EC Inner Six
190,151
Majority German-speaking states of Central Europe
185,151
I International Solar Alliance
77,157
A Assembly of European Regions
53,682
Asia-Pacific Economic Cooperation
51,326
O Organization of American States
49,849
Sovereign states and dependent territories of North America
49,066
G2 Nations
48,075
EC Outer Seven
23,988
O Organisation for Economic Co-operation and Development
20,758
D Development Assistance Committee
20,730
N North Atlantic Treaty Organization
19,573
Club de Paris
17,910
G G20 Nations
15,679
3 Global Governance Group
15,582
G7 Nations
15,543
E European Free Trade Association
14,494
C Council of Europe
13,553
E European Union, European Economic Area and Switzerland
13,340
E European Economic Area
12,953
E Eastern Partnership
12,940
E Euronest Parliamentary Assembly
12,939
E European Union
12,927
EC Inner Six
9,153
I International Solar Alliance
8,767
Majority German-speaking states of Central Europe
8,737
Asia-Pacific Economic Cooperation
7,322
O Organization of American States
7,228
Sovereign states and dependent territories of North America
7,209
G2 Nations
7,079
O Organization of Ibero-American States
4,914
C Commonwealth of Nations
4,299
G Group of 77
4,122
A Assembly of European Regions
2,889
I Interparliamentary Assembly on Orthodoxy
2,859
I IBSA Dialogue Forum
2,798
V Visegrad Group
2,781
I Interparliamentary Assembly on Orthodoxy
2,553
A African Union
2,052
S Southern African Development Community
1,870
A Association of Caribbean State Members
1,322
EC Outer Seven
1,296
P Pacific Alliance
1,294
S Shanghai Cooperation Organisation
1,049
C Community of Portuguese Language Countries
883
M Southern Common Market
763
B Organization of the Black Sea Economic Cooperation
722
F Federation of Euro-Asian Stock Exchanges
706
V Visegrad Group
576
3 Global Governance Group
464
C Commonwealth of Nations
439
O Organisation of Islamic Cooperation
421
E European Free Trade Association
413
E European Union
340
B Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
317
C Central European Free Trade Agreement Members
312
S South Asian Association for Regional Cooperation
293
O Organization of Ibero-American States
216
A Association of Southeast Asian Nations
215
C Commonwealth of Independent States Members
175
E Eurasian Economic Union
167
O Organisation of Eastern Caribbean States
112
G Group of 77
98
E Economic Cooperation Organization
96
A Arab League
90
T Organization of Turkic States
77
O Organization of the Petroleum Exporting Countries
75
I IBSA Dialogue Forum
56
S Shanghai Cooperation Organisation
48
C Community of Portuguese Language Countries
46
G Gulf Cooperation Council
45
G GUAM Organization for Democracy and Economic Development
42
S South Asian Association for Regional Cooperation
41
B Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
41
F Federation of Euro-Asian Stock Exchanges
38
C Caribbean Community Members
37
B Organization of the Black Sea Economic Cooperation
33
C Central American Integration System
30
Caribbean Free Trade Association
26
E East African Community
26
O Organisation of Islamic Cooperation
20
M Southern Common Market
19
S Southern African Development Community
16
A African Union
16
A Association of Southeast Asian Nations
15
E Economic Cooperation Organization
12
G GUAM Organization for Democracy and Economic Development
12
Union of South American Nations
10