Log In · Signup for Free
EN  DE  FR  ES  IT  Pусский  한국어  日本語  简体中文  عربي

DuckDuckGo Bot Disallow Usage Statistics

D DuckDuckGo Bot Disallow

The website has disallow rules for DuckDuckGo bot.

https://help.duckduckgo.com/duckduckgo-help-pages/results/duckduckbot/

Robots.txt

DuckDuckGo Bot Disallow · Customers

Get access to data on 399,013 websites that are DuckDuckGo Bot Disallow Customers. We know of 278,430 live websites using DuckDuckGo Bot Disallow and an additional 120,583 sites that used DuckDuckGo Bot Disallow historically and 51,416 websites in the United States

Download Lead List
Technology Awards
12th Most popular technology in Germany 🇩🇪 under Robots.txt.
16th Most popular technology in New Caledonia 🇳🇨 under Robots.txt.
21st Most popular technology in Curacao 🇨🇼 under Robots.txt.
21st Most popular technology in Austria 🇦🇹 under Robots.txt.
21st Most popular technology in the Netherlands 🇳🇱 under Robots.txt.
23rd Most popular technology in South Africa 🇿🇦 under Robots.txt.
Investor Center
Competitors and Similar Technologies
Webz Omgili Disallow favicon
Webz Omgili Disallow

282,491 live sites

Google Image Bot Disallow favicon
Google Image Bot Disallow

290,384 live sites

Diffbot Disallow favicon
Diffbot Disallow

239,422 live sites

Microsoft MSNBot Disallow favicon
Microsoft MSNBot Disallow

333,596 live sites

Exalead Bot Disallow favicon
Exalead Bot Disallow

335,791 live sites

YOU Disallow favicon
YOU Disallow

155,170 live sites

Google AdsBot Mobile Apps Disallow favicon
Google AdsBot Mobile Apps Disallow

539,515 live sites

Youdao Bot Disallow favicon
Youdao Bot Disallow

141,795 live sites

360 Bot Disallow favicon
360 Bot Disallow

121,377 live sites

LLMS Text favicon
LLMS Text

677,562 live sites

ByteDance Bytespider Disallow favicon
ByteDance Bytespider Disallow

1,266,930 live sites

BuiltWithBot Disallow favicon
BuiltWithBot Disallow

44,424 live sites

Google Video Bot Disallow favicon
Google Video Bot Disallow

67,367 live sites

Google News Bot Disallow favicon
Google News Bot Disallow

65,589 live sites

Semrush Bot Disallow favicon
Semrush Bot Disallow

1,518,445 live sites

Majestic Bot Disallow favicon
Majestic Bot Disallow

1,545,212 live sites

Google Favicon Disallow favicon
Google Favicon Disallow

50,817 live sites

Anthropic Claude User Bot Disallow favicon
Anthropic Claude User Bot Disallow

43,515 live sites

Ahrefs Bot Disallow favicon
Ahrefs Bot Disallow

1,856,245 live sites

Pipl Disallow favicon
Pipl Disallow

26,814 live sites

Google API Bot Disallow favicon
Google API Bot Disallow

25,985 live sites

Perplexity favicon
Perplexity

3,351,874 live sites

Cohere AI Disallow favicon
Cohere AI Disallow

3,366,401 live sites

Facebook Bot Disallow favicon
Facebook Bot Disallow

3,417,528 live sites

Google DuplexWeb Disallow favicon
Google DuplexWeb Disallow

21,224 live sites

Anthropic Claude Search Bot Disallow favicon
Anthropic Claude Search Bot Disallow

20,380 live sites

Apple AI Bot Disallow favicon
Apple AI Bot Disallow

4,019,690 live sites

Google Bard Disallow favicon
Google Bard Disallow

4,127,089 live sites

Anthropic Claude Bot Disallow favicon
Anthropic Claude Bot Disallow

4,238,680 live sites

Soso Bot Disallow favicon
Soso Bot Disallow

4,299,023 live sites

Download Lead List

Get a list of 307,807 websites using DuckDuckGo Bot Disallow which includes location information, hosting data and contact details. The list includes 278,430 live websites and 29,377 websites redirecting to those sites. 51,416 of these sites are in the United States.

We also know of 120,583 sites that have used DuckDuckGo Bot Disallow previously.

Site Totals
Total Live
278,430
29,377 additional website redirects?.
Expired
120,583
🇺🇸 American Live Sites
51,416
Live and Expired
399,013
Expired
120,583
Traffic
Top 1m
3,226
Top 100k
571
Top 10k
73
Top 1000
11
Outside Top 1m
274,380
Technology Spend
$100+
199,013
$500+
11,612
$1000+
8,703
$5k+
2,741
$10k+
1,616
Social Followers
10+
10,930
100+
9,261
500+
5,440
1000+
3,803
5000+
1,384
10k+
903
100k+
142
1m+
14
Sales Revenue
$100
4,310
$500
4,032
$1000
3,877
$5000
3,237
$10k
2,290
$100k
626
$1m
183
$10m
70
$100m
34
SKU Products
10+
900
50+
470
500+
234
100+
177
5000+
64
10k+
33
Live Country Totals
🇺🇸 United States
51,416
🇩🇪 Germany
150,164
🇳🇱 Netherlands
21,661
🇨🇭 Switzerland
14,540
🇦🇹 Austria
6,897
🇫🇷 France
4,757
🇪🇸 Spain
2,724
🇪🇺 European Union
2,019
🇸🇪 Sweden
1,869
🇿🇦 South Africa
1,806
🇬🇧 United Kingdom
1,300
🇲🇽 Mexico
1,205
🇧🇷 Brazil
824
🇫🇮 Finland
819
🇮🇹 Italy
791
🇧🇪 Belgium
650
🇰🇷 South Korea
606
🇦🇺 Australia
538
🇵🇱 Poland
521
🇨🇳 China
517
🇱🇹 Lithuania
458
🇨🇦 Canada
423
🇩🇰 Denmark
423
🇳🇴 Norway
355
🇮🇳 India
309
🇷🇺 Russia
253
🇮🇴 .io
237
🇬🇷 Greece
229
🇵🇹 Portugal
196
🇲🇪 .me
188
🇨🇿 Czech Republic
187
🇨🇨 Cocos Islands
187
🇱🇺 Luxembourg
146
🇦🇱 Albania
144
🇯🇵 Japan
141
🇨🇴 .co
138
🇱🇮 Liechtenstein
130
🇲🇹 Malta
115
🇳🇿 New Zealand
101
🇭🇰 Hong Kong
101
🇷🇴 Romania
98
🇸🇮 Slovenia
95
🇹🇭 Thailand
90
🇭🇺 Hungary
90
🇦🇮 .ai
84
🇻🇳 Vietnam
80
🇹🇷 Turkey
79
🇸🇰 Slovakia
78
🇮🇷 Iran
74
🇮🇩 Indonesia
71
🇮🇪 Ireland
69
🇷🇪 Reunion
64
🇹🇼 Taiwan
61
🇳🇺 Niue
58
🇹🇻 .tv
56
🇺🇦 Ukraine
54
🇦🇷 Argentina
54
🇭🇷 Croatia
49
🇦🇪 UAE
39
🇨🇱 Chile
34
🇧🇬 Bulgaria
33
🇸🇬 Singapore
32
🇼🇸 Samoa
28
🇪🇪 Estonia
28
🇲🇾 Malaysia
28
🇨🇾 Cyprus
27
🇬🇭 Ghana
22
🇵🇭 Philippines
22
🇮🇱 Israel
21
🇲🇦 Morocco
20
🇱🇻 Latvia
19
🇷🇸 Serbia
18
🇬🇵 Guadeloupe
18
🇳🇦 Namibia
16
🇧🇿 Belize
14
🇰🇪 Kenya
14
🇨🇷 Costa Rica
13
🇸🇭 Saint Helena
13
🇬🇬 Guernsey
11
🇪🇬 Egypt
10
🇮🇲 Isle of Man
10
🇧🇩 Bangladesh
10
🇳🇨 New Caledonia
10
🇦🇬 Antigua and Barbuda
9
🇮🇸 Iceland
9
🇸🇦 Saudi Arabia
9
🇩🇿 Algeria
9
🇳🇵 Nepal
9
🇱🇰 Sri Lanka
9
🇲🇨 Monaco
9
🇬🇪 Georgia
8
🇺🇾 Uruguay
8
🇵🇰 Pakistan
8
🇺🇬 Uganda
7
🇹🇿 Tanzania
7
🇧🇾 Belarus
7
🇪🇨 Ecuador
7
🇳🇬 Nigeria
6
🇿🇼 Zimbabwe
6
🇱🇦 Lao People's Democratic Republic
6
🇨🇽 Christmas Island
6
🇵🇪 Peru
6
🇲🇶 Martinique
6
🇲🇬 Madagascar
5
🇵🇼 Palau
5
🇭🇹 Haiti
5
🇹🇳 Tunisia
5
🇸🇷 Suriname
5
🇲🇺 Mauritius
5
🇲🇲 Myanmar
4
🇸🇹 Sao Tome and Principe
4
🇦🇿 Azerbaijan
4
🇰🇭 Cambodia
4
🇬🇱 Greenland
4
🇻🇪 Venezuela
4
🇵🇾 Paraguay
4
🇩🇴 Dominican Republic
4
🇦🇴 Angola
4
🇰🇼 Kuwait
3
🇨🇲 Cameroon
3
🇵🇲 Saint Pierre and Miquelon
3
🇵🇦 Panama
3
🇧🇫 Burkina Faso
3
🇺🇿 Uzbekistan
3
🇲🇩 Moldova
3
🇫🇴 Faroe Islands
3
🇯🇴 Jordan
3
🇹🇴 Tonga
3
🇧🇸 Bahamas
2
🇦🇸 American Samoa
2
🇧🇼 Botswana
2
🇦🇼 Aruba
2
🇫🇲 Micronesia
2
🇴🇲 Oman
2
🇿🇲 Zambia
2
🇰🇿 Kazakhstan
2
🇸🇻 El Salvador
2
🇨🇩 Congo
2
🇸🇩 Sudan
2
🇸🇽 Sint Maarten
2
🇲🇰 Macedonia
2
🇸🇴 Somalia
2
🇻🇨 Saint Vincent and the Grenadines
2
🇸🇨 Seychelles
2
🇰🇬 Kyrgyzstan
1
🇬🇸 South Georgia and the South Sandwich Islands
1
🇲🇸 Montserrat
1
🇬🇮 Gibraltar
1
🇨🇮 Cote d'Ivoire
1
🇳🇮 Nicaragua
1
🇨🇼 Curacao
1
🇲🇼 Malawi
1
🇷🇼 Rwanda
1
🇬🇲 Gambia
1
🇩🇲 Dominica
1
🇬🇹 Guatemala
1
🇪🇹 Ethiopia
1
🇹🇹 Trinidad and Tobago
1
🇾🇹 Mayotte
1
🇲🇳 Mongolia
1
🇭🇳 Honduras
1
🇸🇳 Senegal
1
🇹🇫 French Southern Territories
1
🇸🇿 Swaziland
1
🇲🇷 Mauritania
1
🇵🇷 Puerto Rico
1
🇨🇻 Cabo Verde
1
🇲🇻 Maldives
1
🇦🇩 Andorra
1
🇳🇪 Niger
1
🇬🇾 Guyana
1
🇰🇾 Cayman Islands
1
🇮🇶 Iraq
1
🇨🇺 Cuba
1
🇧🇴 Bolivia
1
🇱🇨 Saint Lucia
1
Live Region Totals
Europe
210,299
Western Europe
200,324
Central Europe
172,702
North America
51,839
B Benelux Union
22,457
CHAPS
7,773
Southern Europe
4,553
Northern Europe
4,049
N Nordics
3,482
Scandinavia
2,647
Africa
2,053
Sub-Saharan Africa
2,005
Southern Africa
1,825
East Asia
1,427
South America
1,090
Balkan States
935
Baltic States
505
South Asia
346
Western Asia
280
Middle East
268
Levant Narrow
130
Southern Cone
100
East Africa
55
Northern Africa
47
Western Africa
37
Central America
35
Central Africa
14
Live Financial Totals
EMEA
212,504
AUKUS
53,254
AMER
52,961
FRITES
8,272
FRIT
5,548
PIGS
3,940
B BRICS
3,709
BASIC
3,456
APAC
3,343
IMEA
2,620
MART
2,564
ASEAN+6
2,549
M MIKTA
2,499
LATCAR
2,460
CANZUK
2,362
LATAM
2,341
MEA
2,311
CIVETS
2,184
VISTA
2,090
ASEAN+5
2,032
ANZUK
1,939
BRIC
1,903
ASEAN+3
1,601
MINT
1,361
ASIAN TIGERS
1,256
ANZ
639
SEA
337
MENA
305
Tiger Cub Economies
291
MEP
276
CLMV
94
Live Group Totals
O Organisation for Economic Co-operation and Development
263,790
D Development Assistance Committee
261,795
Club de Paris
261,241
N North Atlantic Treaty Organization
237,313
G G20 Nations
215,263
C Council of Europe
210,290
G7 Nations
208,992
E European Union, European Economic Area and Switzerland
208,227
E European Economic Area
193,687
E Eastern Partnership
193,269
E Euronest Parliamentary Assembly
193,258
E European Union
193,193
EC Inner Six
178,169
Majority German-speaking states of Central Europe
171,601
I International Solar Alliance
84,523
A Assembly of European Regions
58,154
Asia-Pacific Economic Cooperation
55,725
O Organization of American States
54,190
Sovereign states and dependent territories of North America
53,226
G2 Nations
51,933
EC Outer Seven
25,580
3 Global Governance Group
16,303
E European Free Trade Association
15,034
O Organization of Ibero-American States
5,233
C Commonwealth of Nations
4,915
G Group of 77
4,490
I Interparliamentary Assembly on Orthodoxy
3,174
I IBSA Dialogue Forum
2,939
A African Union
2,110
S Southern African Development Community
1,859
A Association of Caribbean State Members
1,414
P Pacific Alliance
1,383
S Shanghai Cooperation Organisation
1,093
C Community of Portuguese Language Countries
1,029
B Organization of the Black Sea Economic Cooperation
905
M Southern Common Market
890
V Visegrad Group
876
F Federation of Euro-Asian Stock Exchanges
872
O Organisation of Islamic Cooperation
560
B Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
431
C Central European Free Trade Agreement Members
355
S South Asian Association for Regional Cooperation
346
A Association of Southeast Asian Nations
337
C Commonwealth of Independent States Members
273
E Eurasian Economic Union
263
E Economic Cooperation Organization
171
O Organization of the Petroleum Exporting Countries
149
O Organisation of Eastern Caribbean States
122
A Arab League
106
T Organization of Turkic States
89
G GUAM Organization for Democracy and Economic Development
69
G Gulf Cooperation Council
53
C Caribbean Community Members
42
C Central American Integration System
39
E East African Community
31
Caribbean Free Trade Association
30
Union of South American Nations
11