Diffbot Disallow Usage Statistics

Diffbot Disallow

Diffbot uses AI to extract data from websites - this website blocks it.

https://diffbot.com

Robots.txt · AI Bot

Diffbot Disallow Customers

Get access to data on 302,329 websites that are Diffbot Disallow Customers. We know of 262,940 live websites using Diffbot Disallow and an additional 39,389 sites that used Diffbot Disallow historically and 113,081 websites in the United States.

Diffbot Disallow Competitors and Similar

Get a list of 302,329 websites using Diffbot Disallow which includes location information, hosting data, contact details, 262,940 currently live websites and an additional 205,815 domains that redirect to sites in this list. 39,389 sites that used this technology previouslyand 113,081 websites in the United States currently using Diffbot Disallow.

Site Totals

Total Live
262,940
205,815 additional website redirects?.
USA Live Sites
113,081
Live and Historical
302,329
Top 1m
0.75%
7,500
Top 100k
1.93%
1,934
Top 10k
3.75%
375

Countries

United States
113,081
Brazil
17,331
Switzerland
15,617
Italy
13,351
United Kingdom
12,774
Germany
10,423
Spain
7,083
Sweden
6,662
Poland
5,472
Netherlands
4,041
France
3,599
Denmark
3,459
Hungary
3,049
Canada
3,048
South Korea
2,913
Slovakia
2,720
Austria
2,460
Ireland
1,647
Australia
1,556
Czech Republic
1,549
Finland
1,441
Norway
1,249
Greece
1,156
South Africa
1,000
BE Belgium
834
RU Russia
760
ID Indonesia
692
IN India
646
SI Slovenia
576
ME .me
548
CN China
525
LT Lithuania
488
MX Mexico
487
TW Taiwan
474
CO .co
369
IO .io
359
PT Portugal
301
JP Japan
285
NZ New Zealand
266
TR Turkey
259
CC Cocos Islands
228
AR Argentina
195
AE UAE
181
RO Romania
174
LI Liechtenstein
146
NU Niue
141
MY Malaysia
136
UA Ukraine
133
VN Vietnam
133
AI Anguilla
112
SG Singapore
107
TV .tv
107
TH Thailand
95
HK Hong Kong
93
CL Chile
91
LU Luxembourg
81
BG Bulgaria
78
VE Venezuela
73
SH Saint Helena
73
RS Serbia
66
PK Pakistan
61
EE Estonia
59
PH Philippines
58
KE Kenya
53
AX Åland Islands
53
NG Nigeria
52
IL Israel
50
IR Iran
50
PE Peru
50
HR Croatia
49
IS Iceland
47
RE Reunion
46
CY Cyprus
45
MA Morocco
39
UY Uruguay
36
LV Latvia
34
TO Tonga
33
BD Bangladesh
32
IM Isle of Man
30
SA Saudi Arabia
27
GG Guernsey
27
LK Sri Lanka
24
AL Albania
23
NP Nepal
22
EG Egypt
22
WS Samoa
21
CR Costa Rica
20
LB Lebanon
19
EC Ecuador
18
FM Micronesia
18
MT Malta
18
PW Palau
17
CX Christmas Island
17
AS American Samoa
16
MK Macedonia
16
MD Moldova
16
BA Bosnia
15
ST Sao Tome
15
VC Saint Vincent
14
GT Guatemala
13
NA Namibia
13
UG Uganda
12
ET Ethiopia
12
PR Puerto Rico
11
BS Bahamas
11
DO Dominican Republic
11
PY Paraguay
10
BW Botswana
10
KG Kyrgyzstan
9
GE Georgia
9
BY Belarus
9
TZ Tanzania
9
GP Guadeloupe
8
IQ Iraq
8
KZ Kazakhstan
8
PA Panama
8
AM Armenia
8
GH Ghana
8
VG British Virgin Islands
7
TN Tunisia
7
PM Saint Pierre
7
GL Greenland
7
MR Mauritania
7
BZ Belize
7
AG Antigua
7
KH Cambodia
7
QA Qatar
7
BO Bolivia
7
BH Bahrain
6
SV El Salvador
6
HT Haiti
6
FO Faroe Islands
6
CM Cameroon
5
SO Somalia
5
KW Kuwait
5
AF Afghanistan
5
MN Mongolia
5
UZ Uzbekistan
5
MV Maldives
5
DZ Algeria
5
MU Mauritius
5

Financial

AMER AMER
134,031
ANZ ANZ
1,822
ANZUK ANZUK
14,596
APAC APAC
8,646
ASEAN3 ASEAN+3
4,955
ASEAN5 ASEAN+5
6,898
ASEAN6 ASEAN+6
7,423
FOURASIANTIGERS ASIAN TIGERS
3,638
AUKUS AUKUS
127,411
BASIC BASIC
19,502
BRIC BRIC
19,262
BRICS BRICS
20,262
CANZUK CANZUK
17,644
CIVETS CIVETS
2,130
CLMV CLMV
143
EMEA EMEA
103,820
FRIT FRIT
16,950
FRITES FRITES
24,033
IMEA IMEA
2,756
LATAM LATAM
18,413
LATCAR LATCAR
18,588
MART MART
2,870
MEA MEA
2,110
MENA MENA
752
MEP MEP
751
MIKTA MIKTA
5,907
MINT MINT
1,490
PIGS PIGS
21,891
SEA SEA
1,232
TIGERCUB Tiger Cub Economies
1,114
VISTA VISTA
2,279

Group

AFRICANUNION African Union
1,343
ARABLEAGUE Arab League
352
APEC Asia-Pacific Economic Cooperation
124,851
AER Assembly of European Regions
79,670
ACS Association of Caribbean State Members
707
ASEAN Association of Southeast Asian Nations
1,232
BIMSTEC Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
822
CARICOM Caribbean Community Members
60
CARIFTA Caribbean Free Trade Association
41
CAIS Central American Integration System
71
CEFTA Central European Free Trade Agreement Members
137
PARISCLUB Club de Paris
223,664
CIS Commonwealth of Independent States Members
818
COMMONWEALTH Commonwealth of Nations
20,010
CPLP Community of Portuguese Language Countries
17,650
COE Council of Europe
101,996
DAC Development Assistance Committee
220,740
EAC East African Community
80
EAP Eastern Partnership
71,027
INNERSIX EC Inner Six
32,329
OUTERSEVEN EC Outer Seven
42,522
ECO Economic Cooperation Organization
400
EAEU Eurasian Economic Union
794
EURONEST Euronest Parliamentary Assembly
71,015
EEA European Economic Area
72,291
EFTA European Free Trade Association
17,059
EU European Union
70,849
EUEEACH European Union, European Economic Area and Switzerland
87,908
FEAS Federation of Euro-Asian Stock Exchanges
2,591
G2 G2 Nations
113,606
G20 G20 Nations
182,952
G7 G7 Nations
156,561
3G Global Governance Group
19,009
G77 Group of 77
22,229
GUAM GUAM Organization for Democracy and Economic Development
161
GCC Gulf Cooperation Council
227
IBSA IBSA Dialogue Forum
18,977
ISA International Solar Alliance
175,521
IAO Interparliamentary Assembly on Orthodoxy
14,249
DACH Majority German-speaking states of Central Europe
28,500
NATO North Atlantic Treaty Organization
189,074
OECD Organisation for Economic Co-operation and Development
222,252
OECS Organisation of Eastern Caribbean States
155
OIC Organisation of Islamic Cooperation
1,726
OAS Organization of American States
134,573
OEI Organization of Ibero-American States
25,783
BSEC Organization of the Black Sea Economic Cooperation
2,619
OPEC Organization of the Petroleum Exporting Countries
406
TURKIC Organization of Turkic States
284
PACIFICALLIANCE Pacific Alliance
652
SCO Shanghai Cooperation Organisation
2,014
SAARC South Asian Association for Regional Cooperation
795
SADC Southern African Development Community
1,056
MERCOSUR Southern Common Market
17,572
NORAM Sovereign states and dependent territories of North America
116,898
USAN Union of South American Nations
85
V4 Visegrad Group
12,790

Region

AFRICA Africa
1,442
BALKANS Balkan States
2,413
BALTICS Baltic States
581
BENELUX Benelux Union
4,956
CENTRALAFRICA Central Africa
28
CENTRALAMERICA Central America
60
CENTRALASIA Central Asia
22
CENTRALEUROPE Central Europe
42,012
CHAPS CHAPS
15,250
EASTAFRICA East Africa
117
EASTASIA East Asia
4,295
EUROPE Europe
102,014
LEVANT Levant Narrow
383
MIDDLEEAST Middle East
690
NORDICS Nordics
12,925
CUSA North America
116,129
NORTHAFRICA Northern Africa
84
NORTHERNEUROPE Northern Europe
15,086
SCANDINAVIA Scandinavia
11,370
SOUTHAMERICA South America
17,850
SOUTHASIA South Asia
795
SOUTHERNAFRICA Southern Africa
1,026
SOUTHERNCONE Southern Cone
332
SOUTHERNEUROPE Southern Europe
22,657
SUBSAHARA Sub-Saharan Africa
1,358
WESTAFRICA Western Africa
78
WESTASIA Western Asia
710
WESTERNEUROPE Western Europe
51,625
Browse Technology Groups