Diffbot Disallow Usage Statistics

Diffbot Disallow

Diffbot uses AI to extract data from websites - this website blocks it.

https://diffbot.com

Robots.txt · AI Bot

Diffbot Disallow Customers

Get access to data on 307,393 websites that are Diffbot Disallow Customers. We know of 268,227 live websites using Diffbot Disallow and an additional 39,166 sites that used Diffbot Disallow historically and 115,264 websites in the United States.

Diffbot Disallow Awards
Diffbot Disallow Competitors and Similar

Get a list of 307,393 websites using Diffbot Disallow which includes location information, hosting data, contact details, 268,227 currently live websites and an additional 211,225 domains that redirect to sites in this list. 39,166 sites that used this technology previouslyand 115,264 websites in the United States currently using Diffbot Disallow.

Site Totals

Total Live
268,227
211,225 additional website redirects?.
USA Live Sites
115,264
Live and Historical
307,393
Top 1m
0.76%
7,583
Top 100k
1.95%
1,953
Top 10k
3.8%
380

Countries

United States
115,264
Brazil
17,451
Switzerland
15,670
Italy
13,543
United Kingdom
12,985
Germany
10,857
Spain
7,153
Sweden
6,720
Poland
5,594
Netherlands
4,073
France
3,690
Denmark
3,487
Canada
3,116
Hungary
3,065
South Korea
2,928
Slovakia
2,742
Austria
2,495
Ireland
1,655
Australia
1,592
Czech Republic
1,585
Finland
1,454
Norway
1,268
Greece
1,174
South Africa
1,028
BE Belgium
843
RU Russia
801
ID Indonesia
749
IN India
692
SI Slovenia
581
ME .me
569
CN China
561
MX Mexico
501
LT Lithuania
496
TW Taiwan
484
CO .co
388
IO .io
374
PT Portugal
320
JP Japan
299
NZ New Zealand
275
TR Turkey
275
CC Cocos Islands
255
AR Argentina
212
AE UAE
191
RO Romania
176
VN Vietnam
149
LI Liechtenstein
146
NU Niue
141
MY Malaysia
139
UA Ukraine
136
AI Anguilla
134
SG Singapore
113
TV .tv
107
CL Chile
105
HK Hong Kong
100
TH Thailand
100
VE Venezuela
89
LU Luxembourg
82
BG Bulgaria
80
SH Saint Helena
77
PK Pakistan
66
RS Serbia
66
EE Estonia
63
PH Philippines
61
KE Kenya
60
NG Nigeria
57
PE Peru
55
HR Croatia
54
AX Åland Islands
53
IR Iran
52
IL Israel
52
IS Iceland
48
RE Reunion
46
CY Cyprus
44
MA Morocco
41
UY Uruguay
36
LV Latvia
34
TO Tonga
34
BD Bangladesh
34
SA Saudi Arabia
31
IM Isle of Man
30
LK Sri Lanka
29
GG Guernsey
29
EG Egypt
25
NP Nepal
25
AL Albania
23
WS Samoa
21
CX Christmas Island
21
CR Costa Rica
21
FM Micronesia
19
LB Lebanon
19
EC Ecuador
18
PW Palau
18
MT Malta
18
MK Macedonia
17
BA Bosnia
16
ST Sao Tome
16
AS American Samoa
16
MD Moldova
16
VC Saint Vincent
15
GT Guatemala
14
NA Namibia
13
UG Uganda
12
GE Georgia
12
ET Ethiopia
12
DO Dominican Republic
12
PR Puerto Rico
11
AM Armenia
11
KG Kyrgyzstan
11
BS Bahamas
11
PY Paraguay
10
TN Tunisia
10
BW Botswana
10
IQ Iraq
9
KZ Kazakhstan
9
BY Belarus
9
TZ Tanzania
9
KH Cambodia
9
BO Bolivia
9
GP Guadeloupe
8
PA Panama
8
VG British Virgin Islands
8
PM Saint Pierre
8
GL Greenland
8
QA Qatar
8
AG Antigua
8
GH Ghana
8
MR Mauritania
7
BZ Belize
7
AZ Azerbaijan
7
BH Bahrain
6
SV El Salvador
6
FO Faroe Islands
6
HT Haiti
6
CM Cameroon
6
AF Afghanistan
6
GD Grenada
5
SO Somalia
5
KW Kuwait
5
MN Mongolia
5
UZ Uzbekistan
5
MV Maldives
5
SL Sierra Leone
5
MU Mauritius
5
DZ Algeria
5

Financial

AMER AMER
136,463
ANZ ANZ
1,867
ANZUK ANZUK
14,852
APAC APAC
8,962
ASEAN3 ASEAN+3
5,113
ASEAN5 ASEAN+5
7,111
ASEAN6 ASEAN+6
7,672
FOURASIANTIGERS ASIAN TIGERS
3,702
AUKUS AUKUS
129,841
BASIC BASIC
19,732
BRIC BRIC
19,505
BRICS BRICS
20,533
CANZUK CANZUK
17,968
CIVETS CIVETS
2,253
CLMV CLMV
162
EMEA EMEA
105,484
FRIT FRIT
17,233
FRITES FRITES
24,386
IMEA IMEA
2,895
LATAM LATAM
18,609
LATCAR LATCAR
18,812
MART MART
3,004
MEA MEA
2,203
MENA MENA
796
MEP MEP
795
MIKTA MIKTA
6,045
MINT MINT
1,582
PIGS PIGS
22,190
SEA SEA
1,325
TIGERCUB Tiger Cub Economies
1,198
VISTA VISTA
2,413

Group

AFRICANUNION African Union
1,399
ARABLEAGUE Arab League
377
APEC Asia-Pacific Economic Cooperation
127,393
AER Assembly of European Regions
80,601
ACS Association of Caribbean State Members
750
ASEAN Association of Southeast Asian Nations
1,325
BIMSTEC Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
883
CARICOM Caribbean Community Members
65
CARIFTA Caribbean Free Trade Association
46
CAIS Central American Integration System
75
CEFTA Central European Free Trade Agreement Members
139
PARISCLUB Club de Paris
227,396
CIS Commonwealth of Independent States Members
869
COMMONWEALTH Commonwealth of Nations
20,448
CPLP Community of Portuguese Language Countries
17,790
COE Council of Europe
103,581
DAC Development Assistance Committee
224,558
EAC East African Community
87
EAP Eastern Partnership
72,269
INNERSIX EC Inner Six
33,088
OUTERSEVEN EC Outer Seven
42,945
ECO Economic Cooperation Organization
431
EAEU Eurasian Economic Union
841
EURONEST Euronest Parliamentary Assembly
72,253
EEA European Economic Area
73,540
EFTA European Free Trade Association
17,132
EU European Union
72,078
EUEEACH European Union, European Economic Area and Switzerland
89,210
FEAS Federation of Euro-Asian Stock Exchanges
2,650
G2 G2 Nations
115,825
G20 G20 Nations
186,575
G7 G7 Nations
159,754
3G Global Governance Group
19,151
G77 Group of 77
22,685
GUAM GUAM Organization for Democracy and Economic Development
171
GCC Gulf Cooperation Council
242
IBSA IBSA Dialogue Forum
19,171
ISA International Solar Alliance
178,605
IAO Interparliamentary Assembly on Orthodoxy
14,526
DACH Majority German-speaking states of Central Europe
29,022
NATO North Atlantic Treaty Organization
192,689
OECD Organisation for Economic Co-operation and Development
226,132
OECS Organisation of Eastern Caribbean States
182
OIC Organisation of Islamic Cooperation
1,853
OAS Organization of American States
137,024
OEI Organization of Ibero-American States
26,068
BSEC Organization of the Black Sea Economic Cooperation
2,711
OPEC Organization of the Petroleum Exporting Countries
444
TURKIC Organization of Turkic States
307
PACIFICALLIANCE Pacific Alliance
688
SCO Shanghai Cooperation Organisation
2,145
SAARC South Asian Association for Regional Cooperation
857
SADC Southern African Development Community
1,084
MERCOSUR Southern Common Market
17,709
NORAM Sovereign states and dependent territories of North America
119,198
USAN Union of South American Nations
103
V4 Visegrad Group
12,986

Region

AFRICA Africa
1,499
BALKANS Balkan States
2,463
BALTICS Baltic States
593
BENELUX Benelux Union
4,998
CENTRALAFRICA Central Africa
30
CENTRALAMERICA Central America
63
CENTRALASIA Central Asia
25
CENTRALEUROPE Central Europe
42,735
CHAPS CHAPS
15,481
EASTAFRICA East Africa
124
EASTASIA East Asia
4,377
EUROPE Europe
103,600
LEVANT Levant Narrow
401
MIDDLEEAST Middle East
729
NORDICS Nordics
13,045
CUSA North America
118,380
NORTHAFRICA Northern Africa
92
NORTHERNEUROPE Northern Europe
15,225
SCANDINAVIA Scandinavia
11,475
SOUTHAMERICA South America
18,028
SOUTHASIA South Asia
857
SOUTHERNAFRICA Southern Africa
1,054
SOUTHERNCONE Southern Cone
363
SOUTHERNEUROPE Southern Europe
22,968
SUBSAHARA Sub-Saharan Africa
1,407
WESTAFRICA Western Africa
86
WESTASIA Western Asia
759
WESTERNEUROPE Western Europe
52,499
Browse Technology Groups