Diffbot Disallow Usage Statistics

Diffbot Disallow

Diffbot uses AI to extract data from websites - this website blocks it.

https://diffbot.com

Robots.txt · AI Bot

Diffbot Disallow Customers

Get access to data on 310,993 websites that are Diffbot Disallow Customers. We know of 272,325 live websites using Diffbot Disallow and an additional 38,668 sites that used Diffbot Disallow historically and 116,496 websites in the United States.

Diffbot Disallow Awards
Diffbot Disallow Competitors and Similar

Get a list of 310,993 websites using Diffbot Disallow which includes location information, hosting data, contact details, 272,325 currently live websites and an additional 216,536 domains that redirect to sites in this list. 38,668 sites that used this technology previouslyand 116,496 websites in the United States currently using Diffbot Disallow.

Site Totals

Total Live
272,325
216,536 additional website redirects?.
USA Live Sites
116,496
Live and Historical
310,993
Top 1m
0.77%
7,694
Top 100k
1.99%
1,986
Top 10k
3.87%
387

Countries

United States
116,496
Brazil
17,491
Switzerland
15,805
Italy
13,934
United Kingdom
13,225
Germany
11,261
Spain
7,197
Sweden
6,822
Poland
5,692
Netherlands
4,121
France
3,794
Denmark
3,520
Canada
3,142
Hungary
3,076
South Korea
2,953
Slovakia
2,769
Austria
2,516
Ireland
1,665
Czech Republic
1,636
Australia
1,613
Finland
1,475
Norway
1,274
Russia
1,228
Greece
1,178
ZA South Africa
1,044
BE Belgium
855
ID Indonesia
755
IN India
705
SI Slovenia
585
ME .me
575
CN China
565
MX Mexico
505
LT Lithuania
501
TW Taiwan
488
CO .co
397
IO .io
379
PT Portugal
336
JP Japan
305
NZ New Zealand
283
TR Turkey
280
CC Cocos Islands
256
AR Argentina
216
AE UAE
193
RO Romania
182
VN Vietnam
150
LI Liechtenstein
148
NU Niue
143
MY Malaysia
140
UA Ukraine
140
AI Anguilla
134
SG Singapore
119
TV .tv
110
CL Chile
106
TH Thailand
102
HK Hong Kong
100
VE Venezuela
91
LU Luxembourg
84
BG Bulgaria
81
SH Saint Helena
79
PK Pakistan
67
EE Estonia
66
RS Serbia
66
PH Philippines
62
KE Kenya
60
NG Nigeria
58
PE Peru
55
HR Croatia
54
AX Åland Islands
54
CY Cyprus
53
IR Iran
52
IL Israel
52
IS Iceland
48
RE Reunion
46
MA Morocco
41
UY Uruguay
36
BD Bangladesh
35
TO Tonga
35
LV Latvia
33
GG Guernsey
33
SA Saudi Arabia
31
IM Isle of Man
30
LK Sri Lanka
29
EG Egypt
26
NP Nepal
25
AL Albania
24
WS Samoa
21
CX Christmas Island
21
CR Costa Rica
21
LB Lebanon
20
FM Micronesia
19
MT Malta
19
EC Ecuador
18
PW Palau
18
MK Macedonia
17
BA Bosnia
16
ST Sao Tome
16
AS American Samoa
16
MD Moldova
16
VC Saint Vincent
15
PR Puerto Rico
14
GT Guatemala
14
NA Namibia
13
UG Uganda
12
GE Georgia
12
ET Ethiopia
12
DO Dominican Republic
12
AM Armenia
11
KG Kyrgyzstan
11
BS Bahamas
11
KZ Kazakhstan
10
PY Paraguay
10
TN Tunisia
10
BW Botswana
10
IQ Iraq
9
QA Qatar
9
BY Belarus
9
TZ Tanzania
9
KH Cambodia
9
BO Bolivia
9
GP Guadeloupe
8
PA Panama
8
VG British Virgin Islands
8
PM Saint Pierre
8
GL Greenland
8
AG Antigua
8
GH Ghana
8
MR Mauritania
7
BZ Belize
7
AZ Azerbaijan
7
BH Bahrain
6
SV El Salvador
6
FO Faroe Islands
6
CM Cameroon
6
HT Haiti
6
SO Somalia
6
AF Afghanistan
6
GD Grenada
5
KW Kuwait
5
MN Mongolia
5
UZ Uzbekistan
5
MV Maldives
5
SL Sierra Leone
5
MG Madagascar
5
MU Mauritius
5
DZ Algeria
5

Financial

AMER AMER
137,769
ANZ ANZ
1,896
ANZUK ANZUK
15,121
APAC APAC
9,066
ASEAN3 ASEAN+3
5,165
ASEAN5 ASEAN+5
7,201
ASEAN6 ASEAN+6
7,766
FOURASIANTIGERS ASIAN TIGERS
3,737
AUKUS AUKUS
131,334
BASIC BASIC
19,805
BRIC BRIC
19,989
BRICS BRICS
21,033
CANZUK CANZUK
18,263
CIVETS CIVETS
2,282
CLMV CLMV
163
EMEA EMEA
107,760
FRIT FRIT
17,728
FRITES FRITES
24,925
IMEA IMEA
2,950
LATAM LATAM
18,665
LATCAR LATCAR
18,870
MART MART
3,473
MEA MEA
2,245
MENA MENA
815
MEP MEP
815
MIKTA MIKTA
6,106
MINT MINT
1,598
PIGS PIGS
22,645
SEA SEA
1,342
TIGERCUB Tiger Cub Economies
1,209
VISTA VISTA
2,445

Group

AFRICANUNION African Union
1,421
ARABLEAGUE Arab League
383
APEC Asia-Pacific Economic Cooperation
129,168
AER Assembly of European Regions
82,251
ACS Association of Caribbean State Members
758
ASEAN Association of Southeast Asian Nations
1,342
BIMSTEC Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
899
CARICOM Caribbean Community Members
67
CARIFTA Caribbean Free Trade Association
48
CAIS Central American Integration System
75
CEFTA Central European Free Trade Agreement Members
140
PARISCLUB Club de Paris
230,744
CIS Commonwealth of Independent States Members
1,297
COMMONWEALTH Commonwealth of Nations
20,795
CPLP Community of Portuguese Language Countries
17,846
COE Council of Europe
105,828
DAC Development Assistance Committee
227,660
EAC East African Community
88
EAP Eastern Partnership
73,700
INNERSIX EC Inner Six
34,049
OUTERSEVEN EC Outer Seven
43,498
ECO Economic Cooperation Organization
438
EAEU Eurasian Economic Union
1,269
EURONEST Euronest Parliamentary Assembly
73,684
EEA European Economic Area
74,975
EFTA European Free Trade Association
17,275
EU European Union
73,505
EUEEACH European Union, European Economic Area and Switzerland
90,780
FEAS Federation of Euro-Asian Stock Exchanges
2,679
G2 G2 Nations
117,061
G20 G20 Nations
189,543
G7 G7 Nations
162,157
3G Global Governance Group
19,337
G77 Group of 77
22,797
GUAM GUAM Organization for Democracy and Economic Development
175
GCC Gulf Cooperation Council
245
IBSA IBSA Dialogue Forum
19,240
ISA International Solar Alliance
180,803
IAO Interparliamentary Assembly on Orthodoxy
15,183
DACH Majority German-speaking states of Central Europe
29,582
NATO North Atlantic Treaty Organization
195,462
OECD Organisation for Economic Co-operation and Development
229,251
OECS Organisation of Eastern Caribbean States
184
OIC Organisation of Islamic Cooperation
1,876
OAS Organization of American States
138,335
OEI Organization of Ibero-American States
26,182
BSEC Organization of the Black Sea Economic Cooperation
3,159
OPEC Organization of the Petroleum Exporting Countries
449
TURKIC Organization of Turkic States
313
PACIFICALLIANCE Pacific Alliance
693
SCO Shanghai Cooperation Organisation
2,591
SAARC South Asian Association for Regional Cooperation
872
SADC Southern African Development Community
1,102
MERCOSUR Southern Common Market
17,753
NORAM Sovereign states and dependent territories of North America
120,467
USAN Union of South American Nations
105
V4 Visegrad Group
13,173

Region

AFRICA Africa
1,523
BALKANS Balkan States
2,484
BALTICS Baltic States
600
BENELUX Benelux Union
5,060
CENTRALAFRICA Central Africa
31
CENTRALAMERICA Central America
63
CENTRALASIA Central Asia
26
CENTRALEUROPE Central Europe
43,488
CHAPS CHAPS
15,689
EASTAFRICA East Africa
128
EASTASIA East Asia
4,416
EUROPE Europe
105,848
LEVANT Levant Narrow
416
MIDDLEEAST Middle East
748
NORDICS Nordics
13,208
CUSA North America
119,638
NORTHAFRICA Northern Africa
93
NORTHERNEUROPE Northern Europe
15,404
SCANDINAVIA Scandinavia
11,616
SOUTHAMERICA South America
18,076
SOUTHASIA South Asia
872
SOUTHERNAFRICA Southern Africa
1,070
SOUTHERNCONE Southern Cone
368
SOUTHERNEUROPE Southern Europe
23,429
SUBSAHARA Sub-Saharan Africa
1,429
WESTAFRICA Western Africa
87
WESTASIA Western Asia
778
WESTERNEUROPE Western Europe
53,477
Browse Technology Groups