Diffbot Disallow Usage Statistics

Diffbot Disallow

Diffbot uses AI to extract data from websites - this website blocks it.

https://diffbot.com

Robots.txt · AI Bot

Diffbot Disallow Customers

Get access to data on 288,373 websites that are Diffbot Disallow Customers. We know of 257,932 live websites using Diffbot Disallow and an additional 30,441 sites that used Diffbot Disallow historically and 108,217 websites in the United States.

Diffbot Disallow Awards
Diffbot Disallow Competitors and Similar

Get a list of 288,373 websites using Diffbot Disallow which includes location information, hosting data, contact details, 257,932 currently live websites and an additional 210,628 domains that redirect to sites in this list. 30,441 sites that used this technology previouslyand 108,217 websites in the United States currently using Diffbot Disallow.

Site Totals

Total Live
257,932
210,628 additional website redirects?.
USA Live Sites
108,217
Live and Historical
288,373
Top 1m
0.73%
7,265
Top 100k
2.07%
2,067
Top 10k
5.34%
534

Countries

United States
108,217
Brazil
19,817
Switzerland
15,227
Italy
14,248
United Kingdom
12,528
Germany
8,487
Spain
6,929
Sweden
6,467
Poland
5,418
Netherlands
3,971
France
3,596
Hungary
3,413
Denmark
3,379
South Korea
2,897
Canada
2,874
Slovakia
2,669
Austria
2,308
Ireland
1,627
Czech Republic
1,527
Australia
1,495
Finland
1,359
Norway
1,237
Greece
1,106
South Africa
972
BE Belgium
820
RU Russia
703
ID Indonesia
608
IN India
579
TW Taiwan
578
SI Slovenia
563
CN China
535
ME .me
514
LT Lithuania
488
MX Mexico
467
CO .co
344
IO .io
328
JP Japan
271
PT Portugal
257
NZ New Zealand
234
TR Turkey
221
CC Cocos Islands
206
AR Argentina
171
AE UAE
162
RO Romania
153
LI Liechtenstein
152
NU Niue
143
UA Ukraine
126
VN Vietnam
116
MY Malaysia
112
TV .tv
102
SG Singapore
97
AI Anguilla
91
TH Thailand
88
HK Hong Kong
87
CL Chile
78
SH Saint Helena
74
LU Luxembourg
73
BG Bulgaria
68
VE Venezuela
67
RS Serbia
61
PK Pakistan
56
PH Philippines
55
EE Estonia
55
RE Reunion
48
IR Iran
47
AX Åland Islands
47
HR Croatia
44
IS Iceland
44
NG Nigeria
42
PE Peru
40
KE Kenya
40
MA Morocco
38
IL Israel
38
CY Cyprus
35
UY Uruguay
33
LV Latvia
30
TO Tonga
30
IM Isle of Man
29
BD Bangladesh
24
EC Ecuador
21
GG Guernsey
21
AL Albania
20
SA Saudi Arabia
20
WS Samoa
19
NP Nepal
19
EG Egypt
18
PW Palau
18
CX Christmas Island
18
FM Micronesia
18
ET Ethiopia
18
CR Costa Rica
18
LK Sri Lanka
17
ST Sao Tome
17
AS American Samoa
16
MK Macedonia
15
MT Malta
15
LB Lebanon
15
MD Moldova
15
BA Bosnia
13
VC Saint Vincent
13
NA Namibia
12
PR Puerto Rico
11
BS Bahamas
11
BW Botswana
11
GT Guatemala
10
DO Dominican Republic
10
KZ Kazakhstan
9
UG Uganda
9
GP Guadeloupe
8
PA Panama
8
FO Faroe Islands
8
PY Paraguay
8
BY Belarus
8
GH Ghana
8
AM Armenia
7
PM Saint Pierre
7
TZ Tanzania
7
IQ Iraq
6
PS Palestine
6
VG British Virgin Islands
6
KG Kyrgyzstan
6
HT Haiti
6
MR Mauritania
6
BZ Belize
6
GE Georgia
6
SO Somalia
6
GL Greenland
6
QA Qatar
6
MN Mongolia
6
AG Antigua
6
DZ Algeria
6
BO Bolivia
6
BH Bahrain
5
MW Malawi
5
SV El Salvador
5
KW Kuwait
5
KH Cambodia
5
MU Mauritius
5

Financial

AMER AMER
131,412
ANZ ANZ
1,729
ANZUK ANZUK
14,257
APAC APAC
8,371
ASEAN3 ASEAN+3
4,788
ASEAN5 ASEAN+5
6,561
ASEAN6 ASEAN+6
7,096
FOURASIANTIGERS ASIAN TIGERS
3,616
AUKUS AUKUS
122,240
BASIC BASIC
21,903
BRIC BRIC
21,634
BRICS BRICS
22,606
CANZUK CANZUK
17,131
CIVETS CIVETS
1,956
CLMV CLMV
124
EMEA EMEA
101,212
FRIT FRIT
17,844
FRITES FRITES
24,773
IMEA IMEA
2,541
LATAM LATAM
20,813
LATCAR LATCAR
20,961
MART MART
2,665
MEA MEA
1,962
MENA MENA
649
MEP MEP
647
MIKTA MIKTA
5,688
MINT MINT
1,338
PIGS PIGS
22,540
SEA SEA
1,085
TIGERCUB Tiger Cub Economies
979
VISTA VISTA
2,088

Group

AFRICANUNION African Union
1,284
ARABLEAGUE Arab League
312
APEC Asia-Pacific Economic Cooperation
119,553
AER Assembly of European Regions
79,306
ACS Association of Caribbean State Members
666
ASEAN Association of Southeast Asian Nations
1,085
BIMSTEC Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
730
CARICOM Caribbean Community Members
55
CARIFTA Caribbean Free Trade Association
37
CAIS Central American Integration System
63
CEFTA Central European Free Trade Agreement Members
125
PARISCLUB Club de Paris
218,495
CIS Commonwealth of Independent States Members
754
COMMONWEALTH Commonwealth of Nations
19,299
CPLP Community of Portuguese Language Countries
20,094
COE Council of Europe
99,488
DAC Development Assistance Committee
213,241
EAC East African Community
61
EAP Eastern Partnership
69,269
INNERSIX EC Inner Six
31,195
OUTERSEVEN EC Outer Seven
41,403
ECO Economic Cooperation Organization
349
EAEU Eurasian Economic Union
733
EURONEST Euronest Parliamentary Assembly
69,259
EEA European Economic Area
70,538
EFTA European Free Trade Association
16,660
EU European Union
69,105
EUEEACH European Union, European Economic Area and Switzerland
85,765
FEAS Federation of Euro-Asian Stock Exchanges
2,427
G2 G2 Nations
108,752
G20 G20 Nations
178,706
G7 G7 Nations
150,221
3G Global Governance Group
18,385
G77 Group of 77
24,320
GUAM GUAM Organization for Democracy and Economic Development
149
GCC Gulf Cooperation Council
199
IBSA IBSA Dialogue Forum
21,368
ISA International Solar Alliance
173,218
IAO Interparliamentary Assembly on Orthodoxy
13,864
DACH Majority German-speaking states of Central Europe
26,022
NATO North Atlantic Treaty Organization
182,451
OECD Organisation for Economic Co-operation and Development
214,657
OECS Organisation of Eastern Caribbean States
130
OIC Organisation of Islamic Cooperation
1,501
OAS Organization of American States
131,930
OEI Organization of Ibero-American States
27,984
BSEC Organization of the Black Sea Economic Cooperation
2,427
OPEC Organization of the Petroleum Exporting Countries
360
TURKIC Organization of Turkic States
242
PACIFICALLIANCE Pacific Alliance
606
SCO Shanghai Cooperation Organisation
1,892
SAARC South Asian Association for Regional Cooperation
703
SADC Southern African Development Community
1,028
MERCOSUR Southern Common Market
20,029
NORAM Sovereign states and dependent territories of North America
111,805
USAN Union of South American Nations
77
V4 Visegrad Group
13,027

Region

AFRICA Africa
1,389
BALKANS Balkan States
2,265
BALTICS Baltic States
573
BENELUX Benelux Union
4,864
CENTRALAFRICA Central Africa
28
CENTRALAMERICA Central America
53
CENTRALASIA Central Asia
19
CENTRALEUROPE Central Europe
39,764
CHAPS CHAPS
15,335
EASTAFRICA East Africa
105
EASTASIA East Asia
4,374
EUROPE Europe
99,506
LEVANT Levant Narrow
321
MIDDLEEAST Middle East
591
NORDICS Nordics
12,548
CUSA North America
111,091
NORTHAFRICA Northern Africa
76
NORTHERNEUROPE Northern Europe
14,686
SCANDINAVIA Scandinavia
11,083
SOUTHAMERICA South America
20,276
SOUTHASIA South Asia
703
SOUTHERNAFRICA Southern Africa
998
SOUTHERNCONE Southern Cone
290
SOUTHERNEUROPE Southern Europe
23,275
SUBSAHARA Sub-Saharan Africa
1,311
WESTAFRICA Western Africa
68
WESTASIA Western Asia
606
WESTERNEUROPE Western Europe
48,792
Browse Technology Groups