Semrush Bot Disallow Usage Statistics

Semrush Bot Disallow

The website has disallow rules for Semrush Bot.

https://www.semrush.com/bot/

Robots.txt

Semrush Bot Disallow Customers

Get access to data on 3,221,193 websites Semrush Bot Disallow Customers. We know of 1,720,678 live websites using Semrush Bot Disallow and an additional 1,500,515 sites that used Semrush Bot Disallow historically and 985,918 websites in the United States.

Get a list of 3,221,193 websites using Semrush Bot Disallow which includes location information, hosting data, contact details, 1,720,678 currently live websites and an additional 730,683 domains that redirect to sites in this list. 1,500,515 sites that used this technology previouslyand 985,918 websites in the United States currently using Semrush Bot Disallow.

Site Totals

Total Live
1,720,678
730,683 additional website redirects?.
United States Live Sites
985,918
Live and Historical
3,221,193
Top 1m
2.66%
26,575
Top 100k
4.6%
4,595
Top 10k
5.79%
579

Countries

United States
985,918
Russia
142,007
China
50,920
Germany
45,828
United Kingdom
42,936
France
29,696
Japan
29,435
Netherlands
28,516
Italy
28,003
Canada
21,215
Australia
13,100
Poland
12,480
Spain
10,289
Sweden
10,109
Czech Republic
9,194
Thailand
8,976
Brazil
8,720
Switzerland
6,129
Chile
5,810
Hungary
5,650
.co
5,464
India
5,322
.me
5,235
Iran
4,843
BE Belgium
4,685
DK Denmark
4,339
SK Slovakia
4,326
KR South Korea
4,316
ID Indonesia
3,972
TR Turkey
3,284
VN Vietnam
3,252
CC Cocos Islands
3,031
TW Taiwan
2,909
MX Mexico
2,901
AT Austria
2,776
NO Norway
2,684
PT Portugal
2,494
NZ New Zealand
2,413
GR Greece
2,296
RO Romania
2,082
FI Finland
1,991
ZA South Africa
1,825
UA Ukraine
1,696
AR Argentina
1,462
HK Hong Kong
1,356
IO .io
1,341
BG Bulgaria
1,117
IE Ireland
905
SG Singapore
904
TV .tv
787
NU Niue
763
AE UAE
666
LU Luxembourg
663
KZ Kazakhstan
656
EE Estonia
649
SI Slovenia
633
IL Israel
620
MY Malaysia
595
PK Pakistan
538
LT Lithuania
465
LV Latvia
437
PH Philippines
398
BY Belarus
394
PE Peru
382
UZ Uzbekistan
363
NG Nigeria
340
HR Croatia
319
RS Serbia
317
RE Reunion
251
AI Anguilla
238
UY Uruguay
199
BD Bangladesh
177
KE Kenya
168
AL Albania
159
LK Sri Lanka
146
PW Palau
142
LB Lebanon
138
MA Morocco
135
EG Egypt
134
IS Iceland
132
EC Ecuador
131
SA Saudi Arabia
125
DO Dominican Republic
116
RW Rwanda
113
CR Costa Rica
112
NP Nepal
96
MT Malta
94
QA Qatar
87
GH Ghana
84
GE Georgia
83
WS Samoa
82
CY Cyprus
82
LI Liechtenstein
81
FM Micronesia
80
MK Macedonia
79
AM Armenia
75
GT Guatemala
73
GG Guernsey
71
VE Venezuela
71
PR Puerto Rico
70
UG Uganda
70
IM Isle of Man
69
BJ Benin
68
SH Saint Helena
65
TO Tonga
63
PA Panama
61
TZ Tanzania
61
MD Moldova
59
TN Tunisia
58
AF Afghanistan
57
BO Bolivia
56
GP Guadeloupe
55
PY Paraguay
54
BA Bosnia
54
BZ Belize
49
NC New Caledonia
49
VC Saint Vincent
48
AZ Azerbaijan
45
SC Seychelles
44
SO Somalia
43
DZ Algeria
42
JO Jordan
39
KW Kuwait
39
CX Christmas Island
38
MU Mauritius
38
MN Mongolia
35
OM Oman
35
BS Bahamas
33
ZM Zambia
32
CM Cameroon
31
VI Virgin Islands
30
BH Bahrain
30
KG Kyrgyzstan
29
KH Cambodia
29
SV El Salvador
27
SN Senegal
27
ZW Zimbabwe
27
GI Gibraltar
27
ET Ethiopia
25
HN Honduras
25
AD Andorra
24
ST Sao Tome
23
MZ Mozambique
23
NA Namibia
21
MM Myanmar
20
CD Congo
20
MQ Martinique
20
BM Bermuda
19
BF Burkina Faso
19
MG Madagascar
18
MC Monaco
17
AS American Samoa
17
AO Angola
17
BB Barbados
16
CI Cote d'Ivoire
16
PS Palestine
16
IQ Iraq
16
AG Antigua
16
PM Saint Pierre
15
AW Aruba
15
KY Cayman Islands
14
NI Nicaragua
14
PF French Polynesia
14
TT Trinidad
13
BT Bhutan
13
YT Mayotte
13
SM San Marino
12
TJ Tajikistan
12
JM Jamaica
11
MV Maldives
11
VG British Virgin Islands
11
BW Botswana
11
GM Gambia
10
MW Malawi
10
SR Suriname
10
MS Montserrat
9
GD Grenada
9
YE Yemen
9
GS South Georgia
8
HT Haiti
7
GY Guyana
7
MR Mauritania
7
TM Turkmenistan
7
JE Jersey
6
GL Greenland
6
LC Saint Lucia
6
BI Burundi
6
LR Liberia
6
GF French Guiana
6
SX Sint Maarten
5
CU Cuba
5
DJ Djibouti
5
GU Guam
5
SL Sierra Leone
5

Financial

AMER AMER
1,024,694
ANZ ANZ
15,513
ANZUK ANZUK
58,449
APAC APAC
133,312
ASEAN3 ASEAN+3
102,820
ASEAN5 ASEAN+5
72,735
ASEAN6 ASEAN+6
123,655
FOURASIANTIGERS ASIAN TIGERS
57,496
AUKUS AUKUS
1,041,954
BASIC BASIC
66,787
BRIC BRIC
206,969
BRICS BRICS
208,794
CANZUK CANZUK
79,664
CIVETS CIVETS
12,752
CLMV CLMV
3,302
EMEA EMEA
421,654
FRIT FRIT
57,699
FRITES FRITES
67,988
IMEA IMEA
19,296
LATAM LATAM
20,662
LATCAR LATCAR
21,192
MART MART
155,981
MEA MEA
13,974
MENA MENA
10,413
MEP MEP
10,705
MIKTA MIKTA
27,573
MINT MINT
10,497
PIGS PIGS
43,082
SEA SEA
18,152
TIGERCUB Tiger Cub Economies
17,193
VISTA VISTA
13,795

Group

AFRICANUNION African Union
3,876
ARABLEAGUE Arab League
1,628
APEC Asia-Pacific Economic Cooperation
1,280,784
AER Assembly of European Regions
331,943
ACS Association of Caribbean State Members
3,920
ASEAN Association of Southeast Asian Nations
18,149
BIMSTEC Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
14,750
CARICOM Caribbean Community Members
239
CARIFTA Caribbean Free Trade Association
189
CAIS Central American Integration System
477
CEFTA Central European Free Trade Agreement Members
675
PARISCLUB Club de Paris
1,424,217
CIS Commonwealth of Independent States Members
143,640
COMMONWEALTH Commonwealth of Nations
90,799
CPLP Community of Portuguese Language Countries
11,284
COE Council of Europe
409,995
DAC Development Assistance Committee
1,313,151
EAC East African Community
440
EAP Eastern Partnership
212,470
INNERSIX EC Inner Six
137,391
OUTERSEVEN EC Outer Seven
71,467
ECO Economic Cooperation Organization
9,834
EAEU Eurasian Economic Union
143,161
EURONEST Euronest Parliamentary Assembly
212,031
EEA European Economic Area
213,015
EFTA European Free Trade Association
9,026
EU European Union
210,118
EUEEACH European Union, European Economic Area and Switzerland
219,144
FEAS Federation of Euro-Asian Stock Exchanges
15,252
G2 G2 Nations
1,036,838
G20 G20 Nations
1,420,985
G7 G7 Nations
1,183,031
3G Global Governance Group
24,764
G77 Group of 77
103,264
GUAM GUAM Organization for Democracy and Economic Development
1,883
GCC Gulf Cooperation Council
982
IBSA IBSA Dialogue Forum
15,867
ISA International Solar Alliance
1,207,833
IAO Interparliamentary Assembly on Orthodoxy
180,569
DACH Majority German-speaking states of Central Europe
54,733
NATO North Atlantic Treaty Organization
1,250,572
OECD Organisation for Economic Co-operation and Development
1,327,714
OECS Organisation of Eastern Caribbean States
417
OIC Organisation of Islamic Cooperation
17,021
OAS Organization of American States
1,027,862
OEI Organization of Ibero-American States
33,381
BSEC Organization of the Black Sea Economic Cooperation
152,903
OPEC Organization of the Petroleum Exporting Countries
6,164
TURKIC Organization of Turkic States
4,377
PACIFICALLIANCE Pacific Alliance
9,378
SCO Shanghai Cooperation Organisation
199,847
SAARC South Asian Association for Regional Cooperation
6,360
SADC Southern African Development Community
2,151
MERCOSUR Southern Common Market
10,435
NORAM Sovereign states and dependent territories of North America
1,011,189
USAN Union of South American Nations
144
V4 Visegrad Group
31,650

Region

AFRICA Africa
3,941
BALKANS Balkan States
10,347
BALTICS Baltic States
1,551
BENELUX Benelux Union
33,864
CENTRALAFRICA Central Africa
213
CENTRALAMERICA Central America
361
CENTRALASIA Central Asia
1,067
CENTRALEUROPE Central Europe
87,097
CHAPS CHAPS
34,426
EASTAFRICA East Africa
687
EASTASIA East Asia
88,974
EUROPE Europe
411,046
LEVANT Levant Narrow
4,183
MIDDLEEAST Middle East
10,167
NORDICS Nordics
19,268
CUSA North America
1,007,133
NORTHAFRICA Northern Africa
380
NORTHERNEUROPE Northern Europe
21,711
SCANDINAVIA Scandinavia
17,132
SOUTHAMERICA South America
17,261
SOUTHASIA South Asia
6,360
SOUTHERNAFRICA Southern Africa
1,861
SOUTHERNCONE Southern Cone
7,525
SOUTHERNEUROPE Southern Europe
44,804
SUBSAHARA Sub-Saharan Africa
3,523
WESTAFRICA Western Africa
599
WESTASIA Western Asia
10,370
WESTERNEUROPE Western Europe
162,256
Browse Technology Groups