Log In · Signup for Free

EN DE FR ES IT Pусский 한국어 日本語简体中文 عربي

Semrush Bot Disallow Usage Statistics

Top 10k

Top 100k

Top 1m

All Internet

The website has disallow rules for Semrush Bot.

https://www.semrush.com/bot/

Semrush Bot Disallow Customers

Get access to data on 4,621,116 websites that are Semrush Bot Disallow Customers. We know of 2,113,718 live websites using Semrush Bot Disallow and an additional 2,507,398 sites that used Semrush Bot Disallow historically and 885,233 websites in the United States.

Download Lead List

Semrush Bot Disallow Awards

18th most popular in the United States in Robots.txt category.
8th most popular in the Top 100k sites in Robots.txt category.
9th most popular in the Top 1 Million sites in Robots.txt category.
16th most popular in the Top 10k sites in Robots.txt category.
3rd most popular in China in Robots.txt category.
3rd most popular in Russia in Robots.txt category.
3rd most popular in Ecuador in Robots.txt category.
3rd most popular in Iran in Robots.txt category.
4th most popular in Belarus in Robots.txt category.

Download Lead List

Get a list of 4,621,116 websites using Semrush Bot Disallow which includes location information, hosting data, contact details, 2,113,718 currently live websites and an additional 1,011,327 domains that redirect to sites in this list. 2,507,398 sites that used this technology previouslyand 885,233 websites in the United States currently using Semrush Bot Disallow.

Site Totals

Total Live: 2,113,718
1,011,327 additional website redirects^?.
USA Live Sites: 885,233
Live and Historical: 4,621,116

Top 1m: 3.51%
35,058
Top 100k: 6.38%
6,383
Top 10k: 7.57%
757

Countries

Financial

Group

African Union: 4,547
Arab League: 1,846
Asia-Pacific Economic Cooperation: 1,390,796
Assembly of European Regions: 548,346
Association of Caribbean State Members: 4,249
Association of Southeast Asian Nations: 13,473
Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation: 11,162
Caribbean Community Members: 295
Caribbean Free Trade Association: 226
Central American Integration System: 694
Central European Free Trade Agreement Members: 922
Club de Paris: 1,721,216
Commonwealth of Independent States Members: 335,139
Commonwealth of Nations: 91,347
Community of Portuguese Language Countries: 15,281
Council of Europe: 805,700
Development Assistance Committee: 1,413,243
East African Community: 513
Eastern Partnership: 407,823
EC Inner Six: 324,758
EC Outer Seven: 82,537
Economic Cooperation Organization: 10,039
Eurasian Economic Union: 334,523
Euronest Parliamentary Assembly: 407,205
European Economic Area: 408,379
European Free Trade Association: 13,236
European Union: 404,983
European Union, European Economic Area and Switzerland: 418,219
Federation of Euro-Asian Stock Exchanges: 17,222
G2 Nations: 964,715
G20 Nations: 1,734,785
G7 Nations: 1,267,962
Global Governance Group: 24,336
Group of 77: 129,265
GUAM Organization for Democracy and Economic Development: 2,179
Gulf Cooperation Council: 1,106
IBSA Dialogue Forum: 20,260
International Solar Alliance: 1,114,129
Interparliamentary Assembly on Orthodoxy: 371,867
Majority German-speaking states of Central Europe: 240,398
North Atlantic Treaty Organization: 1,345,736
Organisation for Economic Co-operation and Development: 1,425,904
Organisation of Eastern Caribbean States: 679
Organisation of Islamic Cooperation: 17,144
Organization of American States: 927,103
Organization of Ibero-American States: 39,913
Organization of the Black Sea Economic Cooperation: 346,645
Organization of the Petroleum Exporting Countries: 5,130
Organization of Turkic States: 5,756
Pacific Alliance: 4,881
Shanghai Cooperation Organisation: 419,845
South Asian Association for Regional Cooperation: 6,597
Southern African Development Community: 2,674
Southern Common Market: 14,569
Sovereign states and dependent territories of North America: 908,699
Union of South American Nations: 149
Visegrad Group: 29,078

Region

Browse Technology Groups