Log In · Signup for Free

EN DE FR ES IT Pусский 한국어 日本語简体中文 عربي

Semrush Bot Disallow Usage Statistics

Top 10k

Top 100k

Top 1m

All Internet

The website has disallow rules for Semrush Bot.

https://www.semrush.com/bot/

Semrush Bot Disallow Customers

Get access to data on 3,400,642 websites Semrush Bot Disallow Customers. We know of 1,660,423 live websites using Semrush Bot Disallow and an additional 1,740,219 sites that used Semrush Bot Disallow historically and 859,368 websites in the United States.

Download Lead List

Semrush Bot Disallow Awards

18th most popular in the United States in Robots.txt category.
6th most popular in the Top 100k sites in Robots.txt category.
8th most popular in the Top 10k sites in Robots.txt category.
9th most popular in the Top 1 Million sites in Robots.txt category.
18th most popular on the Entire Internet in Robots.txt category.
3rd most popular in Iran in Robots.txt category.
4th most popular in China in Robots.txt category.
4th most popular in Thailand in Robots.txt category.
4th most popular in Benin in Robots.txt category.
5th most popular in Chile in Robots.txt category.

Download Lead List

Get a list of 3,400,642 websites using Semrush Bot Disallow which includes location information, hosting data, contact details, 1,660,423 currently live websites and an additional 659,303 domains that redirect to sites in this list. 1,740,219 sites that used this technology previouslyand 859,368 websites in the United States currently using Semrush Bot Disallow.

Site Totals

Total Live: 1,660,423
659,303 additional website redirects^?.
United States Live Sites: 859,368
Live and Historical: 3,400,642

Top 1m: 2.43%
24,265
Top 100k: 4.66%
4,657
Top 10k: 5.71%
571

Countries

Financial

Group

African Union: 3,349
Arab League: 1,418
Asia-Pacific Economic Cooperation: 1,124,948
Assembly of European Regions: 306,339
Association of Caribbean State Members: 3,472
Association of Southeast Asian Nations: 16,434
Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation: 13,522
Caribbean Community Members: 219
Caribbean Free Trade Association: 166
Central American Integration System: 438
Central European Free Trade Agreement Members: 631
Club de Paris: 1,401,879
Commonwealth of Independent States Members: 131,682
Commonwealth of Nations: 81,700
Community of Portuguese Language Countries: 10,304
Council of Europe: 516,425
Development Assistance Committee: 1,300,362
East African Community: 417
Eastern Partnership: 335,465
EC Inner Six: 264,922
EC Outer Seven: 66,424
Economic Cooperation Organization: 8,146
Eurasian Economic Union: 131,248
Euronest Parliamentary Assembly: 335,101
European Economic Area: 335,800
European Free Trade Association: 8,218
European Union: 333,243
European Union, European Economic Area and Switzerland: 341,461
Federation of Euro-Asian Stock Exchanges: 13,383
G2 Nations: 900,909
G20 Nations: 1,390,095
G7 Nations: 1,178,467
Global Governance Group: 22,324
Group of 77: 87,472
GUAM Organization for Democracy and Economic Development: 1,825
Gulf Cooperation Council: 852
IBSA Dialogue Forum: 13,739
International Solar Alliance: 1,064,703
Interparliamentary Assembly on Orthodoxy: 165,933
Majority German-speaking states of Central Europe: 188,747
North Atlantic Treaty Organization: 1,241,149
Organisation for Economic Co-operation and Development: 1,313,448
Organisation of Eastern Caribbean States: 362
Organisation of Islamic Cooperation: 13,896
Organization of American States: 897,040
Organization of Ibero-American States: 30,507
Organization of the Black Sea Economic Cooperation: 140,342
Organization of the Petroleum Exporting Countries: 4,840
Organization of Turkic States: 3,922
Pacific Alliance: 8,287
Shanghai Cooperation Organisation: 177,422
South Asian Association for Regional Cooperation: 5,107
Southern African Development Community: 1,839
Southern Common Market: 9,640
Sovereign states and dependent territories of North America: 881,877
Union of South American Nations: 122
Visegrad Group: 29,189

Region

Browse Technology Groups