Log In · Signup for Free

EN DE FR ES IT Pусский 한국어 日本語简体中文 عربي

Semrush Bot Disallow Usage Statistics

Top 10k

Top 100k

Top 1m

All Internet

The website has disallow rules for Semrush Bot.

https://www.semrush.com/bot/

Semrush Bot Disallow Customers

Get access to data on 4,155,795 websites Semrush Bot Disallow Customers. We know of 2,441,149 live websites using Semrush Bot Disallow and an additional 1,714,646 sites that used Semrush Bot Disallow historically and 1,056,695 websites in the United States.

Download Lead List

Semrush Bot Disallow Awards

8th most popular in the Top 100k sites in Robots.txt category.
9th most popular in the Top 1 Million sites in Robots.txt category.
11th most popular in the Top 10k sites in Robots.txt category.
3rd most popular in China in Robots.txt category.
3rd most popular in Russia in Robots.txt category.
3rd most popular in Iran in Robots.txt category.
4th most popular in Belarus in Robots.txt category.
4th most popular in Rwanda in Robots.txt category.

Download Lead List

Get a list of 4,155,795 websites using Semrush Bot Disallow which includes location information, hosting data, contact details, 2,441,149 currently live websites and an additional 894,788 domains that redirect to sites in this list. 1,714,646 sites that used this technology previouslyand 1,056,695 websites in the United States currently using Semrush Bot Disallow.

Site Totals

Total Live: 2,441,149
894,788 additional website redirects^?.
United States Live Sites: 1,056,695
Live and Historical: 4,155,795

Top 1m: 3.02%
30,239
Top 100k: 5.74%
5,741
Top 10k: 6.74%
674

Countries

Financial

Group

African Union: 5,099
Arab League: 1,797
Asia-Pacific Economic Cooperation: 1,644,123
Assembly of European Regions: 656,748
Association of Caribbean State Members: 4,621
Association of Southeast Asian Nations: 21,969
Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation: 18,271
Caribbean Community Members: 264
Caribbean Free Trade Association: 204
Central American Integration System: 809
Central European Free Trade Agreement Members: 891
Club de Paris: 2,084,947
Commonwealth of Independent States Members: 441,577
Commonwealth of Nations: 95,793
Community of Portuguese Language Countries: 15,382
Council of Europe: 1,002,354
Development Assistance Committee: 1,677,029
East African Community: 514
Eastern Partnership: 500,474
EC Inner Six: 409,747
EC Outer Seven: 83,021
Economic Cooperation Organization: 10,498
Eurasian Economic Union: 440,996
Euronest Parliamentary Assembly: 499,732
European Economic Area: 500,949
European Free Trade Association: 11,875
European Union: 497,581
European Union, European Economic Area and Switzerland: 509,456
Federation of Euro-Asian Stock Exchanges: 18,705
G2 Nations: 1,096,234
G20 Nations: 2,056,120
G7 Nations: 1,523,644
Global Governance Group: 28,451
Group of 77: 101,895
GUAM Organization for Democracy and Economic Development: 2,137
Gulf Cooperation Council: 1,084
IBSA Dialogue Forum: 21,109
International Solar Alliance: 1,305,042
Interparliamentary Assembly on Orthodoxy: 484,051
Majority German-speaking states of Central Europe: 321,864
North Atlantic Treaty Organization: 1,609,787
Organisation for Economic Co-operation and Development: 1,694,730
Organisation of Eastern Caribbean States: 559
Organisation of Islamic Cooperation: 18,916
Organization of American States: 1,103,580
Organization of Ibero-American States: 41,540
Organization of the Black Sea Economic Cooperation: 453,366
Organization of the Petroleum Exporting Countries: 5,715
Organization of Turkic States: 5,690
Pacific Alliance: 9,817
Shanghai Cooperation Organisation: 486,684
South Asian Association for Regional Cooperation: 6,993
Southern African Development Community: 3,196
Southern Common Market: 14,693
Sovereign states and dependent territories of North America: 1,082,550
Union of South American Nations: 163
Visegrad Group: 34,807

Region

Browse Technology Groups