Log In · Signup for Free

EN DE FR ES IT Pусский 한국어 日本語简体中文 عربي

Semrush Bot Disallow Usage Statistics

Top 10k

Top 100k

Top 1m

All Internet

The website has disallow rules for Semrush Bot.

https://www.semrush.com/bot/

Semrush Bot Disallow Customers

Get access to data on 4,588,760 websites that are Semrush Bot Disallow Customers. We know of 2,026,465 live websites using Semrush Bot Disallow and an additional 2,562,295 sites that used Semrush Bot Disallow historically and 860,373 websites in the United States.

Download Lead List

Semrush Bot Disallow Awards

18th most popular in the United States in Robots.txt category.
8th most popular in the Top 100k sites in Robots.txt category.
9th most popular in the Top 1 Million sites in Robots.txt category.
13th most popular in the Top 10k sites in Robots.txt category.
3rd most popular in Russia in Robots.txt category.
3rd most popular in Ecuador in Robots.txt category.
4th most popular in China in Robots.txt category.
4th most popular in Belarus in Robots.txt category.
4th most popular in Kazakhstan in Robots.txt category.

Download Lead List

Get a list of 4,588,760 websites using Semrush Bot Disallow which includes location information, hosting data, contact details, 2,026,465 currently live websites and an additional 970,093 domains that redirect to sites in this list. 2,562,295 sites that used this technology previouslyand 860,373 websites in the United States currently using Semrush Bot Disallow.

Site Totals

Total Live: 2,026,465
970,093 additional website redirects^?.
USA Live Sites: 860,373
Live and Historical: 4,588,760

Top 1m: 3.42%
34,212
Top 100k: 6.19%
6,191
Top 10k: 7.4%
740

Countries

Financial

Group

African Union: 4,354
Arab League: 1,800
Asia-Pacific Economic Cooperation: 1,361,196
Assembly of European Regions: 538,934
Association of Caribbean State Members: 4,158
Association of Southeast Asian Nations: 12,932
Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation: 10,685
Caribbean Community Members: 293
Caribbean Free Trade Association: 221
Central American Integration System: 676
Central European Free Trade Agreement Members: 890
Club de Paris: 1,660,635
Commonwealth of Independent States Members: 333,189
Commonwealth of Nations: 88,634
Community of Portuguese Language Countries: 14,951
Council of Europe: 771,013
Development Assistance Committee: 1,353,679
East African Community: 519
Eastern Partnership: 377,624
EC Inner Six: 297,645
EC Outer Seven: 78,433
Economic Cooperation Organization: 9,247
Eurasian Economic Union: 332,599
Euronest Parliamentary Assembly: 377,028
European Economic Area: 378,159
European Free Trade Association: 12,243
European Union: 374,904
European Union, European Economic Area and Switzerland: 387,147
Federation of Euro-Asian Stock Exchanges: 16,390
G2 Nations: 939,714
G20 Nations: 1,678,061
G7 Nations: 1,214,497
Global Governance Group: 23,222
Group of 77: 127,586
GUAM Organization for Democracy and Economic Development: 2,081
Gulf Cooperation Council: 1,068
IBSA Dialogue Forum: 19,711
International Solar Alliance: 1,082,581
Interparliamentary Assembly on Orthodoxy: 368,848
Majority German-speaking states of Central Europe: 214,279
North Atlantic Treaty Organization: 1,289,619
Organisation for Economic Co-operation and Development: 1,366,100
Organisation of Eastern Caribbean States: 646
Organisation of Islamic Cooperation: 16,368
Organization of American States: 901,375
Organization of Ibero-American States: 39,536
Organization of the Black Sea Economic Cooperation: 344,419
Organization of the Petroleum Exporting Countries: 4,470
Organization of Turkic States: 5,564
Pacific Alliance: 4,852
Shanghai Cooperation Organisation: 417,730
South Asian Association for Regional Cooperation: 6,555
Southern African Development Community: 2,484
Southern Common Market: 14,318
Sovereign states and dependent territories of North America: 883,016
Union of South American Nations: 148
Visegrad Group: 28,092

Region

Browse Technology Groups