Log In · Signup for Free

EN DE FR ES IT Pусский 한국어 日本語简体中文 عربي

Semrush Bot Disallow Usage Statistics

Top 10k

Top 100k

Top 1m

All Internet

The website has disallow rules for Semrush Bot.

https://www.semrush.com/bot/

Semrush Bot Disallow Customers

Get access to data on 4,559,876 websites that are Semrush Bot Disallow Customers. We know of 2,137,525 live websites using Semrush Bot Disallow and an additional 2,422,351 sites that used Semrush Bot Disallow historically and 911,130 websites in the United States.

Download Lead List

Semrush Bot Disallow Awards

19th most popular in the United States in Robots.txt category.
8th most popular in the Top 100k sites in Robots.txt category.
9th most popular in the Top 1 Million sites in Robots.txt category.
13th most popular in the Top 10k sites in Robots.txt category.
3rd most popular in Russia in Robots.txt category.
3rd most popular in Ecuador in Robots.txt category.
4th most popular in China in Robots.txt category.
4th most popular in Belarus in Robots.txt category.
4th most popular in Kazakhstan in Robots.txt category.

Download Lead List

Get a list of 4,559,876 websites using Semrush Bot Disallow which includes location information, hosting data, contact details, 2,137,525 currently live websites and an additional 1,017,267 domains that redirect to sites in this list. 2,422,351 sites that used this technology previouslyand 911,130 websites in the United States currently using Semrush Bot Disallow.

Site Totals

Total Live: 2,137,525
1,017,267 additional website redirects^?.
USA Live Sites: 911,130
Live and Historical: 4,559,876

Top 1m: 3.48%
34,786
Top 100k: 6.3%
6,303
Top 10k: 7.53%
753

Countries

Financial

Group

African Union: 5,386
Arab League: 2,071
Asia-Pacific Economic Cooperation: 1,438,475
Assembly of European Regions: 554,381
Association of Caribbean State Members: 4,438
Association of Southeast Asian Nations: 13,804
Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation: 11,729
Caribbean Community Members: 315
Caribbean Free Trade Association: 237
Central American Integration System: 704
Central European Free Trade Agreement Members: 946
Club de Paris: 1,731,398
Commonwealth of Independent States Members: 340,672
Commonwealth of Nations: 94,152
Community of Portuguese Language Countries: 15,970
Council of Europe: 789,305
Development Assistance Committee: 1,417,520
East African Community: 572
Eastern Partnership: 386,208
EC Inner Six: 302,750
EC Outer Seven: 81,502
Economic Cooperation Organization: 9,614
Eurasian Economic Union: 340,071
Euronest Parliamentary Assembly: 385,599
European Economic Area: 386,716
European Free Trade Association: 12,657
European Union: 383,360
European Union, European Economic Area and Switzerland: 396,017
Federation of Euro-Asian Stock Exchanges: 17,014
G2 Nations: 1,005,248
G20 Nations: 1,762,256
G7 Nations: 1,273,012
Global Governance Group: 24,579
Group of 77: 146,907
GUAM Organization for Democracy and Economic Development: 2,200
Gulf Cooperation Council: 1,253
IBSA Dialogue Forum: 21,439
International Solar Alliance: 1,143,542
Interparliamentary Assembly on Orthodoxy: 377,570
Majority German-speaking states of Central Europe: 216,597
North Atlantic Treaty Organization: 1,351,288
Organisation for Economic Co-operation and Development: 1,430,559
Organisation of Eastern Caribbean States: 718
Organisation of Islamic Cooperation: 18,266
Organization of American States: 954,799
Organization of Ibero-American States: 42,154
Organization of the Black Sea Economic Cooperation: 352,455
Organization of the Petroleum Exporting Countries: 5,361
Organization of Turkic States: 5,776
Pacific Alliance: 5,249
Shanghai Cooperation Organisation: 440,881
South Asian Association for Regional Cooperation: 7,568
Southern African Development Community: 2,639
Southern Common Market: 15,391
Sovereign states and dependent territories of North America: 935,157
Union of South American Nations: 188
Visegrad Group: 29,016

Region

Browse Technology Groups