Log In · Signup for Free

EN DE FR ES IT Pусский 한국어 日本語简体中文 عربي

Some Robots Disallow Usage Statistics

Top 10k

Top 100k

Top 1m

All Internet

Blocks some but not all robots from indexing the website.

https://robotstxt.org

Some Robots Disallow Customers

Get access to data on 60,830,604 websites that are Some Robots Disallow Customers. We know of 39,138,226 live websites using Some Robots Disallow and an additional 21,692,378 sites that used Some Robots Disallow historically and 596,988 websites in the United States.

Download Lead List

Some Robots Disallow Awards

3rd most popular on the Entire Internet in Robots.txt category.
4th most popular in the Top 10k sites in Robots.txt category.
4th most popular in the Top 100k sites in Robots.txt category.
7th most popular in the Top 1 Million sites in Robots.txt category.
The most popular in Philippines in Robots.txt category.
3rd most popular in South Korea in Robots.txt category.
3rd most popular in Andorra in Robots.txt category.
3rd most popular in Tajikistan in Robots.txt category.
4th most popular in Indonesia in Robots.txt category.

Download Lead List

Get a list of 60,830,604 websites using Some Robots Disallow which includes location information, hosting data, contact details, 39,138,226 currently live websites and an additional 1,058,844 domains that redirect to sites in this list. 21,692,378 sites that used this technology previouslyand 596,988 websites in the United States currently using Some Robots Disallow.

Site Totals

Total Live: 39,138,226
1,058,844 additional website redirects^?.
USA Live Sites: 596,988
Live and Historical: 60,830,604

Top 1m: 4.13%
41,316
Top 100k: 9.47%
9,473
Top 10k: 15.05%
1,505

Countries

Financial

Group

African Union: 78,650
Arab League: 5,480
Asia-Pacific Economic Cooperation: 1,007,110
Assembly of European Regions: 542,169
Association of Caribbean State Members: 71,210
Association of Southeast Asian Nations: 117,554
Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation: 49,207
Caribbean Community Members: 3,065
Caribbean Free Trade Association: 2,984
Central American Integration System: 1,567
Central European Free Trade Agreement Members: 25,934
Club de Paris: 1,582,826
Commonwealth of Independent States Members: 106,053
Commonwealth of Nations: 368,337
Community of Portuguese Language Countries: 32,128
Council of Europe: 898,634
Development Assistance Committee: 1,487,670
East African Community: 1,272
Eastern Partnership: 564,427
EC Inner Six: 442,897
EC Outer Seven: 229,998
Economic Cooperation Organization: 11,105
Eurasian Economic Union: 105,486
Euronest Parliamentary Assembly: 563,913
European Economic Area: 565,212
European Free Trade Association: 20,804
European Union: 560,408
European Union, European Economic Area and Switzerland: 581,212
Federation of Euro-Asian Stock Exchanges: 22,320
G2 Nations: 633,042
G20 Nations: 1,549,186
G7 Nations: 1,219,391
Global Governance Group: 152,215
Group of 77: 333,811
GUAM Organization for Democracy and Economic Development: 2,670
Gulf Cooperation Council: 2,523
IBSA Dialogue Forum: 80,694
International Solar Alliance: 1,187,940
Interparliamentary Assembly on Orthodoxy: 171,152
Majority German-speaking states of Central Europe: 354,229
North Atlantic Treaty Organization: 1,383,562
Organisation for Economic Co-operation and Development: 1,564,957
Organisation of Eastern Caribbean States: 33,360
Organisation of Islamic Cooperation: 39,141
Organization of American States: 743,960
Organization of Ibero-American States: 151,123
Organization of the Black Sea Economic Cooperation: 118,806
Organization of the Petroleum Exporting Countries: 8,667
Organization of Turkic States: 4,083
Pacific Alliance: 70,097
Shanghai Cooperation Organisation: 184,092
South Asian Association for Regional Cooperation: 45,492
Southern African Development Community: 11,792
Southern Common Market: 30,945
Sovereign states and dependent territories of North America: 680,117
Union of South American Nations: 539
Visegrad Group: 24,152

Region

Browse Technology Groups