Log In · Signup for Free

EN DE FR ES IT Pусский 한국어 日本語简体中文 عربي

Alexa Bot Disallow Usage Statistics

Top 10k

Top 100k

Top 1m

All Internet

The website has disallow rules for Alexa's ia_archiver bot.

https://support.alexa.com/hc/en-us/articles/200450194-Alexa-s-Web-and-Site-Audit-Crawlers

Robots.txt · AI Bot

Alexa Bot Disallow Customers

Get access to data on 10,600,083 websites that are Alexa Bot Disallow Customers. We know of 5,217,515 live websites using Alexa Bot Disallow and an additional 5,382,568 sites that used Alexa Bot Disallow historically and 2,289,738 websites in the United States.

Download Lead List

Alexa Bot Disallow Awards

8th most popular in the United States in AI Bot category.
The most popular on the Entire Internet in AI Bot category.
5th most popular in the Top 1 Million sites in AI Bot category.
11th most popular in the Top 100k sites in AI Bot category.
12th most popular in the Top 10k sites in AI Bot category.
The most popular in Cocos Islands in AI Bot category.
The most popular in .tv in AI Bot category.
The most popular in .io in AI Bot category.
The most popular in India in AI Bot category.
The most popular in Armenia in AI Bot category.
9th most popular in the United States in Robots.txt category.
12th most popular on the Entire Internet in Robots.txt category.
18th most popular in the Top 1 Million sites in Robots.txt category.
2nd most popular in Sint Maarten in Robots.txt category.
3rd most popular in Congo in Robots.txt category.
4th most popular in Ethiopia in Robots.txt category.
5th most popular in Thailand in Robots.txt category.
5th most popular in American Samoa in Robots.txt category.

Alexa Bot Disallow Competitors and Similar

GPTBot Disallow
4,075,441 live websites

Common Crawl Bot Disallow
3,838,613 live websites

Anthropic Claude Bot Disallow
3,714,262 live websites

Google Bard Disallow
3,559,411 live websites

Facebook Bot Disallow
3,430,596 live websites

Apple AI Bot Disallow
3,410,037 live websites

Cohere AI Disallow
3,328,080 live websites

Perplexity
3,285,151 live websites

AmazonBot Disallow
2,493,453 live websites

ByteDance Bytespider Disallow
752,357 live websites

Webz Omgili Disallow
396,357 live websites

Diffbot Disallow
272,325 live websites

YOU Disallow
168,669 live websites

Anthropic Claude User Bot Disallow
17,173 live websites

Download Lead List

Get a list of 10,600,083 websites using Alexa Bot Disallow which includes location information, hosting data, contact details, 5,217,515 currently live websites and an additional 552,421 domains that redirect to sites in this list. 5,382,568 sites that used this technology previouslyand 2,289,738 websites in the United States currently using Alexa Bot Disallow.

Site Totals

Total Live: 5,217,515
552,421 additional website redirects^?.
USA Live Sites: 2,289,738
Live and Historical: 10,600,083

Top 1m: 1.89%
18,867
Top 100k: 2.91%
2,914
Top 10k: 4.33%
433

Countries

Financial

Group

African Union: 17,904
Arab League: 3,771
Asia-Pacific Economic Cooperation: 2,623,646
Assembly of European Regions: 465,509
Association of Caribbean State Members: 11,549
Association of Southeast Asian Nations: 31,322
Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation: 51,342
Caribbean Community Members: 1,914
Caribbean Free Trade Association: 1,783
Central American Integration System: 1,449
Central European Free Trade Agreement Members: 1,523
Club de Paris: 3,336,022
Commonwealth of Independent States Members: 102,079
Commonwealth of Nations: 270,286
Community of Portuguese Language Countries: 14,126
Council of Europe: 1,017,222
Development Assistance Committee: 3,293,558
East African Community: 1,218
Eastern Partnership: 779,128
EC Inner Six: 618,564
EC Outer Seven: 158,889
Economic Cooperation Organization: 8,093
Eurasian Economic Union: 101,792
Euronest Parliamentary Assembly: 778,656
European Economic Area: 786,919
European Free Trade Association: 31,378
European Union: 775,526
European Union, European Economic Area and Switzerland: 806,904
Federation of Euro-Asian Stock Exchanges: 30,416
G2 Nations: 2,353,328
G20 Nations: 3,340,421
G7 Nations: 3,015,028
Global Governance Group: 54,529
Group of 77: 187,922
GUAM Organization for Democracy and Economic Development: 2,961
Gulf Cooperation Council: 2,230
IBSA Dialogue Forum: 63,931
International Solar Alliance: 2,736,434
Interparliamentary Assembly on Orthodoxy: 187,703
Majority German-speaking states of Central Europe: 519,273
North Atlantic Treaty Organization: 3,174,048
Organisation for Economic Co-operation and Development: 3,314,801
Organisation of Eastern Caribbean States: 3,812
Organisation of Islamic Cooperation: 31,124
Organization of American States: 2,349,503
Organization of Ibero-American States: 58,218
Organization of the Black Sea Economic Cooperation: 132,887
Organization of the Petroleum Exporting Countries: 3,722
Organization of Turkic States: 6,604
Pacific Alliance: 11,983
Shanghai Cooperation Organisation: 210,079
South Asian Association for Regional Cooperation: 46,359
Southern African Development Community: 9,924
Southern Common Market: 12,431
Sovereign states and dependent territories of North America: 2,336,374
Union of South American Nations: 418
Visegrad Group: 54,083

Region

Browse Technology Groups