Log In
·
Signup for Free
EN
DE
FR
ES
IT
Pусский
한국어
日本語
简体中文
عربي
Tools
Web Technology Trends
Keyword Lists
eCommerce Lists
Top Sites
Technology Investor
LeadsDiscovery
LeadsEye
API Access
Datasets
Browser Extensions
CRM Integrations
Features
Lead Generation
Market Analysis
Sales Intelligence
Future Customers
Global Data Coverage
Cyber Risk Auditing
Alternative Financial Data
Report Filtering
Use Cases
All Features
Screencast Demo
Plans
Customers
Resources
Screencast Demo
Knowledge Base
Exportable Fields
FAQ
About Us
Contact Us
Blog
Lookup
Home
Trends
Robots.txt
Robots.txt Usage Distribution
Distribution for websites using Robots.txt technologies
Explain Chart
Top In Robots.txt Usage Distribution
Technology
Websites
%
0 Detections
of Robots.txt . Last updated 10th Apr 2024.
Top 1m
Top 1,000,000 sites by traffic
557,316
Top 100k
Top 100,000 sites by traffic
88,276
Top 10k
Top 10,000 sites by traffic
11,414
Entire Internet
126,050,042
United States
36,389,334
Germany
5,566,385
United Kingdom
4,674,497
Russia
1,900,299
Australia
1,881,820
Italy
1,694,859
Canada
1,643,494
.co
1,087,847
India
1,035,242
Brazil
1,003,485
France
989,041
Japan
859,964
Netherlands
673,108
Switzerland
596,574
Spain
585,189
China
548,824
.io
433,516
.me
422,226
Poland
417,645
Belgium
314,169
Sweden
298,402
New Zealand
274,165
Mexico
268,600
Austria
238,212
Czech Republic
232,010
Cocos Islands
215,520
Norway
213,879
Denmark
208,550
Turkey
207,545
South Africa
201,569
South Korea
195,754
Romania
188,826
Philippines
158,580
Ireland
156,243
.tv
146,523
Finland
137,654
Indonesia
137,193
Taiwan
107,145
Portugal
103,553
Singapore
102,239
Thailand
94,564
Chile
93,385
Argentina
86,687
Hong Kong
85,290
Vietnam
82,374
Ukraine
80,786
Hungary
78,087
Israel
72,746
Greece
68,819
British Virgin Islands
66,881
UAE
57,308
Malaysia
56,782
Slovakia
55,866
Samoa
46,459
Anguilla
39,337
Luxembourg
39,258
Pakistan
32,320
Cameroon
31,985
Iran
31,937
Bulgaria
30,144
Saudi Arabia
29,280
Lithuania
27,811
Peru
27,549
Latvia
24,512
Estonia
24,057
Slovenia
21,604
Palau
20,298
Iceland
19,689
Croatia
17,201
Nigeria
15,749
Serbia
15,589
Niue
15,408
Belarus
14,183
Uruguay
13,346
Costa Rica
13,048
Puerto Rico
13,047
Ecuador
12,642
Kenya
11,883
Bangladesh
11,469
Guernsey
10,471
Isle of Man
10,088
Kazakhstan
9,890
Liechtenstein
9,234
Morocco
8,817
Egypt
8,806
Tonga
8,635
Reunion
8,478
Malta
8,142
Dominican Republic
7,733
Guatemala
7,376
Saint Helena
6,871
Belize
6,793
Sri Lanka
6,740
Georgia
6,560
Panama
6,048
Venezuela
5,846
Ghana
5,659
Qatar
5,540
Uganda
5,511
Lebanon
5,331
Saint Vincent and the Grenadines
5,280
Armenia
5,225
Somalia
4,945
Cyprus
4,894
Albania
4,796
Micronesia
4,716
Uzbekistan
4,480
Kuwait
4,356
Nepal
4,180
Jordan
3,916
Macedonia
3,825
Moldova
3,074
Honduras
3,051
Tanzania
2,895
Tunisia
2,877
Paraguay
2,814
Cayman Islands
2,576
Oman
2,510
Mauritius
2,433
Christmas Island
2,393
Namibia
2,319
Martinique
2,317
Bolivia
2,278
Azerbaijan
2,277
Antigua and Barbuda
2,211
Monaco
2,186
Bahrain
2,082
Zimbabwe
2,077
Saint Lucia
2,051
Afghanistan
2,040
Bahamas
2,034
Montserrat
1,963
Algeria
1,887
El Salvador
1,879
Sao Tome and Principe
1,868
Bosnia and Herzegovina
1,773
Guadeloupe
1,707
Cambodia
1,652
United States Virgin Islands
1,648
Zambia
1,641
Rwanda
1,634
Mongolia
1,630
Seychelles
1,560
Bermuda
1,535
Iraq
1,414
Cote d'Ivoire
1,348
New Caledonia
1,304
Nicaragua
1,236
Maldives
1,174
Sint Maarten
1,145
Saint Pierre and Miquelon
1,101
Mozambique
1,088
Congo
1,076
Trinidad and Tobago
1,053
Ethiopia
1,038
Gibraltar
1,027
Kyrgyzstan
1,026
American Samoa
935
Jamaica
922
Myanmar
922
Fiji
775
Greenland
766
Andorra
751
Turks and Caicos Islands
696
Madagascar
688
Senegal
675
Jersey
639
French Guiana
621
Mayotte
614
Angola
601
Faroe Islands
599
Togo
581
Grenada
550
Wallis and Futuna
549
Palestine
540
Benin
535
Barbados
533
Botswana
522
Haiti
516
Guyana
494
South Georgia and the South Sandwich Islands
478
Malawi
476
Gambia
453
Aruba
435
Burkina Faso
343
Niger
326
Yemen
319
Bhutan
298
Tajikistan
295
Mali
291
Heard Island and McDonald Islands
284
Cuba
260
Suriname
247
Solomon Islands
233
East Timor
228
Liberia
220
Sudan
219
Burundi
210
Djibouti
204
Turkmenistan
200
Brunei
190
Guam
182
Vanuatu
168
Syria
162
San Marino
160
Cook Islands
154
French Polynesia
153
Lesotho
147
Saint Kitts and Nevis
142
Papua New Guinea
138
Sierra Leone
134
Åland Islands
102
Northern Mariana Islands
102
Mauritania
93
Gabon
92
Lao People's Democratic Republic
91
Dominica
88
Norfolk Island
82
United States Minor Outlying Islands
75
Swaziland
73
Libya
67
Curacao
66
Marshall Islands
53
Macao
51
Congo
43
Guinea-Bissau
41
Vatican City
37
South Sudan
35
Cabo Verde
33
Guinea
30
Chad
30
Svalbard and Jan Mayen
25
Kiribati
16
Pitcairn
15
Falkland Islands
13
Equatorial Guinea
13
Antarctica
11
us
de
gb
ru
au
it
ca
DotCo
in
br
fr
jp
nl
ch
es
cn