Robots.txt Usage Distribution in Malaysia

Distribution for websites using Robots.txt technologies

8,493 Detections

of Robots.txt in Malaysia.

Ahrefs Bot Disallow Ahrefs Bot Disallow is currently the most popular technology in this category.

Top 1m
Top 1,000,000 sites by traffic
456,003
Top 100k
Top 100,000 sites by traffic
78,903
Top 10k
Top 10,000 sites by traffic
10,488
Entire Internet
75,546,548
United States
16,041,451
Germany
1,263,254
Russia
877,482
China
744,728
United Kingdom
681,393
Australia
370,956
Italy
319,839
Canada
287,169
France
265,340
Brazil
263,607
Netherlands
255,100
.co
203,004
Poland
157,896
India
149,437
Sweden
127,810
Spain
98,809
Denmark
93,929
Switzerland
91,808
.me
85,875
Belgium
76,863
New Zealand
58,778
Japan
50,941
Ukraine
50,692
Mali
49,059
Czech Republic
49,041
Austria
41,837
South Africa
38,168
Norway
33,297
South Korea
31,394
Cocos Islands
30,895
British Virgin Islands
30,737
.tv
30,135
Mexico
28,971
Finland
28,919
.io
28,004
Romania
26,560
Iran
26,484
Taiwan
25,368
Hong Kong
20,842
Hungary
19,972
Cameroon
19,143
Turkey
18,969
Vietnam
17,703
Ireland
17,689
Singapore
16,148
Belarus
16,118
Greece
16,109
Slovakia
16,087
Argentina
15,509
Indonesia
14,802
Niue
13,423
Israel
13,229
Palau
13,110
Portugal
13,050
Philippines
12,860
Chile
11,828
Kazakhstan
11,781
Malaysia
8,493
Thailand
8,245
Bulgaria
7,454
UAE
6,901
Samoa
6,790
Pakistan
6,425
Tonga
5,910
Slovenia
5,616
Latvia
5,292
Peru
5,271
Luxembourg
5,000
Lithuania
4,557
Uzbekistan
4,384
Iceland
4,330
Estonia
4,242
Serbia
3,858
Nigeria
2,903
Morocco
2,782
Liechtenstein
2,711
Isle of Man
2,655
Egypt
2,507
Croatia
2,415
Costa Rica
2,366
Saudi Arabia
2,328
Ecuador
2,240
Bangladesh
2,236
Kenya
2,142
Anguilla
2,121
Belize
2,091
Reunion
2,085
Dominican Republic
1,777
Uruguay
1,747
Armenia
1,658
Saint Helena
1,407
Moldova
1,362
Guernsey
1,359
Venezuela
1,343
Puerto Rico
1,316
Georgia
1,258
Micronesia
1,220
Guatemala
1,217
Sri Lanka
1,187
Cyprus
1,167
Lebanon
1,165
Panama
1,153
Saint Vincent and the Grenadines
1,097
Tunisia
1,061
Antigua and Barbuda
1,045
Qatar
1,017
Albania
985
Macedonia
952
Jordan
797
Sao Tome and Principe
794
Azerbaijan
793
Christmas Island
730
Kyrgyzstan
692
Malta
681
Mongolia
681
Bolivia
660
Nepal
656
Afghanistan
629
Seychelles
615
Somalia
606
Kuwait
579
Faroe Islands
578
Ghana
547
Montserrat
520
United States Virgin Islands
501
Cayman Islands
501
Trinidad and Tobago
473
Oman
469
Paraguay
465
Uganda
460
Honduras
447
Bosnia and Herzegovina
446
Tanzania
444
Greenland
421
Cambodia
421
El Salvador
416
Saint Pierre and Miquelon
413
Mayotte
401
Namibia
391
Mauritius
390
Bahamas
383
Jamaica
379
Palestine
364
Cote d'Ivoire
345
South Georgia and the South Sandwich Islands
332
Bahrain
326
Guyana
323
Jersey
317
Algeria
315
Gibraltar
314
Sint Maarten
289
Haiti
288
Bermuda
273
Tajikistan
270
Grenada
258
Nicaragua
256
Turks and Caicos Islands
250
Wallis and Futuna
250
Myanmar
247
Saint Lucia
246
Barbados
239
Zambia
223
Iraq
218
American Samoa
206
East Timor
178
Senegal
175
Ethiopia
168
Botswana
163
Madagascar
161
Burundi
157
New Caledonia
142
Cuba
141
Maldives
141
Congo
140
Rwanda
132
Angola
127
Zimbabwe
125
Norfolk Island
124
Guadeloupe
122
Yemen
114
Brunei
113
Andorra
107
Fiji
107
French Polynesia
105
Aruba
104
Monaco
99
Guam
93
Benin
93
Mozambique
92
Macao
90
Vanuatu
89
Papua New Guinea
83
Niger
79
Turkmenistan
76
Curacao
68
Malawi
68
Djibouti
63
Suriname
63
United States Minor Outlying Islands
58
Mauritania
56
Dominica
55
Cook Islands
51
Burkina Faso
48
Togo
40
Saint Kitts and Nevis
38
Sierra Leone
36
Sudan
34
French Guiana
32
Solomon Islands
30
San Marino
29
Heard Island and McDonald Islands
28
Martinique
28
Lao People's Democratic Republic
27
Northern Mariana Islands
17
Guinea-Bissau
15
Cabo Verde
12