Common Crawl Bot Disallow Estadísticas de uso

Common Crawl Bot Disallow

Bloquear un sitio para que no sea rastreado por Common Crawl Crawler.

https://commoncrawl.org/

Archivo robots.txt · Bot de IA

Common Crawl Bot Disallow Clientes

Obtenga acceso a los datos sobre 4.796.720 sitios web que son Common Crawl Bot Disallow Clientes. Sabemos de 3.722.656 sitios web en vivo usando Common Crawl Bot Disallow y un adicional 1.074.064 sitios que utilizaron Common Crawl Bot Disallow históricamente y 2.568.345 sitios web en Estados Unidos.

Common Crawl Bot Disallow Competidores y similares

Obtenga una lista de 4.796.720 sitios web que utilizan Common Crawl Bot Disallow que incluye información de ubicación, datos de alojamiento, detalles de contacto, 3.722.656 sitios web actualmente activos y un adicional 1.819.486 dominios que redireccionan a sitios de esta lista. 1.074.064 sitios que utilizaron esta tecnología anteriormentey 2.568.345 sitios web en Estados Unidos Actualmente usando Common Crawl Bot Disallow.

Totales del sitio

Total en vivo
3.722.656
1.819.486 redirecciones de sitios web adicionales?.
EE.UU Sitios en vivo
2.568.345
Vivo e histórico
4.796.720
Arriba 1m
2,53%
25.309
Arriba 100k
5,85%
5.850
Arriba 10k
10,11%
1.011

Países

Estados Unidos
2.568.345
Reino Unido
187.895
Australia
136.171
Canadá
101.358
Alemania
58.628
España
43.044
Rusia
42.564
Suiza
35.107
Italia
28.904
Francia
27.882
Países Bajos
27.378
Nueva Zelanda
26.080
Brasil
23.253
.co
22.286
Suecia
21.057
Noruega
13.659
Dinamarca
13.464
Bélgica
12.468
Irlanda
11.628
Japón
10.162
Polonia
9.844
Austria
9.829
.a mí
9.621
Finlandia
9.108
MX México
7.733
KR Corea del Sur
5.598
ZA Sudáfrica
5.417
IN India
5.252
HU Hungría
5.226
PT Portugal
5.040
SG Singapur
4.908
IO .io
4.857
CZ República Checa
4.430
SK Eslovaquia
3.969
CN Porcelana
3.778
GR Grecia
3.644
SA Arabia Saudita
2.856
ID Indonesia
2.766
HK Hong Kong
2.739
TW Taiwán
2.718
RO Rumania
2.632
TH Tailandia
2.553
AI Anguila
2.175
AE Emiratos Árabes Unidos
2.092
AR Argentina
1.859
TR Pavo
1.428
IS Islandia
1.395
SI Eslovenia
1.329
CC Islas Cocos
1.324
TV .televisor
1.322
VN Vietnam
1.268
CL Chile
1.248
MY Malasia
1.236
PH Filipinas
1.182
IR Irán
1.138
UA Ucrania
1.055
IM Isla de Man
1.040
LT Lituania
997
CR Costa Rica
974
IL Israel
902
EE Estonia
821
LU Luxemburgo
779
PR Puerto Rico
662
CY Chipre
662
PE Perú
652
BG Bulgaria
648
LV Letonia
611
HR Croacia
581
EC Ecuador
538
KE Kenia
472
LB Líbano
470
GT Guatemala
467
MT Malta
452
LI Liechtenstein
382
RS Serbia
353
DO República Dominicana
347
UY Uruguay
322
NU Niue
306
PA Panamá
298
MA Marruecos
279
EG Egipto
278
VC San Vicente y las Granadinas
277
PK Pakistán
275
NG Nigeria
273
VE Venezuela
269
BY Bielorrusia
258
GG Guernsey
253
AL Albania
249
RW Ruanda
219
KW Kuwait
206
TZ Tanzania
199
JE Jersey
195
KZ Kazajstán
193
KY Islas Caimán
189
GH Ghana
189
BM islas Bermudas
189
LK Sri Lanka
184
BS Bahamas
183
QA Katar
172
JO Jordán
170
FM Micronesia
162
UG Uganda
162
HN Honduras
155
BD Bangladés
149
VI Islas Vírgenes de los Estados Unidos
141
RE Reunión
133
TT Trinidad y Tobago
131
KH Camboya
129
GE Georgia
126
SH Santa Elena
121
BZ Belice
118
BH Bahréin
117
SV El Salvador
115
BB Barbados
115
MC Mónaco
114
NP Nepal
113
BA Bosnia y Herzegovina
100
JM Jamaica
99
MU Mauricio
97
AM Armenia
91
ET Etiopía
89
NI Nicaragua
88
NA Namibia
87
OM Omán
84
WS Samoa
82
FO Islas Feroe
80
ZM Zambia
75
AX Islas Åland
73
AG Antigua y Barbuda
72
FJ Fiyi
72
PW Palaos
67
TC Islas Turcas y Caicos
67
PY Paraguay
65
MD Moldavia
65
MV Maldivas
62
MM Birmania
62
MK macedonia
61
BO Bolivia
61
TO Tonga
60
ZW Zimbabue
60
SN Senegal
57
SC Seychelles
57
TN Túnez
56
MZ Mozambique
55
GP Guadalupe
54
AS Samoa Americana
52
HT Haití
50
MN Mongolia
50
GI Gibraltar
49
BW Botsuana
48
GL Tierra Verde
48
CD Congo
47
AF Afganistán
44
CI Costa de Marfil
43
AD Andorra
41
DZ Argelia
41
CX Isla de Navidad
39
ST Santo Tomé y Príncipe
39
AO Angola
37
SO Somalia
36
GU Guam
35
PG Papúa Nueva Guinea
35
PS Palestina
34
MG Madagascar
34
AZ Azerbaiyán
33
MW Malaui
33
AW Aruba
31
VG Islas Vírgenes Británicas
31
IQ Irak
31
MQ Martinica
30
CM Camerún
30
UZ Uzbekistán
29
GY Guayana
29
VU Vanuatu
27
CU Cuba
25
BN Brunéi
25
LR Liberia
23
CK Islas Cook
23
GD Granada
22
SL Sierra Leona
22
GM Gambia
21
LC Santa Lucía
20
LA República Democrática Popular Lao
19
SR Surinam
18
MS Montserrat
18
ML Malí
16
PM San Pedro y Miquelón
15
CW Curazao
14
PF Polinesia Francesa
13
SD Sudán
12
SZ Suazilandia
12
GS Islas Georgias del Sur y Sandwich del Sur
11
TL Timor Oriental
11
LY Libia
11
GA Gabón
11
SB Islas Salomón
10
MO Macao
10
SJ Svalbard y Jan Mayen
10
MP Islas Marianas del Norte
9
KG Kirguistán
9
DJ Yibuti
9
BI Burundi
9
GF Guayana Francesa
9
DM Dominica
9
KN San Cristóbal y Nieves
9
BF Burkina Faso
9
SM San Marino
9
SY Siria
9
MR Mauritania
8
TG Ir
8
TJ Tayikistán
8
BJ Benín
8
YT Mayotte
7
BT Bután
7
YE Yemen
6
LS Lesoto
6
WF Wallis y Futuna
6
NC Nueva Caledonia
6
SX San Martín
5
KI Kiribati
5
UM Islas menores alejadas de los Estados Unidos
5
FK Islas Malvinas
5

Financial

AMER AMER
2.700.927
ANZ ANZ
162.251
ANZUK ANZUK
350.146
APAC APAC
209.909
ASEAN3 ASEAN+3
33.686
ASEAN5 ASEAN+5
197.411
ASEAN6 ASEAN+6
201.189
FOURASIANTIGERS ASIAN TIGERS
17.023
AUKUS AUKUS
2.892.411
BASIC BASIC
37.700
BRIC BRIC
74.847
BRICS BRICS
80.264
CANZUK CANZUK
451.504
CIVETS CIVETS
11.721
CLMV CLMV
1.478
EMEA EMEA
607.523
FRIT FRIT
56.786
FRITES FRITES
99.830
IMEA IMEA
24.605
LATAM LATAM
39.841
LATCAR LATCAR
43.564
MART MART
61.917
MEA MEA
19.353
MENA MENA
11.062
MEP MEP
10.930
MIKTA MIKTA
153.696
MINT MINT
12.200
PIGS PIGS
80.632
SEA SEA
14.159
TIGERCUB Tiger Cub Economies
9.005
VISTA VISTA
12.738

Group

AFRICANUNION African Union
9.228
ARABLEAGUE Arab League
6.968
APEC Asia-Pacific Economic Cooperation
2.923.119
AER Assembly of European Regions
502.785
ACS Association of Caribbean State Members
12.187
ASEAN Association of Southeast Asian Nations
14.148
BIMSTEC Bay of Bengal Initiative for Multi-Sectoral Technical and Economic Cooperation
8.320
CARICOM Caribbean Community Members
1.170
CARIFTA Caribbean Free Trade Association
919
CAIS Central American Integration System
2.562
CEFTA Central European Free Trade Agreement Members
865
PARISCLUB Club de Paris
3.388.404
CIS Commonwealth of Independent States Members
43.250
COMMONWEALTH Commonwealth of Nations
473.569
CPLP Community of Portuguese Language Countries
28.441
COE Council of Europe
589.808
DAC Development Assistance Committee
3.383.421
EAC East African Community
1.112
EAP Eastern Partnership
306.683
INNERSIX EC Inner Six
156.039
OUTERSEVEN EC Outer Seven
286.051
ECO Economic Cooperation Organization
3.159
EAEU Eurasian Economic Union
43.115
EURONEST Euronest Parliamentary Assembly
306.392
EEA European Economic Area
320.491
EFTA European Free Trade Association
50.543
EU European Union
305.055
EUEEACH European Union, European Economic Area and Switzerland
355.598
FEAS Federation of Euro-Asian Stock Exchanges
16.134
G2 G2 Nations
2.572.123
G20 G20 Nations
3.221.849
G7 G7 Nations
2.983.174
3G Global Governance Group
88.822
G77 Group of 77
73.123
GUAM GUAM Organization for Democracy and Economic Development
1.279
GCC Gulf Cooperation Council
5.527
IBSA IBSA Dialogue Forum
33.922
ISA International Solar Alliance
3.084.853
IAO Interparliamentary Assembly on Orthodoxy
82.346
DACH Majority German-speaking states of Central Europe
103.564
NATO North Atlantic Treaty Organization
3.126.735
OECD Organisation for Economic Co-operation and Development
3.398.699
OECS Organisation of Eastern Caribbean States
2.717
OIC Organisation of Islamic Cooperation
15.384
OAS Organization of American States
2.709.863
OEI Organization of Ibero-American States
87.820
BSEC Organization of the Black Sea Economic Cooperation
52.535
OPEC Organization of the Petroleum Exporting Countries
6.968
TURKIC Organization of Turkic States
1.692
PACIFICALLIANCE Pacific Alliance
10.197
SCO Shanghai Cooperation Organisation
52.108
SAARC South Asian Association for Regional Cooperation
6.086
SADC Southern African Development Community
6.264
MERCOSUR Southern Common Market
25.499
NORAM Sovereign states and dependent territories of North America
2.684.679
USAN Union of South American Nations
377
V4 Visegrad Group
23.469

Region

AFRICA Africa
8.976
BALKANS Balkan States
11.062
BALTICS Baltic States
2.429
BENELUX Benelux Union
40.625
CENTRALAFRICA Central Africa
396
CENTRALAMERICA Central America
2.215
CENTRALASIA Central Asia
241
CENTRALEUROPE Central Europe
128.744
CHAPS CHAPS
33.298
EASTAFRICA East Africa
1.623
EASTASIA East Asia
25.055
EUROPE Europe
590.260
LEVANT Levant Narrow
3.675
MIDDLEEAST Middle East
10.655
NORDICS Nordics
58.894
CUSA North America
2.669.703
NORTHAFRICA Northern Africa
685
NORTHERNEUROPE Northern Europe
72.740
SCANDINAVIA Scandinavia
48.180
SOUTHAMERICA South America
29.307
SOUTHASIA South Asia
6.086
SOUTHERNAFRICA Southern Africa
5.570
SOUTHERNCONE Southern Cone
3.494
SOUTHERNEUROPE Southern Europe
83.882
SUBSAHARA Sub-Saharan Africa
8.259
WESTAFRICA Western Africa
688
WESTASIA Western Asia
10.905
WESTERNEUROPE Western Europe
372.131
Explorar grupos de tecnología