Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-38

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2025-38). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,281,373,135 1,274,410,770 27,069,333 26,000,926 53.70 57.59 57.94
ccTLD 1,056,287,273 1,050,929,668 19,506,052 18,465,692 44.28 41.50 41.15
sTLD 37,861,997 37,618,754 197,300 190,649 1.59 0.42 0.42
grTLD 6,162,540 6,138,382 147,347 142,720 0.26 0.31 0.32
IDN ccTLD 4,028,726 4,018,396 76,011 74,516 0.17 0.16 0.17
IDN gTLD 192,886 192,352 4,261 4,196 0.01 0.01 0.01
ARPA 34 34 9 9 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 1,019,173,195 1,013,494,772 22,021,515 21,140,894 42.70 46.85 47.11
org 110,339,743 109,782,964 1,761,004 1,672,703 4.63 3.75 3.73
de 106,403,522 105,750,347 2,730,319 2,573,871 4.46 5.81 5.74
ru 106,163,841 105,737,912 1,196,441 1,146,161 4.46 2.55 2.55
net 75,480,867 75,170,859 1,389,021 1,325,989 3.17 2.96 2.95
jp 55,845,055 55,633,243 846,038 805,323 2.34 1.80 1.79
uk 52,339,206 52,059,099 1,140,922 1,089,128 2.19 2.43 2.43
fr 42,183,408 41,957,590 884,917 854,819 1.77 1.88 1.90
pl 38,164,309 38,018,390 629,166 601,748 1.60 1.34 1.34
it 37,925,267 37,759,930 662,860 627,974 1.59 1.41 1.40
nl 37,243,856 37,010,630 923,880 871,475 1.56 1.97 1.94
br 34,304,123 34,173,936 560,774 527,805 1.44 1.19 1.18
au 31,866,372 31,698,140 550,776 529,993 1.34 1.17 1.18
cn 28,981,507 28,934,187 1,428,009 1,306,843 1.22 3.04 2.91
cz 22,988,657 22,868,437 377,830 357,731 0.96 0.80 0.80
edu 22,563,773 22,441,575 113,567 111,112 0.95 0.24 0.25
ca 21,856,917 21,740,831 431,184 413,477 0.92 0.92 0.92
es 20,745,265 20,631,439 304,423 291,814 0.87 0.65 0.65
ua 18,528,559 18,187,379 114,098 110,555 0.77 0.24 0.25
eu 16,151,821 16,072,641 325,459 309,855 0.68 0.69 0.69
in 16,001,182 15,944,783 292,378 279,864 0.67 0.62 0.62
ch 15,366,452 15,271,426 418,646 394,479 0.64 0.89 0.88
ro 14,189,865 14,149,243 192,058 177,850 0.60 0.41 0.40
info 13,999,626 13,953,828 243,672 233,630 0.59 0.52 0.52
vn 13,728,401 13,680,159 143,806 137,588 0.58 0.31 0.31
be 13,549,637 13,472,096 312,122 294,648 0.57 0.66 0.66
se 13,454,265 13,380,552 287,815 275,193 0.56 0.61 0.61
gr 12,268,749 12,234,802 159,734 148,160 0.52 0.34 0.33
at 11,765,030 11,688,440 282,295 267,897 0.49 0.60 0.60
co 11,473,022 11,236,292 208,770 203,721 0.47 0.44 0.45
hu 11,166,524 11,123,424 178,327 167,642 0.47 0.38 0.37
dk 10,537,629 10,473,929 242,237 232,879 0.44 0.52 0.52
ir 10,287,235 10,263,647 99,822 96,497 0.43 0.21 0.22
id 10,219,420 10,194,250 156,121 151,004 0.43 0.33 0.34
tr 9,950,602 9,915,429 132,421 120,580 0.42 0.28 0.27
kr 9,836,890 9,813,249 196,570 169,797 0.41 0.42 0.38
gov 9,748,149 9,673,587 26,796 25,409 0.41 0.06 0.06
sk 9,028,529 8,981,203 128,997 121,655 0.38 0.27 0.27
ar 8,647,148 8,622,258 132,893 121,577 0.36 0.28 0.27
tw 8,024,594 7,993,920 113,572 103,430 0.34 0.24 0.23
no 7,837,893 7,795,220 143,171 137,032 0.33 0.30 0.31
fi 7,610,664 7,570,496 149,589 140,456 0.32 0.32 0.31
mx 7,360,185 7,328,595 104,155 99,723 0.31 0.22 0.22
pt 7,228,432 7,204,014 102,497 94,547 0.30 0.22 0.21
io 7,038,751 6,981,776 202,912 200,555 0.29 0.43 0.45
nz 6,029,402 5,996,258 117,190 112,952 0.25 0.25 0.25
za 6,002,949 5,980,884 136,350 129,804 0.25 0.29 0.29
cl 5,917,552 5,893,414 91,957 87,562 0.25 0.20 0.20
shop 5,171,141 5,149,273 92,279 90,707 0.22 0.20 0.20
il 5,151,876 5,134,876 87,399 83,114 0.22 0.19 0.19
by 5,104,616 5,090,162 47,576 45,492 0.21 0.10 0.10
tv 4,596,076 4,574,695 39,508 37,606 0.19 0.08 0.08
hr 4,258,573 4,242,291 54,798 49,866 0.18 0.12 0.11
us 4,260,856 4,241,318 96,803 93,425 0.18 0.21 0.21
me 4,205,518 4,183,053 87,402 85,672 0.18 0.19 0.19
cc 4,078,833 4,042,008 73,547 69,940 0.17 0.16 0.16
lt 4,052,605 4,034,217 64,961 61,304 0.17 0.14 0.14
ie 4,035,209 4,009,533 63,789 61,162 0.17 0.14 0.14
rs 3,773,688 3,763,419 42,320 39,177 0.16 0.09 0.09
bg 3,689,443 3,674,593 28,151 26,868 0.15 0.06 0.06
kz 3,568,914 3,558,674 31,676 30,548 0.15 0.07 0.07
online 3,450,930 3,436,739 96,841 95,563 0.14 0.21 0.21
biz 3,433,558 3,421,491 86,835 83,580 0.14 0.18 0.19
si 3,289,006 3,278,145 56,827 51,147 0.14 0.12 0.11
ee 3,251,188 3,237,688 46,263 41,897 0.14 0.10 0.09
top 3,042,347 3,031,760 95,840 93,846 0.13 0.20 0.21
th 2,843,287 2,833,988 35,775 32,139 0.12 0.08 0.07
hk 2,670,416 2,652,793 36,554 33,004 0.11 0.08 0.07
xyz 2,683,990 2,650,368 130,919 129,421 0.11 0.28 0.29
cat 2,652,502 2,635,559 24,389 22,995 0.11 0.05 0.05
my 2,586,381 2,575,601 49,905 47,111 0.11 0.11 0.10
lv 2,485,931 2,473,990 31,667 29,197 0.10 0.07 0.07
pro 2,434,552 2,423,203 55,229 54,130 0.10 0.12 0.12
pk 2,412,743 2,403,594 26,986 25,993 0.10 0.06 0.06
ai 2,358,403 2,335,329 69,020 67,592 0.10 0.15 0.15
store 2,212,789 2,201,740 46,769 46,150 0.09 0.10 0.10
pe 2,182,724 2,165,295 28,541 27,202 0.09 0.06 0.06
app 2,163,506 2,148,237 98,067 97,276 0.09 0.21 0.22
news 2,149,594 2,144,211 8,413 7,751 0.09 0.02 0.02
su 2,053,418 2,046,405 20,897 20,048 0.09 0.04 0.04
sg 2,026,653 2,014,799 33,552 31,730 0.08 0.07 0.07
ae 1,990,035 1,980,496 28,014 26,929 0.08 0.06 0.06
link 1,876,881 1,875,314 17,518 17,368 0.08 0.04 0.04
club 1,624,137 1,616,554 34,233 33,565 0.07 0.07 0.07
ng 1,552,976 1,548,709 19,884 18,518 0.07 0.04 0.04
is 1,477,291 1,470,094 18,604 17,622 0.06 0.04 0.04
ba 1,415,132 1,412,165 12,668 11,701 0.06 0.03 0.03
fm 1,413,095 1,410,663 8,347 8,115 0.06 0.02 0.02
az 1,367,524 1,363,999 9,708 8,831 0.06 0.02 0.02
ph 1,389,130 1,346,276 18,843 18,024 0.06 0.04 0.04
ge 1,251,500 1,248,548 13,620 12,522 0.05 0.03 0.03
uy 1,243,889 1,239,150 14,225 13,150 0.05 0.03 0.03
md 1,199,003 1,194,370 11,737 11,007 0.05 0.02 0.02
ma 1,191,826 1,187,331 14,890 14,086 0.05 0.03 0.03