Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-18

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2025-18). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,513,523,443 1,504,721,266 28,181,391 27,024,437 55.08 59.26 59.53
ccTLD 1,173,324,212 1,166,998,201 18,941,971 17,949,910 42.72 39.83 39.54
sTLD 49,904,759 49,528,787 206,881 200,172 1.81 0.44 0.44
grTLD 6,717,130 6,683,208 149,829 145,226 0.24 0.32 0.32
IDN ccTLD 3,607,849 3,595,185 71,658 70,195 0.13 0.15 0.15
IDN gTLD 178,546 178,044 3,852 3,784 0.01 0.01 0.01
ARPA 2 2 2 2 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 1,186,810,799 1,179,805,873 22,823,315 21,874,122 43.19 47.99 48.19
org 151,040,871 150,226,848 1,905,769 1,804,237 5.50 4.01 3.97
ru 115,552,826 115,065,287 1,224,861 1,170,353 4.21 2.58 2.58
de 112,752,445 112,080,069 2,671,133 2,508,300 4.10 5.62 5.53
net 92,480,514 92,079,619 1,450,902 1,383,196 3.37 3.05 3.05
uk 62,853,258 62,472,942 1,136,686 1,093,708 2.29 2.39 2.41
jp 60,765,420 60,527,672 805,746 765,978 2.22 1.69 1.69
it 49,253,981 49,038,366 711,094 675,757 1.80 1.50 1.49
pl 48,286,862 48,054,055 632,498 606,045 1.76 1.33 1.34
fr 47,158,207 46,900,998 832,897 802,650 1.72 1.75 1.77
br 42,957,580 42,769,572 586,661 548,851 1.57 1.23 1.21
nl 40,265,937 40,012,801 906,195 858,585 1.46 1.91 1.89
au 31,839,678 31,671,025 516,661 501,199 1.16 1.09 1.10
edu 31,708,940 31,510,990 119,964 117,377 1.15 0.25 0.26
cz 28,347,157 28,135,596 406,415 383,446 1.03 0.85 0.84
ca 25,359,629 25,194,072 423,490 408,391 0.92 0.89 0.90
es 25,330,385 25,188,018 304,698 293,462 0.92 0.64 0.65
cn 24,916,169 24,863,518 1,045,971 939,295 0.91 2.20 2.07
eu 18,704,155 18,607,674 327,957 311,837 0.68 0.69 0.69
ua 18,367,768 18,067,400 112,721 109,238 0.66 0.24 0.24
ro 17,128,334 17,059,201 181,278 172,106 0.62 0.38 0.38
in 16,894,842 16,825,332 276,204 263,560 0.62 0.58 0.58
info 16,339,393 16,274,696 274,799 263,581 0.60 0.58 0.58
ch 16,225,070 16,129,607 408,965 385,181 0.59 0.86 0.85
se 16,200,139 16,090,549 283,473 272,008 0.59 0.60 0.60
gr 14,059,973 14,011,221 147,937 139,695 0.51 0.31 0.31
vn 13,732,721 13,676,704 136,517 130,918 0.50 0.29 0.29
be 13,590,084 13,515,740 305,235 288,235 0.49 0.64 0.63
hu 12,760,530 12,702,419 177,299 167,154 0.46 0.37 0.37
dk 12,651,692 12,558,120 233,907 224,790 0.46 0.49 0.50
co 12,401,849 12,247,926 228,618 223,802 0.45 0.48 0.49
at 11,788,838 11,704,035 271,768 258,521 0.43 0.57 0.57
gov 11,552,271 11,447,944 27,224 25,810 0.42 0.06 0.06
kr 11,165,695 11,133,272 193,916 166,886 0.41 0.41 0.37
id 11,098,041 11,061,489 150,050 145,786 0.40 0.32 0.32
tw 10,020,628 9,958,894 111,875 102,139 0.36 0.24 0.23
sk 9,871,051 9,821,968 127,836 120,047 0.36 0.27 0.26
ir 9,794,744 9,760,792 100,729 97,208 0.36 0.21 0.21
fi 9,325,055 9,268,353 144,083 138,198 0.34 0.30 0.30
tr 9,063,670 9,025,161 122,376 111,911 0.33 0.26 0.25
no 8,548,614 8,493,526 138,789 132,908 0.31 0.29 0.29
ar 8,444,825 8,419,937 129,287 115,359 0.31 0.27 0.25
mx 8,280,643 8,238,617 101,826 97,029 0.30 0.21 0.21
pt 8,141,471 8,100,715 98,395 92,198 0.30 0.21 0.20
io 8,051,775 7,972,773 250,704 248,245 0.29 0.53 0.55
nz 6,425,569 6,390,175 113,930 110,456 0.23 0.24 0.24
za 6,279,030 6,252,142 118,553 114,295 0.23 0.25 0.25
cl 6,215,900 6,191,643 88,623 84,983 0.23 0.19 0.19
il 6,091,256 6,059,173 84,784 82,030 0.22 0.18 0.18
shop 5,977,187 5,949,161 112,491 110,883 0.22 0.24 0.24
tv 5,440,378 5,414,592 40,472 38,517 0.20 0.09 0.08
us 5,064,337 5,037,795 103,233 99,694 0.18 0.22 0.22
by 4,979,269 4,958,218 46,106 44,380 0.18 0.10 0.10
me 4,833,094 4,786,571 96,335 94,557 0.18 0.20 0.21
hr 4,718,850 4,698,685 51,855 48,064 0.17 0.11 0.11
lt 4,682,031 4,653,427 65,251 61,378 0.17 0.14 0.14
ie 4,573,866 4,547,543 62,975 60,853 0.17 0.13 0.13
app 4,229,290 4,212,043 111,032 110,225 0.15 0.23 0.24
bg 4,116,322 4,098,674 33,240 31,433 0.15 0.07 0.07
ee 4,080,354 4,061,316 48,336 43,689 0.15 0.10 0.10
rs 4,029,232 4,015,851 40,682 37,856 0.15 0.09 0.08
si 4,025,393 4,003,600 54,067 50,063 0.15 0.11 0.11
online 3,979,788 3,960,030 105,990 104,482 0.14 0.22 0.23
biz 3,839,804 3,821,169 91,458 88,170 0.14 0.19 0.19
cc 3,765,346 3,739,185 69,383 65,985 0.14 0.15 0.15
kz 3,739,516 3,724,087 38,254 36,674 0.14 0.08 0.08
th 3,492,411 3,479,910 34,881 31,557 0.13 0.07 0.07
xyz 3,344,189 3,318,302 141,498 139,623 0.12 0.30 0.31
my 3,324,410 3,306,121 49,750 47,537 0.12 0.10 0.10
hk 3,258,523 3,217,411 37,604 33,719 0.12 0.08 0.07
cat 2,998,861 2,983,294 23,714 22,401 0.11 0.05 0.05
lv 2,811,702 2,795,644 32,427 29,769 0.10 0.07 0.07
pro 2,541,059 2,527,364 52,834 51,801 0.09 0.11 0.11
store 2,361,797 2,342,246 50,489 49,848 0.09 0.11 0.11
top 2,332,189 2,314,317 105,375 102,676 0.08 0.22 0.23
pk 2,307,570 2,294,446 23,655 22,759 0.08 0.05 0.05
sg 2,224,080 2,210,428 33,524 32,068 0.08 0.07 0.07
news 2,195,760 2,185,995 8,688 7,995 0.08 0.02 0.02
pe 2,193,148 2,180,493 25,645 24,544 0.08 0.05 0.05
ai 2,022,630 2,002,731 60,568 59,338 0.07 0.13 0.13
su 1,981,541 1,966,678 21,426 20,534 0.07 0.05 0.05
link 1,809,589 1,806,766 18,833 18,680 0.07 0.04 0.04
ae 1,791,796 1,782,543 25,598 24,680 0.07 0.05 0.05
club 1,742,481 1,732,866 36,979 36,270 0.06 0.08 0.08
fm 1,712,097 1,708,445 8,962 8,741 0.06 0.02 0.02
ph 1,713,464 1,707,067 18,904 18,097 0.06 0.04 0.04
ng 1,577,219 1,571,208 17,127 16,501 0.06 0.04 0.04
is 1,538,412 1,531,664 18,253 17,335 0.06 0.04 0.04
az 1,485,681 1,481,374 9,716 8,794 0.05 0.02 0.02
nu 1,401,495 1,396,339 28,602 27,443 0.05 0.06 0.06
ba 1,380,061 1,370,988 11,755 10,936 0.05 0.02 0.02
ge 1,370,226 1,366,772 13,240 12,102 0.05 0.03 0.03