Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-08

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2025-08). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,473,137,802 1,464,950,780 27,946,832 26,732,241 54.96 58.66 58.91
ccTLD 1,147,198,922 1,141,447,080 19,256,549 18,222,869 42.83 40.42 40.16
sTLD 48,543,092 48,184,900 209,342 202,444 1.81 0.44 0.45
grTLD 6,792,700 6,762,363 148,846 143,812 0.25 0.31 0.32
IDN ccTLD 3,778,414 3,766,253 74,924 73,342 0.14 0.16 0.16
IDN gTLD 177,562 176,737 3,933 3,871 0.01 0.01 0.01
ARPA 2 2 2 2 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 1,156,722,891 1,150,193,214 22,699,396 21,706,326 43.15 47.65 47.83
org 145,195,390 144,441,836 1,909,470 1,803,021 5.42 4.01 3.97
ru 120,901,992 120,478,694 1,303,167 1,244,698 4.52 2.74 2.74
de 108,726,989 108,125,861 2,741,447 2,568,823 4.06 5.75 5.66
net 91,043,089 90,663,016 1,461,624 1,388,444 3.40 3.07 3.06
jp 59,604,047 59,363,889 851,816 806,444 2.23 1.79 1.78
uk 56,696,844 56,370,051 1,078,448 1,031,388 2.11 2.26 2.27
it 48,304,456 48,096,760 721,008 684,786 1.80 1.51 1.51
fr 45,465,614 45,239,587 831,312 800,190 1.70 1.74 1.76
pl 44,333,655 44,156,295 616,534 591,151 1.66 1.29 1.30
br 42,022,176 41,846,920 576,953 538,409 1.57 1.21 1.19
nl 39,000,139 38,777,927 965,839 914,993 1.45 2.03 2.02
edu 30,593,503 30,435,431 121,908 119,275 1.14 0.26 0.26
au 29,705,868 29,541,870 519,552 503,267 1.11 1.09 1.11
cz 26,970,501 26,762,737 388,860 365,887 1.00 0.82 0.81
cn 26,238,007 26,189,959 1,110,664 1,009,895 0.98 2.33 2.23
es 24,264,070 24,142,440 306,203 294,342 0.91 0.64 0.65
ca 23,727,502 23,586,337 428,437 412,695 0.88 0.90 0.91
eu 18,178,375 18,088,038 325,336 308,437 0.68 0.68 0.68
ua 17,985,528 17,677,665 111,945 108,358 0.66 0.23 0.24
in 17,241,905 17,172,313 285,167 272,025 0.64 0.60 0.60
ro 16,486,115 16,429,629 182,260 172,861 0.62 0.38 0.38
info 16,272,187 16,208,263 259,962 247,835 0.61 0.55 0.55
ch 15,476,308 15,392,290 416,055 390,400 0.58 0.87 0.86
se 15,407,793 15,317,096 286,491 274,275 0.57 0.60 0.60
gr 14,238,353 14,191,556 156,899 147,857 0.53 0.33 0.33
vn 13,836,640 13,788,811 141,951 136,257 0.52 0.30 0.30
be 13,523,418 13,442,551 318,498 299,894 0.50 0.67 0.66
hu 12,363,273 12,308,647 182,288 171,601 0.46 0.38 0.38
dk 12,144,309 12,048,057 239,405 229,648 0.45 0.50 0.51
co 11,865,744 11,747,347 214,881 209,924 0.44 0.45 0.46
id 11,450,352 11,410,298 152,773 148,233 0.43 0.32 0.33
gov 11,295,264 11,200,768 26,701 25,252 0.42 0.06 0.06
at 11,273,678 11,200,020 276,282 262,032 0.42 0.58 0.58
kr 11,149,340 11,118,518 199,491 170,901 0.42 0.42 0.38
ir 9,911,387 9,876,024 104,111 100,433 0.37 0.22 0.22
tw 9,877,102 9,821,200 113,898 103,634 0.37 0.24 0.23
sk 9,422,694 9,381,612 129,150 121,080 0.35 0.27 0.27
tr 9,284,542 9,243,139 120,008 110,003 0.35 0.25 0.24
ar 9,202,324 9,172,833 133,915 119,093 0.34 0.28 0.26
fi 8,913,025 8,857,008 147,207 140,994 0.33 0.31 0.31
no 8,194,800 8,141,221 140,751 134,668 0.31 0.30 0.30
mx 8,048,969 8,010,372 100,404 95,602 0.30 0.21 0.21
pt 8,046,257 8,008,263 98,712 92,539 0.30 0.21 0.20
io 7,299,894 7,232,653 217,105 214,608 0.27 0.46 0.47
nz 6,322,435 6,293,847 114,994 111,306 0.24 0.24 0.25
cl 6,287,393 6,266,465 91,579 87,785 0.24 0.19 0.19
za 6,275,877 6,251,933 126,591 121,876 0.23 0.27 0.27
shop 5,964,970 5,936,137 94,238 92,411 0.22 0.20 0.20
il 5,725,229 5,699,756 85,299 82,420 0.21 0.18 0.18
tv 5,111,033 5,081,391 41,522 39,527 0.19 0.09 0.09
by 4,972,390 4,945,221 47,025 45,216 0.19 0.10 0.10
us 4,875,035 4,846,944 105,066 101,464 0.18 0.22 0.22
me 4,776,577 4,715,135 96,302 94,506 0.18 0.20 0.21
hr 4,575,440 4,557,002 52,265 48,400 0.17 0.11 0.11
lt 4,522,909 4,498,881 65,995 62,090 0.17 0.14 0.14
ie 4,451,878 4,429,005 64,114 61,888 0.17 0.13 0.14
bg 4,209,388 4,194,581 33,440 31,526 0.16 0.07 0.07
cc 4,171,515 4,146,052 86,897 83,023 0.16 0.18 0.18
ee 4,012,179 3,987,391 49,437 44,593 0.15 0.10 0.10
rs 3,860,619 3,848,154 43,187 40,099 0.14 0.09 0.09
xyz 3,876,159 3,839,757 138,423 136,762 0.14 0.29 0.30
biz 3,841,761 3,827,153 88,833 85,157 0.14 0.19 0.19
online 3,814,995 3,794,629 91,798 90,378 0.14 0.19 0.20
si 3,705,723 3,685,440 52,806 48,859 0.14 0.11 0.11
kz 3,593,338 3,581,337 39,207 37,584 0.13 0.08 0.08
th 3,353,095 3,343,512 36,693 33,294 0.13 0.08 0.07
app 3,253,531 3,239,621 85,359 84,590 0.12 0.18 0.19
my 3,232,022 3,217,322 50,407 48,029 0.12 0.11 0.11
hk 3,215,388 3,192,618 38,166 34,155 0.12 0.08 0.08
cat 2,994,967 2,975,899 23,657 22,326 0.11 0.05 0.05
lv 2,845,879 2,832,940 33,601 30,828 0.11 0.07 0.07
pro 2,613,338 2,599,335 54,354 53,293 0.10 0.11 0.12
store 2,369,798 2,358,801 41,378 40,642 0.09 0.09 0.09
pe 2,329,638 2,320,591 25,700 24,552 0.09 0.05 0.05
pk 2,329,682 2,317,240 24,072 23,145 0.09 0.05 0.05
top 2,273,316 2,253,688 101,891 97,701 0.08 0.21 0.22
sg 2,260,164 2,248,166 37,864 36,172 0.08 0.08 0.08
news 2,149,021 2,141,776 8,769 8,064 0.08 0.02 0.02
su 2,014,124 2,007,200 21,876 20,917 0.08 0.05 0.05
ai 1,845,177 1,828,968 55,910 54,744 0.07 0.12 0.12
ae 1,798,507 1,787,098 25,545 24,569 0.07 0.05 0.05
fm 1,666,995 1,660,907 8,792 8,555 0.06 0.02 0.02
club 1,653,951 1,643,683 34,588 33,840 0.06 0.07 0.07
ph 1,596,295 1,590,726 19,277 18,451 0.06 0.04 0.04
is 1,576,969 1,569,965 18,298 17,322 0.06 0.04 0.04
ng 1,509,172 1,503,671 17,933 17,242 0.06 0.04 0.04
az 1,443,208 1,438,587 9,887 8,910 0.05 0.02 0.02
ba 1,369,341 1,362,137 11,798 10,922 0.05 0.02 0.02