Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-05

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2025-05). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,666,447,688 1,657,342,498 28,747,354 27,504,058 54.97 58.84 59.11
ccTLD 1,303,652,013 1,296,910,094 19,669,177 18,599,816 43.02 40.26 39.97
sTLD 48,888,102 48,546,576 212,356 205,244 1.61 0.43 0.44
grTLD 7,655,893 7,618,498 150,343 145,171 0.25 0.31 0.31
IDN ccTLD 4,315,655 4,302,901 74,823 73,245 0.14 0.15 0.16
IDN gTLD 205,682 205,218 3,994 3,927 0.01 0.01 0.01
ARPA 3 3 3 3 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 1,313,263,813 1,305,938,972 23,403,367 22,386,196 43.32 47.90 48.11
org 161,767,497 160,931,667 1,981,886 1,872,419 5.34 4.06 4.02
ru 135,378,310 134,921,344 1,322,643 1,262,608 4.48 2.71 2.71
de 125,626,030 124,874,454 2,825,917 2,643,011 4.14 5.78 5.68
net 99,881,110 99,469,347 1,430,126 1,358,122 3.30 2.93 2.92
jp 67,588,316 67,321,741 857,709 811,917 2.23 1.76 1.74
uk 67,519,163 67,134,331 1,104,944 1,055,834 2.23 2.26 2.27
it 55,021,480 54,731,439 731,395 693,560 1.82 1.50 1.49
fr 54,227,995 53,972,401 883,897 850,068 1.79 1.81 1.83
pl 51,101,876 50,894,479 646,237 618,822 1.69 1.32 1.33
br 47,230,526 47,041,532 575,958 538,560 1.56 1.18 1.16
nl 47,065,302 46,804,833 980,091 928,876 1.55 2.01 2.00
au 34,685,082 34,514,375 522,162 505,791 1.14 1.07 1.09
cz 30,449,771 30,219,661 392,292 368,748 1.00 0.80 0.79
edu 30,272,669 30,123,566 122,444 119,798 1.00 0.25 0.26
es 28,315,502 28,178,485 328,422 315,505 0.93 0.67 0.68
ca 27,525,937 27,364,849 436,993 420,894 0.91 0.89 0.90
cn 26,114,936 26,057,760 1,115,591 1,011,785 0.86 2.28 2.17
eu 20,916,021 20,721,848 338,825 320,777 0.69 0.69 0.69
ua 20,415,018 20,079,317 118,367 114,467 0.67 0.24 0.25
in 19,456,254 19,376,251 283,889 270,588 0.64 0.58 0.58
info 18,724,688 18,652,428 266,767 254,120 0.62 0.55 0.55
ro 18,312,548 18,199,437 180,191 170,910 0.60 0.37 0.37
ch 18,173,914 18,065,554 430,671 403,656 0.60 0.88 0.87
se 17,717,150 17,613,479 292,166 279,266 0.58 0.60 0.60
be 16,161,647 16,077,797 330,172 310,448 0.53 0.68 0.67
gr 15,874,927 15,825,077 158,722 149,511 0.52 0.32 0.32
vn 15,043,338 14,986,440 139,573 133,933 0.50 0.29 0.29
dk 14,315,397 14,202,852 249,106 238,809 0.47 0.51 0.51
hu 13,973,163 13,918,275 188,355 177,089 0.46 0.39 0.38
co 13,398,193 13,280,441 219,130 214,090 0.44 0.45 0.46
at 12,898,950 12,815,734 283,024 267,996 0.43 0.58 0.58
id 12,576,032 12,531,821 153,156 148,763 0.42 0.31 0.32
gov 11,443,818 11,351,977 27,128 25,665 0.38 0.06 0.06
kr 11,293,364 11,263,062 199,163 170,368 0.37 0.41 0.37
tr 11,092,532 11,042,749 126,690 115,789 0.37 0.26 0.25
ir 11,049,793 11,016,755 105,148 101,395 0.37 0.22 0.22
tw 10,696,143 10,634,431 116,190 105,423 0.35 0.24 0.23
sk 10,656,684 10,609,135 131,838 123,726 0.35 0.27 0.27
fi 10,367,715 10,306,334 150,013 143,645 0.34 0.31 0.31
ar 9,907,812 9,877,691 133,462 119,064 0.33 0.27 0.26
no 9,539,085 9,475,061 143,787 137,402 0.31 0.29 0.30
mx 8,978,730 8,937,142 101,995 97,272 0.30 0.21 0.21
pt 8,966,206 8,923,255 102,414 95,889 0.30 0.21 0.21
io 7,811,127 7,752,860 212,944 210,431 0.26 0.44 0.45
za 7,632,629 7,602,356 130,202 125,194 0.25 0.27 0.27
nz 7,471,125 7,431,458 116,962 113,187 0.25 0.24 0.24
cl 7,252,110 7,226,555 93,106 89,180 0.24 0.19 0.19
il 6,767,198 6,739,263 85,621 82,673 0.22 0.18 0.18
shop 6,599,854 6,573,301 93,028 91,287 0.22 0.19 0.20
us 5,592,362 5,562,841 110,940 107,222 0.18 0.23 0.23
tv 5,504,187 5,469,326 42,199 40,115 0.18 0.09 0.09
by 5,300,488 5,270,823 44,952 43,321 0.17 0.09 0.09
ie 5,263,846 5,236,630 67,774 65,436 0.17 0.14 0.14
me 5,243,036 5,181,167 98,973 97,150 0.17 0.20 0.21
lt 5,145,919 5,119,708 66,575 62,582 0.17 0.14 0.13
hr 5,088,156 5,067,961 53,121 49,100 0.17 0.11 0.11
xyz 4,806,828 4,770,710 141,131 139,289 0.16 0.29 0.30
ee 4,632,201 4,605,839 51,360 46,204 0.15 0.11 0.10
online 4,619,784 4,593,918 94,574 93,080 0.15 0.19 0.20
biz 4,432,600 4,416,300 90,656 86,907 0.15 0.19 0.19
bg 4,427,005 4,410,556 33,748 31,775 0.15 0.07 0.07
rs 4,383,190 4,366,815 43,886 40,654 0.14 0.09 0.09
si 4,129,017 4,107,864 53,683 49,681 0.14 0.11 0.11
cc 4,027,943 3,994,715 98,126 94,295 0.13 0.20 0.20
kz 3,993,864 3,980,932 39,529 37,918 0.13 0.08 0.08
app 3,618,941 3,607,635 90,027 89,263 0.12 0.18 0.19
hk 3,554,603 3,531,309 38,778 34,686 0.12 0.08 0.07
my 3,534,598 3,515,856 50,054 47,723 0.12 0.10 0.10
th 3,474,160 3,462,756 35,566 32,077 0.11 0.07 0.07
cat 3,268,863 3,248,972 25,686 24,163 0.11 0.05 0.05
lv 3,178,733 3,162,440 34,202 31,334 0.10 0.07 0.07
pro 2,847,014 2,828,355 53,975 52,848 0.09 0.11 0.11
store 2,669,037 2,654,956 40,546 39,888 0.09 0.08 0.09
pe 2,651,835 2,638,435 25,638 24,499 0.09 0.05 0.05
sg 2,585,262 2,570,533 38,191 36,426 0.09 0.08 0.08
pk 2,547,799 2,534,250 23,677 22,700 0.08 0.05 0.05
top 2,485,154 2,466,834 113,198 107,346 0.08 0.23 0.23
news 2,374,839 2,365,127 8,633 7,923 0.08 0.02 0.02
su 2,225,301 2,216,334 22,041 21,070 0.07 0.05 0.05
ae 1,994,829 1,979,251 25,557 24,535 0.07 0.05 0.05
ai 1,983,648 1,964,152 52,393 51,264 0.07 0.11 0.11
club 1,952,673 1,941,807 35,831 35,112 0.06 0.07 0.08
fm 1,912,964 1,902,613 8,927 8,705 0.06 0.02 0.02
is 1,827,154 1,819,696 18,643 17,606 0.06 0.04 0.04
ph 1,725,863 1,716,931 19,294 18,479 0.06 0.04 0.04
ng 1,643,109 1,635,887 17,689 17,069 0.05 0.04 0.04