Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-13

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2025-13). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,517,864,035 1,509,574,653 27,995,163 26,824,678 55.38 59.94 60.20
ccTLD 1,161,114,274 1,154,915,720 18,284,262 17,318,075 42.37 39.15 38.87
sTLD 51,177,678 50,823,726 206,388 199,708 1.86 0.44 0.45
grTLD 6,584,583 6,553,891 143,804 139,161 0.24 0.31 0.31
IDN ccTLD 3,838,001 3,823,774 73,996 72,430 0.14 0.16 0.16
IDN gTLD 189,368 188,743 3,992 3,922 0.01 0.01 0.01
ARPA 4 4 4 4 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 1,193,030,343 1,186,422,537 22,858,673 21,895,738 43.52 48.94 49.14
org 149,239,144 148,465,537 1,858,293 1,757,630 5.45 3.98 3.94
ru 119,241,852 118,726,717 1,247,111 1,189,697 4.36 2.67 2.67
de 103,142,844 102,561,938 2,334,900 2,194,106 3.76 5.00 4.92
net 91,842,085 91,445,631 1,411,258 1,343,444 3.35 3.02 3.02
jp 59,155,675 58,906,351 812,001 771,145 2.16 1.74 1.73
uk 58,693,765 58,319,157 1,023,133 980,175 2.14 2.19 2.20
it 49,704,586 49,478,889 716,982 681,202 1.82 1.54 1.53
fr 44,832,217 44,596,663 772,423 744,565 1.64 1.65 1.67
br 43,576,445 43,387,184 574,048 535,855 1.59 1.23 1.20
pl 43,329,386 43,137,064 560,807 538,447 1.58 1.20 1.21
nl 40,113,859 39,877,358 925,930 877,387 1.46 1.98 1.97
edu 32,786,077 32,590,480 120,478 117,903 1.20 0.26 0.26
au 31,987,706 31,815,200 521,490 505,770 1.17 1.12 1.14
cz 28,305,417 28,081,029 395,426 372,655 1.03 0.85 0.84
cn 28,099,837 28,048,852 1,000,281 903,639 1.03 2.14 2.03
ca 25,470,824 25,306,618 425,171 409,935 0.93 0.91 0.92
es 24,166,561 24,034,849 268,237 258,111 0.88 0.57 0.58
ua 18,875,129 18,493,182 111,678 108,203 0.68 0.24 0.24
in 17,913,573 17,835,931 285,564 272,561 0.65 0.61 0.61
eu 17,920,541 17,826,932 303,997 288,546 0.65 0.65 0.65
ro 17,735,190 17,662,958 182,892 173,342 0.65 0.39 0.39
se 16,154,018 16,051,354 283,279 271,285 0.59 0.61 0.61
info 15,973,537 15,910,337 250,258 239,435 0.58 0.54 0.54
ch 15,973,179 15,887,339 412,530 388,520 0.58 0.88 0.87
gr 14,858,001 14,806,292 157,345 148,256 0.54 0.34 0.33
vn 13,949,341 13,898,629 140,380 134,741 0.51 0.30 0.30
be 13,769,299 13,688,562 311,838 294,220 0.50 0.67 0.66
hu 12,521,481 12,468,788 180,385 169,904 0.46 0.39 0.38
co 12,335,324 12,227,851 214,219 209,236 0.45 0.46 0.47
dk 12,225,829 12,130,880 229,887 220,570 0.45 0.49 0.50
gov 12,005,162 11,920,375 26,978 25,524 0.44 0.06 0.06
id 11,634,730 11,584,166 150,800 146,326 0.42 0.32 0.33
at 11,418,537 11,331,601 264,797 251,533 0.42 0.57 0.56
kr 11,315,736 11,285,448 198,497 170,253 0.41 0.42 0.38
ir 10,263,106 10,228,690 103,806 100,248 0.38 0.22 0.22
tw 10,275,666 10,211,704 112,748 103,012 0.37 0.24 0.23
sk 9,825,786 9,782,486 129,248 121,192 0.36 0.28 0.27
fi 9,268,413 9,210,508 146,882 140,591 0.34 0.31 0.32
tr 9,172,072 9,135,636 119,164 109,044 0.34 0.26 0.24
ar 8,897,626 8,872,064 132,876 118,245 0.33 0.28 0.27
pt 8,425,870 8,386,429 99,042 92,926 0.31 0.21 0.21
no 8,413,456 8,364,262 140,410 134,372 0.31 0.30 0.30
mx 8,342,831 8,300,565 100,799 96,087 0.30 0.22 0.22
io 7,665,344 7,593,828 214,685 212,292 0.28 0.46 0.48
cl 6,528,986 6,502,886 92,366 88,478 0.24 0.20 0.20
nz 6,509,601 6,475,306 115,743 112,176 0.24 0.25 0.25
za 6,277,941 6,251,199 117,980 113,548 0.23 0.25 0.25
shop 6,230,027 6,202,198 93,912 92,313 0.23 0.20 0.21
il 5,896,278 5,871,245 85,468 82,504 0.22 0.18 0.19
tv 5,200,444 5,166,892 40,090 38,163 0.19 0.09 0.09
us 4,958,681 4,929,616 102,217 98,680 0.18 0.22 0.22
by 4,943,618 4,925,298 45,677 43,951 0.18 0.10 0.10
me 4,781,142 4,752,551 88,316 86,571 0.17 0.19 0.19
hr 4,643,550 4,623,002 52,057 48,172 0.17 0.11 0.11
lt 4,645,092 4,618,005 65,412 61,560 0.17 0.14 0.14
ie 4,630,348 4,601,715 63,616 61,401 0.17 0.14 0.14
bg 4,184,306 4,168,179 33,425 31,589 0.15 0.07 0.07
cc 4,098,179 4,068,683 75,714 72,134 0.15 0.16 0.16
rs 4,006,654 3,993,714 41,853 38,961 0.15 0.09 0.09
ee 4,007,806 3,981,395 48,540 43,845 0.15 0.10 0.10
si 3,904,422 3,882,871 53,197 49,073 0.14 0.11 0.11
online 3,841,703 3,823,840 89,304 87,922 0.14 0.19 0.20
kz 3,800,836 3,788,328 39,033 37,450 0.14 0.08 0.08
xyz 3,758,993 3,731,785 133,443 131,871 0.14 0.29 0.30
app 3,742,932 3,731,595 97,502 96,721 0.14 0.21 0.22
biz 3,671,664 3,656,990 85,625 82,265 0.13 0.18 0.18
th 3,417,818 3,406,036 35,060 31,684 0.12 0.08 0.07
my 3,355,997 3,335,424 50,212 47,862 0.12 0.11 0.11
hk 3,266,916 3,236,358 38,082 34,084 0.12 0.08 0.08
cat 2,875,429 2,860,316 22,728 21,474 0.10 0.05 0.05
lv 2,711,874 2,697,470 32,775 30,135 0.10 0.07 0.07
store 2,604,992 2,593,458 41,539 40,861 0.10 0.09 0.09
pro 2,587,188 2,573,067 52,811 51,795 0.09 0.11 0.12
top 2,471,326 2,453,093 101,590 97,489 0.09 0.22 0.22
pk 2,438,466 2,425,931 23,934 22,989 0.09 0.05 0.05
sg 2,320,628 2,305,183 35,715 34,189 0.08 0.08 0.08
news 2,241,090 2,233,527 8,581 7,880 0.08 0.02 0.02
link 2,223,143 2,220,972 19,118 18,967 0.08 0.04 0.04
pe 2,190,531 2,180,661 25,798 24,655 0.08 0.06 0.06
su 2,072,899 2,062,477 21,550 20,609 0.08 0.05 0.05
ai 1,981,314 1,961,732 56,481 55,285 0.07 0.12 0.12
fm 1,938,173 1,934,585 9,422 9,209 0.07 0.02 0.02
ae 1,822,336 1,810,646 25,676 24,693 0.07 0.05 0.06
ph 1,653,184 1,647,420 19,197 18,410 0.06 0.04 0.04
club 1,642,531 1,632,429 33,513 32,839 0.06 0.07 0.07
ng 1,594,255 1,588,708 17,418 16,798 0.06 0.04 0.04
is 1,553,615 1,547,142 18,379 17,424 0.06 0.04 0.04
az 1,470,550 1,465,868 9,836 8,891 0.05 0.02 0.02
ge 1,399,826 1,396,045 13,403 12,231 0.05 0.03 0.03
nu 1,379,594 1,374,602 28,103 26,897 0.05 0.06 0.06
ba 1,378,247 1,368,281 11,715 10,821 0.05 0.03 0.02