Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-30

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2025-30). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,340,992,863 1,333,835,610 28,556,229 27,426,542 55.35 59.94 60.27
ccTLD 1,031,863,931 1,026,604,706 18,665,687 17,668,800 42.60 39.18 38.83
sTLD 40,372,591 40,118,246 199,313 192,627 1.66 0.42 0.42
grTLD 5,857,179 5,831,733 146,279 141,774 0.24 0.31 0.31
IDN ccTLD 3,268,389 3,259,128 71,725 70,263 0.14 0.15 0.15
IDN gTLD 155,524 155,069 3,788 3,721 0.01 0.01 0.01
ARPA 3 3 3 3 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 1,071,766,712 1,065,929,651 23,312,712 22,378,721 44.23 48.93 49.18
org 115,924,643 115,349,437 1,865,399 1,772,005 4.79 3.92 3.89
ru 102,859,410 102,439,710 1,209,887 1,157,665 4.25 2.54 2.54
de 100,789,934 100,182,137 2,646,105 2,491,640 4.16 5.55 5.48
net 79,472,570 79,176,419 1,408,975 1,343,781 3.29 2.96 2.95
jp 55,322,043 55,098,746 820,351 780,088 2.29 1.72 1.71
uk 51,268,600 50,980,068 1,099,294 1,049,652 2.12 2.31 2.31
it 45,203,351 45,008,011 705,246 668,092 1.87 1.48 1.47
pl 38,885,202 38,730,981 622,434 594,077 1.61 1.31 1.31
fr 38,442,569 38,222,763 786,411 757,959 1.59 1.65 1.67
br 36,509,068 36,360,549 553,953 521,034 1.51 1.16 1.15
nl 34,351,228 34,144,371 885,924 836,169 1.42 1.86 1.84
cn 27,629,123 27,585,572 1,048,685 957,309 1.14 2.20 2.10
au 27,436,679 27,303,523 485,933 467,676 1.13 1.02 1.03
edu 24,433,929 24,315,044 113,768 111,315 1.01 0.24 0.24
cz 23,990,425 23,833,804 381,354 360,098 0.99 0.80 0.79
ca 22,348,742 22,229,762 422,484 405,133 0.92 0.89 0.89
es 21,630,563 21,510,255 299,048 286,180 0.89 0.63 0.63
ua 17,175,133 16,931,392 112,882 109,283 0.70 0.24 0.24
eu 15,999,499 15,922,855 326,081 310,164 0.66 0.68 0.68
in 15,161,962 15,105,242 279,622 267,173 0.63 0.59 0.59
info 14,735,825 14,689,363 247,981 237,575 0.61 0.52 0.52
ro 14,485,035 14,445,093 186,108 172,444 0.60 0.39 0.38
ch 14,176,951 14,090,082 400,324 377,581 0.58 0.84 0.83
se 14,130,341 14,042,929 289,367 276,930 0.58 0.61 0.61
gr 12,196,803 12,165,541 154,881 143,118 0.50 0.33 0.31
vn 12,158,738 12,098,897 137,739 131,690 0.50 0.29 0.29
be 11,922,075 11,849,961 295,708 279,172 0.49 0.62 0.61
dk 11,242,152 11,167,800 251,804 242,063 0.46 0.53 0.53
hu 11,052,556 11,004,623 173,552 163,198 0.46 0.36 0.36
co 11,050,471 10,958,183 211,662 206,829 0.45 0.44 0.45
at 10,734,228 10,659,358 270,035 256,330 0.44 0.57 0.56
gov 10,386,301 10,304,117 26,984 25,565 0.43 0.06 0.06
kr 10,034,268 10,000,087 192,491 166,253 0.41 0.40 0.37
id 9,664,304 9,637,775 152,110 147,143 0.40 0.32 0.32
ir 9,136,553 9,115,653 93,438 90,400 0.38 0.20 0.20
tw 8,775,659 8,735,569 113,410 103,281 0.36 0.24 0.23
sk 8,742,546 8,701,223 127,295 119,845 0.36 0.27 0.26
tr 8,619,669 8,580,692 125,517 114,534 0.36 0.26 0.25
ar 8,033,782 8,012,112 126,900 116,140 0.33 0.27 0.26
fi 8,011,076 7,967,490 146,358 137,626 0.33 0.31 0.30
no 7,525,371 7,476,350 138,084 131,994 0.31 0.29 0.29
mx 7,282,246 7,240,195 100,465 95,796 0.30 0.21 0.21
pt 7,006,592 6,976,297 98,415 91,076 0.29 0.21 0.20
io 6,526,821 6,467,553 214,414 212,133 0.27 0.45 0.47
shop 6,016,605 5,994,389 113,100 111,586 0.25 0.24 0.25
za 5,847,030 5,826,360 129,509 123,488 0.24 0.27 0.27
nz 5,855,684 5,825,411 113,029 108,834 0.24 0.24 0.24
cl 5,735,424 5,713,101 88,830 84,674 0.24 0.19 0.19
il 5,507,680 5,487,445 86,925 82,603 0.23 0.18 0.18
tv 4,795,262 4,769,455 39,540 37,601 0.20 0.08 0.08
us 4,345,838 4,325,536 99,255 95,737 0.18 0.21 0.21
hr 4,331,332 4,314,455 53,761 48,845 0.18 0.11 0.11
by 4,305,760 4,294,442 45,764 43,852 0.18 0.10 0.10
me 4,190,841 4,159,930 95,733 94,002 0.17 0.20 0.21
lt 4,134,541 4,114,402 64,122 60,441 0.17 0.13 0.13
ie 3,968,193 3,945,218 63,950 61,361 0.16 0.13 0.13
rs 3,869,431 3,856,400 41,264 38,162 0.16 0.09 0.08
cc 3,770,863 3,736,490 67,189 63,832 0.16 0.14 0.14
biz 3,403,978 3,392,520 86,418 83,181 0.14 0.18 0.18
online 3,321,173 3,307,409 101,788 100,368 0.14 0.21 0.22
kz 3,314,483 3,303,983 36,558 35,156 0.14 0.08 0.08
ee 3,300,231 3,284,116 45,988 41,581 0.14 0.10 0.09
bg 3,267,546 3,257,197 27,523 26,219 0.14 0.06 0.06
si 3,215,167 3,199,789 55,213 49,890 0.13 0.12 0.11
xyz 3,138,217 3,092,124 155,784 153,941 0.13 0.33 0.34
my 2,923,088 2,911,119 50,822 48,005 0.12 0.11 0.11
hk 2,927,434 2,904,930 36,972 33,146 0.12 0.08 0.07
th 2,764,433 2,755,422 35,396 31,850 0.11 0.07 0.07
cat 2,663,456 2,646,900 23,840 22,468 0.11 0.05 0.05
lv 2,624,226 2,610,839 32,919 30,233 0.11 0.07 0.07
app 2,291,914 2,275,877 100,505 99,713 0.09 0.21 0.22
top 2,255,968 2,241,356 103,975 101,787 0.09 0.22 0.22
store 2,212,347 2,200,571 50,620 49,962 0.09 0.11 0.11
pk 2,201,963 2,193,570 25,807 24,852 0.09 0.05 0.05
pro 2,167,430 2,154,672 54,611 53,616 0.09 0.11 0.12
ai 2,040,250 2,020,526 63,826 62,465 0.08 0.13 0.14
pe 2,018,425 2,010,756 25,787 24,500 0.08 0.05 0.05
news 2,001,346 1,994,700 8,652 7,964 0.08 0.02 0.02
sg 1,995,861 1,984,701 33,196 31,395 0.08 0.07 0.07
ae 1,807,823 1,800,092 26,536 25,499 0.07 0.06 0.06
su 1,755,473 1,749,894 20,796 19,959 0.07 0.04 0.04
club 1,519,339 1,512,565 34,174 33,514 0.06 0.07 0.07
ph 1,575,155 1,458,525 18,713 17,873 0.06 0.04 0.04
is 1,401,721 1,394,242 18,119 17,189 0.06 0.04 0.04
ng 1,326,195 1,321,946 17,140 16,408 0.05 0.04 0.04
ba 1,313,935 1,310,269 12,362 11,348 0.05 0.03 0.02
az 1,297,679 1,294,895 9,633 8,772 0.05 0.02 0.02