Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-47

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2025-47). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,226,326,310 1,219,896,343 25,987,720 24,868,000 53.44 57.39 57.69
ccTLD 1,022,477,477 1,017,356,782 18,889,409 17,850,056 44.57 41.72 41.41
sTLD 36,153,732 35,884,911 191,470 184,968 1.57 0.42 0.43
grTLD 5,586,105 5,565,472 133,583 129,155 0.24 0.30 0.30
IDN ccTLD 3,701,155 3,691,085 73,068 71,616 0.16 0.16 0.17
IDN gTLD 174,902 174,361 3,831 3,763 0.01 0.01 0.01
ARPA 13 13 9 9 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 962,353,423 957,333,216 21,138,546 20,216,987 41.94 46.69 46.90
org 122,070,809 121,317,494 1,786,415 1,689,112 5.31 3.95 3.92
ru 108,784,456 108,407,303 1,189,118 1,139,054 4.75 2.63 2.64
de 98,096,557 97,502,340 2,525,945 2,370,517 4.27 5.58 5.50
net 73,552,542 73,252,522 1,321,074 1,255,810 3.21 2.92 2.91
jp 57,052,883 56,859,075 845,611 803,900 2.49 1.87 1.86
uk 47,333,710 47,080,193 1,094,238 1,042,463 2.06 2.42 2.42
pl 42,723,957 42,553,661 631,368 602,374 1.86 1.39 1.40
fr 41,212,253 40,984,166 884,732 854,129 1.80 1.95 1.98
it 39,151,121 38,976,396 666,487 631,095 1.71 1.47 1.46
br 38,061,960 37,912,973 561,791 527,021 1.66 1.24 1.22
nl 33,066,824 32,882,844 834,184 786,833 1.44 1.84 1.83
cn 30,826,918 30,561,605 1,499,108 1,366,726 1.34 3.31 3.17
cz 25,318,094 25,173,078 386,073 364,943 1.10 0.85 0.85
edu 21,368,855 21,220,455 110,838 108,362 0.93 0.24 0.25
es 21,088,196 20,976,578 292,084 279,702 0.92 0.65 0.65
au 20,677,722 20,579,307 465,044 447,144 0.90 1.03 1.04
ca 19,609,427 19,510,603 414,780 396,886 0.85 0.92 0.92
ua 16,944,612 16,628,198 109,317 105,987 0.73 0.24 0.25
eu 15,765,977 15,686,706 309,714 294,080 0.69 0.68 0.68
info 15,447,577 15,399,600 232,648 222,511 0.67 0.51 0.52
ro 14,965,970 14,926,206 188,491 174,160 0.65 0.42 0.40
in 14,598,365 14,541,325 286,080 273,372 0.64 0.63 0.63
se 14,272,853 14,188,084 274,933 262,837 0.62 0.61 0.61
ch 14,138,302 14,051,779 389,672 366,114 0.62 0.86 0.85
vn 13,071,729 13,020,369 140,539 134,616 0.57 0.31 0.31
be 12,014,463 11,946,730 290,795 275,124 0.52 0.64 0.64
gr 11,970,918 11,939,234 154,438 143,560 0.52 0.34 0.33
dk 11,539,233 11,463,571 247,386 238,224 0.50 0.55 0.55
hu 11,382,097 11,341,773 188,407 177,845 0.50 0.42 0.41
at 10,585,442 10,507,335 259,832 246,029 0.46 0.57 0.57
ir 9,864,566 9,842,203 93,407 90,526 0.43 0.21 0.21
id 9,831,954 9,808,844 146,746 141,752 0.43 0.32 0.33
kr 9,737,562 9,713,537 196,198 168,890 0.43 0.43 0.39
co 9,707,889 9,597,522 192,433 187,458 0.42 0.42 0.43
gov 9,399,052 9,332,323 26,672 25,288 0.41 0.06 0.06
tw 9,198,033 9,151,985 118,650 107,899 0.40 0.26 0.25
sk 9,176,844 9,130,750 129,583 121,978 0.40 0.29 0.28
tr 8,587,564 8,560,117 126,408 115,056 0.38 0.28 0.27
ar 8,270,102 8,245,704 129,550 118,238 0.36 0.29 0.27
fi 7,910,467 7,868,524 147,589 138,794 0.34 0.33 0.32
no 7,127,386 7,084,510 137,470 131,621 0.31 0.30 0.31
pt 6,946,436 6,921,027 102,730 94,811 0.30 0.23 0.22
mx 6,837,604 6,814,244 100,417 95,698 0.30 0.22 0.22
io 6,542,324 6,489,010 202,091 199,620 0.28 0.45 0.46
za 5,512,679 5,497,404 123,431 117,641 0.24 0.27 0.27
cl 5,418,726 5,399,562 86,960 82,705 0.24 0.19 0.19
il 5,105,740 5,086,486 84,585 80,482 0.22 0.19 0.19
by 4,995,247 4,974,926 47,878 45,842 0.22 0.11 0.11
tv 4,589,861 4,574,294 38,268 36,382 0.20 0.08 0.08
nz 4,403,025 4,381,105 107,302 103,043 0.19 0.24 0.24
rs 4,199,229 4,187,331 44,373 41,046 0.18 0.10 0.10
lt 4,084,423 4,066,340 63,523 59,913 0.18 0.14 0.14
me 4,008,561 3,989,903 86,076 84,406 0.17 0.19 0.20
hr 3,996,001 3,982,139 48,414 44,303 0.17 0.11 0.10
us 3,825,596 3,806,736 95,254 91,921 0.17 0.21 0.21
shop 3,627,342 3,611,703 71,178 69,634 0.16 0.16 0.16
cc 3,623,127 3,588,892 71,294 67,791 0.16 0.16 0.16
ee 3,579,401 3,564,236 47,362 42,856 0.16 0.10 0.10
kz 3,323,125 3,307,493 30,651 29,549 0.14 0.07 0.07
bg 3,308,943 3,296,132 26,557 25,343 0.14 0.06 0.06
ie 3,290,582 3,274,070 55,445 53,258 0.14 0.12 0.12
biz 3,220,117 3,209,996 79,384 76,182 0.14 0.18 0.18
si 3,047,144 3,036,246 48,571 44,006 0.13 0.11 0.10
online 3,051,361 3,029,152 86,089 84,872 0.13 0.19 0.20
my 2,910,559 2,898,308 49,155 46,379 0.13 0.11 0.11
xyz 2,775,914 2,763,127 135,606 134,189 0.12 0.30 0.31
cat 2,641,266 2,627,986 22,924 21,628 0.12 0.05 0.05
th 2,638,670 2,626,650 35,300 31,752 0.12 0.08 0.07
hk 2,638,743 2,623,385 35,364 31,699 0.11 0.08 0.07
lv 2,425,119 2,413,864 29,942 27,688 0.11 0.07 0.06
app 2,316,769 2,302,468 103,681 102,814 0.10 0.23 0.24
ai 2,291,808 2,270,613 72,224 70,627 0.10 0.16 0.16
pe 2,087,317 2,074,189 27,259 25,973 0.09 0.06 0.06
pro 2,077,597 2,068,018 49,192 48,228 0.09 0.11 0.11
news 1,935,526 1,929,529 7,749 7,111 0.08 0.02 0.02
su 1,924,934 1,918,096 20,171 19,347 0.08 0.04 0.04
top 1,911,326 1,901,942 73,412 71,738 0.08 0.16 0.17
pk 1,767,439 1,760,388 24,561 23,624 0.08 0.05 0.05
sg 1,668,635 1,659,892 31,547 29,773 0.07 0.07 0.07
ae 1,516,592 1,510,043 26,783 25,696 0.07 0.06 0.06
club 1,491,502 1,485,958 32,133 31,436 0.07 0.07 0.07
ng 1,374,119 1,370,584 17,640 16,956 0.06 0.04 0.04
fm 1,345,505 1,343,459 8,831 8,598 0.06 0.02 0.02
store 1,322,970 1,317,599 35,304 34,745 0.06 0.08 0.08
is 1,306,134 1,299,894 17,478 16,591 0.06 0.04 0.04
ba 1,245,732 1,243,391 11,893 10,963 0.05 0.03 0.03
az 1,230,793 1,225,594 9,393 8,542 0.05 0.02 0.02
ph 1,234,391 1,225,102 18,056 17,226 0.05 0.04 0.04
md 1,195,750 1,191,310 11,474 10,737 0.05 0.03 0.02