Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-43

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2025-43). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,450,314,971 1,442,935,814 27,168,361 26,040,572 55.42 57.77 58.10
ccTLD 1,119,540,780 1,113,970,692 19,434,349 18,369,463 42.79 41.32 40.98
sTLD 36,935,012 36,656,234 208,754 202,239 1.41 0.44 0.45
grTLD 6,090,292 6,066,528 139,057 134,453 0.23 0.30 0.30
IDN ccTLD 3,672,607 3,662,739 74,196 72,728 0.14 0.16 0.16
IDN gTLD 187,400 187,039 3,970 3,900 0.01 0.01 0.01
ARPA 44 44 6 6 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 1,150,753,644 1,144,808,036 22,128,905 21,204,592 43.97 47.05 47.31
org 139,326,482 138,639,243 1,840,394 1,739,448 5.33 3.91 3.88
ru 112,175,684 111,773,671 1,207,036 1,155,260 4.29 2.57 2.58
de 108,607,358 107,947,075 2,760,184 2,598,186 4.15 5.87 5.80
net 82,968,986 82,649,713 1,380,317 1,314,532 3.17 2.94 2.93
jp 59,810,746 59,596,206 869,088 826,908 2.29 1.85 1.84
uk 58,306,702 57,995,839 1,139,874 1,087,104 2.23 2.42 2.43
pl 46,124,959 45,948,994 650,148 620,771 1.76 1.38 1.38
fr 46,042,507 45,784,189 913,145 882,139 1.76 1.94 1.97
br 41,434,449 41,267,468 576,117 540,894 1.59 1.23 1.21
it 40,110,005 39,935,308 666,940 632,095 1.53 1.42 1.41
nl 38,367,278 38,136,116 910,846 859,516 1.46 1.94 1.92
cn 29,145,245 29,099,916 1,242,596 1,109,975 1.12 2.64 2.48
au 28,428,190 28,289,270 516,124 497,558 1.09 1.10 1.11
cz 27,023,168 26,880,881 391,747 370,150 1.03 0.83 0.83
ca 23,726,510 23,604,914 432,590 414,763 0.91 0.92 0.93
es 23,312,267 23,180,048 305,717 292,901 0.89 0.65 0.65
edu 21,898,271 21,773,083 125,326 122,896 0.84 0.27 0.27
ua 18,067,337 17,695,019 112,685 109,227 0.68 0.24 0.24
eu 17,657,119 17,574,856 323,875 307,730 0.68 0.69 0.69
se 16,635,687 16,540,421 292,111 278,872 0.64 0.62 0.62
ro 16,434,746 16,385,138 193,298 179,445 0.63 0.41 0.40
in 16,432,653 16,369,756 291,987 279,399 0.63 0.62 0.62
info 15,716,224 15,658,920 242,422 232,029 0.60 0.52 0.52
ch 15,561,344 15,466,406 418,478 394,296 0.59 0.89 0.88
vn 13,560,957 13,515,921 141,803 135,820 0.52 0.30 0.30
dk 13,286,420 13,201,098 250,188 240,406 0.51 0.53 0.54
be 13,186,716 13,116,911 307,813 290,657 0.50 0.65 0.65
gr 12,916,739 12,881,119 158,875 147,649 0.49 0.34 0.33
hu 12,216,841 12,176,084 195,718 184,314 0.47 0.42 0.41
co 12,108,301 11,967,832 209,161 204,013 0.46 0.44 0.46
at 11,378,739 11,296,795 284,863 270,253 0.43 0.61 0.60
id 10,637,248 10,610,387 152,159 147,188 0.41 0.32 0.33
ir 9,755,454 9,732,732 98,006 94,959 0.37 0.21 0.21
tr 9,677,606 9,643,505 132,927 120,825 0.37 0.28 0.27
sk 9,625,293 9,569,179 130,006 122,404 0.37 0.28 0.27
gov 9,433,489 9,357,507 27,051 25,665 0.36 0.06 0.06
kr 9,325,423 9,299,482 196,515 169,189 0.36 0.42 0.38
tw 9,041,090 9,000,332 116,915 106,180 0.35 0.25 0.24
fi 8,694,252 8,646,238 151,228 142,376 0.33 0.32 0.32
ar 8,570,789 8,543,775 130,630 119,447 0.33 0.28 0.27
no 7,919,991 7,859,820 142,870 136,782 0.30 0.30 0.31
mx 7,849,044 7,818,036 104,644 99,816 0.30 0.22 0.22
pt 7,478,576 7,453,048 102,974 95,105 0.29 0.22 0.21
io 7,173,418 7,107,779 205,860 203,403 0.27 0.44 0.45
za 6,809,612 6,783,872 138,460 132,202 0.26 0.29 0.29
cl 6,206,046 6,180,715 91,235 86,889 0.24 0.19 0.19
nz 6,130,398 6,098,025 116,295 112,075 0.23 0.25 0.25
il 5,883,605 5,860,966 88,303 83,977 0.23 0.19 0.19
shop 5,452,985 5,430,679 87,208 85,605 0.21 0.19 0.19
by 5,160,324 5,132,629 47,497 45,501 0.20 0.10 0.10
tv 4,814,244 4,796,060 39,326 37,404 0.18 0.08 0.08
lt 4,487,489 4,467,228 65,476 61,686 0.17 0.14 0.14
us 4,458,827 4,436,749 98,975 95,497 0.17 0.21 0.21
me 4,400,542 4,375,649 89,138 87,409 0.17 0.19 0.20
hr 4,234,990 4,220,058 50,096 45,891 0.16 0.11 0.10
ie 4,173,636 4,150,028 59,953 57,586 0.16 0.13 0.13
rs 4,119,940 4,106,198 45,008 41,721 0.16 0.10 0.09
cc 3,924,510 3,874,839 70,844 67,399 0.15 0.15 0.15
bg 3,561,464 3,549,925 27,886 26,609 0.14 0.06 0.06
biz 3,549,762 3,538,385 82,628 79,289 0.14 0.18 0.18
online 3,534,231 3,520,770 91,398 90,067 0.14 0.19 0.20
kz 3,477,570 3,465,092 30,783 29,641 0.13 0.07 0.07
ee 3,440,660 3,424,113 45,175 40,885 0.13 0.10 0.09
si 3,208,464 3,195,412 49,592 44,942 0.12 0.11 0.10
my 3,039,131 3,026,871 50,366 47,488 0.12 0.11 0.11
xyz 3,004,382 2,987,275 124,834 123,151 0.11 0.27 0.27
hk 2,921,105 2,902,383 36,946 33,233 0.11 0.08 0.07
th 2,872,039 2,861,658 36,248 32,677 0.11 0.08 0.07
cat 2,756,008 2,740,570 24,134 22,827 0.11 0.05 0.05
lv 2,627,585 2,616,447 31,549 29,141 0.10 0.07 0.07
ai 2,406,192 2,382,803 71,194 69,662 0.09 0.15 0.16
app 2,379,687 2,366,982 102,542 101,706 0.09 0.22 0.23
store 2,328,597 2,316,185 43,116 42,542 0.09 0.09 0.09
pe 2,257,222 2,243,126 28,299 27,023 0.09 0.06 0.06
pk 2,248,139 2,239,495 26,653 25,690 0.09 0.06 0.06
pro 2,242,032 2,230,290 51,287 50,294 0.09 0.11 0.11
top 2,237,983 2,227,548 77,219 75,364 0.09 0.16 0.17
sg 2,125,254 2,113,714 33,663 31,853 0.08 0.07 0.07
news 2,028,556 2,023,189 7,976 7,333 0.08 0.02 0.02
su 1,890,883 1,885,226 20,737 19,897 0.07 0.04 0.04
ae 1,877,017 1,866,663 28,074 27,033 0.07 0.06 0.06
link 1,729,243 1,727,676 16,746 16,612 0.07 0.04 0.04
club 1,670,419 1,663,519 33,485 32,810 0.06 0.07 0.07
ng 1,492,207 1,487,106 18,430 17,691 0.06 0.04 0.04
is 1,443,363 1,436,222 18,443 17,508 0.06 0.04 0.04
ph 1,443,510 1,426,687 18,617 17,779 0.05 0.04 0.04
fm 1,419,797 1,417,245 8,908 8,686 0.05 0.02 0.02
az 1,398,834 1,393,776 9,591 8,704 0.05 0.02 0.02
ba 1,334,368 1,331,916 12,219 11,264 0.05 0.03 0.03