Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-51

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2025-51). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,151,053,831 1,145,106,164 26,159,586 25,062,894 53.07 56.80 57.03
ccTLD 974,722,822 969,829,747 19,499,236 18,498,456 44.94 42.34 42.09
sTLD 34,374,332 34,126,009 187,053 180,622 1.58 0.41 0.41
grTLD 5,204,015 5,182,894 136,344 131,978 0.24 0.30 0.30
IDN ccTLD 3,520,054 3,509,011 72,951 71,514 0.16 0.16 0.16
IDN gTLD 163,243 162,907 3,886 3,820 0.01 0.01 0.01
ARPA 11 11 6 6 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 907,429,821 902,721,239 21,243,407 20,341,840 41.83 46.12 46.28
org 112,084,095 111,436,564 1,768,912 1,672,497 5.16 3.84 3.81
ru 103,210,579 102,832,980 1,181,572 1,131,544 4.77 2.57 2.57
de 92,045,159 91,478,103 2,505,279 2,351,604 4.24 5.44 5.35
net 68,121,833 67,843,043 1,333,961 1,270,859 3.14 2.90 2.89
jp 52,754,902 52,555,967 826,739 785,869 2.44 1.79 1.79
uk 43,794,853 43,551,339 1,092,784 1,042,386 2.02 2.37 2.37
pl 40,015,953 39,860,403 634,236 605,595 1.85 1.38 1.38
fr 39,658,230 39,436,952 906,626 876,067 1.83 1.97 1.99
it 38,388,492 38,221,299 668,761 634,557 1.77 1.45 1.44
cn 37,767,149 37,681,016 2,083,270 1,973,838 1.75 4.52 4.49
br 36,154,514 36,014,077 556,946 522,788 1.67 1.21 1.19
nl 30,549,282 30,380,581 827,247 781,070 1.41 1.80 1.78
cz 23,398,952 23,253,000 382,647 362,159 1.08 0.83 0.82
edu 19,696,405 19,577,918 107,602 105,176 0.91 0.23 0.24
es 19,409,419 19,304,324 288,386 276,077 0.89 0.63 0.63
au 19,351,661 19,258,600 457,798 440,580 0.89 0.99 1.00
ua 18,246,069 17,953,983 109,576 106,174 0.83 0.24 0.24
ca 17,571,961 17,485,556 408,311 390,887 0.81 0.89 0.89
eu 14,722,472 14,651,221 305,056 289,795 0.68 0.66 0.66
in 14,262,684 14,200,167 289,943 277,259 0.66 0.63 0.63
ch 13,883,999 13,795,294 398,250 373,121 0.64 0.86 0.85
se 13,700,023 13,617,436 336,755 324,508 0.63 0.73 0.74
info 13,596,652 13,554,416 233,020 223,066 0.63 0.51 0.51
ro 12,549,967 12,516,727 165,493 153,547 0.58 0.36 0.35
vn 12,286,174 12,231,392 137,300 131,589 0.57 0.30 0.30
gr 11,333,691 11,301,820 153,613 143,003 0.52 0.33 0.33
be 11,163,072 11,101,682 287,152 272,034 0.51 0.62 0.62
dk 10,750,432 10,674,464 303,506 294,214 0.49 0.66 0.67
hu 10,538,106 10,498,564 189,188 178,584 0.49 0.41 0.41
at 10,131,481 10,066,589 259,093 245,564 0.47 0.56 0.56
ir 10,035,622 10,012,004 99,549 96,665 0.46 0.22 0.22
co 9,911,240 9,671,446 191,555 186,640 0.45 0.42 0.42
id 9,208,430 9,186,443 144,652 139,912 0.43 0.31 0.32
gov 9,232,626 9,163,577 26,391 25,003 0.42 0.06 0.06
kr 9,156,352 9,133,715 194,571 167,857 0.42 0.42 0.38
tw 9,070,224 9,037,704 119,805 109,189 0.42 0.26 0.25
sk 8,433,286 8,390,572 128,374 121,114 0.39 0.28 0.28
tr 8,340,036 8,312,760 125,368 114,367 0.39 0.27 0.26
ar 7,977,583 7,954,661 127,628 116,392 0.37 0.28 0.26
fi 7,274,242 7,231,212 148,724 139,933 0.34 0.32 0.32
pt 6,794,834 6,764,773 102,174 94,461 0.31 0.22 0.21
no 6,739,078 6,692,047 139,202 133,312 0.31 0.30 0.30
io 6,504,285 6,448,600 202,109 199,589 0.30 0.44 0.45
mx 6,240,817 6,217,397 97,840 93,257 0.29 0.21 0.21
cl 5,146,818 5,124,469 84,041 79,957 0.24 0.18 0.18
za 4,924,485 4,907,748 123,009 117,382 0.23 0.27 0.27
il 4,880,160 4,860,547 83,653 79,813 0.23 0.18 0.18
by 4,757,097 4,735,140 47,435 45,444 0.22 0.10 0.10
tv 4,351,338 4,336,370 36,881 35,029 0.20 0.08 0.08
nz 4,091,352 4,069,873 107,027 102,875 0.19 0.23 0.23
rs 3,983,205 3,969,981 45,619 42,363 0.18 0.10 0.10
lt 3,797,493 3,779,721 63,362 59,887 0.18 0.14 0.14
me 3,790,179 3,766,384 83,093 81,458 0.17 0.18 0.19
hr 3,677,822 3,664,327 46,735 43,010 0.17 0.10 0.10
us 3,501,173 3,484,234 93,295 89,790 0.16 0.20 0.20
cc 3,456,299 3,422,279 71,926 68,514 0.16 0.16 0.16
kz 3,375,119 3,359,485 35,089 33,765 0.16 0.08 0.08
ee 3,355,409 3,340,191 48,109 43,643 0.15 0.10 0.10
shop 3,139,378 3,126,414 72,180 70,664 0.14 0.16 0.16
ie 3,072,498 3,057,422 56,014 53,694 0.14 0.12 0.12
biz 2,931,135 2,920,296 81,302 78,160 0.14 0.18 0.18
bg 2,933,110 2,919,940 25,701 24,557 0.14 0.06 0.06
si 2,827,759 2,818,161 47,599 43,277 0.13 0.10 0.10
online 2,825,619 2,813,324 83,594 82,386 0.13 0.18 0.19
my 2,686,871 2,676,857 48,522 45,860 0.12 0.11 0.10
xyz 2,632,242 2,620,833 161,721 160,049 0.12 0.35 0.36
th 2,577,432 2,569,470 35,561 32,138 0.12 0.08 0.07
hk 2,463,305 2,447,994 35,218 31,585 0.11 0.08 0.07
cat 2,444,342 2,431,500 22,595 21,287 0.11 0.05 0.05
lv 2,306,775 2,295,666 31,278 28,889 0.11 0.07 0.07
ai 2,303,833 2,284,825 72,935 71,299 0.11 0.16 0.16
app 2,088,147 2,075,826 101,684 100,837 0.10 0.22 0.23
pro 2,003,859 1,994,272 50,110 49,143 0.09 0.11 0.11
pe 1,941,498 1,929,534 26,067 24,787 0.09 0.06 0.06
su 1,848,740 1,843,210 20,792 19,992 0.09 0.05 0.05
news 1,826,834 1,821,315 7,754 7,093 0.08 0.02 0.02
pk 1,719,669 1,714,442 24,485 23,556 0.08 0.05 0.05
top 1,713,014 1,704,766 82,705 80,891 0.08 0.18 0.18
sg 1,493,142 1,485,548 30,996 29,306 0.07 0.07 0.07
ae 1,439,631 1,433,244 26,906 25,869 0.07 0.06 0.06
club 1,400,043 1,394,512 32,539 31,867 0.06 0.07 0.07
ng 1,328,764 1,325,458 17,473 16,753 0.06 0.04 0.04
fm 1,312,346 1,310,214 7,222 6,994 0.06 0.02 0.02
store 1,263,650 1,256,871 33,978 33,444 0.06 0.07 0.08
is 1,222,636 1,216,992 17,220 16,310 0.06 0.04 0.04
az 1,180,894 1,177,248 9,174 8,346 0.05 0.02 0.02
md 1,165,820 1,162,130 11,396 10,683 0.05 0.02 0.02
ba 1,153,093 1,150,237 11,644 10,761 0.05 0.03 0.02
ph 1,137,028 1,131,520 17,031 16,240 0.05 0.04 0.04
uy 1,106,082 1,102,286 13,440 12,440 0.05 0.03 0.03
ge 1,102,549 1,099,729 13,186 12,098 0.05 0.03 0.03