Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-26

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2025-26). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,307,646,409 1,300,563,549 27,909,321 26,687,770 54.81 58.84 59.15
ccTLD 1,026,581,301 1,021,490,779 19,098,507 18,018,360 43.05 40.26 39.94
sTLD 41,469,925 41,212,848 203,861 196,896 1.74 0.43 0.44
grTLD 6,083,961 6,056,340 145,270 140,479 0.26 0.31 0.31
IDN ccTLD 3,579,472 3,570,382 72,809 71,314 0.15 0.15 0.16
IDN gTLD 173,803 173,476 3,922 3,860 0.01 0.01 0.01
ARPA 4 4 4 4 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 1,033,045,967 1,027,334,717 22,569,724 21,561,275 43.29 47.58 47.79
org 120,801,129 120,187,162 1,825,623 1,723,519 5.06 3.85 3.82
ru 104,255,905 103,876,771 1,201,886 1,148,665 4.38 2.53 2.55
de 100,187,160 99,594,720 2,691,173 2,527,415 4.20 5.67 5.60
net 79,592,518 79,287,027 1,539,377 1,468,322 3.34 3.25 3.25
jp 52,516,660 52,319,435 799,181 759,844 2.20 1.68 1.68
uk 50,728,251 50,457,847 1,114,604 1,058,887 2.13 2.35 2.35
it 41,361,225 41,176,040 714,839 673,990 1.74 1.51 1.49
pl 40,856,095 40,689,377 641,755 610,835 1.71 1.35 1.35
fr 39,238,083 39,011,819 820,554 790,443 1.64 1.73 1.75
br 37,569,509 37,417,049 578,981 543,145 1.58 1.22 1.20
nl 35,279,964 35,081,956 916,870 861,775 1.48 1.93 1.91
cn 25,295,913 25,256,658 1,153,283 1,045,461 1.06 2.43 2.32
edu 25,313,524 25,191,760 117,165 114,614 1.06 0.25 0.25
au 24,714,701 24,593,591 492,372 472,012 1.04 1.04 1.05
cz 23,521,844 23,373,226 385,514 363,474 0.98 0.81 0.81
es 21,374,464 21,257,753 304,622 290,413 0.90 0.64 0.64
ca 21,298,655 21,183,475 435,476 415,750 0.89 0.92 0.92
ua 17,822,943 17,498,499 115,600 112,012 0.74 0.24 0.25
ro 16,123,394 16,081,485 198,002 181,514 0.68 0.42 0.40
eu 16,047,991 15,965,459 335,815 318,589 0.67 0.71 0.71
in 15,674,352 15,622,206 288,920 275,264 0.66 0.61 0.61
info 14,634,554 14,585,559 251,578 240,487 0.61 0.53 0.53
se 14,254,445 14,170,805 300,010 286,107 0.60 0.63 0.63
ch 13,643,647 13,560,397 406,862 382,776 0.57 0.86 0.85
vn 13,231,868 13,187,487 143,787 137,327 0.56 0.30 0.30
gr 12,744,976 12,711,196 158,079 145,884 0.54 0.33 0.32
be 11,891,372 11,826,503 304,111 286,284 0.50 0.64 0.63
hu 11,038,401 10,993,799 176,609 165,850 0.46 0.37 0.37
gov 10,558,423 10,472,084 27,147 25,674 0.44 0.06 0.06
id 10,467,144 10,438,058 159,448 153,592 0.44 0.34 0.34
at 10,482,397 10,410,814 274,315 259,911 0.44 0.58 0.58
co 10,483,143 10,389,648 210,240 204,945 0.44 0.44 0.45
dk 10,396,869 10,321,433 250,880 240,683 0.43 0.53 0.53
kr 9,637,959 9,606,659 196,570 169,338 0.40 0.41 0.38
tr 9,168,235 9,131,056 129,062 117,185 0.38 0.27 0.26
sk 8,971,210 8,929,771 129,725 121,992 0.38 0.27 0.27
tw 8,937,129 8,894,877 115,043 104,586 0.37 0.24 0.23
ar 8,360,377 8,338,102 130,875 119,042 0.35 0.28 0.26
fi 8,069,926 8,026,335 150,294 140,218 0.34 0.32 0.31
no 7,494,609 7,447,361 142,033 135,377 0.31 0.30 0.30
mx 7,279,280 7,239,844 104,316 99,237 0.31 0.22 0.22
pt 7,106,300 7,073,520 101,303 93,020 0.30 0.21 0.21
io 6,859,259 6,793,337 226,959 224,470 0.29 0.48 0.50
ir 6,334,589 6,320,308 70,370 68,484 0.27 0.15 0.15
cl 5,626,944 5,604,638 93,683 88,999 0.24 0.20 0.20
za 5,614,593 5,594,465 125,613 118,796 0.24 0.26 0.26
il 5,505,237 5,484,601 88,886 83,876 0.23 0.19 0.19
shop 5,334,985 5,314,379 107,015 105,503 0.22 0.23 0.23
nz 5,150,752 5,121,455 115,541 110,868 0.22 0.24 0.25
tv 5,025,303 4,999,164 40,694 38,692 0.21 0.09 0.09
by 4,638,235 4,626,125 47,312 45,153 0.19 0.10 0.10
hr 4,413,212 4,397,598 55,414 49,883 0.19 0.12 0.11
us 4,346,021 4,326,799 101,663 97,957 0.18 0.21 0.22
me 4,309,970 4,280,500 97,434 95,613 0.18 0.21 0.21
lt 4,185,177 4,164,815 65,905 61,976 0.18 0.14 0.14
rs 4,025,372 4,014,754 42,422 39,070 0.17 0.09 0.09
ie 3,930,234 3,910,911 66,774 63,829 0.16 0.14 0.14
kz 3,731,943 3,718,987 38,886 37,326 0.16 0.08 0.08
cc 3,727,030 3,694,845 68,578 64,899 0.16 0.14 0.14
ee 3,609,875 3,592,447 48,242 43,546 0.15 0.10 0.10
online 3,532,744 3,516,712 99,664 98,208 0.15 0.21 0.22
si 3,531,432 3,514,771 57,198 51,068 0.15 0.12 0.11
biz 3,447,383 3,434,416 84,447 80,990 0.14 0.18 0.18
xyz 3,324,015 3,279,638 158,169 156,247 0.14 0.33 0.35
bg 3,209,011 3,197,490 27,579 26,290 0.13 0.06 0.06
my 2,949,550 2,938,289 52,619 49,399 0.12 0.11 0.11
hk 2,931,120 2,910,622 37,997 34,012 0.12 0.08 0.08
th 2,823,459 2,814,210 36,025 32,283 0.12 0.08 0.07
cat 2,689,809 2,674,959 23,894 22,442 0.11 0.05 0.05
lv 2,629,192 2,615,381 34,243 31,343 0.11 0.07 0.07
app 2,413,560 2,399,210 102,988 102,206 0.10 0.22 0.23
pro 2,338,311 2,324,740 55,281 54,230 0.10 0.12 0.12
top 2,166,844 2,153,473 95,695 92,808 0.09 0.20 0.21
pe 2,102,638 2,095,905 27,050 25,598 0.09 0.06 0.06
pk 2,095,828 2,087,997 25,529 24,519 0.09 0.05 0.05
news 2,086,126 2,080,295 8,734 8,031 0.09 0.02 0.02
ai 2,061,044 2,040,531 63,078 61,776 0.09 0.13 0.14
sg 1,883,543 1,873,765 34,571 32,531 0.08 0.07 0.07
su 1,869,875 1,858,801 21,372 20,513 0.08 0.05 0.05
store 1,791,487 1,782,377 48,412 47,750 0.08 0.10 0.11
ae 1,681,349 1,673,629 26,957 25,821 0.07 0.06 0.06
club 1,555,494 1,548,421 34,306 33,538 0.07 0.07 0.07
ng 1,519,048 1,514,387 17,879 17,155 0.06 0.04 0.04
link 1,491,002 1,488,982 18,946 18,784 0.06 0.04 0.04
ph 1,417,890 1,385,187 19,148 18,276 0.06 0.04 0.04
fm 1,368,839 1,366,149 8,297 8,069 0.06 0.02 0.02
is 1,347,781 1,341,568 18,339 17,311 0.06 0.04 0.04
az 1,312,584 1,309,308 9,828 8,924 0.06 0.02 0.02
ba 1,303,379 1,300,971 12,440 11,365 0.05 0.03 0.03
md 1,252,071 1,248,003 11,325 10,606 0.05 0.02 0.02