Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-33

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2025-33). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,313,853,971 1,306,987,453 27,482,678 26,398,685 53.79 57.82 58.38
ccTLD 1,080,013,349 1,074,592,776 19,627,944 18,413,888 44.22 41.29 40.72
sTLD 38,632,062 38,383,098 196,037 189,484 1.58 0.41 0.42
grTLD 6,032,181 6,007,049 146,282 141,821 0.25 0.31 0.31
IDN ccTLD 3,729,717 3,718,183 74,198 72,713 0.15 0.16 0.16
IDN gTLD 170,161 169,760 3,922 3,852 0.01 0.01 0.01
ARPA 7 7 7 7 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 1,041,842,524 1,036,246,365 22,296,710 21,403,158 42.65 46.91 47.33
org 114,640,395 114,085,178 1,788,013 1,698,004 4.70 3.76 3.75
ru 110,162,466 109,751,195 1,233,924 1,182,884 4.52 2.60 2.62
de 106,223,203 105,596,049 2,706,753 2,550,114 4.35 5.69 5.64
net 80,157,445 79,861,409 1,446,422 1,382,519 3.29 3.04 3.06
uk 56,572,748 56,266,289 1,133,534 1,082,703 2.32 2.38 2.39
jp 55,933,579 55,714,344 831,724 791,591 2.29 1.75 1.75
fr 44,062,487 43,821,303 866,866 837,202 1.80 1.82 1.85
it 40,479,099 40,296,639 667,416 632,174 1.66 1.40 1.40
pl 40,219,985 40,069,611 627,925 599,930 1.65 1.32 1.33
nl 37,186,919 36,967,500 911,751 861,317 1.52 1.92 1.90
br 37,110,584 36,964,909 560,566 527,483 1.52 1.18 1.17
au 30,392,019 30,245,832 537,619 517,748 1.24 1.13 1.14
cn 27,970,153 27,922,394 1,629,067 1,327,180 1.15 3.43 2.93
cz 24,291,060 24,142,617 379,787 359,436 0.99 0.80 0.79
edu 23,117,586 23,004,294 112,274 109,831 0.95 0.24 0.24
ca 22,670,268 22,555,447 427,158 409,857 0.93 0.90 0.91
es 21,326,495 21,205,412 300,408 288,155 0.87 0.63 0.64
ua 18,386,950 18,039,301 113,738 110,200 0.74 0.24 0.24
eu 16,427,674 16,350,523 331,779 316,056 0.67 0.70 0.70
in 16,252,815 16,196,717 288,928 275,793 0.67 0.61 0.61
ro 15,590,860 15,544,217 190,104 176,183 0.64 0.40 0.39
ch 15,080,149 14,986,065 417,430 392,527 0.62 0.88 0.87
info 14,722,622 14,674,580 247,744 237,591 0.60 0.52 0.53
se 14,568,379 14,487,379 287,504 275,172 0.60 0.60 0.61
vn 13,349,270 13,297,379 144,490 138,396 0.55 0.30 0.31
gr 12,928,078 12,890,410 156,678 145,418 0.53 0.33 0.32
be 12,647,360 12,579,837 303,615 287,031 0.52 0.64 0.63
dk 11,651,602 11,574,470 247,499 237,938 0.48 0.52 0.53
hu 11,608,872 11,563,064 176,441 166,055 0.48 0.37 0.37
co 11,368,702 11,254,170 208,652 203,695 0.46 0.44 0.45
at 11,030,974 10,954,751 276,124 262,177 0.45 0.58 0.58
ir 10,563,225 10,536,417 99,712 96,421 0.43 0.21 0.21
id 10,096,863 10,072,025 155,234 150,266 0.41 0.33 0.33
kr 10,090,761 10,062,800 195,164 168,718 0.41 0.41 0.37
gov 10,035,955 9,962,212 26,565 25,178 0.41 0.06 0.06
tr 9,485,750 9,440,608 129,884 118,370 0.39 0.27 0.26
sk 9,386,110 9,338,728 129,884 122,578 0.38 0.27 0.27
tw 9,000,367 8,964,868 114,554 104,151 0.37 0.24 0.23
fi 8,208,572 8,167,108 149,063 140,157 0.34 0.31 0.31
ar 8,150,881 8,127,757 128,021 117,303 0.33 0.27 0.26
no 7,746,006 7,701,222 141,428 135,321 0.32 0.30 0.30
mx 7,679,089 7,647,578 102,203 97,502 0.31 0.22 0.22
pt 7,147,191 7,116,650 100,218 92,586 0.29 0.21 0.20
io 6,756,926 6,690,436 211,250 208,996 0.28 0.44 0.46
za 6,544,539 6,520,766 137,045 130,640 0.27 0.29 0.29
shop 6,351,896 6,331,130 114,573 113,041 0.26 0.24 0.25
nz 6,120,629 6,089,568 116,473 112,147 0.25 0.25 0.25
cl 5,806,989 5,782,418 91,239 87,020 0.24 0.19 0.19
il 5,762,525 5,741,305 87,787 83,336 0.24 0.18 0.18
tv 4,900,820 4,877,180 39,338 37,406 0.20 0.08 0.08
by 4,678,682 4,660,133 46,807 44,839 0.19 0.10 0.10
hr 4,566,377 4,551,416 54,407 49,532 0.19 0.11 0.11
us 4,528,772 4,506,842 99,419 95,998 0.19 0.21 0.21
me 4,385,240 4,360,352 93,760 92,057 0.18 0.20 0.20
lt 4,334,928 4,311,454 64,802 61,105 0.18 0.14 0.14
ie 4,309,537 4,286,237 67,363 64,623 0.18 0.14 0.14
rs 4,022,681 4,011,669 41,847 38,703 0.17 0.09 0.09
cc 3,913,904 3,878,027 68,871 65,319 0.16 0.14 0.14
kz 3,588,971 3,576,591 35,380 34,132 0.15 0.07 0.08
online 3,478,595 3,465,563 101,028 99,717 0.14 0.21 0.22
si 3,465,174 3,452,029 56,340 50,797 0.14 0.12 0.11
biz 3,400,353 3,389,386 86,964 83,776 0.14 0.18 0.19
bg 3,353,533 3,342,276 27,279 26,015 0.14 0.06 0.06
ee 3,310,815 3,296,345 45,446 41,125 0.14 0.10 0.09
my 3,040,327 3,028,978 51,274 48,460 0.12 0.11 0.11
hk 3,007,240 2,985,729 36,984 33,223 0.12 0.08 0.07
th 2,774,447 2,763,899 35,238 31,755 0.11 0.07 0.07
top 2,736,238 2,724,961 96,867 94,660 0.11 0.20 0.21
xyz 2,738,378 2,710,348 138,223 136,684 0.11 0.29 0.30
cat 2,598,177 2,580,525 23,961 22,658 0.11 0.05 0.05
lv 2,569,939 2,559,085 33,230 30,575 0.11 0.07 0.07
pk 2,358,011 2,348,479 26,794 25,806 0.10 0.06 0.06
pro 2,333,300 2,320,201 54,106 53,091 0.10 0.11 0.12
store 2,305,204 2,294,422 49,249 48,597 0.09 0.10 0.11
app 2,262,002 2,246,401 100,736 99,951 0.09 0.21 0.22
pe 2,195,441 2,188,086 26,891 25,654 0.09 0.06 0.06
sg 2,096,644 2,084,845 33,530 31,653 0.09 0.07 0.07
news 2,074,174 2,069,026 8,470 7,841 0.09 0.02 0.02
ai 2,074,420 2,056,679 65,906 64,498 0.08 0.14 0.14
su 1,875,339 1,869,078 20,837 19,988 0.08 0.04 0.04
ae 1,855,380 1,847,358 27,402 26,347 0.08 0.06 0.06
link 1,808,276 1,806,507 17,728 17,588 0.07 0.04 0.04
club 1,594,548 1,587,032 34,488 33,829 0.07 0.07 0.07
ng 1,564,222 1,558,862 18,748 17,891 0.06 0.04 0.04
fm 1,531,534 1,527,997 8,240 8,010 0.06 0.02 0.02
ph 1,562,402 1,452,553 18,862 18,029 0.06 0.04 0.04
is 1,415,681 1,408,923 18,249 17,330 0.06 0.04 0.04
ba 1,344,785 1,342,404 12,395 11,439 0.06 0.03 0.03
az 1,274,673 1,270,506 9,545 8,664 0.05 0.02 0.02