Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-21

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2025-21). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,365,900,801 1,358,560,915 27,632,586 26,521,903 55.13 58.82 59.08
ccTLD 1,059,357,851 1,054,097,353 18,925,633 17,959,277 42.78 40.28 40.01
sTLD 42,024,144 41,739,528 204,713 198,081 1.69 0.44 0.44
grTLD 6,091,185 6,062,636 142,271 137,931 0.25 0.30 0.31
IDN ccTLD 3,538,550 3,529,425 72,375 70,927 0.14 0.15 0.16
IDN gTLD 183,958 183,451 3,963 3,897 0.01 0.01 0.01
ARPA 5 5 5 5 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 1,083,657,877 1,077,704,733 22,515,654 21,599,650 43.73 47.92 48.11
org 127,285,637 126,633,410 1,821,687 1,728,726 5.14 3.88 3.85
ru 105,956,955 105,558,950 1,205,395 1,152,624 4.28 2.57 2.57
de 102,886,079 102,299,375 2,713,974 2,549,631 4.15 5.78 5.68
net 79,556,835 79,249,786 1,375,478 1,311,100 3.22 2.93 2.92
uk 54,957,349 54,650,695 1,089,898 1,048,895 2.22 2.32 2.34
jp 52,434,915 52,241,275 787,244 749,833 2.12 1.68 1.67
it 43,572,971 43,392,786 708,283 672,839 1.76 1.51 1.50
pl 41,821,799 41,643,308 630,430 603,816 1.69 1.34 1.35
fr 40,843,372 40,620,698 828,015 798,510 1.65 1.76 1.78
br 38,293,292 38,139,328 578,817 545,021 1.55 1.23 1.21
nl 36,907,837 36,700,127 903,657 857,896 1.49 1.92 1.91
au 28,177,621 28,046,465 500,005 485,328 1.14 1.06 1.08
edu 25,667,107 25,535,621 118,455 115,924 1.04 0.25 0.26
cz 23,972,783 23,833,227 391,964 369,644 0.97 0.83 0.82
ca 23,353,365 23,220,558 426,044 411,220 0.94 0.91 0.92
es 22,879,061 22,757,941 301,178 290,180 0.92 0.64 0.65
cn 22,608,080 22,529,880 1,098,940 995,530 0.91 2.34 2.22
ua 17,439,833 17,097,147 112,444 109,055 0.69 0.24 0.24
eu 16,679,651 16,593,717 315,695 300,432 0.67 0.67 0.67
in 16,241,961 16,184,344 284,102 271,921 0.66 0.60 0.61
ro 15,963,553 15,905,164 180,890 172,009 0.65 0.39 0.38
info 14,294,735 14,239,835 250,728 240,226 0.58 0.53 0.54
se 14,321,055 14,224,727 300,517 289,117 0.58 0.64 0.64
ch 14,171,622 14,086,606 406,108 383,938 0.57 0.86 0.86
gr 12,940,671 12,901,265 148,493 140,412 0.52 0.32 0.31
vn 12,659,702 12,620,268 138,628 132,876 0.51 0.30 0.30
be 12,343,769 12,283,218 304,291 287,360 0.50 0.65 0.64
hu 11,359,645 11,316,969 178,779 168,777 0.46 0.38 0.38
dk 11,289,924 11,214,161 266,025 256,791 0.46 0.57 0.57
co 11,288,311 11,188,365 212,451 207,861 0.45 0.45 0.46
at 10,734,261 10,663,025 272,792 259,674 0.43 0.58 0.58
gov 10,417,917 10,325,972 26,921 25,511 0.42 0.06 0.06
id 10,267,775 10,236,887 153,165 148,858 0.42 0.33 0.33
ir 9,615,502 9,592,153 98,172 94,890 0.39 0.21 0.21
kr 9,517,008 9,492,156 196,345 169,129 0.39 0.42 0.38
tr 9,198,948 9,163,905 123,549 113,175 0.37 0.26 0.25
tw 8,877,482 8,840,903 113,603 103,914 0.36 0.24 0.23
sk 8,834,347 8,796,304 129,213 121,594 0.36 0.28 0.27
fi 8,403,278 8,358,763 144,902 139,169 0.34 0.31 0.31
ar 8,360,139 8,333,695 128,138 117,245 0.34 0.27 0.26
mx 7,780,326 7,743,746 101,558 96,990 0.31 0.22 0.22
no 7,670,011 7,621,789 139,775 133,989 0.31 0.30 0.30
pt 7,418,673 7,381,136 97,992 91,912 0.30 0.21 0.20
io 6,955,210 6,894,428 233,733 231,365 0.28 0.50 0.52
za 6,299,756 6,275,605 123,335 119,012 0.25 0.26 0.27
cl 5,983,991 5,962,094 90,053 86,464 0.24 0.19 0.19
shop 5,865,149 5,846,045 103,527 102,077 0.24 0.22 0.23
nz 5,846,672 5,818,111 113,619 110,274 0.24 0.24 0.25
il 5,678,207 5,654,944 85,092 82,486 0.23 0.18 0.18
tv 4,992,843 4,967,823 40,308 38,458 0.20 0.09 0.09
by 4,692,677 4,677,976 45,778 44,054 0.19 0.10 0.10
us 4,632,466 4,609,876 101,840 98,388 0.19 0.22 0.22
me 4,368,564 4,337,540 98,938 97,246 0.18 0.21 0.22
hr 4,307,671 4,292,451 52,459 48,594 0.17 0.11 0.11
lt 4,310,812 4,289,898 65,442 61,742 0.17 0.14 0.14
ie 4,227,164 4,203,546 63,615 61,519 0.17 0.14 0.14
online 3,870,318 3,853,745 96,509 95,097 0.16 0.21 0.21
si 3,847,922 3,820,686 54,444 50,397 0.16 0.12 0.11
ee 3,763,835 3,748,614 48,732 44,143 0.15 0.10 0.10
rs 3,725,385 3,712,548 40,380 37,623 0.15 0.09 0.08
kz 3,695,630 3,683,923 38,658 37,086 0.15 0.08 0.08
cc 3,578,069 3,555,204 68,440 64,879 0.14 0.15 0.14
biz 3,497,866 3,483,428 84,220 81,106 0.14 0.18 0.18
bg 3,196,475 3,185,655 27,353 26,089 0.13 0.06 0.06
my 3,043,474 3,031,692 49,942 47,726 0.12 0.11 0.11
xyz 3,038,682 3,018,577 138,460 136,779 0.12 0.29 0.30
hk 2,883,778 2,867,386 37,590 33,766 0.12 0.08 0.08
th 2,797,789 2,787,961 35,327 31,988 0.11 0.08 0.07
cat 2,798,298 2,783,361 23,866 22,603 0.11 0.05 0.05
app 2,714,160 2,700,560 100,780 100,052 0.11 0.21 0.22
lv 2,588,367 2,573,960 32,333 29,725 0.10 0.07 0.07
pro 2,306,967 2,293,900 52,632 51,680 0.09 0.11 0.12
pk 2,266,099 2,255,612 23,920 23,094 0.09 0.05 0.05
store 2,251,005 2,240,394 45,710 45,123 0.09 0.10 0.10
pe 2,229,350 2,221,310 25,940 24,865 0.09 0.06 0.06
top 2,124,445 2,109,683 99,314 96,048 0.09 0.21 0.21
news 2,070,309 2,063,546 8,616 7,957 0.08 0.02 0.02
sg 2,025,559 2,015,693 33,614 32,188 0.08 0.07 0.07
fm 1,941,295 1,936,900 8,714 8,484 0.08 0.02 0.02
ai 1,906,526 1,889,354 60,640 59,429 0.08 0.13 0.13
su 1,876,531 1,865,719 21,525 20,641 0.08 0.05 0.05
ae 1,796,627 1,786,547 26,142 25,236 0.07 0.06 0.06
club 1,612,232 1,604,481 34,325 33,606 0.07 0.07 0.07
ng 1,580,141 1,575,019 17,140 16,566 0.06 0.04 0.04
ph 1,540,441 1,535,152 18,959 18,200 0.06 0.04 0.04
link 1,413,069 1,410,955 17,222 17,073 0.06 0.04 0.04
is 1,416,706 1,410,446 18,140 17,230 0.06 0.04 0.04
az 1,343,488 1,340,509 9,821 8,924 0.05 0.02 0.02
ba 1,267,995 1,263,977 11,916 11,065 0.05 0.03 0.02