Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2026-34

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2026-34). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,129,906,012 1,123,255,528 22,945,585 21,835,400 52.80 57.01 57.26
ccTLD 970,088,823 964,834,276 16,932,223 15,944,226 45.35 42.07 41.81
sTLD 30,460,936 30,247,497 185,780 179,079 1.42 0.46 0.47
grTLD 4,972,433 4,948,187 115,125 110,354 0.23 0.29 0.29
IDN ccTLD 3,956,882 3,944,676 66,472 64,531 0.19 0.17 0.17
IDN gTLD 180,322 179,790 3,328 3,239 0.01 0.01 0.01
ARPA 33 33 2 2 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 887,406,279 882,099,793 18,487,726 17,591,266 41.46 45.93 46.13
org 116,432,511 115,765,352 1,763,571 1,657,217 5.44 4.38 4.35
ru 108,392,121 107,908,719 1,133,606 1,068,089 5.07 2.82 2.80
de 93,680,168 93,081,131 2,393,764 2,218,650 4.38 5.95 5.82
net 61,573,705 61,275,188 1,120,662 1,055,138 2.88 2.78 2.77
jp 50,123,478 49,907,384 712,227 674,465 2.35 1.77 1.77
uk 44,018,878 43,725,366 1,022,681 974,661 2.06 2.54 2.56
fr 42,299,146 42,081,101 882,232 846,446 1.98 2.19 2.22
it 39,720,301 39,537,335 653,837 620,442 1.86 1.62 1.63
pl 39,624,228 39,449,775 601,312 571,787 1.85 1.49 1.50
br 37,183,880 37,010,583 536,646 502,728 1.74 1.33 1.32
nl 29,866,034 29,641,165 746,925 702,362 1.39 1.86 1.84
cz 23,836,995 23,701,302 368,042 345,296 1.11 0.91 0.91
ua 19,822,189 19,664,172 129,985 124,802 0.92 0.32 0.33
es 19,563,502 19,451,258 299,260 286,658 0.91 0.74 0.75
cn 19,370,671 19,329,172 523,304 474,114 0.91 1.30 1.24
au 19,338,265 19,232,191 436,654 421,518 0.90 1.08 1.11
ca 17,443,490 17,339,538 385,007 369,223 0.82 0.96 0.97
edu 16,362,503 16,245,752 106,037 103,672 0.76 0.26 0.27
eu 15,647,865 15,535,686 293,160 275,715 0.73 0.73 0.72
se 14,203,709 14,125,015 285,961 272,720 0.66 0.71 0.72
ch 14,029,963 13,925,588 389,503 360,739 0.65 0.97 0.95
in 13,918,130 13,859,145 260,131 245,891 0.65 0.65 0.64
vn 12,489,129 12,447,600 119,291 113,137 0.59 0.30 0.30
ro 12,184,514 12,134,168 135,771 128,277 0.57 0.34 0.34
info 12,039,043 11,993,976 199,218 188,064 0.56 0.49 0.49
be 11,609,194 11,531,747 279,096 261,825 0.54 0.69 0.69
dk 10,925,528 10,854,513 253,616 243,159 0.51 0.63 0.64
gr 10,634,489 10,592,823 136,741 128,500 0.50 0.34 0.34
at 10,566,893 10,488,429 253,468 238,622 0.49 0.63 0.63
hu 10,526,358 10,484,342 178,375 166,977 0.49 0.44 0.44
tr 10,403,988 10,360,005 132,389 120,236 0.49 0.33 0.32
co 9,667,547 9,569,800 183,778 177,207 0.45 0.46 0.46
kr 9,488,169 9,462,857 184,825 154,353 0.44 0.46 0.40
id 8,856,895 8,832,317 119,047 114,557 0.42 0.30 0.30
tw 8,782,121 8,745,893 114,104 102,625 0.41 0.28 0.27
gov 8,715,404 8,652,070 26,740 25,243 0.41 0.07 0.07
ir 8,635,649 8,604,116 70,933 68,339 0.40 0.18 0.18
sk 8,466,285 8,414,036 121,631 114,007 0.40 0.30 0.30
io 7,855,899 7,768,121 218,218 214,468 0.37 0.54 0.56
fi 7,695,425 7,651,225 138,400 132,302 0.36 0.34 0.35
ar 7,270,026 7,247,721 118,083 106,823 0.34 0.29 0.28
no 6,820,179 6,775,747 134,383 127,440 0.32 0.33 0.33
pt 6,260,583 6,224,930 89,229 83,046 0.29 0.22 0.22
mx 6,080,265 6,031,764 96,926 91,729 0.28 0.24 0.24
by 5,296,999 5,272,429 44,458 42,273 0.25 0.11 0.11
il 4,897,147 4,870,202 76,033 73,425 0.23 0.19 0.19
cl 4,754,155 4,732,847 76,565 73,129 0.22 0.19 0.19
za 4,719,564 4,698,203 113,386 108,779 0.22 0.28 0.29
tv 4,313,050 4,285,539 34,271 32,227 0.20 0.09 0.08
ai 4,281,248 4,239,363 91,176 88,370 0.20 0.23 0.23
rs 4,198,232 4,183,786 43,383 40,399 0.20 0.11 0.11
kz 4,129,611 4,110,069 33,144 31,655 0.19 0.08 0.08
nz 4,069,324 4,030,205 103,204 99,302 0.19 0.26 0.26
lt 3,863,703 3,846,585 59,214 55,974 0.18 0.15 0.15
me 3,827,786 3,797,761 78,478 76,377 0.18 0.19 0.20
ee 3,696,402 3,677,028 47,871 43,258 0.17 0.12 0.11
app 3,652,021 3,630,622 138,366 136,763 0.17 0.34 0.36
hr 3,519,147 3,504,219 40,429 37,526 0.16 0.10 0.10
us 3,474,117 3,448,340 87,915 83,741 0.16 0.22 0.22
bg 3,261,045 3,246,042 29,781 28,069 0.15 0.07 0.07
cc 3,206,930 3,191,694 63,369 60,458 0.15 0.16 0.16
shop 3,067,917 3,053,468 66,269 64,545 0.14 0.16 0.17
ie 3,054,377 3,034,323 52,739 50,761 0.14 0.13 0.13
si 3,020,227 3,007,807 41,282 38,397 0.14 0.10 0.10
online 2,773,870 2,761,198 66,876 65,646 0.13 0.17 0.17
biz 2,688,006 2,675,918 66,814 63,481 0.13 0.17 0.17
th 2,672,517 2,662,783 34,646 31,146 0.13 0.09 0.08
cat 2,645,176 2,631,797 24,761 23,324 0.12 0.06 0.06
my 2,630,014 2,618,320 45,090 42,787 0.12 0.11 0.11
hk 2,490,327 2,472,764 33,694 29,720 0.12 0.08 0.08
lv 2,224,010 2,211,152 28,413 26,084 0.10 0.07 0.07
xyz 2,161,178 2,147,259 91,304 89,893 0.10 0.23 0.24
pro 2,037,911 2,026,658 43,844 42,687 0.10 0.11 0.11
su 1,846,952 1,840,203 19,065 18,020 0.09 0.05 0.05
news 1,825,740 1,816,963 7,548 6,831 0.09 0.02 0.02
pe 1,757,461 1,746,292 22,907 21,801 0.08 0.06 0.06
pk 1,738,589 1,730,688 24,089 23,014 0.08 0.06 0.06
ae 1,641,010 1,629,445 26,893 25,744 0.08 0.07 0.07
sg 1,569,668 1,558,170 29,113 27,719 0.07 0.07 0.07
top 1,563,347 1,553,096 68,504 67,175 0.07 0.17 0.18
club 1,296,649 1,289,525 27,833 27,077 0.06 0.07 0.07
ba 1,271,984 1,269,015 11,017 10,183 0.06 0.03 0.03
dev 1,266,232 1,256,244 51,404 50,578 0.06 0.13 0.13
ph 1,256,120 1,252,932 15,906 15,065 0.06 0.04 0.04
store 1,245,510 1,238,371 28,282 27,718 0.06 0.07 0.07
md 1,219,866 1,215,231 10,483 9,721 0.06 0.03 0.03
ng 1,170,428 1,167,313 13,979 13,243 0.05 0.03 0.03
uz 1,168,688 1,160,628 10,632 9,947 0.05 0.03 0.03
click 1,136,395 1,124,870 9,362 9,242 0.05 0.02 0.02
ge 1,123,901 1,120,762 12,468 11,280 0.05 0.03 0.03
uy 1,098,500 1,093,285 12,086 11,186 0.05 0.03 0.03
ma 1,089,663 1,084,981 13,173 12,442 0.05 0.03 0.03
nu 1,086,972 1,082,160 25,157 23,877 0.05 0.06 0.06