Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2026-43

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2026-43). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,169,476,094 1,161,882,653 23,933,093 22,870,130 53.90 57.68 57.96
ccTLD 961,617,464 955,747,452 17,190,590 16,230,584 44.34 41.43 41.13
sTLD 29,658,273 29,433,433 185,703 178,992 1.37 0.45 0.45
grTLD 5,003,626 4,976,001 117,345 112,915 0.23 0.28 0.29
IDN ccTLD 3,460,178 3,449,147 63,521 61,631 0.16 0.15 0.16
IDN gTLD 165,010 164,629 3,362 3,282 0.01 0.01 0.01
ARPA 5 5 5 5 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 919,336,363 913,289,032 19,145,725 18,291,763 42.37 46.14 46.36
org 121,634,459 120,884,970 1,832,515 1,727,989 5.61 4.42 4.38
ru 100,597,834 100,166,240 1,103,303 1,040,458 4.65 2.66 2.64
de 92,377,541 91,701,565 2,395,620 2,227,016 4.25 5.77 5.64
net 61,081,302 60,761,197 1,127,078 1,065,190 2.82 2.72 2.70
jp 48,821,663 48,598,466 678,239 643,811 2.25 1.63 1.63
uk 47,227,774 46,741,409 1,085,318 1,033,734 2.17 2.62 2.62
it 42,275,559 42,043,520 675,701 646,293 1.95 1.63 1.64
fr 41,426,245 41,192,700 872,292 837,693 1.91 2.10 2.12
pl 36,446,960 36,276,112 549,724 525,832 1.68 1.32 1.33
br 36,353,247 36,168,812 536,530 502,823 1.68 1.29 1.27
nl 30,189,528 29,858,946 763,977 721,760 1.39 1.84 1.83
cz 23,864,906 23,712,191 366,166 343,997 1.10 0.88 0.87
au 22,025,055 21,893,697 496,169 480,165 1.02 1.20 1.22
es 20,572,356 20,425,230 307,149 294,663 0.95 0.74 0.75
cn 19,812,541 19,769,045 529,872 480,518 0.92 1.28 1.22
ca 18,810,692 18,671,125 419,431 403,139 0.87 1.01 1.02
ua 18,601,200 18,464,405 128,693 123,675 0.86 0.31 0.31
edu 16,036,414 15,911,016 105,584 103,202 0.74 0.25 0.26
eu 15,507,224 15,402,607 296,064 279,758 0.71 0.71 0.71
se 14,356,338 14,260,507 290,549 277,207 0.66 0.70 0.70
ch 14,216,888 14,100,889 400,002 370,968 0.65 0.96 0.94
in 13,785,336 13,717,104 264,446 250,618 0.64 0.64 0.64
ro 11,972,204 11,924,717 135,214 127,884 0.55 0.33 0.32
info 11,814,518 11,757,538 197,789 187,264 0.55 0.48 0.47
be 11,648,900 11,573,054 281,880 264,913 0.54 0.68 0.67
dk 10,924,166 10,850,345 269,457 258,645 0.50 0.65 0.66
vn 10,877,636 10,840,646 115,445 109,392 0.50 0.28 0.28
hu 10,587,904 10,539,546 176,279 165,336 0.49 0.42 0.42
at 10,463,149 10,379,348 254,510 240,476 0.48 0.61 0.61
gr 10,155,276 10,115,148 137,455 129,004 0.47 0.33 0.33
kr 9,876,793 9,845,264 183,815 153,792 0.46 0.44 0.39
co 9,701,593 9,614,655 202,865 196,098 0.45 0.49 0.50
tw 8,900,884 8,864,011 113,404 102,301 0.41 0.27 0.26
id 8,657,940 8,631,063 118,631 114,162 0.40 0.29 0.29
io 8,522,016 8,428,830 226,966 223,326 0.39 0.55 0.57
tr 8,372,159 8,334,063 120,190 108,859 0.39 0.29 0.28
gov 8,356,182 8,293,180 26,421 24,894 0.38 0.06 0.06
sk 8,340,317 8,282,604 122,181 114,912 0.38 0.29 0.29
ar 7,601,926 7,577,557 120,249 108,755 0.35 0.29 0.28
fi 7,593,456 7,541,320 136,978 131,482 0.35 0.33 0.33
ir 7,112,783 7,091,046 70,045 67,608 0.33 0.17 0.17
no 7,028,195 6,977,253 137,921 131,243 0.32 0.33 0.33
pt 6,137,877 6,105,456 89,337 83,488 0.28 0.22 0.21
mx 5,965,695 5,933,616 99,128 93,959 0.28 0.24 0.24
ai 5,269,637 5,214,426 106,916 104,084 0.24 0.26 0.26
by 4,991,839 4,973,994 45,221 42,700 0.23 0.11 0.11
il 4,900,946 4,874,315 77,135 74,460 0.23 0.19 0.19
cl 4,841,435 4,820,112 77,148 73,787 0.22 0.19 0.19
za 4,615,610 4,590,400 113,385 108,882 0.21 0.27 0.28
nz 4,339,616 4,297,698 111,948 108,032 0.20 0.27 0.27
tv 4,296,216 4,264,077 35,929 34,081 0.20 0.09 0.09
rs 4,166,723 4,149,634 43,872 40,888 0.19 0.11 0.10
app 4,040,865 4,011,504 145,104 143,501 0.19 0.35 0.36
lt 3,864,027 3,843,868 58,850 55,700 0.18 0.14 0.14
me 3,856,455 3,822,492 80,165 78,174 0.18 0.19 0.20
us 3,847,658 3,788,229 96,523 91,282 0.18 0.23 0.23
ee 3,689,773 3,668,891 49,185 44,823 0.17 0.12 0.11
ie 3,488,358 3,466,639 57,625 55,568 0.16 0.14 0.14
hr 3,446,674 3,429,880 38,309 35,510 0.16 0.09 0.09
kz 3,371,931 3,356,839 32,585 31,033 0.16 0.08 0.08
cc 3,274,941 3,254,468 125,690 122,921 0.15 0.30 0.31
shop 3,054,090 3,039,605 78,557 75,844 0.14 0.19 0.19
si 3,016,683 2,999,771 41,283 38,536 0.14 0.10 0.10
online 2,839,174 2,823,573 78,506 77,300 0.13 0.19 0.20
bg 2,815,658 2,800,561 30,323 28,583 0.13 0.07 0.07
cat 2,754,243 2,737,110 25,512 24,066 0.13 0.06 0.06
biz 2,694,530 2,681,084 65,970 62,948 0.12 0.16 0.16
my 2,654,110 2,640,361 49,253 46,977 0.12 0.12 0.12
xyz 2,605,139 2,559,013 126,796 124,710 0.12 0.31 0.32
hk 2,510,015 2,490,386 33,782 29,935 0.12 0.08 0.08
th 2,494,340 2,484,240 32,937 29,755 0.12 0.08 0.08
lv 2,264,845 2,251,106 28,044 25,950 0.10 0.07 0.07
pro 2,055,969 2,043,092 46,757 45,640 0.09 0.11 0.12
news 1,920,738 1,911,136 7,873 7,201 0.09 0.02 0.02
pe 1,810,315 1,801,330 23,456 22,342 0.08 0.06 0.06
sg 1,732,504 1,718,909 30,978 29,617 0.08 0.07 0.08
ae 1,725,877 1,714,521 27,466 26,388 0.08 0.07 0.07
su 1,648,299 1,640,902 17,974 16,968 0.08 0.04 0.04
top 1,568,466 1,556,282 119,354 118,066 0.07 0.29 0.30
pk 1,550,540 1,545,489 24,295 23,208 0.07 0.06 0.06
dev 1,536,703 1,525,128 58,431 57,651 0.07 0.14 0.15
club 1,282,818 1,275,779 28,745 28,003 0.06 0.07 0.07
ph 1,279,579 1,275,706 17,908 17,092 0.06 0.04 0.04
md 1,225,547 1,219,940 10,778 10,036 0.06 0.03 0.03
ng 1,220,331 1,216,028 14,063 13,385 0.06 0.03 0.03
click 1,186,847 1,174,216 12,767 12,561 0.05 0.03 0.03
store 1,154,446 1,145,731 32,331 31,782 0.05 0.08 0.08
ge 1,145,251 1,139,840 12,569 11,375 0.05 0.03 0.03
ba 1,139,893 1,136,878 10,422 9,660 0.05 0.03 0.02
nu 1,103,729 1,099,326 25,342 24,070 0.05 0.06 0.06
az 1,098,247 1,095,156 8,268 7,371 0.05 0.02 0.02
is 1,101,323 1,094,276 15,461 14,724 0.05 0.04 0.04
uy 1,089,421 1,084,378 12,140 11,270 0.05 0.03 0.03