Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2026-17

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2026-17). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,171,334,855 1,164,494,368 24,710,880 23,512,597 53.43 57.19 57.44
ccTLD 978,982,191 973,606,537 18,109,685 17,050,029 44.67 41.91 41.65
sTLD 32,358,184 32,108,658 187,582 180,650 1.47 0.43 0.44
grTLD 5,193,228 5,169,879 126,260 120,978 0.24 0.29 0.30
IDN ccTLD 3,840,679 3,829,455 70,933 69,059 0.18 0.16 0.17
IDN gTLD 172,377 171,948 4,062 3,981 0.01 0.01 0.01
ARPA 1 1 1 1 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 918,035,054 912,637,644 19,928,575 18,965,474 41.88 46.12 46.33
org 120,478,054 119,738,931 1,831,092 1,712,048 5.49 4.24 4.18
ru 106,756,027 106,349,919 1,188,137 1,121,954 4.88 2.75 2.74
de 95,650,541 94,950,427 2,496,888 2,307,593 4.36 5.78 5.64
net 65,050,604 64,753,682 1,220,248 1,148,766 2.97 2.82 2.81
jp 50,331,104 50,090,914 731,504 691,571 2.30 1.69 1.69
uk 46,106,320 45,806,154 1,062,304 1,010,498 2.10 2.46 2.47
fr 42,237,000 42,002,602 917,847 880,184 1.93 2.12 2.15
pl 41,491,471 41,309,416 634,884 603,401 1.90 1.47 1.47
it 38,060,552 37,875,266 662,750 627,568 1.74 1.53 1.53
br 37,254,474 37,094,432 562,266 525,191 1.70 1.30 1.28
nl 32,137,629 31,937,772 820,393 769,987 1.47 1.90 1.88
cz 24,497,312 24,243,284 377,628 353,443 1.11 0.87 0.86
cn 23,650,354 23,599,961 1,026,423 969,028 1.08 2.38 2.37
es 19,880,767 19,756,848 309,111 295,492 0.91 0.72 0.72
ua 19,359,646 19,197,917 123,964 119,024 0.88 0.29 0.29
au 19,300,780 19,191,339 431,138 414,215 0.88 1.00 1.01
ca 18,388,028 18,282,578 399,341 382,048 0.84 0.92 0.93
edu 18,167,199 18,038,391 106,032 103,607 0.83 0.25 0.25
eu 15,928,468 15,829,300 311,177 292,747 0.73 0.72 0.72
in 14,703,150 14,650,031 278,968 264,109 0.67 0.65 0.65
se 14,641,754 14,549,917 309,180 294,004 0.67 0.72 0.72
ch 14,139,669 14,023,492 401,642 371,051 0.64 0.93 0.91
vn 13,013,793 12,962,675 129,026 123,017 0.59 0.30 0.30
info 12,790,040 12,741,500 220,350 207,825 0.58 0.51 0.51
ro 12,775,628 12,724,876 147,761 139,069 0.58 0.34 0.34
be 11,861,578 11,785,902 293,514 274,881 0.54 0.68 0.67
dk 11,544,786 11,471,765 275,476 263,196 0.53 0.64 0.64
gr 11,427,100 11,386,614 145,816 136,383 0.52 0.34 0.33
hu 11,124,200 11,076,250 193,742 181,660 0.51 0.45 0.44
at 10,516,664 10,440,830 258,354 242,569 0.48 0.60 0.59
id 9,633,148 9,605,620 136,284 131,129 0.44 0.32 0.32
co 9,499,717 9,398,703 189,183 183,379 0.43 0.44 0.45
tw 9,396,997 9,360,501 124,182 112,077 0.43 0.29 0.27
tr 9,177,139 9,143,395 128,514 116,768 0.42 0.30 0.29
kr 9,155,743 9,128,208 195,165 163,555 0.42 0.45 0.40
sk 8,689,320 8,627,849 127,792 119,007 0.40 0.30 0.29
gov 8,689,554 8,624,661 27,028 25,495 0.40 0.06 0.06
fi 7,844,908 7,794,541 144,227 137,573 0.36 0.33 0.34
ar 7,591,879 7,567,442 125,889 113,699 0.35 0.29 0.28
no 7,252,962 7,205,272 141,135 133,720 0.33 0.33 0.33
io 7,107,020 7,038,495 212,249 208,109 0.32 0.49 0.51
pt 6,500,568 6,462,776 94,760 88,054 0.30 0.22 0.22
mx 6,367,373 6,341,409 100,173 94,740 0.29 0.23 0.23
cl 5,111,970 5,088,776 81,026 77,224 0.23 0.19 0.19
il 4,828,801 4,804,202 79,699 76,917 0.22 0.18 0.19
by 4,666,987 4,645,396 43,329 41,266 0.21 0.10 0.10
za 4,509,805 4,489,262 113,557 108,413 0.21 0.26 0.26
tv 4,470,769 4,451,517 35,655 33,463 0.20 0.08 0.08
shop 4,447,572 4,435,503 74,998 73,536 0.20 0.17 0.18
nz 4,238,892 4,213,404 106,498 102,214 0.19 0.25 0.25
rs 4,128,226 4,112,394 44,174 40,978 0.19 0.10 0.10
lt 3,893,450 3,876,186 62,259 58,616 0.18 0.14 0.14
me 3,880,514 3,856,068 84,785 82,591 0.18 0.20 0.20
cc 3,674,616 3,658,758 75,294 72,081 0.17 0.17 0.18
us 3,651,299 3,628,822 93,422 89,006 0.17 0.22 0.22
hr 3,501,079 3,487,007 41,729 38,628 0.16 0.10 0.09
ee 3,473,932 3,457,253 48,658 43,816 0.16 0.11 0.11
app 3,203,341 3,181,514 113,218 111,719 0.15 0.26 0.27
ie 3,115,239 3,097,579 54,718 52,573 0.14 0.13 0.13
online 3,087,616 3,071,529 79,200 77,713 0.14 0.18 0.19
si 3,084,130 3,070,999 42,991 39,820 0.14 0.10 0.10
ai 3,097,545 3,064,149 80,872 78,310 0.14 0.19 0.19
kz 3,053,650 3,043,287 29,245 27,871 0.14 0.07 0.07
bg 3,001,650 2,988,367 26,482 25,233 0.14 0.06 0.06
biz 2,883,480 2,871,392 74,010 70,339 0.13 0.17 0.17
my 2,684,804 2,673,686 47,155 44,750 0.12 0.11 0.11
cat 2,616,179 2,603,022 25,079 23,585 0.12 0.06 0.06
hk 2,565,271 2,547,023 35,543 31,323 0.12 0.08 0.08
xyz 2,514,466 2,500,638 134,418 132,344 0.11 0.31 0.32
th 2,491,264 2,482,862 35,242 31,524 0.11 0.08 0.08
lv 2,262,924 2,246,863 29,827 27,263 0.10 0.07 0.07
ir 2,219,542 2,214,190 21,170 20,470 0.10 0.05 0.05
pro 2,020,737 2,011,062 47,439 46,138 0.09 0.11 0.11
top 2,016,773 2,006,691 88,932 87,453 0.09 0.21 0.21
su 1,906,416 1,899,093 20,528 19,460 0.09 0.05 0.05
pe 1,900,793 1,888,595 24,702 23,504 0.09 0.06 0.06
news 1,891,968 1,885,549 7,614 6,911 0.09 0.02 0.02
pk 1,727,158 1,721,951 23,818 22,678 0.08 0.06 0.06
ae 1,582,478 1,573,648 27,092 25,900 0.07 0.06 0.06
sg 1,564,083 1,551,080 29,816 28,377 0.07 0.07 0.07
club 1,390,628 1,384,288 31,655 30,834 0.06 0.07 0.08
store 1,378,895 1,371,317 33,081 32,475 0.06 0.08 0.08
ng 1,345,357 1,341,787 16,206 15,491 0.06 0.04 0.04
ph 1,276,912 1,251,140 16,404 15,476 0.06 0.04 0.04
ba 1,200,399 1,196,799 11,501 10,620 0.05 0.03 0.03
az 1,193,371 1,189,940 9,113 8,030 0.05 0.02 0.02
md 1,194,537 1,189,715 10,822 10,061 0.05 0.03 0.02
uy 1,161,819 1,156,512 13,550 12,493 0.05 0.03 0.03
is 1,116,164 1,107,682 15,528 14,723 0.05 0.04 0.04
dev 1,110,730 1,101,292 51,054 50,331 0.05 0.12 0.12
ma 1,096,675 1,092,413 14,151 13,332 0.05 0.03 0.03