Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2026-30

View the Project on GitHub

Top-Level Domains of the Latest Monthly Crawl

Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2026-30). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru contain also the occurrences of .рф.

pages urls hosts domains %urls %hosts %domains
type
gTLD 1,139,802,862 1,132,544,052 23,181,314 22,055,626 53.02 57.20 57.45
ccTLD 969,577,826 964,070,372 16,970,440 15,974,190 45.14 41.88 41.61
sTLD 30,753,386 30,492,508 185,756 178,975 1.43 0.46 0.47
grTLD 5,011,905 4,987,495 117,176 112,241 0.23 0.29 0.29
IDN ccTLD 3,642,597 3,629,753 65,394 63,525 0.17 0.16 0.17
IDN gTLD 169,629 169,321 3,359 3,272 0.01 0.01 0.01
ARPA 4 4 3 3 0.00 0.00 0.00

pages urls hosts domains %urls %hosts %domains
tld
com 896,073,363 890,339,981 18,697,835 17,788,972 41.68 46.14 46.34
org 118,372,182 117,584,110 1,790,062 1,681,093 5.51 4.42 4.38
ru 108,690,895 108,248,697 1,126,173 1,062,629 5.07 2.78 2.77
de 94,884,584 94,228,722 2,412,967 2,234,638 4.41 5.95 5.82
net 62,363,556 62,059,918 1,141,154 1,074,866 2.91 2.82 2.80
jp 50,955,261 50,697,860 723,827 685,063 2.37 1.79 1.78
uk 42,151,317 41,839,562 997,581 949,213 1.96 2.46 2.47
fr 41,973,834 41,730,075 878,208 842,764 1.95 2.17 2.20
it 40,538,305 40,349,258 641,838 609,700 1.89 1.58 1.59
pl 39,628,662 39,456,488 598,877 569,046 1.85 1.48 1.48
br 36,808,025 36,624,409 533,490 499,306 1.71 1.32 1.30
nl 30,821,754 30,621,906 777,528 730,845 1.43 1.92 1.90
cz 24,369,964 24,220,992 373,328 349,740 1.13 0.92 0.91
cn 20,534,104 20,486,453 566,172 515,350 0.96 1.40 1.34
es 19,270,908 19,151,130 297,404 284,907 0.90 0.73 0.74
ua 18,816,522 18,685,045 128,856 123,763 0.87 0.32 0.32
au 17,716,666 17,618,124 404,200 389,458 0.82 1.00 1.01
ca 17,550,396 17,442,931 384,689 368,331 0.82 0.95 0.96
edu 16,429,617 16,285,684 106,110 103,695 0.76 0.26 0.27
eu 15,742,169 15,650,838 295,843 278,187 0.73 0.73 0.72
in 14,482,551 14,420,640 263,174 248,839 0.68 0.65 0.65
se 14,414,960 14,326,414 286,473 273,284 0.67 0.71 0.71
ch 14,176,126 14,062,002 391,372 362,264 0.66 0.97 0.94
vn 12,318,913 12,276,190 119,311 113,259 0.57 0.29 0.30
info 12,146,683 12,091,681 205,232 193,701 0.57 0.51 0.50
be 11,881,217 11,807,527 283,647 265,994 0.55 0.70 0.69
ro 11,756,243 11,706,199 136,010 128,279 0.55 0.34 0.33
dk 11,012,303 10,927,577 255,249 244,687 0.51 0.63 0.64
gr 10,713,665 10,677,143 135,772 127,621 0.50 0.34 0.33
hu 10,587,557 10,540,649 178,479 167,060 0.49 0.44 0.44
at 10,594,973 10,506,647 253,751 238,785 0.49 0.63 0.62
tr 10,297,171 10,254,639 126,531 114,954 0.48 0.31 0.30
co 9,693,525 9,570,071 181,961 176,372 0.45 0.45 0.46
kr 9,466,167 9,435,673 188,740 157,080 0.44 0.47 0.41
gov 9,020,923 8,939,451 26,802 25,316 0.42 0.07 0.07
id 8,868,383 8,841,576 119,876 115,408 0.41 0.30 0.30
tw 8,847,890 8,812,382 114,149 102,612 0.41 0.28 0.27
sk 8,327,501 8,277,852 121,472 113,653 0.39 0.30 0.30
ir 7,976,639 7,946,061 60,785 58,592 0.37 0.15 0.15
fi 7,783,932 7,727,583 138,725 132,529 0.36 0.34 0.35
io 7,580,587 7,490,292 217,754 214,018 0.35 0.54 0.56
ar 7,429,775 7,403,064 118,822 107,608 0.35 0.29 0.28
no 6,924,007 6,874,744 135,450 128,433 0.32 0.33 0.33
pt 6,368,696 6,331,230 90,159 83,973 0.30 0.22 0.22
mx 6,136,567 6,108,416 96,828 91,649 0.29 0.24 0.24
by 5,074,390 5,048,179 43,540 41,500 0.24 0.11 0.11
cl 4,866,517 4,793,314 76,487 72,983 0.22 0.19 0.19
il 4,626,931 4,601,972 75,858 73,187 0.22 0.19 0.19
za 4,482,652 4,461,280 111,457 106,513 0.21 0.28 0.28
tv 4,202,234 4,176,935 34,009 31,967 0.20 0.08 0.08
nz 4,185,364 4,160,707 101,448 97,573 0.19 0.25 0.25
kz 4,107,863 4,087,545 31,140 29,767 0.19 0.08 0.08
ai 3,950,281 3,909,304 86,307 83,646 0.18 0.21 0.22
me 3,903,204 3,874,076 79,894 77,819 0.18 0.20 0.20
lt 3,835,189 3,816,555 59,742 56,453 0.18 0.15 0.15
rs 3,740,247 3,727,637 42,455 39,451 0.17 0.10 0.10
hr 3,613,356 3,590,806 41,253 38,268 0.17 0.10 0.10
ee 3,561,227 3,543,730 47,032 42,414 0.17 0.12 0.11
us 3,382,831 3,360,982 86,679 82,490 0.16 0.21 0.21
cc 3,217,751 3,197,068 65,787 62,874 0.15 0.16 0.16
bg 3,203,564 3,187,965 30,313 28,535 0.15 0.07 0.07
shop 3,065,784 3,031,504 65,305 63,727 0.14 0.16 0.17
app 2,988,057 2,962,814 120,159 118,616 0.14 0.30 0.31
ie 2,963,982 2,945,539 51,889 49,882 0.14 0.13 0.13
si 2,800,042 2,787,133 41,088 38,159 0.13 0.10 0.10
online 2,778,028 2,766,402 67,292 66,072 0.13 0.17 0.17
biz 2,758,839 2,747,251 69,345 65,863 0.13 0.17 0.17
my 2,625,909 2,613,500 45,172 42,807 0.12 0.11 0.11
cat 2,627,735 2,612,489 24,699 23,227 0.12 0.06 0.06
th 2,548,611 2,535,472 34,123 30,701 0.12 0.08 0.08
hk 2,549,259 2,531,333 33,964 29,976 0.12 0.08 0.08
lv 2,213,736 2,197,190 28,583 26,255 0.10 0.07 0.07
pro 2,008,753 1,997,026 43,301 42,151 0.09 0.11 0.11
xyz 1,883,988 1,870,824 84,821 83,473 0.09 0.21 0.22
pk 1,838,584 1,831,253 24,058 22,990 0.09 0.06 0.06
su 1,807,302 1,798,782 19,062 18,020 0.08 0.05 0.05
news 1,792,060 1,786,173 7,349 6,651 0.08 0.02 0.02
pe 1,763,538 1,753,855 22,711 21,587 0.08 0.06 0.06
ae 1,624,390 1,613,292 26,422 25,302 0.08 0.07 0.07
top 1,611,466 1,598,232 74,069 72,666 0.07 0.18 0.19
sg 1,574,323 1,563,332 28,970 27,507 0.07 0.07 0.07
club 1,364,627 1,357,954 28,226 27,466 0.06 0.07 0.07
md 1,333,860 1,329,173 10,830 10,063 0.06 0.03 0.03
ph 1,343,655 1,272,940 15,726 14,875 0.06 0.04 0.04
ng 1,245,032 1,240,937 14,084 13,360 0.06 0.03 0.03
ba 1,223,871 1,220,750 11,139 10,280 0.06 0.03 0.03
dev 1,225,324 1,216,646 49,860 49,076 0.06 0.12 0.13
uy 1,136,034 1,131,053 12,796 11,832 0.05 0.03 0.03
uz 1,117,611 1,111,117 10,448 9,800 0.05 0.03 0.03
click 1,099,214 1,086,215 10,195 10,087 0.05 0.03 0.03
nu 1,085,980 1,080,885 25,406 24,084 0.05 0.06 0.06
ge 1,082,851 1,078,504 12,604 11,352 0.05 0.03 0.03
store 1,084,375 1,073,234 26,258 25,704 0.05 0.06 0.07