Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-18
Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2025-18). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru
contain also the occurrences of .рф.
pages | urls | hosts | domains | %urls | %hosts | %domains | |
---|---|---|---|---|---|---|---|
type | |||||||
gTLD | 1,513,523,443 | 1,504,721,266 | 28,181,391 | 27,024,437 | 55.08 | 59.26 | 59.53 |
ccTLD | 1,173,324,212 | 1,166,998,201 | 18,941,971 | 17,949,910 | 42.72 | 39.83 | 39.54 |
sTLD | 49,904,759 | 49,528,787 | 206,881 | 200,172 | 1.81 | 0.44 | 0.44 |
grTLD | 6,717,130 | 6,683,208 | 149,829 | 145,226 | 0.24 | 0.32 | 0.32 |
IDN ccTLD | 3,607,849 | 3,595,185 | 71,658 | 70,195 | 0.13 | 0.15 | 0.15 |
IDN gTLD | 178,546 | 178,044 | 3,852 | 3,784 | 0.01 | 0.01 | 0.01 |
ARPA | 2 | 2 | 2 | 2 | 0.00 | 0.00 | 0.00 |
pages | urls | hosts | domains | %urls | %hosts | %domains | |
---|---|---|---|---|---|---|---|
tld | |||||||
com | 1,186,810,799 | 1,179,805,873 | 22,823,315 | 21,874,122 | 43.19 | 47.99 | 48.19 |
org | 151,040,871 | 150,226,848 | 1,905,769 | 1,804,237 | 5.50 | 4.01 | 3.97 |
ru | 115,552,826 | 115,065,287 | 1,224,861 | 1,170,353 | 4.21 | 2.58 | 2.58 |
de | 112,752,445 | 112,080,069 | 2,671,133 | 2,508,300 | 4.10 | 5.62 | 5.53 |
net | 92,480,514 | 92,079,619 | 1,450,902 | 1,383,196 | 3.37 | 3.05 | 3.05 |
uk | 62,853,258 | 62,472,942 | 1,136,686 | 1,093,708 | 2.29 | 2.39 | 2.41 |
jp | 60,765,420 | 60,527,672 | 805,746 | 765,978 | 2.22 | 1.69 | 1.69 |
it | 49,253,981 | 49,038,366 | 711,094 | 675,757 | 1.80 | 1.50 | 1.49 |
pl | 48,286,862 | 48,054,055 | 632,498 | 606,045 | 1.76 | 1.33 | 1.34 |
fr | 47,158,207 | 46,900,998 | 832,897 | 802,650 | 1.72 | 1.75 | 1.77 |
br | 42,957,580 | 42,769,572 | 586,661 | 548,851 | 1.57 | 1.23 | 1.21 |
nl | 40,265,937 | 40,012,801 | 906,195 | 858,585 | 1.46 | 1.91 | 1.89 |
au | 31,839,678 | 31,671,025 | 516,661 | 501,199 | 1.16 | 1.09 | 1.10 |
edu | 31,708,940 | 31,510,990 | 119,964 | 117,377 | 1.15 | 0.25 | 0.26 |
cz | 28,347,157 | 28,135,596 | 406,415 | 383,446 | 1.03 | 0.85 | 0.84 |
ca | 25,359,629 | 25,194,072 | 423,490 | 408,391 | 0.92 | 0.89 | 0.90 |
es | 25,330,385 | 25,188,018 | 304,698 | 293,462 | 0.92 | 0.64 | 0.65 |
cn | 24,916,169 | 24,863,518 | 1,045,971 | 939,295 | 0.91 | 2.20 | 2.07 |
eu | 18,704,155 | 18,607,674 | 327,957 | 311,837 | 0.68 | 0.69 | 0.69 |
ua | 18,367,768 | 18,067,400 | 112,721 | 109,238 | 0.66 | 0.24 | 0.24 |
ro | 17,128,334 | 17,059,201 | 181,278 | 172,106 | 0.62 | 0.38 | 0.38 |
in | 16,894,842 | 16,825,332 | 276,204 | 263,560 | 0.62 | 0.58 | 0.58 |
info | 16,339,393 | 16,274,696 | 274,799 | 263,581 | 0.60 | 0.58 | 0.58 |
ch | 16,225,070 | 16,129,607 | 408,965 | 385,181 | 0.59 | 0.86 | 0.85 |
se | 16,200,139 | 16,090,549 | 283,473 | 272,008 | 0.59 | 0.60 | 0.60 |
gr | 14,059,973 | 14,011,221 | 147,937 | 139,695 | 0.51 | 0.31 | 0.31 |
vn | 13,732,721 | 13,676,704 | 136,517 | 130,918 | 0.50 | 0.29 | 0.29 |
be | 13,590,084 | 13,515,740 | 305,235 | 288,235 | 0.49 | 0.64 | 0.63 |
hu | 12,760,530 | 12,702,419 | 177,299 | 167,154 | 0.46 | 0.37 | 0.37 |
dk | 12,651,692 | 12,558,120 | 233,907 | 224,790 | 0.46 | 0.49 | 0.50 |
co | 12,401,849 | 12,247,926 | 228,618 | 223,802 | 0.45 | 0.48 | 0.49 |
at | 11,788,838 | 11,704,035 | 271,768 | 258,521 | 0.43 | 0.57 | 0.57 |
gov | 11,552,271 | 11,447,944 | 27,224 | 25,810 | 0.42 | 0.06 | 0.06 |
kr | 11,165,695 | 11,133,272 | 193,916 | 166,886 | 0.41 | 0.41 | 0.37 |
id | 11,098,041 | 11,061,489 | 150,050 | 145,786 | 0.40 | 0.32 | 0.32 |
tw | 10,020,628 | 9,958,894 | 111,875 | 102,139 | 0.36 | 0.24 | 0.23 |
sk | 9,871,051 | 9,821,968 | 127,836 | 120,047 | 0.36 | 0.27 | 0.26 |
ir | 9,794,744 | 9,760,792 | 100,729 | 97,208 | 0.36 | 0.21 | 0.21 |
fi | 9,325,055 | 9,268,353 | 144,083 | 138,198 | 0.34 | 0.30 | 0.30 |
tr | 9,063,670 | 9,025,161 | 122,376 | 111,911 | 0.33 | 0.26 | 0.25 |
no | 8,548,614 | 8,493,526 | 138,789 | 132,908 | 0.31 | 0.29 | 0.29 |
ar | 8,444,825 | 8,419,937 | 129,287 | 115,359 | 0.31 | 0.27 | 0.25 |
mx | 8,280,643 | 8,238,617 | 101,826 | 97,029 | 0.30 | 0.21 | 0.21 |
pt | 8,141,471 | 8,100,715 | 98,395 | 92,198 | 0.30 | 0.21 | 0.20 |
io | 8,051,775 | 7,972,773 | 250,704 | 248,245 | 0.29 | 0.53 | 0.55 |
nz | 6,425,569 | 6,390,175 | 113,930 | 110,456 | 0.23 | 0.24 | 0.24 |
za | 6,279,030 | 6,252,142 | 118,553 | 114,295 | 0.23 | 0.25 | 0.25 |
cl | 6,215,900 | 6,191,643 | 88,623 | 84,983 | 0.23 | 0.19 | 0.19 |
il | 6,091,256 | 6,059,173 | 84,784 | 82,030 | 0.22 | 0.18 | 0.18 |
shop | 5,977,187 | 5,949,161 | 112,491 | 110,883 | 0.22 | 0.24 | 0.24 |
tv | 5,440,378 | 5,414,592 | 40,472 | 38,517 | 0.20 | 0.09 | 0.08 |
us | 5,064,337 | 5,037,795 | 103,233 | 99,694 | 0.18 | 0.22 | 0.22 |
by | 4,979,269 | 4,958,218 | 46,106 | 44,380 | 0.18 | 0.10 | 0.10 |
me | 4,833,094 | 4,786,571 | 96,335 | 94,557 | 0.18 | 0.20 | 0.21 |
hr | 4,718,850 | 4,698,685 | 51,855 | 48,064 | 0.17 | 0.11 | 0.11 |
lt | 4,682,031 | 4,653,427 | 65,251 | 61,378 | 0.17 | 0.14 | 0.14 |
ie | 4,573,866 | 4,547,543 | 62,975 | 60,853 | 0.17 | 0.13 | 0.13 |
app | 4,229,290 | 4,212,043 | 111,032 | 110,225 | 0.15 | 0.23 | 0.24 |
bg | 4,116,322 | 4,098,674 | 33,240 | 31,433 | 0.15 | 0.07 | 0.07 |
ee | 4,080,354 | 4,061,316 | 48,336 | 43,689 | 0.15 | 0.10 | 0.10 |
rs | 4,029,232 | 4,015,851 | 40,682 | 37,856 | 0.15 | 0.09 | 0.08 |
si | 4,025,393 | 4,003,600 | 54,067 | 50,063 | 0.15 | 0.11 | 0.11 |
online | 3,979,788 | 3,960,030 | 105,990 | 104,482 | 0.14 | 0.22 | 0.23 |
biz | 3,839,804 | 3,821,169 | 91,458 | 88,170 | 0.14 | 0.19 | 0.19 |
cc | 3,765,346 | 3,739,185 | 69,383 | 65,985 | 0.14 | 0.15 | 0.15 |
kz | 3,739,516 | 3,724,087 | 38,254 | 36,674 | 0.14 | 0.08 | 0.08 |
th | 3,492,411 | 3,479,910 | 34,881 | 31,557 | 0.13 | 0.07 | 0.07 |
xyz | 3,344,189 | 3,318,302 | 141,498 | 139,623 | 0.12 | 0.30 | 0.31 |
my | 3,324,410 | 3,306,121 | 49,750 | 47,537 | 0.12 | 0.10 | 0.10 |
hk | 3,258,523 | 3,217,411 | 37,604 | 33,719 | 0.12 | 0.08 | 0.07 |
cat | 2,998,861 | 2,983,294 | 23,714 | 22,401 | 0.11 | 0.05 | 0.05 |
lv | 2,811,702 | 2,795,644 | 32,427 | 29,769 | 0.10 | 0.07 | 0.07 |
pro | 2,541,059 | 2,527,364 | 52,834 | 51,801 | 0.09 | 0.11 | 0.11 |
store | 2,361,797 | 2,342,246 | 50,489 | 49,848 | 0.09 | 0.11 | 0.11 |
top | 2,332,189 | 2,314,317 | 105,375 | 102,676 | 0.08 | 0.22 | 0.23 |
pk | 2,307,570 | 2,294,446 | 23,655 | 22,759 | 0.08 | 0.05 | 0.05 |
sg | 2,224,080 | 2,210,428 | 33,524 | 32,068 | 0.08 | 0.07 | 0.07 |
news | 2,195,760 | 2,185,995 | 8,688 | 7,995 | 0.08 | 0.02 | 0.02 |
pe | 2,193,148 | 2,180,493 | 25,645 | 24,544 | 0.08 | 0.05 | 0.05 |
ai | 2,022,630 | 2,002,731 | 60,568 | 59,338 | 0.07 | 0.13 | 0.13 |
su | 1,981,541 | 1,966,678 | 21,426 | 20,534 | 0.07 | 0.05 | 0.05 |
link | 1,809,589 | 1,806,766 | 18,833 | 18,680 | 0.07 | 0.04 | 0.04 |
ae | 1,791,796 | 1,782,543 | 25,598 | 24,680 | 0.07 | 0.05 | 0.05 |
club | 1,742,481 | 1,732,866 | 36,979 | 36,270 | 0.06 | 0.08 | 0.08 |
fm | 1,712,097 | 1,708,445 | 8,962 | 8,741 | 0.06 | 0.02 | 0.02 |
ph | 1,713,464 | 1,707,067 | 18,904 | 18,097 | 0.06 | 0.04 | 0.04 |
ng | 1,577,219 | 1,571,208 | 17,127 | 16,501 | 0.06 | 0.04 | 0.04 |
is | 1,538,412 | 1,531,664 | 18,253 | 17,335 | 0.06 | 0.04 | 0.04 |
az | 1,485,681 | 1,481,374 | 9,716 | 8,794 | 0.05 | 0.02 | 0.02 |
nu | 1,401,495 | 1,396,339 | 28,602 | 27,443 | 0.05 | 0.06 | 0.06 |
ba | 1,380,061 | 1,370,988 | 11,755 | 10,936 | 0.05 | 0.02 | 0.02 |
ge | 1,370,226 | 1,366,772 | 13,240 | 12,102 | 0.05 | 0.03 | 0.03 |