Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-30
Detailed numbers and percentage of top-level domains (groups) in the latest monthly crawl (CC-MAIN-2025-30). Note that Internationalized country code TLDs (IDN ccTLDs) are mapped to their ASCII equivalents before counting TLDs. E.g., the counts of .ru
contain also the occurrences of .рф.
pages | urls | hosts | domains | %urls | %hosts | %domains | |
---|---|---|---|---|---|---|---|
type | |||||||
gTLD | 1,340,992,863 | 1,333,835,610 | 28,556,229 | 27,426,542 | 55.35 | 59.94 | 60.27 |
ccTLD | 1,031,863,931 | 1,026,604,706 | 18,665,687 | 17,668,800 | 42.60 | 39.18 | 38.83 |
sTLD | 40,372,591 | 40,118,246 | 199,313 | 192,627 | 1.66 | 0.42 | 0.42 |
grTLD | 5,857,179 | 5,831,733 | 146,279 | 141,774 | 0.24 | 0.31 | 0.31 |
IDN ccTLD | 3,268,389 | 3,259,128 | 71,725 | 70,263 | 0.14 | 0.15 | 0.15 |
IDN gTLD | 155,524 | 155,069 | 3,788 | 3,721 | 0.01 | 0.01 | 0.01 |
ARPA | 3 | 3 | 3 | 3 | 0.00 | 0.00 | 0.00 |
pages | urls | hosts | domains | %urls | %hosts | %domains | |
---|---|---|---|---|---|---|---|
tld | |||||||
com | 1,071,766,712 | 1,065,929,651 | 23,312,712 | 22,378,721 | 44.23 | 48.93 | 49.18 |
org | 115,924,643 | 115,349,437 | 1,865,399 | 1,772,005 | 4.79 | 3.92 | 3.89 |
ru | 102,859,410 | 102,439,710 | 1,209,887 | 1,157,665 | 4.25 | 2.54 | 2.54 |
de | 100,789,934 | 100,182,137 | 2,646,105 | 2,491,640 | 4.16 | 5.55 | 5.48 |
net | 79,472,570 | 79,176,419 | 1,408,975 | 1,343,781 | 3.29 | 2.96 | 2.95 |
jp | 55,322,043 | 55,098,746 | 820,351 | 780,088 | 2.29 | 1.72 | 1.71 |
uk | 51,268,600 | 50,980,068 | 1,099,294 | 1,049,652 | 2.12 | 2.31 | 2.31 |
it | 45,203,351 | 45,008,011 | 705,246 | 668,092 | 1.87 | 1.48 | 1.47 |
pl | 38,885,202 | 38,730,981 | 622,434 | 594,077 | 1.61 | 1.31 | 1.31 |
fr | 38,442,569 | 38,222,763 | 786,411 | 757,959 | 1.59 | 1.65 | 1.67 |
br | 36,509,068 | 36,360,549 | 553,953 | 521,034 | 1.51 | 1.16 | 1.15 |
nl | 34,351,228 | 34,144,371 | 885,924 | 836,169 | 1.42 | 1.86 | 1.84 |
cn | 27,629,123 | 27,585,572 | 1,048,685 | 957,309 | 1.14 | 2.20 | 2.10 |
au | 27,436,679 | 27,303,523 | 485,933 | 467,676 | 1.13 | 1.02 | 1.03 |
edu | 24,433,929 | 24,315,044 | 113,768 | 111,315 | 1.01 | 0.24 | 0.24 |
cz | 23,990,425 | 23,833,804 | 381,354 | 360,098 | 0.99 | 0.80 | 0.79 |
ca | 22,348,742 | 22,229,762 | 422,484 | 405,133 | 0.92 | 0.89 | 0.89 |
es | 21,630,563 | 21,510,255 | 299,048 | 286,180 | 0.89 | 0.63 | 0.63 |
ua | 17,175,133 | 16,931,392 | 112,882 | 109,283 | 0.70 | 0.24 | 0.24 |
eu | 15,999,499 | 15,922,855 | 326,081 | 310,164 | 0.66 | 0.68 | 0.68 |
in | 15,161,962 | 15,105,242 | 279,622 | 267,173 | 0.63 | 0.59 | 0.59 |
info | 14,735,825 | 14,689,363 | 247,981 | 237,575 | 0.61 | 0.52 | 0.52 |
ro | 14,485,035 | 14,445,093 | 186,108 | 172,444 | 0.60 | 0.39 | 0.38 |
ch | 14,176,951 | 14,090,082 | 400,324 | 377,581 | 0.58 | 0.84 | 0.83 |
se | 14,130,341 | 14,042,929 | 289,367 | 276,930 | 0.58 | 0.61 | 0.61 |
gr | 12,196,803 | 12,165,541 | 154,881 | 143,118 | 0.50 | 0.33 | 0.31 |
vn | 12,158,738 | 12,098,897 | 137,739 | 131,690 | 0.50 | 0.29 | 0.29 |
be | 11,922,075 | 11,849,961 | 295,708 | 279,172 | 0.49 | 0.62 | 0.61 |
dk | 11,242,152 | 11,167,800 | 251,804 | 242,063 | 0.46 | 0.53 | 0.53 |
hu | 11,052,556 | 11,004,623 | 173,552 | 163,198 | 0.46 | 0.36 | 0.36 |
co | 11,050,471 | 10,958,183 | 211,662 | 206,829 | 0.45 | 0.44 | 0.45 |
at | 10,734,228 | 10,659,358 | 270,035 | 256,330 | 0.44 | 0.57 | 0.56 |
gov | 10,386,301 | 10,304,117 | 26,984 | 25,565 | 0.43 | 0.06 | 0.06 |
kr | 10,034,268 | 10,000,087 | 192,491 | 166,253 | 0.41 | 0.40 | 0.37 |
id | 9,664,304 | 9,637,775 | 152,110 | 147,143 | 0.40 | 0.32 | 0.32 |
ir | 9,136,553 | 9,115,653 | 93,438 | 90,400 | 0.38 | 0.20 | 0.20 |
tw | 8,775,659 | 8,735,569 | 113,410 | 103,281 | 0.36 | 0.24 | 0.23 |
sk | 8,742,546 | 8,701,223 | 127,295 | 119,845 | 0.36 | 0.27 | 0.26 |
tr | 8,619,669 | 8,580,692 | 125,517 | 114,534 | 0.36 | 0.26 | 0.25 |
ar | 8,033,782 | 8,012,112 | 126,900 | 116,140 | 0.33 | 0.27 | 0.26 |
fi | 8,011,076 | 7,967,490 | 146,358 | 137,626 | 0.33 | 0.31 | 0.30 |
no | 7,525,371 | 7,476,350 | 138,084 | 131,994 | 0.31 | 0.29 | 0.29 |
mx | 7,282,246 | 7,240,195 | 100,465 | 95,796 | 0.30 | 0.21 | 0.21 |
pt | 7,006,592 | 6,976,297 | 98,415 | 91,076 | 0.29 | 0.21 | 0.20 |
io | 6,526,821 | 6,467,553 | 214,414 | 212,133 | 0.27 | 0.45 | 0.47 |
shop | 6,016,605 | 5,994,389 | 113,100 | 111,586 | 0.25 | 0.24 | 0.25 |
za | 5,847,030 | 5,826,360 | 129,509 | 123,488 | 0.24 | 0.27 | 0.27 |
nz | 5,855,684 | 5,825,411 | 113,029 | 108,834 | 0.24 | 0.24 | 0.24 |
cl | 5,735,424 | 5,713,101 | 88,830 | 84,674 | 0.24 | 0.19 | 0.19 |
il | 5,507,680 | 5,487,445 | 86,925 | 82,603 | 0.23 | 0.18 | 0.18 |
tv | 4,795,262 | 4,769,455 | 39,540 | 37,601 | 0.20 | 0.08 | 0.08 |
us | 4,345,838 | 4,325,536 | 99,255 | 95,737 | 0.18 | 0.21 | 0.21 |
hr | 4,331,332 | 4,314,455 | 53,761 | 48,845 | 0.18 | 0.11 | 0.11 |
by | 4,305,760 | 4,294,442 | 45,764 | 43,852 | 0.18 | 0.10 | 0.10 |
me | 4,190,841 | 4,159,930 | 95,733 | 94,002 | 0.17 | 0.20 | 0.21 |
lt | 4,134,541 | 4,114,402 | 64,122 | 60,441 | 0.17 | 0.13 | 0.13 |
ie | 3,968,193 | 3,945,218 | 63,950 | 61,361 | 0.16 | 0.13 | 0.13 |
rs | 3,869,431 | 3,856,400 | 41,264 | 38,162 | 0.16 | 0.09 | 0.08 |
cc | 3,770,863 | 3,736,490 | 67,189 | 63,832 | 0.16 | 0.14 | 0.14 |
biz | 3,403,978 | 3,392,520 | 86,418 | 83,181 | 0.14 | 0.18 | 0.18 |
online | 3,321,173 | 3,307,409 | 101,788 | 100,368 | 0.14 | 0.21 | 0.22 |
kz | 3,314,483 | 3,303,983 | 36,558 | 35,156 | 0.14 | 0.08 | 0.08 |
ee | 3,300,231 | 3,284,116 | 45,988 | 41,581 | 0.14 | 0.10 | 0.09 |
bg | 3,267,546 | 3,257,197 | 27,523 | 26,219 | 0.14 | 0.06 | 0.06 |
si | 3,215,167 | 3,199,789 | 55,213 | 49,890 | 0.13 | 0.12 | 0.11 |
xyz | 3,138,217 | 3,092,124 | 155,784 | 153,941 | 0.13 | 0.33 | 0.34 |
my | 2,923,088 | 2,911,119 | 50,822 | 48,005 | 0.12 | 0.11 | 0.11 |
hk | 2,927,434 | 2,904,930 | 36,972 | 33,146 | 0.12 | 0.08 | 0.07 |
th | 2,764,433 | 2,755,422 | 35,396 | 31,850 | 0.11 | 0.07 | 0.07 |
cat | 2,663,456 | 2,646,900 | 23,840 | 22,468 | 0.11 | 0.05 | 0.05 |
lv | 2,624,226 | 2,610,839 | 32,919 | 30,233 | 0.11 | 0.07 | 0.07 |
app | 2,291,914 | 2,275,877 | 100,505 | 99,713 | 0.09 | 0.21 | 0.22 |
top | 2,255,968 | 2,241,356 | 103,975 | 101,787 | 0.09 | 0.22 | 0.22 |
store | 2,212,347 | 2,200,571 | 50,620 | 49,962 | 0.09 | 0.11 | 0.11 |
pk | 2,201,963 | 2,193,570 | 25,807 | 24,852 | 0.09 | 0.05 | 0.05 |
pro | 2,167,430 | 2,154,672 | 54,611 | 53,616 | 0.09 | 0.11 | 0.12 |
ai | 2,040,250 | 2,020,526 | 63,826 | 62,465 | 0.08 | 0.13 | 0.14 |
pe | 2,018,425 | 2,010,756 | 25,787 | 24,500 | 0.08 | 0.05 | 0.05 |
news | 2,001,346 | 1,994,700 | 8,652 | 7,964 | 0.08 | 0.02 | 0.02 |
sg | 1,995,861 | 1,984,701 | 33,196 | 31,395 | 0.08 | 0.07 | 0.07 |
ae | 1,807,823 | 1,800,092 | 26,536 | 25,499 | 0.07 | 0.06 | 0.06 |
su | 1,755,473 | 1,749,894 | 20,796 | 19,959 | 0.07 | 0.04 | 0.04 |
club | 1,519,339 | 1,512,565 | 34,174 | 33,514 | 0.06 | 0.07 | 0.07 |
ph | 1,575,155 | 1,458,525 | 18,713 | 17,873 | 0.06 | 0.04 | 0.04 |
is | 1,401,721 | 1,394,242 | 18,119 | 17,189 | 0.06 | 0.04 | 0.04 |
ng | 1,326,195 | 1,321,946 | 17,140 | 16,408 | 0.05 | 0.04 | 0.04 |
ba | 1,313,935 | 1,310,269 | 12,362 | 11,348 | 0.05 | 0.03 | 0.02 |
az | 1,297,679 | 1,294,895 | 9,633 | 8,772 | 0.05 | 0.02 | 0.02 |