Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2025-47

View the Project on GitHub

Top-Level Domains By Year and Continent

Many top-level domains can be mapped to geographic regions, for example, the country-code TLDs or regional one (.asia). For other domains, such as .com or .net this is not possible.

The aggregation by year and the percentage allows to better understand the long-term trends of top-level domain and geographical coverage. For the latter, TLDs are mapped to continents. distribution over continents

Percentage of top-level domains by year and continent

The underlying data of the plot is provided in the table below or as CSV (tlds-by-year-and-continent.csv).

The second table shows the percentage of the 16 most common top-level domains. The data is also provided as CSV: selected-tlds-by-year.csv.

(other) com,net org edu gov,mil North America South America Oceania Africa Asia Europe
year
2009 2.37 80.38 8.10 1.28 0.38 0.11 0.49 0.64 0.03 1.48 4.75
2010 1.49 74.96 7.14 1.31 0.51 0.77 0.98 1.41 0.13 1.78 9.53
2012 1.81 61.29 6.02 0.61 0.27 1.31 1.19 1.74 0.23 2.77 22.76
2013 0.40 76.35 9.40 2.91 1.41 1.02 0.42 1.08 0.19 0.85 5.97
2014 0.42 76.45 9.75 3.36 1.69 0.96 0.53 0.87 0.18 0.83 4.96
2015 0.37 76.47 10.25 3.34 1.68 0.84 0.51 0.85 0.17 0.81 4.69
2016 0.74 68.20 8.96 2.48 1.27 0.95 0.81 1.09 0.24 2.48 12.77
2017 1.38 60.76 5.64 1.02 0.42 1.15 1.38 1.33 0.30 5.13 21.49
2018 2.47 54.47 5.28 0.75 0.28 1.40 1.72 1.51 0.40 5.87 25.83
2019 2.80 50.19 5.68 0.89 0.31 1.36 2.04 1.65 0.48 6.62 27.99
2020 2.76 48.68 5.68 1.08 0.35 1.36 2.18 1.66 0.48 7.16 28.61
2021 2.81 47.91 5.71 1.28 0.41 1.45 2.34 1.72 0.50 6.68 29.17
2022 2.88 48.93 6.16 1.49 0.48 1.51 2.08 1.40 0.48 6.37 28.21
2023 2.99 50.02 6.06 1.31 0.47 1.57 1.66 0.94 0.43 6.36 28.21
2024 3.05 46.96 5.51 1.14 0.44 1.59 2.63 1.66 0.60 7.68 28.76
2025 3.18 46.55 5.16 1.03 0.43 1.65 2.80 1.76 0.63 8.37 28.43

com org ru net de uk jp edu fr it pl nl br au cz info
year
(any) 52.23 6.41 4.03 3.78 3.27 2.06 1.66 1.44 1.36 1.35 1.24 1.11 0.98 0.82 0.82 0.76
2009 71.20 8.10 0.05 9.19 0.05 4.04 0.05 1.28 0.02 0.04 0.19 0.01 0.34 0.60 0.01 1.81
2010 68.93 7.14 0.46 6.03 1.51 3.12 0.50 1.31 0.44 0.57 0.48 0.44 0.79 1.02 0.17 1.07
2012 55.86 6.02 1.71 5.43 4.75 3.45 1.14 0.61 1.30 1.30 1.79 1.43 0.76 0.98 0.76 1.32
2013 73.08 9.40 0.06 3.27 1.12 2.00 0.16 2.91 0.38 0.34 0.02 0.25 0.22 0.63 0.10 0.22
2014 73.25 9.75 0.11 3.20 0.81 1.74 0.13 3.36 0.30 0.26 0.16 0.16 0.28 0.51 0.06 0.21
2015 73.31 10.25 0.11 3.16 0.76 1.67 0.14 3.34 0.28 0.25 0.14 0.17 0.26 0.51 0.05 0.18
2016 64.55 8.96 2.56 3.66 1.97 1.79 0.81 2.48 0.63 0.65 0.49 0.51 0.43 0.60 0.52 0.37
2017 56.54 5.64 5.30 4.22 2.83 2.03 2.09 1.02 1.15 1.08 0.99 0.73 0.81 0.70 0.85 0.69
2018 50.06 5.28 6.06 4.41 3.49 2.22 2.16 0.75 1.42 1.28 1.37 1.02 0.99 0.78 0.93 1.26
2019 46.21 5.68 5.09 3.98 3.88 2.38 1.99 0.89 1.67 1.63 1.51 1.38 1.19 0.92 0.99 1.26
2020 44.97 5.68 4.85 3.71 4.03 2.30 1.89 1.08 1.75 1.70 1.52 1.46 1.31 0.98 1.02 0.87
2021 44.33 5.71 4.79 3.59 4.15 2.38 1.89 1.28 1.79 1.77 1.59 1.52 1.40 1.05 1.05 0.76
2022 45.38 6.16 4.14 3.56 4.21 1.75 1.78 1.49 1.85 1.88 1.66 1.64 1.05 0.80 1.03 0.70
2023 46.53 6.06 4.27 3.49 4.30 0.77 1.66 1.31 1.91 2.06 1.64 1.76 0.49 0.41 1.08 0.68
2024 43.65 5.51 4.40 3.32 4.03 2.09 2.08 1.14 1.75 1.92 1.75 1.54 1.41 1.05 1.03 0.62
2025 43.27 5.16 4.26 3.28 4.16 2.19 2.25 1.03 1.71 1.74 1.69 1.48 1.56 1.13 1.01 0.61