Statistics of Common Crawl Monthly Archives

Number of pages, distribution of top-level domains, crawl overlaps, etc. - basic metrics about Common Crawl Monthly Crawl Archives
Latest crawl: CC-MAIN-2021-31

View the Project on GitHub

Top-500 Registered Domains of the Latest Main Crawl

The table below shows the top-500 (in terms of page captures) registered domains of the latest main/monthly crawl (CC-MAIN-2021-31). The underlying data is provided as CSV, see domains-top-500.csv.

Note that the ranking by page captures only partially corresponds with the importance of domains, given that the crawler respects the robots.txt and tries hard not to overload web servers. High-ranking domains such tend to be underrepresented. If you’re looking for a list of domain or host names ranked by page rank or harmonic centrality, consider to use one of the webgraph datasets instead.

domain pages urls hosts %pages %urls
blogspot.com 19184361 19103275 403629 0.606124 0.606783
wordpress.com 12788305 12733102 389288 0.404042 0.404446
livejournal.com 8508551 8481478 62806 0.268825 0.269400
wikipedia.org 6187601 6183475 651 0.195495 0.196408
photoshelter.com 2879154 2877287 4239 0.090966 0.091392
europa.eu 1846329 1832623 504 0.058334 0.058210
fandom.com 1803875 1785547 11699 0.056993 0.056715
workplace.com 1777714 1777679 207 0.056166 0.056465
hatenablog.com 1432753 1398726 29136 0.045267 0.044428
yahoo.com 1378030 1372835 318 0.043538 0.043606
stackexchange.com 1375403 1313953 344 0.043455 0.041736
altervista.org 1271390 1267955 5641 0.040169 0.040274
wiktionary.org 1213745 1213337 343 0.038348 0.038540
fc2.com 1117241 1115938 11398 0.035299 0.035446
osu.edu 1003311 1002634 816 0.031699 0.031847
uol.com.br 978297 974827 660 0.030909 0.030964
herokuapp.com 957834 957585 4538 0.030262 0.030416
google.com 941544 927933 551 0.029748 0.029474
yahoo.co.jp 938436 928940 203 0.029650 0.029506
ox.ac.uk 895716 888683 970 0.028300 0.028228
airbnb.com 885727 885069 53 0.027984 0.028113
mit.edu 866337 864428 1523 0.027372 0.027457
tistory.com 858570 858349 6510 0.027126 0.027264
elsevier.com 842168 841136 77 0.026608 0.026717
sapo.pt 809271 806027 3770 0.025569 0.025602
pinterest.com 806235 805532 30 0.025473 0.025586
nih.gov 795814 782241 412 0.025143 0.024847
pixnet.net 793068 791861 5157 0.025057 0.025152
alibaba.com 783404 782564 6035 0.024751 0.024857
threadless.com 767871 767490 3672 0.024261 0.024378
craigslist.org 757757 757104 700 0.023941 0.024048
web.app 740221 729905 5788 0.023387 0.023184
usda.gov 731675 731096 174 0.023117 0.023222
typepad.com 724431 723551 13903 0.022888 0.022982
yandex.ru 722320 720763 99 0.022821 0.022894
usatoday.com 712046 710998 99 0.022497 0.022584
tradingview.com 680203 679624 27 0.021491 0.021587
harvard.edu 667536 666017 1565 0.021091 0.021155
thefreedictionary.com 666505 659749 27 0.021058 0.020956
appspot.com 657172 656084 1993 0.020763 0.020839
medium.com 639482 638316 44017 0.020204 0.020275
amazonaws.com 631078 625598 6643 0.019939 0.019871
cafe24.com 622901 622469 4082 0.019680 0.019772
cornell.edu 614613 613515 900 0.019419 0.019487
sina.com.cn 613465 612585 711 0.019382 0.019458
utoronto.ca 605625 604967 834 0.019135 0.019216
microsoft.com 594774 581680 263 0.018792 0.018476
ning.com 591105 588704 1178 0.018676 0.018699
oregonstate.edu 585398 584483 413 0.018495 0.018565
rakuten.co.jp 573533 572623 161 0.018121 0.018188
si.edu 567950 566950 171 0.017944 0.018008
uk.com 563120 560270 2776 0.017792 0.017796
hotels.com 557175 555390 64 0.017604 0.017641
utexas.edu 551794 551356 604 0.017434 0.017513
163.com 548611 547855 1027 0.017333 0.017402
stanford.edu 546186 529215 1452 0.017257 0.016810
firebaseapp.com 542229 542215 1277 0.017132 0.017223
sme.sk 541700 536654 683 0.017115 0.017046
sched.com 540560 540181 3798 0.017079 0.017158
cnn.com 536278 535269 80 0.016944 0.017002
columbia.edu 532832 532059 836 0.016835 0.016900
berkeley.edu 532198 531151 1253 0.016815 0.016871
weebly.com 529878 526707 61272 0.016741 0.016730
umich.edu 521569 520457 1146 0.016479 0.016531
nasa.gov 520706 519046 574 0.016452 0.016487
globo.com 520615 518973 143 0.016449 0.016484
player.fm 517494 516930 38 0.016350 0.016419
yale.edu 494085 493525 760 0.015610 0.015676
qq.com 493293 492070 1979 0.015585 0.015630
tribunnews.com 483603 483318 107 0.015279 0.015352
azurewebsites.net 479477 477754 4881 0.015149 0.015175
ctvnews.ca 473556 468541 22 0.014962 0.014882
aif.ru 471890 471355 84 0.014909 0.014972
lefigaro.fr 471207 467453 96 0.014888 0.014848
sakura.ne.jp 469090 468754 5894 0.014821 0.014889
uu.se 467874 467742 297 0.014782 0.014857
apple.com 457609 452386 115 0.014458 0.014369
duke.edu 456593 454983 680 0.014426 0.014452
fanpop.com 453918 450756 20 0.014341 0.014318
cam.ac.uk 428490 366825 856 0.013538 0.011652
admin.ch 427330 425397 243 0.013501 0.013512
teacup.com 426165 425876 996 0.013465 0.013527
nsw.gov.au 425387 409840 1536 0.013440 0.013018
libsyn.com 417721 417438 9337 0.013198 0.013259
wisc.edu 413388 412009 1526 0.013061 0.013087
debian.org 412985 410533 89 0.013048 0.013040
nicovideo.jp 411835 410966 54 0.013012 0.013054
voanews.com 410693 409320 22 0.012976 0.013001
tradingeconomics.com 410479 409633 34 0.012969 0.013011
wixsite.com 409008 401416 81051 0.012922 0.012750
sohu.com 399732 398669 615 0.012629 0.012663
mpg.de 395367 394153 453 0.012491 0.012520
justia.com 389205 388511 163 0.012297 0.012340
ifixit.com 381820 378611 21 0.012063 0.012026
mail.ru 377230 374771 138 0.011918 0.011904
googlesource.com 377087 376498 50 0.011914 0.011959
spb.ru 371270 370518 2796 0.011730 0.011769
scribd.com 361105 360938 14 0.011409 0.011465
psu.edu 360757 360291 609 0.011398 0.011444
schoolloop.com 357653 350737 695 0.011300 0.011141
adobe.com 355734 345408 105 0.011239 0.010971
ku.dk 354266 353098 413 0.011193 0.011216
chinaz.com 351301 344893 65 0.011099 0.010955
mynavi.jp 350866 348761 81 0.011085 0.011078
flightaware.com 350611 350311 20 0.011077 0.011127
freepik.com 350007 349781 14 0.011058 0.011110
skyrock.com 348658 348258 21335 0.011016 0.011062
princeton.edu 348616 348224 763 0.011014 0.011061
goo.ne.jp 346752 345077 57 0.010956 0.010961
sputniknews.com 345180 339897 15 0.010906 0.010796
slideshare.net 343107 342099 10 0.010840 0.010866
dict.cc 340875 340874 221 0.010770 0.010827
lbl.gov 340301 339687 339 0.010752 0.010790
123rf.com 340280 340247 21 0.010751 0.010807
worldbank.org 337898 337369 89 0.010676 0.010716
nii.ac.jp 335832 335427 569 0.010611 0.010654
eklablog.com 335661 335622 9519 0.010605 0.010660
ubc.ca 334955 334202 1113 0.010583 0.010615
noaa.gov 329280 328639 340 0.010403 0.010439
fedoraproject.org 325469 324997 89 0.010283 0.010323
smugmug.com 321113 320928 4921 0.010145 0.010194
usp.br 319978 318799 777 0.010110 0.010126
apache.org 312862 312265 279 0.009885 0.009919
github.io 312558 311332 21759 0.009875 0.009889
us.com 311211 309612 2121 0.009833 0.009834
over-blog.com 307451 306268 13747 0.009714 0.009728
ucsb.edu 303789 302860 647 0.009598 0.009620
baidu.com 295465 294453 252 0.009335 0.009353
ebay.com 294409 292189 72 0.009302 0.009281
ig.com.br 294224 291349 79 0.009296 0.009254
indiatimes.com 290675 287862 66 0.009184 0.009143
as.com 288379 287061 22 0.009111 0.009118
ucla.edu 287228 286057 1024 0.009075 0.009086
rambler.ru 286922 285850 36 0.009065 0.009080
iherb.com 285843 251241 67 0.009031 0.007980
byu.edu 284610 284092 500 0.008992 0.009024
msu.edu 283527 283201 745 0.008958 0.008995
interia.pl 282446 280676 64 0.008924 0.008915
estadao.com.br 282228 281309 55 0.008917 0.008935
motorsport.com 280824 275085 27 0.008873 0.008738
umd.edu 277174 276766 689 0.008757 0.008791
illinois.edu 276275 275810 1108 0.008729 0.008761
washington.edu 274032 273785 404 0.008658 0.008696
impress.co.jp 272960 272000 42 0.008624 0.008640
banggood.com 269653 269077 42 0.008520 0.008547
hp.com 266400 264659 112 0.008417 0.008406
forvo.com 265847 265844 44 0.008399 0.008444
jhu.edu 264945 264266 349 0.008371 0.008394
corriere.it 264592 263338 4573 0.008360 0.008364
com.ru 264537 262217 1354 0.008358 0.008329
wikiloc.com 263695 262815 24 0.008331 0.008348
myshopify.com 262819 261601 6908 0.008304 0.008309
shein.com 261251 261246 26 0.008254 0.008298
wordpress.org 261214 260502 219 0.008253 0.008274
nbcsports.com 260786 242796 29 0.008239 0.007712
uni-heidelberg.de 260194 259337 275 0.008221 0.008237
bmj.com 259044 258125 104 0.008184 0.008199
dhgate.com 258758 258590 43 0.008175 0.008214
wikisource.org 257123 256796 138 0.008124 0.008157
cuni.cz 257068 256612 535 0.008122 0.008151
utah.edu 256457 256195 581 0.008103 0.008138
uab.cat 254498 254239 184 0.008041 0.008075
ed.ac.uk 253751 253506 473 0.008017 0.008052
cnrs.fr 252698 247319 862 0.007984 0.007856
mozilla.org 251377 249115 90 0.007942 0.007913
jd.com 251284 250751 1209 0.007939 0.007965
eu.org 250366 250009 915 0.007910 0.007941
unesco.org 247790 246727 83 0.007829 0.007837
tufts.edu 246731 246352 190 0.007795 0.007825
made-in-china.com 243229 242019 1662 0.007685 0.007687
hm.com 242965 242105 18 0.007676 0.007690
free.fr 242078 241493 15951 0.007648 0.007671
wikimedia.org 241404 241160 148 0.007627 0.007660
orange.fr 241354 239096 94 0.007626 0.007594
wikiquote.org 240601 234826 172 0.007602 0.007459
freelancer.com 240539 240251 10 0.007600 0.007631
csdn.net 240417 239968 1680 0.007596 0.007622
kayak.com 239488 238809 17 0.007567 0.007585
archive.org 239216 238884 593 0.007558 0.007588
ca.gov 239136 237836 1071 0.007555 0.007554
blog.jp 238332 236950 2768 0.007530 0.007526
motherjones.com 238260 235953 11 0.007528 0.007495
elpais.com 236938 235981 42 0.007486 0.007496
amazon.com 236679 232810 92 0.007478 0.007395
euronews.com 236167 235459 17 0.007462 0.007479
umn.edu 235224 233426 957 0.007432 0.007414
rutgers.edu 233199 232739 998 0.007368 0.007393
zenfolio.com 231174 230163 2195 0.007304 0.007311
tripadvisor.com 230477 227949 12 0.007282 0.007240
foursquare.com 228848 228845 21 0.007230 0.007269
nfl.com 228584 227826 37 0.007222 0.007237
viator.com 228168 226400 118 0.007209 0.007191
un.org 227877 227351 210 0.007200 0.007221
vecteezy.com 227669 227501 10 0.007193 0.007226
uwaterloo.ca 227653 227454 204 0.007193 0.007225
cloudfront.net 227364 226937 2723 0.007183 0.007208
exblog.jp 226846 226742 2913 0.007167 0.007202
wikia.org 226621 224987 152 0.007160 0.007146
ohio-state.edu 225413 225399 82 0.007122 0.007159
odoo.com 223515 218992 598 0.007062 0.006956
iastate.edu 223092 222222 538 0.007049 0.007059
sagepub.com 222397 220658 34 0.007027 0.007009
ethz.ch 221686 221479 464 0.007004 0.007035
repubblica.it 221566 220157 531 0.007000 0.006993
ncsu.edu 220990 219140 934 0.006982 0.006961
hatena.ne.jp 220508 215526 26 0.006967 0.006846
twitcasting.tv 220414 218845 28 0.006964 0.006951
pitt.edu 218221 217993 835 0.006895 0.006924
stackoverflow.com 218172 204973 19 0.006893 0.006511
ubisoft.com 218018 210115 56 0.006888 0.006674
webcindario.com 217027 217025 2029 0.006857 0.006893
app.link 216925 216851 2248 0.006854 0.006888
archives-ouvertes.fr 213602 213165 133 0.006749 0.006771
inria.fr 212472 210888 288 0.006713 0.006699
idnes.cz 211351 205268 2691 0.006678 0.006520
utk.edu 209764 209495 403 0.006627 0.006654
universitypressscholarship.com 209624 208443 50 0.006623 0.006621
dtu.dk 209486 209405 208 0.006619 0.006651
zendesk.com 209391 198312 8912 0.006616 0.006299
tu-berlin.de 208687 208410 600 0.006593 0.006620
kcl.ac.uk 208498 208459 73 0.006587 0.006621
hostadvice.com 207464 205893 42 0.006555 0.006540
knack.be 206289 205504 34 0.006518 0.006527
nifty.com 206185 205751 67 0.006514 0.006535
colorado.edu 205822 205558 160 0.006503 0.006529
wvu.edu 204705 204631 408 0.006468 0.006500
gatech.edu 204217 180881 1053 0.006452 0.005745
teachable.com 203772 203204 8288 0.006438 0.006454
lodz.pl 203101 202885 537 0.006417 0.006444
geneanet.org 202404 198331 15 0.006395 0.006300
rt.com 202395 201485 31 0.006395 0.006400
umass.edu 202253 201704 178 0.006390 0.006407
univie.ac.at 202157 201929 757 0.006387 0.006414
fu-berlin.de 201571 201439 146 0.006369 0.006398
mercadolivre.com.br 200250 197961 41 0.006327 0.006288
wikidot.com 199165 197328 9917 0.006293 0.006268
uio.no 198574 198283 113 0.006274 0.006298
sap.com 198197 197296 65 0.006262 0.006267
home.pl 197854 195905 1130 0.006251 0.006223
hermitagemuseum.org 196910 196480 122 0.006221 0.006241
oracle.com 196494 193120 54 0.006208 0.006134
cvut.cz 195583 195454 350 0.006179 0.006208
gearbest.com 195404 194923 27 0.006174 0.006191
ifeng.com 194696 193758 557 0.006151 0.006154
mcmaster.ca 194546 194309 305 0.006147 0.006172
kaist.ac.kr 193939 193525 307 0.006127 0.006147
martech.zone 193228 193068 106 0.006105 0.006132
ucsc.edu 193156 193009 437 0.006103 0.006131
indiana.edu 192514 192283 456 0.006082 0.006108
mos.ru 192458 192238 436 0.006081 0.006106
globalvoices.org 192393 189741 68 0.006079 0.006027
line.me 191538 191416 123 0.006052 0.006080
kompass.com 191513 189592 118 0.006051 0.006022
000webhostapp.com 190344 190209 806 0.006014 0.006042
umontreal.ca 189239 189012 298 0.005979 0.006004
simcast.com 188820 188720 3 0.005966 0.005994
bplaced.net 188643 188552 1039 0.005960 0.005989
proboards.com 187819 187654 3446 0.005934 0.005961
northwestern.edu 187756 187567 465 0.005932 0.005958
upenn.edu 187385 186614 722 0.005920 0.005927
wsu.edu 186344 186215 511 0.005887 0.005915
groups.io 185736 185678 402 0.005868 0.005898
youtube.com 184727 179980 14 0.005836 0.005717
virginia.edu 184224 184023 525 0.005820 0.005845
claz.org 183416 179544 1921 0.005795 0.005703
uni-muenster.de 183398 183272 83 0.005794 0.005821
bandcamp.com 183349 181900 12073 0.005793 0.005778
unc.edu 181864 179742 894 0.005746 0.005709
biomedcentral.com 181168 178655 419 0.005724 0.005675
linternaute.com 179896 174874 25 0.005684 0.005555
ha.com 179788 179229 16 0.005680 0.005693
tamu.edu 179517 179256 877 0.005672 0.005694
asu.edu 179497 179203 632 0.005671 0.005692
kit.edu 179469 178950 500 0.005670 0.005684
currencyrate.today 179168 176516 1941 0.005661 0.005607
udn.com 179074 178996 51 0.005658 0.005686
wp.pl 179001 174774 191 0.005655 0.005551
tum.de 178849 178646 376 0.005651 0.005674
sanook.com 178470 175810 50 0.005639 0.005584
hostelworld.com 178254 172054 24 0.005632 0.005465
cnki.net 178121 177191 1327 0.005628 0.005628
detik.com 177252 176869 25 0.005600 0.005618
rochester.edu 176046 175872 137 0.005562 0.005586
loc.gov 175778 175528 37 0.005554 0.005575
purdue.edu 175276 174774 226 0.005538 0.005551
uni-hamburg.de 175073 174971 321 0.005531 0.005558
uq.edu.au 174477 174341 244 0.005513 0.005538
kompas.com 174135 173043 74 0.005502 0.005496
5ch.net 174108 173997 383 0.005501 0.005527
bayern.de 173259 169730 412 0.005474 0.005391
hhs.gov 173132 172216 88 0.005470 0.005470
home.blog 172575 172412 8812 0.005452 0.005476
unam.mx 172151 171887 961 0.005439 0.005460
francetvinfo.fr 171861 168459 13 0.005430 0.005351
levif.be 171660 171108 28 0.005424 0.005435
ruhr-uni-bochum.de 171485 171170 226 0.005418 0.005437
biglobe.ne.jp 171396 171201 103 0.005415 0.005438
rs-online.com 170781 163885 36 0.005396 0.005206
nikkei.com 170392 169442 35 0.005383 0.005382
sogou.com 169654 169462 86 0.005360 0.005383
centos.org 168559 168549 41 0.005326 0.005354
xrea.com 168180 168147 1629 0.005314 0.005341
cbslocal.com 167543 165778 39 0.005293 0.005266
mlb.com 165144 164953 69 0.005218 0.005239
launchpad.net 164120 163725 14 0.005185 0.005200
milesplit.com 163957 158111 83 0.005180 0.005022
mathworks.com 163729 163353 26 0.005173 0.005189
denik.cz 163032 162956 84 0.005151 0.005176
vistaprint.com 162775 162773 19 0.005143 0.005170
cocolog-nifty.com 162693 162317 3397 0.005140 0.005156
oup.com 161814 161515 25 0.005112 0.005130
uvic.ca 161764 161537 115 0.005111 0.005131
canada.ca 161012 159721 121 0.005087 0.005073
eleconomista.es 160534 160335 17 0.005072 0.005093
csic.es 160376 159332 346 0.005067 0.005061
aleteia.org 160115 160070 15 0.005059 0.005084
uci.edu 160055 159854 541 0.005057 0.005077
yorku.ca 160034 159496 493 0.005056 0.005066
vt.edu 159858 158688 605 0.005051 0.005040
lenovo.com 159594 155746 57 0.005042 0.004947
trekearth.com 159207 158156 13 0.005030 0.005024
cdc.gov 159195 158080 70 0.005030 0.005021
unl.edu 159168 158879 460 0.005029 0.005047
gnavi.co.jp 158763 157207 52 0.005016 0.004993
virgilio.it 158668 157818 35 0.005013 0.005013
reuters.com 158385 157206 25 0.005004 0.004993
ddns.net 158200 157915 937 0.004998 0.005016
zoom.us 157763 156485 7291 0.004984 0.004970
maps.me 157610 157550 11 0.004980 0.005004
err.ee 156565 153118 32 0.004947 0.004864
ucsf.edu 156265 156133 676 0.004937 0.004959
usu.edu 155987 155787 167 0.004928 0.004948
allaccess.com 155103 154454 21 0.004900 0.004906
wikileaks.org 154960 154937 17 0.004896 0.004921
investing.com 154831 154238 68 0.004892 0.004899
uni-bonn.de 154775 154582 344 0.004890 0.004910
imagekind.com 154590 154492 120 0.004884 0.004907
uchicago.edu 154574 154052 727 0.004884 0.004893
zoznam.sk 153865 153617 66 0.004861 0.004879
opensuse.org 153689 152194 63 0.004856 0.004834
mcgill.ca 153628 153027 261 0.004854 0.004861
embrapa.br 152902 152343 62 0.004831 0.004839
shopify.com 152716 151591 34 0.004825 0.004815
up.pt 152698 152578 264 0.004824 0.004846
ucsd.edu 152151 151802 1116 0.004807 0.004822
xsrv.jp 151938 151812 1304 0.004800 0.004822
drivethrurpg.com 151758 151664 14 0.004795 0.004817
aliyun.com 151487 150837 263 0.004786 0.004791
su.se 151392 148540 163 0.004783 0.004718
blogs.com 151237 151051 1117 0.004778 0.004798
booking.com 150977 131248 39 0.004770 0.004169
i.ua 150771 150229 53 0.004764 0.004772
upc.edu 150561 150287 449 0.004757 0.004774
upv.es 149969 149197 585 0.004738 0.004739
springer.com 149886 148441 18 0.004736 0.004715
ufl.edu 149689 149131 898 0.004729 0.004737
digitale-sammlungen.de 148690 145390 25 0.004698 0.004618
flagcounter.com 148580 148360 27 0.004694 0.004712
nyu.edu 148368 147862 287 0.004688 0.004697
dnevnik.hr 148058 147480 27 0.004678 0.004684
u-tokyo.ac.jp 147598 147562 659 0.004663 0.004687
pathofexile.com 147235 147226 10 0.004652 0.004676
org.ru 147121 144299 633 0.004648 0.004583
ucalgary.ca 147039 146784 181 0.004646 0.004662
ahrq.gov 146330 146097 30 0.004623 0.004641
napster.com 145867 145698 42 0.004609 0.004628
nrw.de 145847 145743 401 0.004608 0.004629
ouest-france.fr 145744 145128 51 0.004605 0.004610
nuget.org 145350 145343 12 0.004592 0.004617
gentoo.org 145244 145151 327 0.004589 0.004610
news18.com 144561 143911 23 0.004567 0.004571
ap.org 144300 144233 32 0.004559 0.004581
china.com 144253 143915 79 0.004558 0.004571
xerox.com 144195 143163 64 0.004556 0.004547
exlibrisgroup.com 143980 135339 537 0.004549 0.004299
samsung.com 143554 142918 65 0.004536 0.004540
unibo.it 143551 143088 284 0.004535 0.004545
lublin.pl 142954 142636 569 0.004517 0.004531
netlify.app 141936 141674 4169 0.004484 0.004500
elespanol.com 141725 140836 9 0.004478 0.004473
t-online.de 141724 140295 1271 0.004478 0.004456
helsinki.fi 141574 140599 106 0.004473 0.004466
academic.ru 141538 141334 987 0.004472 0.004489
avid.com 141031 140987 21 0.004456 0.004478
canalblog.com 140920 140466 2910 0.004452 0.004462
archives.gov 140550 139993 47 0.004441 0.004447
blog.hu 140425 140420 1927 0.004437 0.004460
ok.ru 140202 139864 9 0.004430 0.004443
brusheezy.com 140071 140006 8 0.004425 0.004447
usf.edu 139897 139384 214 0.004420 0.004427
parliament.uk 139809 136806 57 0.004417 0.004345
7digital.com 139576 139554 26 0.004410 0.004433
symbaloo.com 139539 139484 90 0.004409 0.004430
imvu.com 139507 137739 49 0.004408 0.004375
uni-goettingen.de 139375 139019 229 0.004404 0.004416
spotify.com 139354 134243 27 0.004403 0.004264
culture.gouv.fr 139308 139160 43 0.004401 0.004420
aalto.fi 139199 138997 145 0.004398 0.004415
ocnk.net 139159 139131 796 0.004397 0.004419
weibo.com 139025 137318 58 0.004392 0.004362
cntv.cn 138687 138578 80 0.004382 0.004402
termwiki.com 138637 129083 42 0.004380 0.004100
dangdang.com 138252 137796 60 0.004368 0.004377
netdna-ssl.com 138222 134034 2994 0.004367 0.004257
qt.io 138059 137662 23 0.004362 0.004373
seesaa.net 138052 137611 4299 0.004362 0.004371
weatherspark.com 137952 137803 16 0.004359 0.004377
atlassian.net 137649 137326 2864 0.004349 0.004362
niu.edu 137593 137128 101 0.004347 0.004356
eclipse.org 137307 123524 32 0.004338 0.003924
kernel.org 136882 136183 44 0.004325 0.004326
ugent.be 136393 136089 352 0.004309 0.004323
freebsd.org 135926 134999 79 0.004295 0.004288
epa.gov 135714 134766 74 0.004288 0.004281
muni.cz 135688 135171 306 0.004287 0.004293
espn.com 135652 126308 20 0.004286 0.004012
usgs.gov 135483 135181 164 0.004281 0.004294
wikibooks.org 135014 133580 236 0.004266 0.004243
unt.edu 134722 106833 284 0.004256 0.003393
net.ru 134076 132881 448 0.004236 0.004221
imdb.com 133952 133052 7 0.004232 0.004226
iheart.com 133922 133190 936 0.004231 0.004231
github.com 133614 128003 39 0.004221 0.004066
wantedly.com 133146 129160 34 0.004207 0.004103
ird.fr 132923 132902 74 0.004200 0.004221
assoc-amazon.com 132717 132610 5 0.004193 0.004212
bnf.fr 132386 131749 59 0.004183 0.004185
itmedia.co.jp 131469 130853 23 0.004154 0.004156
sportsdirect.com 131389 131192 42 0.004151 0.004167
yandex.ua 131343 130967 21 0.004150 0.004160
joins.com 131141 129870 65 0.004143 0.004125
douban.com 131082 130627 18 0.004141 0.004149
steampowered.com 130876 130301 7 0.004135 0.004139
uiowa.edu 130759 130549 622 0.004131 0.004147
adelaide.edu.au 130749 130566 63 0.004131 0.004147
pchome.com.tw 130516 129510 38 0.004124 0.004114
spreaker.com 130464 130370 12 0.004122 0.004141
cointelegraph.com 130449 129823 20 0.004121 0.004124
nba.com 130146 129203 139 0.004112 0.004104
indeed.com 130064 129339 86 0.004109 0.004108
people.com.cn 129947 129875 156 0.004106 0.004125
gameforge.com 129936 102192 215 0.004105 0.003246
weblio.jp 128925 128868 22 0.004073 0.004093
gva.es 128915 127550 242 0.004073 0.004051
syr.edu 128739 122777 286 0.004067 0.003900
coursera.org 128673 128417 19 0.004065 0.004079
vanderbilt.edu 128409 128180 140 0.004057 0.004071
ulb.ac.be 128117 127885 110 0.004048 0.004062
tommy.com 128107 125592 47 0.004047 0.003989
zippyshare.com 127988 127881 127 0.004044 0.004062
uib.no 127968 127399 294 0.004043 0.004047
sudouest.fr 127929 126976 82 0.004042 0.004033
wikinews.org 127684 127373 67 0.004034 0.004046
jimdo.com 127387 126018 5982 0.004025 0.004003
openrice.com 127381 126710 15 0.004025 0.004025
art.pl 127339 126995 484 0.004023 0.004034
ccc.de 127334 127301 82 0.004023 0.004044
ovh.net 127151 126729 1223 0.004017 0.004025
kb.se 127000 125233 48 0.004013 0.003978
aliexpress.com 126982 126909 1079 0.004012 0.004031
rbth.com 126980 126483 29 0.004012 0.004018
donga.com 126905 126711 39 0.004010 0.004025
intel.com 126726 123307 63 0.004004 0.003917
mnhn.fr 125816 125454 80 0.003975 0.003985
perfdrive.com 125740 125740 3 0.003973 0.003994
redhat.com 125554 124710 44 0.003967 0.003961
ed.gov 125482 125360 80 0.003965 0.003982
elte.hu 125173 125118 430 0.003955 0.003974
gov.ro 125089 125041 102 0.003952 0.003972
mayoclinic.org 125072 123223 54 0.003952 0.003914
ietf.org 124840 124292 27 0.003944 0.003948
podbean.com 124427 123758 8394 0.003931 0.003931
uv.es 124363 124002 212 0.003929 0.003939
hu-berlin.de 124153 123796 226 0.003923 0.003932
hatenablog.jp 124078 123702 2064 0.003920 0.003929
uct.ac.za 123975 123850 320 0.003917 0.003934
tradekey.com 123818 123724 94 0.003912 0.003930
tuwien.ac.at 123451 123389 278 0.003900 0.003919
lehigh.edu 123354 123289 186 0.003897 0.003916
aarp.org 123003 122271 45 0.003886 0.003884
nd.edu 122934 122165 592 0.003884 0.003880
gov.ru 122866 120042 1549 0.003882 0.003813
dyndns.org 122838 121904 564 0.003881 0.003872
wn.com 122737 121363 69 0.003878 0.003855
wa.gov 122520 121708 346 0.003871 0.003866
googleblog.com 122510 121027 173 0.003871 0.003844
public.lu 122464 120367 107 0.003869 0.003823
habr.com 122280 121619 12 0.003863 0.003863
sfu.ca 121827 121702 102 0.003849 0.003866
naver.com 121797 120832 140 0.003848 0.003838
ugr.es 121593 121361 299 0.003842 0.003855
jooble.org 121550 121469 68 0.003840 0.003858
blingee.com 121532 109576 8 0.003840 0.003480
tianya.cn 121342 121044 960 0.003834 0.003845
rootsweb.com 119947 119731 27 0.003790 0.003803
librarything.com 119916 118289 11 0.003789 0.003757
msu.ru 119734 119640 374 0.003783 0.003800
jpn.org 119689 119555 721 0.003782 0.003797
lu.se 119680 119450 328 0.003781 0.003794
museoreinasofia.es 119632 119604 11 0.003780 0.003799