Document (#40431)

Author

Kurtz, M.J.
Henneken, E.A.

Title

Measuring metrics : a 40-year longitudinal cross-validation of citations, downloads, and peer review in astrophysics

Source

Journal of the Association for Information Science and Technology. 68(2017) no.3, S.695-708

Year

2017

Abstract

Citation measures, and newer altmetric measures such as downloads are now commonly used to inform personnel decisions. How well do or can these measures measure or predict the past, current, or future scholarly performance of an individual? Using data from the Smithsonian/NASA Astrophysics Data System we analyze the publication, citation, download, and distinction histories of a cohort of 922 individuals who received a U.S. PhD in astronomy in the period 1972-1976. By examining the same and different measures at the same and different times for the same individuals we are able to show the capabilities and limitations of each measure. Because the distributions are lognormal, measurement uncertainties are multiplicative; we show that in order to state with 95% confidence that one person's citations and downloads are significantly higher than another person's, the log difference in the ratio of counts must be at least 0.3dex, which corresponds to a multiplicative factor of 2.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23689/full.

Theme

Informetrie

Field

Astronomie

Similar documents (author)

1. Kurtz, J.: Multicultural children's books : the subtle tug of war (1996) 6.01

   6.010904 = sum of:
     6.010904 = weight(author_txt:kurtz in 4773) [ClassicSimilarity], result of:
       6.010904 = fieldWeight in 4773, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.617446 = idf(docFreq=7, maxDocs=44218)
         0.625 = fieldNorm(doc=4773)
   

2. Kurtz, L.A.: Data base management systems : an introduction (1985) 6.01

   6.010904 = sum of:
     6.010904 = weight(author_txt:kurtz in 7820) [ClassicSimilarity], result of:
       6.010904 = fieldWeight in 7820, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.617446 = idf(docFreq=7, maxDocs=44218)
         0.625 = fieldNorm(doc=7820)
   

3. Kurtz, M.; Bollen, J.: Usage bibliometrics (2010) 4.81

   4.808723 = sum of:
     4.808723 = weight(author_txt:kurtz in 4206) [ClassicSimilarity], result of:
       4.808723 = fieldWeight in 4206, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.617446 = idf(docFreq=7, maxDocs=44218)
         0.5 = fieldNorm(doc=4206)
   

4. Kurtz, M.J.; Eichhorn, G.; Accomazzi, A.; Grant, C.; Demleitner, M.; Murray, S.S.: Worldwide use and impact of the NASA Astrophysics Data System Digital Library (2005) 2.40

   2.4043615 = sum of:
     2.4043615 = weight(author_txt:kurtz in 3267) [ClassicSimilarity], result of:
       2.4043615 = fieldWeight in 3267, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.617446 = idf(docFreq=7, maxDocs=44218)
         0.25 = fieldNorm(doc=3267)
   

5. Kurtz, M.J.; Eichhorn, G.; Accomazzi, A.; Grant, C.; Demleitner, D.; Murray, S.S.; Martimbeau, N.; Elwell, B.: ¬The bibliometric properties of article readership information (2005) 2.40

   2.4043615 = sum of:
     2.4043615 = weight(author_txt:kurtz in 3307) [ClassicSimilarity], result of:
       2.4043615 = fieldWeight in 3307, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.617446 = idf(docFreq=7, maxDocs=44218)
         0.25 = fieldNorm(doc=3307)
   

Similar documents (content)

1. Moed, H.F.: Statistical relationships between downloads and citations at the level of individual documents within a single journal (2005) 0.28

   0.27639297 = sum of:
     0.27639297 = product of:
       0.98711777 = sum of:
         0.0484885 = weight(abstract_txt:download in 3882) [ClassicSimilarity], result of:
           0.0484885 = score(doc=3882,freq=1.0), product of:
             0.13321483 = queryWeight, product of:
               1.0213768 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.016796611 = queryNorm
             0.36398727 = fieldWeight in 3882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.046875 = fieldNorm(doc=3882)
         0.01771502 = weight(abstract_txt:show in 3882) [ClassicSimilarity], result of:
           0.01771502 = score(doc=3882,freq=1.0), product of:
             0.08577575 = queryWeight, product of:
               1.1590629 = boost
               4.4059124 = idf(docFreq=1466, maxDocs=44218)
               0.016796611 = queryNorm
             0.20652714 = fieldWeight in 3882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4059124 = idf(docFreq=1466, maxDocs=44218)
               0.046875 = fieldNorm(doc=3882)
         0.092126235 = weight(abstract_txt:cohort in 3882) [ClassicSimilarity], result of:
           0.092126235 = score(doc=3882,freq=1.0), product of:
             0.2043536 = queryWeight, product of:
               1.2650301 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.016796611 = queryNorm
             0.45081776 = fieldWeight in 3882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.046875 = fieldNorm(doc=3882)
         0.06878506 = weight(abstract_txt:citation in 3882) [ClassicSimilarity], result of:
           0.06878506 = score(doc=3882,freq=8.0), product of:
             0.10595045 = queryWeight, product of:
               1.2881788 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.016796611 = queryNorm
             0.6492191 = fieldWeight in 3882, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.046875 = fieldNorm(doc=3882)
         0.06304561 = weight(abstract_txt:citations in 3882) [ClassicSimilarity], result of:
           0.06304561 = score(doc=3882,freq=4.0), product of:
             0.12595633 = queryWeight, product of:
               1.404542 = boost
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.016796611 = queryNorm
             0.5005355 = fieldWeight in 3882, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.046875 = fieldNorm(doc=3882)
         0.033295486 = weight(abstract_txt:measure in 3882) [ClassicSimilarity], result of:
           0.033295486 = score(doc=3882,freq=1.0), product of:
             0.13063523 = queryWeight, product of:
               1.4303914 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.016796611 = queryNorm
             0.25487372 = fieldWeight in 3882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.046875 = fieldNorm(doc=3882)
         0.66366184 = weight(abstract_txt:downloads in 3882) [ClassicSimilarity], result of:
           0.66366184 = score(doc=3882,freq=14.0), product of:
             0.45613042 = queryWeight, product of:
               3.273519 = boost
               8.29569 = idf(docFreq=29, maxDocs=44218)
               0.016796611 = queryNorm
             1.4549826 = fieldWeight in 3882, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               8.29569 = idf(docFreq=29, maxDocs=44218)
               0.046875 = fieldNorm(doc=3882)
       0.28 = coord(7/25)
   

2. Kurtz, M.J.; Eichhorn, G.; Accomazzi, A.; Grant, C.; Demleitner, D.; Murray, S.S.; Martimbeau, N.; Elwell, B.: ¬The bibliometric properties of article readership information (2005) 0.20

   0.19968894 = sum of:
     0.19968894 = product of:
       0.62402797 = sum of:
         0.079594225 = weight(abstract_txt:nasa in 3307) [ClassicSimilarity], result of:
           0.079594225 = score(doc=3307,freq=1.0), product of:
             0.16726944 = queryWeight, product of:
               1.1445059 = boost
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.016796611 = queryNorm
             0.47584438 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
         0.04621399 = weight(abstract_txt:show in 3307) [ClassicSimilarity], result of:
           0.04621399 = score(doc=3307,freq=5.0), product of:
             0.08577575 = queryWeight, product of:
               1.1590629 = boost
               4.4059124 = idf(docFreq=1466, maxDocs=44218)
               0.016796611 = queryNorm
             0.5387769 = fieldWeight in 3307, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.4059124 = idf(docFreq=1466, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
         0.049142417 = weight(abstract_txt:citation in 3307) [ClassicSimilarity], result of:
           0.049142417 = score(doc=3307,freq=3.0), product of:
             0.10595045 = queryWeight, product of:
               1.2881788 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.016796611 = queryNorm
             0.4638245 = fieldWeight in 3307, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
         0.07355321 = weight(abstract_txt:citations in 3307) [ClassicSimilarity], result of:
           0.07355321 = score(doc=3307,freq=4.0), product of:
             0.12595633 = queryWeight, product of:
               1.404542 = boost
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.016796611 = queryNorm
             0.583958 = fieldWeight in 3307, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
         0.06728105 = weight(abstract_txt:measure in 3307) [ClassicSimilarity], result of:
           0.06728105 = score(doc=3307,freq=3.0), product of:
             0.13063523 = queryWeight, product of:
               1.4303914 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.016796611 = queryNorm
             0.5150299 = fieldWeight in 3307, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
         0.046613526 = weight(abstract_txt:individuals in 3307) [ClassicSimilarity], result of:
           0.046613526 = score(doc=3307,freq=1.0), product of:
             0.14751862 = queryWeight, product of:
               1.520016 = boost
               5.777993 = idf(docFreq=371, maxDocs=44218)
               0.016796611 = queryNorm
             0.315984 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.777993 = idf(docFreq=371, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
         0.18402198 = weight(abstract_txt:astrophysics in 3307) [ClassicSimilarity], result of:
           0.18402198 = score(doc=3307,freq=1.0), product of:
             0.36848405 = queryWeight, product of:
               2.4023378 = boost
               9.131938 = idf(docFreq=12, maxDocs=44218)
               0.016796611 = queryNorm
             0.49940285 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.131938 = idf(docFreq=12, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
         0.07760762 = weight(abstract_txt:measures in 3307) [ClassicSimilarity], result of:
           0.07760762 = score(doc=3307,freq=1.0), product of:
             0.2610869 = queryWeight, product of:
               2.8597777 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.016796611 = queryNorm
             0.2972482 = fieldWeight in 3307, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3307)
       0.32 = coord(8/25)
   

3. Schloegl, C.; Gorraiz, J.: Global usage versus global citation metrics : the case of pharmacology journals (2011) 0.18

   0.18256545 = sum of:
     0.18256545 = product of:
       0.7606894 = sum of:
         0.08000194 = weight(abstract_txt:download in 4141) [ClassicSimilarity], result of:
           0.08000194 = score(doc=4141,freq=2.0), product of:
             0.13321483 = queryWeight, product of:
               1.0213768 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.016796611 = queryNorm
             0.6005483 = fieldWeight in 4141, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4141)
         0.020667523 = weight(abstract_txt:show in 4141) [ClassicSimilarity], result of:
           0.020667523 = score(doc=4141,freq=1.0), product of:
             0.08577575 = queryWeight, product of:
               1.1590629 = boost
               4.4059124 = idf(docFreq=1466, maxDocs=44218)
               0.016796611 = queryNorm
             0.24094833 = fieldWeight in 4141, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4059124 = idf(docFreq=1466, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4141)
         0.08511716 = weight(abstract_txt:citation in 4141) [ClassicSimilarity], result of:
           0.08511716 = score(doc=4141,freq=9.0), product of:
             0.10595045 = queryWeight, product of:
               1.2881788 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.016796611 = queryNorm
             0.8033676 = fieldWeight in 4141, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4141)
         0.07355321 = weight(abstract_txt:citations in 4141) [ClassicSimilarity], result of:
           0.07355321 = score(doc=4141,freq=4.0), product of:
             0.12595633 = queryWeight, product of:
               1.404542 = boost
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.016796611 = queryNorm
             0.583958 = fieldWeight in 4141, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4141)
         0.038633395 = weight(abstract_txt:same in 4141) [ClassicSimilarity], result of:
           0.038633395 = score(doc=4141,freq=1.0), product of:
             0.14899713 = queryWeight, product of:
               1.8709375 = boost
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.016796611 = queryNorm
             0.25928953 = fieldWeight in 4141, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4141)
         0.4627161 = weight(abstract_txt:downloads in 4141) [ClassicSimilarity], result of:
           0.4627161 = score(doc=4141,freq=5.0), product of:
             0.45613042 = queryWeight, product of:
               3.273519 = boost
               8.29569 = idf(docFreq=29, maxDocs=44218)
               0.016796611 = queryNorm
             1.0144382 = fieldWeight in 4141, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               8.29569 = idf(docFreq=29, maxDocs=44218)
               0.0546875 = fieldNorm(doc=4141)
       0.24 = coord(6/25)
   

4. Botting, N.; Dipper, L.; Hilari, K.: ¬The effect of social media promotion on academic article uptake (2017) 0.11

   0.11289215 = sum of:
     0.11289215 = product of:
       0.56446075 = sum of:
         0.111979395 = weight(abstract_txt:download in 3522) [ClassicSimilarity], result of:
           0.111979395 = score(doc=3522,freq=3.0), product of:
             0.13321483 = queryWeight, product of:
               1.0213768 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.016796611 = queryNorm
             0.84059256 = fieldWeight in 3522, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.0625 = fieldNorm(doc=3522)
         0.06485117 = weight(abstract_txt:citation in 3522) [ClassicSimilarity], result of:
           0.06485117 = score(doc=3522,freq=4.0), product of:
             0.10595045 = queryWeight, product of:
               1.2881788 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.016796611 = queryNorm
             0.61208963 = fieldWeight in 3522, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0625 = fieldNorm(doc=3522)
         0.062440995 = weight(abstract_txt:same in 3522) [ClassicSimilarity], result of:
           0.062440995 = score(doc=3522,freq=2.0), product of:
             0.14899713 = queryWeight, product of:
               1.8709375 = boost
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.016796611 = queryNorm
             0.41907516 = fieldWeight in 3522, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.0625 = fieldNorm(doc=3522)
         0.088694416 = weight(abstract_txt:measures in 3522) [ClassicSimilarity], result of:
           0.088694416 = score(doc=3522,freq=1.0), product of:
             0.2610869 = queryWeight, product of:
               2.8597777 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.016796611 = queryNorm
             0.33971223 = fieldWeight in 3522, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=3522)
         0.23649476 = weight(abstract_txt:downloads in 3522) [ClassicSimilarity], result of:
           0.23649476 = score(doc=3522,freq=1.0), product of:
             0.45613042 = queryWeight, product of:
               3.273519 = boost
               8.29569 = idf(docFreq=29, maxDocs=44218)
               0.016796611 = queryNorm
             0.5184806 = fieldWeight in 3522, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.29569 = idf(docFreq=29, maxDocs=44218)
               0.0625 = fieldNorm(doc=3522)
       0.2 = coord(5/25)
   

5. Moed, H.F.; Halevi, G.: On full text download and citation distributions in scientific-scholarly journals (2016) 0.10

   0.097754344 = sum of:
     0.097754344 = product of:
       0.61096466 = sum of:
         0.14456478 = weight(abstract_txt:download in 2646) [ClassicSimilarity], result of:
           0.14456478 = score(doc=2646,freq=5.0), product of:
             0.13321483 = queryWeight, product of:
               1.0213768 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.016796611 = queryNorm
             1.0852003 = fieldWeight in 2646, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.0625 = fieldNorm(doc=2646)
         0.07250582 = weight(abstract_txt:citation in 2646) [ClassicSimilarity], result of:
           0.07250582 = score(doc=2646,freq=5.0), product of:
             0.10595045 = queryWeight, product of:
               1.2881788 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.016796611 = queryNorm
             0.684337 = fieldWeight in 2646, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0625 = fieldNorm(doc=2646)
         0.059439972 = weight(abstract_txt:citations in 2646) [ClassicSimilarity], result of:
           0.059439972 = score(doc=2646,freq=2.0), product of:
             0.12595633 = queryWeight, product of:
               1.404542 = boost
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.016796611 = queryNorm
             0.47190937 = fieldWeight in 2646, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.0625 = fieldNorm(doc=2646)
         0.3344541 = weight(abstract_txt:downloads in 2646) [ClassicSimilarity], result of:
           0.3344541 = score(doc=2646,freq=2.0), product of:
             0.45613042 = queryWeight, product of:
               3.273519 = boost
               8.29569 = idf(docFreq=29, maxDocs=44218)
               0.016796611 = queryNorm
             0.7332423 = fieldWeight in 2646, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.29569 = idf(docFreq=29, maxDocs=44218)
               0.0625 = fieldNorm(doc=2646)
       0.16 = coord(4/25)