Document (#40636)

Author

Mayernik, M.S.
Hart, D.L.
Maull, K.E.
Weber, N.M.

Title

Assessing and tracing the outcomes and impact of research infrastructures

Source

Journal of the Association for Information Science and Technology. 68(2017) no.6, S.1341-1359

Year

2017

Series

AIS reviews

Abstract

Recent policy shifts on the part of funding agencies and journal publishers are causing changes in the acknowledgment and citation behaviors of scholars. A growing emphasis on open science and reproducibility is changing how authors cite and acknowledge "research infrastructures"-entities that are used as inputs to or as underlying foundations for scholarly research, including data sets, software packages, computational models, observational platforms, and computing facilities. At the same time, stakeholder interest in quantitative understanding of impact is spurring increased collection and analysis of metrics related to use of research infrastructures. This article reviews work spanning several decades on tracing and assessing the outcomes and impacts from these kinds of research infrastructures. We discuss how research infrastructures are identified and referenced by scholars in the research literature and how those references are being collected and analyzed for the purposes of evaluating impact. Synthesizing common features of a wide range of studies, we identify notable challenges that impede the analysis of impact metrics for research infrastructures and outline key open research questions that can guide future research and applications related to such metrics.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23721/full.

Theme

Informetrie

Similar documents (author)

1. Hart, R.L.: Information gathering among the faculty of a comprehensive college : formality and globality (1997) 2.53

   2.5262873 = sum of:
     2.5262873 = product of:
       5.0525746 = sum of:
         5.0525746 = weight(author_txt:hart in 636) [ClassicSimilarity], result of:
           5.0525746 = score(doc=636,freq=1.0), product of:
             0.8509901 = queryWeight, product of:
               1.2729386 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.07037345 = queryNorm
             5.937289 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.625 = fieldNorm(doc=636)
       0.5 = coord(1/2)
   

2. Hart, G.: Information literacy education : a new role for public libraries (1998) 2.53

   2.5262873 = sum of:
     2.5262873 = product of:
       5.0525746 = sum of:
         5.0525746 = weight(author_txt:hart in 3356) [ClassicSimilarity], result of:
           5.0525746 = score(doc=3356,freq=1.0), product of:
             0.8509901 = queryWeight, product of:
               1.2729386 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.07037345 = queryNorm
             5.937289 = fieldWeight in 3356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.625 = fieldNorm(doc=3356)
       0.5 = coord(1/2)
   

3. Hart, A.: RDA made simple : a practical guide to the new cataloging rules (2014) 2.53

   2.5262873 = sum of:
     2.5262873 = product of:
       5.0525746 = sum of:
         5.0525746 = weight(author_txt:hart in 2807) [ClassicSimilarity], result of:
           5.0525746 = score(doc=2807,freq=1.0), product of:
             0.8509901 = queryWeight, product of:
               1.2729386 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.07037345 = queryNorm
             5.937289 = fieldWeight in 2807, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.625 = fieldNorm(doc=2807)
       0.5 = coord(1/2)
   

4. Hart, J.L.; Miller, J.P.: Migrating databases : CD-ROM vs. the Internet (1997) 2.02

   2.0210297 = sum of:
     2.0210297 = product of:
       4.0420594 = sum of:
         4.0420594 = weight(author_txt:hart in 30) [ClassicSimilarity], result of:
           4.0420594 = score(doc=30,freq=1.0), product of:
             0.8509901 = queryWeight, product of:
               1.2729386 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.07037345 = queryNorm
             4.749831 = fieldWeight in 30, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.5 = fieldNorm(doc=30)
       0.5 = coord(1/2)
   

5. Hart, P.E.; Graham, J.: Query-free information retrieval (1997) 2.02

   2.0210297 = sum of:
     2.0210297 = product of:
       4.0420594 = sum of:
         4.0420594 = weight(author_txt:hart in 2289) [ClassicSimilarity], result of:
           4.0420594 = score(doc=2289,freq=1.0), product of:
             0.8509901 = queryWeight, product of:
               1.2729386 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.07037345 = queryNorm
             4.749831 = fieldWeight in 2289, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.5 = fieldNorm(doc=2289)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Hocker, J.; Schindler, C.; Rittberger, M.: Participatory design for ontologies : a case study of an open science ontology for qualitative coding schemas (2020) 0.14

   0.14376609 = sum of:
     0.14376609 = product of:
       0.59902537 = sum of:
         0.004409241 = weight(abstract_txt:that in 179) [ClassicSimilarity], result of:
           0.004409241 = score(doc=179,freq=1.0), product of:
             0.034026995 = queryWeight, product of:
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.014360563 = queryNorm
             0.12958068 = fieldWeight in 179, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0546875 = fieldNorm(doc=179)
         0.015239634 = weight(abstract_txt:analysis in 179) [ClassicSimilarity], result of:
           0.015239634 = score(doc=179,freq=2.0), product of:
             0.0539333 = queryWeight, product of:
               1.0279478 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.014360563 = queryNorm
             0.28256446 = fieldWeight in 179, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0546875 = fieldNorm(doc=179)
         0.05545597 = weight(abstract_txt:open in 179) [ClassicSimilarity], result of:
           0.05545597 = score(doc=179,freq=5.0), product of:
             0.09401406 = queryWeight, product of:
               1.3571848 = boost
               4.8237233 = idf(docFreq=965, maxDocs=44218)
               0.014360563 = queryNorm
             0.5898689 = fieldWeight in 179, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.8237233 = idf(docFreq=965, maxDocs=44218)
               0.0546875 = fieldNorm(doc=179)
         0.060026575 = weight(abstract_txt:outcomes in 179) [ClassicSimilarity], result of:
           0.060026575 = score(doc=179,freq=1.0), product of:
             0.16947788 = queryWeight, product of:
               1.8222128 = boost
               6.4765315 = idf(docFreq=184, maxDocs=44218)
               0.014360563 = queryNorm
             0.3541853 = fieldWeight in 179, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4765315 = idf(docFreq=184, maxDocs=44218)
               0.0546875 = fieldNorm(doc=179)
         0.078720495 = weight(abstract_txt:research in 179) [ClassicSimilarity], result of:
           0.078720495 = score(doc=179,freq=5.0), product of:
             0.2030529 = queryWeight, product of:
               4.4599724 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.014360563 = queryNorm
             0.38768467 = fieldWeight in 179, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0546875 = fieldNorm(doc=179)
         0.38517347 = weight(abstract_txt:infrastructures in 179) [ClassicSimilarity], result of:
           0.38517347 = score(doc=179,freq=2.0), product of:
             0.66991335 = queryWeight, product of:
               6.2749825 = boost
               7.4342074 = idf(docFreq=70, maxDocs=44218)
               0.014360563 = queryNorm
             0.5749601 = fieldWeight in 179, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.4342074 = idf(docFreq=70, maxDocs=44218)
               0.0546875 = fieldNorm(doc=179)
       0.24 = coord(6/25)
   

2. Marín-Arraiza, P.: ORCID in the Open Science scenario : opportunities for academic libraries (2019) 0.13

   0.1334289 = sum of:
     0.1334289 = product of:
       0.8339306 = sum of:
         0.028157853 = weight(abstract_txt:related in 5704) [ClassicSimilarity], result of:
           0.028157853 = score(doc=5704,freq=1.0), product of:
             0.07143234 = queryWeight, product of:
               1.1830143 = boost
               4.2046843 = idf(docFreq=1793, maxDocs=44218)
               0.014360563 = queryNorm
             0.39418915 = fieldWeight in 5704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2046843 = idf(docFreq=1793, maxDocs=44218)
               0.09375 = fieldNorm(doc=5704)
         0.060125884 = weight(abstract_txt:open in 5704) [ClassicSimilarity], result of:
           0.060125884 = score(doc=5704,freq=2.0), product of:
             0.09401406 = queryWeight, product of:
               1.3571848 = boost
               4.8237233 = idf(docFreq=965, maxDocs=44218)
               0.014360563 = queryNorm
             0.6395414 = fieldWeight in 5704, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8237233 = idf(docFreq=965, maxDocs=44218)
               0.09375 = fieldNorm(doc=5704)
         0.08534951 = weight(abstract_txt:research in 5704) [ClassicSimilarity], result of:
           0.08534951 = score(doc=5704,freq=2.0), product of:
             0.2030529 = queryWeight, product of:
               4.4599724 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.014360563 = queryNorm
             0.4203314 = fieldWeight in 5704, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.09375 = fieldNorm(doc=5704)
         0.66029733 = weight(abstract_txt:infrastructures in 5704) [ClassicSimilarity], result of:
           0.66029733 = score(doc=5704,freq=2.0), product of:
             0.66991335 = queryWeight, product of:
               6.2749825 = boost
               7.4342074 = idf(docFreq=70, maxDocs=44218)
               0.014360563 = queryNorm
             0.9856459 = fieldWeight in 5704, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.4342074 = idf(docFreq=70, maxDocs=44218)
               0.09375 = fieldNorm(doc=5704)
       0.16 = coord(4/25)
   

3. Aung, H.H.; Zheng, H.; Erdt, M.; Aw, A.S.; Sin, S.-C.J.; Theng, Y.-L.: Investigating familiarity and usage of traditional metrics and altmetrics (2019) 0.13

   0.1319661 = sum of:
     0.1319661 = product of:
       0.54985875 = sum of:
         0.007126409 = weight(abstract_txt:that in 5328) [ClassicSimilarity], result of:
           0.007126409 = score(doc=5328,freq=2.0), product of:
             0.034026995 = queryWeight, product of:
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.014360563 = queryNorm
             0.20943399 = fieldWeight in 5328, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=5328)
         0.08178667 = weight(abstract_txt:acknowledge in 5328) [ClassicSimilarity], result of:
           0.08178667 = score(doc=5328,freq=1.0), product of:
             0.15124035 = queryWeight, product of:
               1.2171985 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.014360563 = queryNorm
             0.5407728 = fieldWeight in 5328, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.0625 = fieldNorm(doc=5328)
         0.085086614 = weight(abstract_txt:scholars in 5328) [ClassicSimilarity], result of:
           0.085086614 = score(doc=5328,freq=3.0), product of:
             0.13565102 = queryWeight, product of:
               1.6302496 = boost
               5.794254 = idf(docFreq=365, maxDocs=44218)
               0.014360563 = queryNorm
             0.6272464 = fieldWeight in 5328, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.794254 = idf(docFreq=365, maxDocs=44218)
               0.0625 = fieldNorm(doc=5328)
         0.04877067 = weight(abstract_txt:impact in 5328) [ClassicSimilarity], result of:
           0.04877067 = score(doc=5328,freq=1.0), product of:
             0.17008728 = queryWeight, product of:
               2.581627 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.014360563 = queryNorm
             0.28673908 = fieldWeight in 5328, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.0625 = fieldNorm(doc=5328)
         0.24662012 = weight(abstract_txt:metrics in 5328) [ClassicSimilarity], result of:
           0.24662012 = score(doc=5328,freq=5.0), product of:
             0.2662454 = queryWeight, product of:
               2.797237 = boost
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.014360563 = queryNorm
             0.9262888 = fieldWeight in 5328, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.627983 = idf(docFreq=158, maxDocs=44218)
               0.0625 = fieldNorm(doc=5328)
         0.08046828 = weight(abstract_txt:research in 5328) [ClassicSimilarity], result of:
           0.08046828 = score(doc=5328,freq=4.0), product of:
             0.2030529 = queryWeight, product of:
               4.4599724 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.014360563 = queryNorm
             0.39629224 = fieldWeight in 5328, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=5328)
       0.24 = coord(6/25)
   

4. Hamilton, E.C.: ¬The impact of survey data : measuring success (2007) 0.13

   0.12773193 = sum of:
     0.12773193 = product of:
       0.39916232 = sum of:
         0.004409241 = weight(abstract_txt:that in 71) [ClassicSimilarity], result of:
           0.004409241 = score(doc=71,freq=1.0), product of:
             0.034026995 = queryWeight, product of:
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.014360563 = queryNorm
             0.12958068 = fieldWeight in 71, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0546875 = fieldNorm(doc=71)
         0.015239634 = weight(abstract_txt:analysis in 71) [ClassicSimilarity], result of:
           0.015239634 = score(doc=71,freq=2.0), product of:
             0.0539333 = queryWeight, product of:
               1.0279478 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.014360563 = queryNorm
             0.28256446 = fieldWeight in 71, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0546875 = fieldNorm(doc=71)
         0.04792159 = weight(abstract_txt:shifts in 71) [ClassicSimilarity], result of:
           0.04792159 = score(doc=71,freq=1.0), product of:
             0.11576078 = queryWeight, product of:
               1.0648987 = boost
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.014360563 = queryNorm
             0.41397086 = fieldWeight in 71, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.0546875 = fieldNorm(doc=71)
         0.08713304 = weight(abstract_txt:inputs in 71) [ClassicSimilarity], result of:
           0.08713304 = score(doc=71,freq=2.0), product of:
             0.13687345 = queryWeight, product of:
               1.157943 = boost
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.014360563 = queryNorm
             0.6365956 = fieldWeight in 71, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.231152 = idf(docFreq=31, maxDocs=44218)
               0.0546875 = fieldNorm(doc=71)
         0.04298418 = weight(abstract_txt:scholars in 71) [ClassicSimilarity], result of:
           0.04298418 = score(doc=71,freq=1.0), product of:
             0.13565102 = queryWeight, product of:
               1.6302496 = boost
               5.794254 = idf(docFreq=365, maxDocs=44218)
               0.014360563 = queryNorm
             0.31687325 = fieldWeight in 71, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.794254 = idf(docFreq=365, maxDocs=44218)
               0.0546875 = fieldNorm(doc=71)
         0.06565696 = weight(abstract_txt:assessing in 71) [ClassicSimilarity], result of:
           0.06565696 = score(doc=71,freq=1.0), product of:
             0.17991656 = queryWeight, product of:
               1.8774922 = boost
               6.6730065 = idf(docFreq=151, maxDocs=44218)
               0.014360563 = queryNorm
             0.36493003 = fieldWeight in 71, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6730065 = idf(docFreq=151, maxDocs=44218)
               0.0546875 = fieldNorm(doc=71)
         0.042674337 = weight(abstract_txt:impact in 71) [ClassicSimilarity], result of:
           0.042674337 = score(doc=71,freq=1.0), product of:
             0.17008728 = queryWeight, product of:
               2.581627 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.014360563 = queryNorm
             0.2508967 = fieldWeight in 71, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.0546875 = fieldNorm(doc=71)
         0.09314334 = weight(abstract_txt:research in 71) [ClassicSimilarity], result of:
           0.09314334 = score(doc=71,freq=7.0), product of:
             0.2030529 = queryWeight, product of:
               4.4599724 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.014360563 = queryNorm
             0.45871466 = fieldWeight in 71, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0546875 = fieldNorm(doc=71)
       0.32 = coord(8/25)
   

5. Jonkers, K.; Moya Anegon, F. de; Aguillo, I.F.: Measuring the usage of e-research infrastructure as an indicator of research activity (2012) 0.13

   0.12579904 = sum of:
     0.12579904 = product of:
       0.6289952 = sum of:
         0.0062989155 = weight(abstract_txt:that in 277) [ClassicSimilarity], result of:
           0.0062989155 = score(doc=277,freq=1.0), product of:
             0.034026995 = queryWeight, product of:
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.014360563 = queryNorm
             0.18511525 = fieldWeight in 277, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=277)
         0.021770906 = weight(abstract_txt:analysis in 277) [ClassicSimilarity], result of:
           0.021770906 = score(doc=277,freq=2.0), product of:
             0.0539333 = queryWeight, product of:
               1.0279478 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.014360563 = queryNorm
             0.40366352 = fieldWeight in 277, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.078125 = fieldNorm(doc=277)
         0.06096334 = weight(abstract_txt:impact in 277) [ClassicSimilarity], result of:
           0.06096334 = score(doc=277,freq=1.0), product of:
             0.17008728 = queryWeight, product of:
               2.581627 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.014360563 = queryNorm
             0.35842386 = fieldWeight in 277, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.078125 = fieldNorm(doc=277)
         0.15087804 = weight(abstract_txt:research in 277) [ClassicSimilarity], result of:
           0.15087804 = score(doc=277,freq=9.0), product of:
             0.2030529 = queryWeight, product of:
               4.4599724 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.014360563 = queryNorm
             0.74304795 = fieldWeight in 277, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.078125 = fieldNorm(doc=277)
         0.38908395 = weight(abstract_txt:infrastructures in 277) [ClassicSimilarity], result of:
           0.38908395 = score(doc=277,freq=1.0), product of:
             0.66991335 = queryWeight, product of:
               6.2749825 = boost
               7.4342074 = idf(docFreq=70, maxDocs=44218)
               0.014360563 = queryNorm
             0.58079743 = fieldWeight in 277, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4342074 = idf(docFreq=70, maxDocs=44218)
               0.078125 = fieldNorm(doc=277)
       0.2 = coord(5/25)