Document (#38390)

Author

Kenyon, T.

Title

Defining and measuring research impact in the humanities, social sciences and creative arts in the digital age

Source

Knowledge organization. 41(2014) no.3, S.249-257

Year

2014

Abstract

There are powerful reasons for and against research ers taking the lead in formulating research impact measures for disciplines in the humanities, social sciences and creative arts (HSSCA). On balance, the reasons in favour are stronger, not least because such measures are otherwise apt to be formulated badly by those with little expertise. This invites us to inquire about the sorts of measures would best apply to HSSCA disciplines (among others), and whether some of the more popular impact measures, such as citation indices, really are reasonable indicators of impact or quality in these domains. It also raises questions about how burgeoning modes of research, knowledge mobilization, and impact tracking in the digital domain play into HSSCA research measures. On reflection, empirically adequate and arithmetically meaningful HSSCA impact measures will be pluralistic, non-reductive, and highly context-dependent; they are unlikely to lend themselves to the current pseudoscience of single-dimensional ordinal rankings between research institutions. Nevertheless they may support comparisons of interesting sorts, and enable assessments for accountability and planning purposes.

Content

Vgl.: http://www.ergon-verlag.de/isko_ko/downloads/ko_41_2014_3_g.pdf.

Footnote

Papers from the 2013 World Social Science Forum, Montréal, Canada.

Theme

Informetrie

Field

Sozialwissenschaften
Geisteswissenschaften
Kunst

Similar documents (content)

1. Mohammadi , E.; Thelwall, M.: Mendeley readership altmetrics for the social sciences and humanities : research evaluation and knowledge flows (2014) 0.17

   0.17420155 = sum of:
     0.17420155 = product of:
       0.6221484 = sum of:
         0.03925559 = weight(abstract_txt:social in 2190) [ClassicSimilarity], result of:
           0.03925559 = score(doc=2190,freq=3.0), product of:
             0.085979864 = queryWeight, product of:
               1.1240783 = boost
               4.2175875 = idf(docFreq=1770, maxDocs=44218)
               0.018135773 = queryNorm
             0.45656723 = fieldWeight in 2190, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.2175875 = idf(docFreq=1770, maxDocs=44218)
               0.0625 = fieldNorm(doc=2190)
         0.061639607 = weight(abstract_txt:sciences in 2190) [ClassicSimilarity], result of:
           0.061639607 = score(doc=2190,freq=2.0), product of:
             0.1329636 = queryWeight, product of:
               1.3978629 = boost
               5.244838 = idf(docFreq=633, maxDocs=44218)
               0.018135773 = queryNorm
             0.46358258 = fieldWeight in 2190, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.244838 = idf(docFreq=633, maxDocs=44218)
               0.0625 = fieldNorm(doc=2190)
         0.09341438 = weight(abstract_txt:disciplines in 2190) [ClassicSimilarity], result of:
           0.09341438 = score(doc=2190,freq=4.0), product of:
             0.13923828 = queryWeight, product of:
               1.4304659 = boost
               5.3671665 = idf(docFreq=560, maxDocs=44218)
               0.018135773 = queryNorm
             0.6708958 = fieldWeight in 2190, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.3671665 = idf(docFreq=560, maxDocs=44218)
               0.0625 = fieldNorm(doc=2190)
         0.089880526 = weight(abstract_txt:humanities in 2190) [ClassicSimilarity], result of:
           0.089880526 = score(doc=2190,freq=2.0), product of:
             0.17097655 = queryWeight, product of:
               1.5851358 = boost
               5.947494 = idf(docFreq=313, maxDocs=44218)
               0.018135773 = queryNorm
             0.5256892 = fieldWeight in 2190, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.947494 = idf(docFreq=313, maxDocs=44218)
               0.0625 = fieldNorm(doc=2190)
         0.04084148 = weight(abstract_txt:research in 2190) [ClassicSimilarity], result of:
           0.04084148 = score(doc=2190,freq=2.0), product of:
             0.14574742 = queryWeight, product of:
               2.534891 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.018135773 = queryNorm
             0.28022093 = fieldWeight in 2190, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=2190)
         0.15158318 = weight(abstract_txt:impact in 2190) [ClassicSimilarity], result of:
           0.15158318 = score(doc=2190,freq=3.0), product of:
             0.30521333 = queryWeight, product of:
               3.668264 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.018135773 = queryNorm
             0.49664664 = fieldWeight in 2190, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.0625 = fieldNorm(doc=2190)
         0.14553362 = weight(abstract_txt:measures in 2190) [ClassicSimilarity], result of:
           0.14553362 = score(doc=2190,freq=1.0), product of:
             0.42840263 = queryWeight, product of:
               4.3459516 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.018135773 = queryNorm
             0.33971223 = fieldWeight in 2190, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=2190)
       0.28 = coord(7/25)
   

2. Thelwall, M.; Delgado, M.M.: Arts and humanities research evaluation : no metrics please, just data (2015) 0.17

   0.17207733 = sum of:
     0.17207733 = product of:
       0.71698886 = sum of:
         0.019946245 = weight(abstract_txt:they in 2313) [ClassicSimilarity], result of:
           0.019946245 = score(doc=2313,freq=1.0), product of:
             0.06804616 = queryWeight, product of:
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.018135773 = queryNorm
             0.29312816 = fieldWeight in 2313, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.078125 = fieldNorm(doc=2313)
         0.03219791 = weight(abstract_txt:about in 2313) [ClassicSimilarity], result of:
           0.03219791 = score(doc=2313,freq=2.0), product of:
             0.07431982 = queryWeight, product of:
               1.0450823 = boost
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.018135773 = queryNorm
             0.43323454 = fieldWeight in 2313, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.078125 = fieldNorm(doc=2313)
         0.17764197 = weight(abstract_txt:humanities in 2313) [ClassicSimilarity], result of:
           0.17764197 = score(doc=2313,freq=5.0), product of:
             0.17097655 = queryWeight, product of:
               1.5851358 = boost
               5.947494 = idf(docFreq=313, maxDocs=44218)
               0.018135773 = queryNorm
             1.0389844 = fieldWeight in 2313, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.947494 = idf(docFreq=313, maxDocs=44218)
               0.078125 = fieldNorm(doc=2313)
         0.2602956 = weight(abstract_txt:arts in 2313) [ClassicSimilarity], result of:
           0.2602956 = score(doc=2313,freq=5.0), product of:
             0.22057216 = queryWeight, product of:
               1.8004189 = boost
               6.7552447 = idf(docFreq=139, maxDocs=44218)
               0.018135773 = queryNorm
             1.1800927 = fieldWeight in 2313, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.7552447 = idf(docFreq=139, maxDocs=44218)
               0.078125 = fieldNorm(doc=2313)
         0.07219821 = weight(abstract_txt:research in 2313) [ClassicSimilarity], result of:
           0.07219821 = score(doc=2313,freq=4.0), product of:
             0.14574742 = queryWeight, product of:
               2.534891 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.018135773 = queryNorm
             0.4953653 = fieldWeight in 2313, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.078125 = fieldNorm(doc=2313)
         0.15470894 = weight(abstract_txt:impact in 2313) [ClassicSimilarity], result of:
           0.15470894 = score(doc=2313,freq=2.0), product of:
             0.30521333 = queryWeight, product of:
               3.668264 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.018135773 = queryNorm
             0.50688785 = fieldWeight in 2313, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.078125 = fieldNorm(doc=2313)
       0.24 = coord(6/25)
   

3. White, H.D.; Boell, S.K.; Yu, H.; Davis, M.; Wilson, C.S.; Cole, F.T.H.: Libcitations : a measure for comparative assessment of book publications in the humanities and social sciences (2009) 0.14

   0.14356242 = sum of:
     0.14356242 = product of:
       0.5127229 = sum of:
         0.019745776 = weight(abstract_txt:they in 2846) [ClassicSimilarity], result of:
           0.019745776 = score(doc=2846,freq=2.0), product of:
             0.06804616 = queryWeight, product of:
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.018135773 = queryNorm
             0.29018208 = fieldWeight in 2846, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2846)
         0.019831197 = weight(abstract_txt:social in 2846) [ClassicSimilarity], result of:
           0.019831197 = score(doc=2846,freq=1.0), product of:
             0.085979864 = queryWeight, product of:
               1.1240783 = boost
               4.2175875 = idf(docFreq=1770, maxDocs=44218)
               0.018135773 = queryNorm
             0.23064932 = fieldWeight in 2846, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2175875 = idf(docFreq=1770, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2846)
         0.038137563 = weight(abstract_txt:sciences in 2846) [ClassicSimilarity], result of:
           0.038137563 = score(doc=2846,freq=1.0), product of:
             0.1329636 = queryWeight, product of:
               1.3978629 = boost
               5.244838 = idf(docFreq=633, maxDocs=44218)
               0.018135773 = queryNorm
             0.2868271 = fieldWeight in 2846, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.244838 = idf(docFreq=633, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2846)
         0.055610735 = weight(abstract_txt:humanities in 2846) [ClassicSimilarity], result of:
           0.055610735 = score(doc=2846,freq=1.0), product of:
             0.17097655 = queryWeight, product of:
               1.5851358 = boost
               5.947494 = idf(docFreq=313, maxDocs=44218)
               0.018135773 = queryNorm
             0.32525358 = fieldWeight in 2846, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.947494 = idf(docFreq=313, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2846)
         0.050538752 = weight(abstract_txt:research in 2846) [ClassicSimilarity], result of:
           0.050538752 = score(doc=2846,freq=4.0), product of:
             0.14574742 = queryWeight, product of:
               2.534891 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.018135773 = queryNorm
             0.3467557 = fieldWeight in 2846, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2846)
         0.10829625 = weight(abstract_txt:impact in 2846) [ClassicSimilarity], result of:
           0.10829625 = score(doc=2846,freq=2.0), product of:
             0.30521333 = queryWeight, product of:
               3.668264 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.018135773 = queryNorm
             0.3548215 = fieldWeight in 2846, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2846)
         0.22056265 = weight(abstract_txt:measures in 2846) [ClassicSimilarity], result of:
           0.22056265 = score(doc=2846,freq=3.0), product of:
             0.42840263 = queryWeight, product of:
               4.3459516 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.018135773 = queryNorm
             0.51484895 = fieldWeight in 2846, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0546875 = fieldNorm(doc=2846)
       0.28 = coord(7/25)
   

4. Larivière, V.; Gingras, Y.; Archambault, E.: ¬The decline in the concentration of citations, 1900-2007 (2009) 0.14

   0.14265512 = sum of:
     0.14265512 = product of:
       0.59439635 = sum of:
         0.02833028 = weight(abstract_txt:social in 2763) [ClassicSimilarity], result of:
           0.02833028 = score(doc=2763,freq=1.0), product of:
             0.085979864 = queryWeight, product of:
               1.1240783 = boost
               4.2175875 = idf(docFreq=1770, maxDocs=44218)
               0.018135773 = queryNorm
             0.329499 = fieldWeight in 2763, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2175875 = idf(docFreq=1770, maxDocs=44218)
               0.078125 = fieldNorm(doc=2763)
         0.07704951 = weight(abstract_txt:sciences in 2763) [ClassicSimilarity], result of:
           0.07704951 = score(doc=2763,freq=2.0), product of:
             0.1329636 = queryWeight, product of:
               1.3978629 = boost
               5.244838 = idf(docFreq=633, maxDocs=44218)
               0.018135773 = queryNorm
             0.5794782 = fieldWeight in 2763, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.244838 = idf(docFreq=633, maxDocs=44218)
               0.078125 = fieldNorm(doc=2763)
         0.05838399 = weight(abstract_txt:disciplines in 2763) [ClassicSimilarity], result of:
           0.05838399 = score(doc=2763,freq=1.0), product of:
             0.13923828 = queryWeight, product of:
               1.4304659 = boost
               5.3671665 = idf(docFreq=560, maxDocs=44218)
               0.018135773 = queryNorm
             0.41930988 = fieldWeight in 2763, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3671665 = idf(docFreq=560, maxDocs=44218)
               0.078125 = fieldNorm(doc=2763)
         0.07944391 = weight(abstract_txt:humanities in 2763) [ClassicSimilarity], result of:
           0.07944391 = score(doc=2763,freq=1.0), product of:
             0.17097655 = queryWeight, product of:
               1.5851358 = boost
               5.947494 = idf(docFreq=313, maxDocs=44218)
               0.018135773 = queryNorm
             0.46464798 = fieldWeight in 2763, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.947494 = idf(docFreq=313, maxDocs=44218)
               0.078125 = fieldNorm(doc=2763)
         0.036099106 = weight(abstract_txt:research in 2763) [ClassicSimilarity], result of:
           0.036099106 = score(doc=2763,freq=1.0), product of:
             0.14574742 = queryWeight, product of:
               2.534891 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.018135773 = queryNorm
             0.24768265 = fieldWeight in 2763, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.078125 = fieldNorm(doc=2763)
         0.31508952 = weight(abstract_txt:measures in 2763) [ClassicSimilarity], result of:
           0.31508952 = score(doc=2763,freq=3.0), product of:
             0.42840263 = queryWeight, product of:
               4.3459516 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.018135773 = queryNorm
             0.73549855 = fieldWeight in 2763, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.078125 = fieldNorm(doc=2763)
       0.24 = coord(6/25)
   

5. Hartley, J.: Reading and writing book reviews across the disciplines (2006) 0.14

   0.13949367 = sum of:
     0.13949367 = product of:
       0.43591774 = sum of:
         0.02763833 = weight(abstract_txt:they in 195) [ClassicSimilarity], result of:
           0.02763833 = score(doc=195,freq=3.0), product of:
             0.06804616 = queryWeight, product of:
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.018135773 = queryNorm
             0.4061703 = fieldWeight in 195, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.0625 = fieldNorm(doc=195)
         0.018213889 = weight(abstract_txt:about in 195) [ClassicSimilarity], result of:
           0.018213889 = score(doc=195,freq=1.0), product of:
             0.07431982 = queryWeight, product of:
               1.0450823 = boost
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.018135773 = queryNorm
             0.24507447 = fieldWeight in 195, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.0625 = fieldNorm(doc=195)
         0.03205205 = weight(abstract_txt:social in 195) [ClassicSimilarity], result of:
           0.03205205 = score(doc=195,freq=2.0), product of:
             0.085979864 = queryWeight, product of:
               1.1240783 = boost
               4.2175875 = idf(docFreq=1770, maxDocs=44218)
               0.018135773 = queryNorm
             0.37278557 = fieldWeight in 195, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2175875 = idf(docFreq=1770, maxDocs=44218)
               0.0625 = fieldNorm(doc=195)
         0.08717157 = weight(abstract_txt:sciences in 195) [ClassicSimilarity], result of:
           0.08717157 = score(doc=195,freq=4.0), product of:
             0.1329636 = queryWeight, product of:
               1.3978629 = boost
               5.244838 = idf(docFreq=633, maxDocs=44218)
               0.018135773 = queryNorm
             0.6556048 = fieldWeight in 195, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.244838 = idf(docFreq=633, maxDocs=44218)
               0.0625 = fieldNorm(doc=195)
         0.04670719 = weight(abstract_txt:disciplines in 195) [ClassicSimilarity], result of:
           0.04670719 = score(doc=195,freq=1.0), product of:
             0.13923828 = queryWeight, product of:
               1.4304659 = boost
               5.3671665 = idf(docFreq=560, maxDocs=44218)
               0.018135773 = queryNorm
             0.3354479 = fieldWeight in 195, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3671665 = idf(docFreq=560, maxDocs=44218)
               0.0625 = fieldNorm(doc=195)
         0.06355513 = weight(abstract_txt:humanities in 195) [ClassicSimilarity], result of:
           0.06355513 = score(doc=195,freq=1.0), product of:
             0.17097655 = queryWeight, product of:
               1.5851358 = boost
               5.947494 = idf(docFreq=313, maxDocs=44218)
               0.018135773 = queryNorm
             0.37171838 = fieldWeight in 195, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.947494 = idf(docFreq=313, maxDocs=44218)
               0.0625 = fieldNorm(doc=195)
         0.1317003 = weight(abstract_txt:arts in 195) [ClassicSimilarity], result of:
           0.1317003 = score(doc=195,freq=2.0), product of:
             0.22057216 = queryWeight, product of:
               1.8004189 = boost
               6.7552447 = idf(docFreq=139, maxDocs=44218)
               0.018135773 = queryNorm
             0.5970849 = fieldWeight in 195, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.7552447 = idf(docFreq=139, maxDocs=44218)
               0.0625 = fieldNorm(doc=195)
         0.028879287 = weight(abstract_txt:research in 195) [ClassicSimilarity], result of:
           0.028879287 = score(doc=195,freq=1.0), product of:
             0.14574742 = queryWeight, product of:
               2.534891 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.018135773 = queryNorm
             0.19814612 = fieldWeight in 195, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=195)
       0.32 = coord(8/25)