Document (#34418)

Author

Adler, R.
Ewing, J.
Taylor, P.

Title

Citation statistics : A report from the International Mathematical Union (IMU) in cooperation with the International Council of Industrial and Applied Mathematics (ICIAM) and the Institute of Mathematical Statistics (IMS)

Issue

Corrected version, 6/12/08.

Imprint

Joint IMU/ICIAM/IMS-Committee on Quantitative Assessment of Research : o.O.

Year

2008

Pages

26 S

Abstract

This is a report about the use and misuse of citation data in the assessment of scientific research. The idea that research assessment must be done using "simple and objective" methods is increasingly prevalent today. The "simple and objective" methods are broadly interpreted as bibliometrics, that is, citation data and the statistics derived from them. There is a belief that citation statistics are inherently more accurate because they substitute simple numbers for complex judgments, and hence overcome the possible subjectivity of peer review. But this belief is unfounded. - Relying on statistics is not more accurate when the statistics are improperly used. Indeed, statistics can mislead when they are misapplied or misunderstood. Much of modern bibliometrics seems to rely on experience and intuition about the interpretation and validity of citation statistics. - While numbers appear to be "objective", their objectivity can be illusory. The meaning of a citation can be even more subjective than peer review. Because this subjectivity is less obvious for citations, those who use citation data are less likely to understand their limitations. - The sole reliance on citation data provides at best an incomplete and often shallow understanding of research - an understanding that is valid only when reinforced by other judgments. Numbers are not inherently superior to sound judgments.
Using citation data to assess research ultimately means using citation-based statistics to rank things.journals, papers, people, programs, and disciplines. The statistical tools used to rank these things are often misunderstood and misused. - For journals, the impact factor is most often used for ranking. This is a simple average derived from the distribution of citations for a collection of articles in the journal. The average captures only a small amount of information about that distribution, and it is a rather crude statistic. In addition, there are many confounding factors when judging journals by citations, and any comparison of journals requires caution when using impact factors. Using the impact factor alone to judge a journal is like using weight alone to judge a person's health. - For papers, instead of relying on the actual count of citations to compare individual papers, people frequently substitute the impact factor of the journals in which the papers appear. They believe that higher impact factors must mean higher citation counts. But this is often not the case! This is a pervasive misuse of statistics that needs to be challenged whenever and wherever it occurs. -For individual scientists, complete citation records can be difficult to compare. As a consequence, there have been attempts to find simple statistics that capture the full complexity of a scientist's citation record with a single number. The most notable of these is the h-index, which seems to be gaining in popularity. But even a casual inspection of the h-index and its variants shows that these are naive attempts to understand complicated citation records. While they capture a small amount of information about the distribution of a scientist's citations, they lose crucial information that is essential for the assessment of research.
The validity of statistics such as the impact factor and h-index is neither well understood nor well studied. The connection of these statistics with research quality is sometimes established on the basis of "experience." The justification for relying on them is that they are "readily available." The few studies of these statistics that were done focused narrowly on showing a correlation with some other measure of quality rather than on determining how one can best derive useful information from citation data. We do not dismiss citation statistics as a tool for assessing the quality of research.citation data and statistics can provide some valuable information. We recognize that assessment must be practical, and for this reason easily-derived citation statistics almost surely will be part of the process. But citation data provide only a limited and incomplete view of research quality, and the statistics derived from citation data are sometimes poorly understood and misused. Research is too important to measure its value with only a single coarse tool. We hope those involved in assessment will read both the commentary and the details of this report in order to understand not only the limitations of citation statistics but also how better to use them. If we set high standards for the conduct of science, surely we should set equally high standards for assessing its quality.

Content

Der vollständige Bericht ist im Internet unter der folgenden Adresse zugänglich: http://www.mathunion.org/fileadmin/IMU/Report/CitationStatistics.pdf. - Vgl. auch den Beitrag: Zitaten-Statistiken. In: Mitteilungen der Deutschen Mathematiker-Vereinigung. 2008, H.3, S.198-203.

Theme

Informetrie

Field

Mathematik

Object

h-index

Similar documents (author)

1. Adler, S.: ¬The birth of a standard (1992) 2.33

   2.3300867 = sum of:
     2.3300867 = product of:
       4.6601734 = sum of:
         4.6601734 = weight(author_txt:adler in 5950) [ClassicSimilarity], result of:
           4.6601734 = score(doc=5950,freq=1.0), product of:
             0.82318586 = queryWeight, product of:
               1.2040983 = boost
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.075476505 = queryNorm
             5.661144 = fieldWeight in 5950, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.625 = fieldNorm(doc=5950)
       0.5 = coord(1/2)
   

2. Adler, S.C.: ¬The "¬ABCs" of DSSSL (1997) 2.33

   2.3300867 = sum of:
     2.3300867 = product of:
       4.6601734 = sum of:
         4.6601734 = weight(author_txt:adler in 387) [ClassicSimilarity], result of:
           4.6601734 = score(doc=387,freq=1.0), product of:
             0.82318586 = queryWeight, product of:
               1.2040983 = boost
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.075476505 = queryNorm
             5.661144 = fieldWeight in 387, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.625 = fieldNorm(doc=387)
       0.5 = coord(1/2)
   

3. Adler, P.S.: ¬An introduction : where are we heading? (1997) 2.33

   2.3300867 = sum of:
     2.3300867 = product of:
       4.6601734 = sum of:
         4.6601734 = weight(author_txt:adler in 1671) [ClassicSimilarity], result of:
           4.6601734 = score(doc=1671,freq=1.0), product of:
             0.82318586 = queryWeight, product of:
               1.2040983 = boost
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.075476505 = queryNorm
             5.661144 = fieldWeight in 1671, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.625 = fieldNorm(doc=1671)
       0.5 = coord(1/2)
   

4. Adler, E.: Multilingual and multiscript access : the case of Israel (2000) 2.33

   2.3300867 = sum of:
     2.3300867 = product of:
       4.6601734 = sum of:
         4.6601734 = weight(author_txt:adler in 5396) [ClassicSimilarity], result of:
           4.6601734 = score(doc=5396,freq=1.0), product of:
             0.82318586 = queryWeight, product of:
               1.2040983 = boost
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.075476505 = queryNorm
             5.661144 = fieldWeight in 5396, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.625 = fieldNorm(doc=5396)
       0.5 = coord(1/2)
   

5. Adler, M.A.: Disciplining knowledge at the Library of Congress (2012) 2.33

   2.3300867 = sum of:
     2.3300867 = product of:
       4.6601734 = sum of:
         4.6601734 = weight(author_txt:adler in 423) [ClassicSimilarity], result of:
           4.6601734 = score(doc=423,freq=1.0), product of:
             0.82318586 = queryWeight, product of:
               1.2040983 = boost
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.075476505 = queryNorm
             5.661144 = fieldWeight in 423, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.625 = fieldNorm(doc=423)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Zhang, C.; Liu, X.; Xu, Y.(C.); Wang, Y.: Quality-structure index : a new metric to measure scientific journal influence (2011) 0.39

   0.39099535 = sum of:
     0.39099535 = product of:
       0.81457365 = sum of:
         0.011336413 = weight(abstract_txt:this in 4366) [ClassicSimilarity], result of:
           0.011336413 = score(doc=4366,freq=3.0), product of:
             0.043398485 = queryWeight, product of:
               1.0274388 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.01750484 = queryNorm
             0.2612168 = fieldWeight in 4366, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.06295028 = weight(abstract_txt:journals in 4366) [ClassicSimilarity], result of:
           0.06295028 = score(doc=4366,freq=4.0), product of:
             0.09813704 = queryWeight, product of:
               1.0924968 = boost
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.01750484 = queryNorm
             0.6414528 = fieldWeight in 4366, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.014510986 = weight(abstract_txt:using in 4366) [ClassicSimilarity], result of:
           0.014510986 = score(doc=4366,freq=1.0), product of:
             0.0670424 = queryWeight, product of:
               1.1059209 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.01750484 = queryNorm
             0.21644491 = fieldWeight in 4366, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.044193257 = weight(abstract_txt:derived in 4366) [ClassicSimilarity], result of:
           0.044193257 = score(doc=4366,freq=1.0), product of:
             0.1230529 = queryWeight, product of:
               1.2233468 = boost
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.01750484 = queryNorm
             0.3591403 = fieldWeight in 4366, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.04550358 = weight(abstract_txt:factor in 4366) [ClassicSimilarity], result of:
           0.04550358 = score(doc=4366,freq=1.0), product of:
             0.12547337 = queryWeight, product of:
               1.23532 = boost
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.01750484 = queryNorm
             0.36265528 = fieldWeight in 4366, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.050796364 = weight(abstract_txt:quality in 4366) [ClassicSimilarity], result of:
           0.050796364 = score(doc=4366,freq=3.0), product of:
             0.10084922 = queryWeight, product of:
               1.2382119 = boost
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.01750484 = queryNorm
             0.50368625 = fieldWeight in 4366, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.014843978 = weight(abstract_txt:research in 4366) [ClassicSimilarity], result of:
           0.014843978 = score(doc=4366,freq=1.0), product of:
             0.0749143 = queryWeight, product of:
               1.3498982 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.01750484 = queryNorm
             0.19814612 = fieldWeight in 4366, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.0337377 = weight(abstract_txt:impact in 4366) [ClassicSimilarity], result of:
           0.0337377 = score(doc=4366,freq=1.0), product of:
             0.11765993 = queryWeight, product of:
               1.4650875 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.01750484 = queryNorm
             0.28673908 = fieldWeight in 4366, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.05554411 = weight(abstract_txt:assessment in 4366) [ClassicSimilarity], result of:
           0.05554411 = score(doc=4366,freq=1.0), product of:
             0.1543772 = queryWeight, product of:
               1.53197 = boost
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.01750484 = queryNorm
             0.35979474 = fieldWeight in 4366, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.014241588 = weight(abstract_txt:that in 4366) [ClassicSimilarity], result of:
           0.014241588 = score(doc=4366,freq=2.0), product of:
             0.06800037 = queryWeight, product of:
               1.6394606 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01750484 = queryNorm
             0.20943399 = fieldWeight in 4366, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.19337648 = weight(abstract_txt:citation in 4366) [ClassicSimilarity], result of:
           0.19337648 = score(doc=4366,freq=2.0), product of:
             0.4467902 = queryWeight, product of:
               5.212433 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.01750484 = queryNorm
             0.43281272 = fieldWeight in 4366, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
         0.27353895 = weight(abstract_txt:statistics in 4366) [ClassicSimilarity], result of:
           0.27353895 = score(doc=4366,freq=1.0), product of:
             0.69731957 = queryWeight, product of:
               6.346969 = boost
               6.2763524 = idf(docFreq=225, maxDocs=44218)
               0.01750484 = queryNorm
             0.39227203 = fieldWeight in 4366, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2763524 = idf(docFreq=225, maxDocs=44218)
               0.0625 = fieldNorm(doc=4366)
       0.48 = coord(12/25)
   

2. Huang, H.; Andrews, J.; Tang, J.: Citation characterization and impact normalization in bioinformatics journals (2012) 0.38

   0.3838232 = sum of:
     0.3838232 = product of:
       0.8723254 = sum of:
         0.0065450813 = weight(abstract_txt:this in 69) [ClassicSimilarity], result of:
           0.0065450813 = score(doc=69,freq=1.0), product of:
             0.043398485 = queryWeight, product of:
               1.0274388 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.01750484 = queryNorm
             0.1508136 = fieldWeight in 69, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=69)
         0.08327539 = weight(abstract_txt:journals in 69) [ClassicSimilarity], result of:
           0.08327539 = score(doc=69,freq=7.0), product of:
             0.09813704 = queryWeight, product of:
               1.0924968 = boost
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.01750484 = queryNorm
             0.84856224 = fieldWeight in 69, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.0625 = fieldNorm(doc=69)
         0.0624987 = weight(abstract_txt:derived in 69) [ClassicSimilarity], result of:
           0.0624987 = score(doc=69,freq=2.0), product of:
             0.1230529 = queryWeight, product of:
               1.2233468 = boost
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.01750484 = queryNorm
             0.5079011 = fieldWeight in 69, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.0625 = fieldNorm(doc=69)
         0.04550358 = weight(abstract_txt:factor in 69) [ClassicSimilarity], result of:
           0.04550358 = score(doc=69,freq=1.0), product of:
             0.12547337 = queryWeight, product of:
               1.23532 = boost
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.01750484 = queryNorm
             0.36265528 = fieldWeight in 69, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.0625 = fieldNorm(doc=69)
         0.014843978 = weight(abstract_txt:research in 69) [ClassicSimilarity], result of:
           0.014843978 = score(doc=69,freq=1.0), product of:
             0.0749143 = queryWeight, product of:
               1.3498982 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.01750484 = queryNorm
             0.19814612 = fieldWeight in 69, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=69)
         0.044310268 = weight(abstract_txt:citations in 69) [ClassicSimilarity], result of:
           0.044310268 = score(doc=69,freq=1.0), product of:
             0.1327886 = queryWeight, product of:
               1.42082 = boost
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.01750484 = queryNorm
             0.33369032 = fieldWeight in 69, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.0625 = fieldNorm(doc=69)
         0.07543979 = weight(abstract_txt:impact in 69) [ClassicSimilarity], result of:
           0.07543979 = score(doc=69,freq=5.0), product of:
             0.11765993 = queryWeight, product of:
               1.4650875 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.01750484 = queryNorm
             0.64116806 = fieldWeight in 69, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.0625 = fieldNorm(doc=69)
         0.019462565 = weight(abstract_txt:data in 69) [ClassicSimilarity], result of:
           0.019462565 = score(doc=69,freq=1.0), product of:
             0.093335904 = queryWeight, product of:
               1.5981565 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.01750484 = queryNorm
             0.20852174 = fieldWeight in 69, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=69)
         0.010070324 = weight(abstract_txt:that in 69) [ClassicSimilarity], result of:
           0.010070324 = score(doc=69,freq=1.0), product of:
             0.06800037 = queryWeight, product of:
               1.6394606 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01750484 = queryNorm
             0.1480922 = fieldWeight in 69, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=69)
         0.23683684 = weight(abstract_txt:citation in 69) [ClassicSimilarity], result of:
           0.23683684 = score(doc=69,freq=3.0), product of:
             0.4467902 = queryWeight, product of:
               5.212433 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.01750484 = queryNorm
             0.53008515 = fieldWeight in 69, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0625 = fieldNorm(doc=69)
         0.27353895 = weight(abstract_txt:statistics in 69) [ClassicSimilarity], result of:
           0.27353895 = score(doc=69,freq=1.0), product of:
             0.69731957 = queryWeight, product of:
               6.346969 = boost
               6.2763524 = idf(docFreq=225, maxDocs=44218)
               0.01750484 = queryNorm
             0.39227203 = fieldWeight in 69, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2763524 = idf(docFreq=225, maxDocs=44218)
               0.0625 = fieldNorm(doc=69)
       0.44 = coord(11/25)
   

3. Radev, D.R.; Joseph, M.T.; Gibson, B.; Muthukrishnan, P.: ¬A bibliometric and network analysis of the field of computational linguistics (2016) 0.38

   0.38123706 = sum of:
     0.38123706 = product of:
       1.0589918 = sum of:
         0.02176648 = weight(abstract_txt:using in 2764) [ClassicSimilarity], result of:
           0.02176648 = score(doc=2764,freq=1.0), product of:
             0.0670424 = queryWeight, product of:
               1.1059209 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.01750484 = queryNorm
             0.32466736 = fieldWeight in 2764, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.09375 = fieldNorm(doc=2764)
         0.072534174 = weight(abstract_txt:papers in 2764) [ClassicSimilarity], result of:
           0.072534174 = score(doc=2764,freq=2.0), product of:
             0.10370796 = queryWeight, product of:
               1.1230775 = boost
               5.2752647 = idf(docFreq=614, maxDocs=44218)
               0.01750484 = queryNorm
             0.69940794 = fieldWeight in 2764, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.2752647 = idf(docFreq=614, maxDocs=44218)
               0.09375 = fieldNorm(doc=2764)
         0.068255365 = weight(abstract_txt:factor in 2764) [ClassicSimilarity], result of:
           0.068255365 = score(doc=2764,freq=1.0), product of:
             0.12547337 = queryWeight, product of:
               1.23532 = boost
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.01750484 = queryNorm
             0.5439829 = fieldWeight in 2764, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8024845 = idf(docFreq=362, maxDocs=44218)
               0.09375 = fieldNorm(doc=2764)
         0.022265967 = weight(abstract_txt:research in 2764) [ClassicSimilarity], result of:
           0.022265967 = score(doc=2764,freq=1.0), product of:
             0.0749143 = queryWeight, product of:
               1.3498982 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.01750484 = queryNorm
             0.2972192 = fieldWeight in 2764, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.09375 = fieldNorm(doc=2764)
         0.09399627 = weight(abstract_txt:citations in 2764) [ClassicSimilarity], result of:
           0.09399627 = score(doc=2764,freq=2.0), product of:
             0.1327886 = queryWeight, product of:
               1.42082 = boost
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.01750484 = queryNorm
             0.70786405 = fieldWeight in 2764, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.09375 = fieldNorm(doc=2764)
         0.05060655 = weight(abstract_txt:impact in 2764) [ClassicSimilarity], result of:
           0.05060655 = score(doc=2764,freq=1.0), product of:
             0.11765993 = queryWeight, product of:
               1.4650875 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.01750484 = queryNorm
             0.4301086 = fieldWeight in 2764, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.09375 = fieldNorm(doc=2764)
         0.029193848 = weight(abstract_txt:data in 2764) [ClassicSimilarity], result of:
           0.029193848 = score(doc=2764,freq=1.0), product of:
             0.093335904 = queryWeight, product of:
               1.5981565 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.01750484 = queryNorm
             0.31278262 = fieldWeight in 2764, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.09375 = fieldNorm(doc=2764)
         0.29006472 = weight(abstract_txt:citation in 2764) [ClassicSimilarity], result of:
           0.29006472 = score(doc=2764,freq=2.0), product of:
             0.4467902 = queryWeight, product of:
               5.212433 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.01750484 = queryNorm
             0.6492191 = fieldWeight in 2764, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.09375 = fieldNorm(doc=2764)
         0.41030845 = weight(abstract_txt:statistics in 2764) [ClassicSimilarity], result of:
           0.41030845 = score(doc=2764,freq=1.0), product of:
             0.69731957 = queryWeight, product of:
               6.346969 = boost
               6.2763524 = idf(docFreq=225, maxDocs=44218)
               0.01750484 = queryNorm
             0.58840805 = fieldWeight in 2764, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2763524 = idf(docFreq=225, maxDocs=44218)
               0.09375 = fieldNorm(doc=2764)
       0.36 = coord(9/25)
   

4. Leydesdorff, L.; Shin, J.C.: How to evaluate universities in terms of their relative citation impacts : fractional counting of citations and the normalization of differences among disciplines (2011) 0.36

   0.35946807 = sum of:
     0.35946807 = product of:
       0.9985224 = sum of:
         0.066768855 = weight(abstract_txt:journals in 4466) [ClassicSimilarity], result of:
           0.066768855 = score(doc=4466,freq=2.0), product of:
             0.09813704 = queryWeight, product of:
               1.0924968 = boost
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.01750484 = queryNorm
             0.6803634 = fieldWeight in 4466, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.09375 = fieldNorm(doc=4466)
         0.031176344 = weight(abstract_txt:when in 4466) [ClassicSimilarity], result of:
           0.031176344 = score(doc=4466,freq=1.0), product of:
             0.0801642 = queryWeight, product of:
               1.1039487 = boost
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.01750484 = queryNorm
             0.38890606 = fieldWeight in 4466, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.148331 = idf(docFreq=1897, maxDocs=44218)
               0.09375 = fieldNorm(doc=4466)
         0.02176648 = weight(abstract_txt:using in 4466) [ClassicSimilarity], result of:
           0.02176648 = score(doc=4466,freq=1.0), product of:
             0.0670424 = queryWeight, product of:
               1.1059209 = boost
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.01750484 = queryNorm
             0.32466736 = fieldWeight in 4466, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4631186 = idf(docFreq=3765, maxDocs=44218)
               0.09375 = fieldNorm(doc=4466)
         0.051289402 = weight(abstract_txt:papers in 4466) [ClassicSimilarity], result of:
           0.051289402 = score(doc=4466,freq=1.0), product of:
             0.10370796 = queryWeight, product of:
               1.1230775 = boost
               5.2752647 = idf(docFreq=614, maxDocs=44218)
               0.01750484 = queryNorm
             0.49455607 = fieldWeight in 4466, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2752647 = idf(docFreq=614, maxDocs=44218)
               0.09375 = fieldNorm(doc=4466)
         0.031488832 = weight(abstract_txt:research in 4466) [ClassicSimilarity], result of:
           0.031488832 = score(doc=4466,freq=2.0), product of:
             0.0749143 = queryWeight, product of:
               1.3498982 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.01750484 = queryNorm
             0.4203314 = fieldWeight in 4466, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.09375 = fieldNorm(doc=4466)
         0.06646541 = weight(abstract_txt:citations in 4466) [ClassicSimilarity], result of:
           0.06646541 = score(doc=4466,freq=1.0), product of:
             0.1327886 = queryWeight, product of:
               1.42082 = boost
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.01750484 = queryNorm
             0.5005355 = fieldWeight in 4466, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.09375 = fieldNorm(doc=4466)
         0.029193848 = weight(abstract_txt:data in 4466) [ClassicSimilarity], result of:
           0.029193848 = score(doc=4466,freq=1.0), product of:
             0.093335904 = queryWeight, product of:
               1.5981565 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.01750484 = queryNorm
             0.31278262 = fieldWeight in 4466, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.09375 = fieldNorm(doc=4466)
         0.29006472 = weight(abstract_txt:citation in 4466) [ClassicSimilarity], result of:
           0.29006472 = score(doc=4466,freq=2.0), product of:
             0.4467902 = queryWeight, product of:
               5.212433 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.01750484 = queryNorm
             0.6492191 = fieldWeight in 4466, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.09375 = fieldNorm(doc=4466)
         0.41030845 = weight(abstract_txt:statistics in 4466) [ClassicSimilarity], result of:
           0.41030845 = score(doc=4466,freq=1.0), product of:
             0.69731957 = queryWeight, product of:
               6.346969 = boost
               6.2763524 = idf(docFreq=225, maxDocs=44218)
               0.01750484 = queryNorm
             0.58840805 = fieldWeight in 4466, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2763524 = idf(docFreq=225, maxDocs=44218)
               0.09375 = fieldNorm(doc=4466)
       0.36 = coord(9/25)
   

5. Haustein, S.; Sugimoto, C.; Larivière, V.: Social media in scholarly communication : Guest editorial (2015) 0.32

   0.31561413 = sum of:
     0.31561413 = product of:
       0.56359667 = sum of:
         0.0065450813 = weight(abstract_txt:this in 3809) [ClassicSimilarity], result of:
           0.0065450813 = score(doc=3809,freq=4.0), product of:
             0.043398485 = queryWeight, product of:
               1.0274388 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.01750484 = queryNorm
             0.1508136 = fieldWeight in 3809, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.03125 = fieldNorm(doc=3809)
         0.01573757 = weight(abstract_txt:journals in 3809) [ClassicSimilarity], result of:
           0.01573757 = score(doc=3809,freq=1.0), product of:
             0.09813704 = queryWeight, product of:
               1.0924968 = boost
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.01750484 = queryNorm
             0.1603632 = fieldWeight in 3809, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1316223 = idf(docFreq=709, maxDocs=44218)
               0.03125 = fieldNorm(doc=3809)
         0.034192935 = weight(abstract_txt:papers in 3809) [ClassicSimilarity], result of:
           0.034192935 = score(doc=3809,freq=4.0), product of:
             0.10370796 = queryWeight, product of:
               1.1230775 = boost
               5.2752647 = idf(docFreq=614, maxDocs=44218)
               0.01750484 = queryNorm
             0.32970405 = fieldWeight in 3809, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.2752647 = idf(docFreq=614, maxDocs=44218)
               0.03125 = fieldNorm(doc=3809)
         0.0110546 = weight(abstract_txt:only in 3809) [ClassicSimilarity], result of:
           0.0110546 = score(doc=3809,freq=1.0), product of:
             0.08353591 = queryWeight, product of:
               1.1269257 = boost
               4.234672 = idf(docFreq=1740, maxDocs=44218)
               0.01750484 = queryNorm
             0.1323335 = fieldWeight in 3809, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.234672 = idf(docFreq=1740, maxDocs=44218)
               0.03125 = fieldNorm(doc=3809)
         0.015981887 = weight(abstract_txt:they in 3809) [ClassicSimilarity], result of:
           0.015981887 = score(doc=3809,freq=3.0), product of:
             0.0786955 = queryWeight, product of:
               1.198186 = boost
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.01750484 = queryNorm
             0.20308515 = fieldWeight in 3809, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.03125 = fieldNorm(doc=3809)
         0.014663648 = weight(abstract_txt:quality in 3809) [ClassicSimilarity], result of:
           0.014663648 = score(doc=3809,freq=1.0), product of:
             0.10084922 = queryWeight, product of:
               1.2382119 = boost
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.01750484 = queryNorm
             0.1454017 = fieldWeight in 3809, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6528544 = idf(docFreq=1145, maxDocs=44218)
               0.03125 = fieldNorm(doc=3809)
         0.019636735 = weight(abstract_txt:research in 3809) [ClassicSimilarity], result of:
           0.019636735 = score(doc=3809,freq=7.0), product of:
             0.0749143 = queryWeight, product of:
               1.3498982 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.01750484 = queryNorm
             0.26212266 = fieldWeight in 3809, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.03125 = fieldNorm(doc=3809)
         0.03133209 = weight(abstract_txt:citations in 3809) [ClassicSimilarity], result of:
           0.03133209 = score(doc=3809,freq=2.0), product of:
             0.1327886 = queryWeight, product of:
               1.42082 = boost
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.01750484 = queryNorm
             0.23595469 = fieldWeight in 3809, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.339045 = idf(docFreq=576, maxDocs=44218)
               0.03125 = fieldNorm(doc=3809)
         0.023856156 = weight(abstract_txt:impact in 3809) [ClassicSimilarity], result of:
           0.023856156 = score(doc=3809,freq=2.0), product of:
             0.11765993 = queryWeight, product of:
               1.4650875 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.01750484 = queryNorm
             0.20275514 = fieldWeight in 3809, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.03125 = fieldNorm(doc=3809)
         0.04810261 = weight(abstract_txt:assessment in 3809) [ClassicSimilarity], result of:
           0.04810261 = score(doc=3809,freq=3.0), product of:
             0.1543772 = queryWeight, product of:
               1.53197 = boost
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.01750484 = queryNorm
             0.3115914 = fieldWeight in 3809, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.03125 = fieldNorm(doc=3809)
         0.0097312825 = weight(abstract_txt:data in 3809) [ClassicSimilarity], result of:
           0.0097312825 = score(doc=3809,freq=1.0), product of:
             0.093335904 = queryWeight, product of:
               1.5981565 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.01750484 = queryNorm
             0.10426087 = fieldWeight in 3809, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.03125 = fieldNorm(doc=3809)
         0.015105485 = weight(abstract_txt:that in 3809) [ClassicSimilarity], result of:
           0.015105485 = score(doc=3809,freq=9.0), product of:
             0.06800037 = queryWeight, product of:
               1.6394606 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01750484 = queryNorm
             0.22213829 = fieldWeight in 3809, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.03125 = fieldNorm(doc=3809)
         0.18088712 = weight(abstract_txt:citation in 3809) [ClassicSimilarity], result of:
           0.18088712 = score(doc=3809,freq=7.0), product of:
             0.4467902 = queryWeight, product of:
               5.212433 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.01750484 = queryNorm
             0.40485922 = fieldWeight in 3809, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.03125 = fieldNorm(doc=3809)
         0.13676947 = weight(abstract_txt:statistics in 3809) [ClassicSimilarity], result of:
           0.13676947 = score(doc=3809,freq=1.0), product of:
             0.69731957 = queryWeight, product of:
               6.346969 = boost
               6.2763524 = idf(docFreq=225, maxDocs=44218)
               0.01750484 = queryNorm
             0.19613601 = fieldWeight in 3809, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2763524 = idf(docFreq=225, maxDocs=44218)
               0.03125 = fieldNorm(doc=3809)
       0.56 = coord(14/25)