Document (#17328)

Author

So, C.Y.K.

Title

Citation ranking versus expert judgement in evaluating communication scholars : effects of research specialty size and individual prominence

Source

Scientometrics. 41(1998) no.3, S.325-333

Year

1998

Abstract

Numerous attempts have been made to validate the use of citations as an evaluation method by comparing it with peer review. Unlike past studies using journals, research articles or universities as the subject matter, the present study extends the comparison to the ranking of individual scholars. Results show that citation ranking and expert judgement of communication scholars are highly correlated. The citation methods and the expert judgement method are found to work better in smaller research areas and yield more valid evaluation results for more prominent scholars

Theme

Informetrie
Citation indexing

Similar documents (content)

1. Meho, L.I.; Rogers, Y.: Citation counting, citation ranking, and h-index of human-computer interaction researchers : a comparison of Scopus and Web of Science (2008) 0.23

   0.22521321 = sum of:
     0.22521321 = product of:
       0.62559223 = sum of:
         0.049055487 = weight(abstract_txt:peer in 2352) [ClassicSimilarity], result of:
           0.049055487 = score(doc=2352,freq=1.0), product of:
             0.12078188 = queryWeight, product of:
               1.0075238 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.018447636 = queryNorm
             0.4061494 = fieldWeight in 2352, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.0625 = fieldNorm(doc=2352)
         0.019909112 = weight(abstract_txt:more in 2352) [ClassicSimilarity], result of:
           0.019909112 = score(doc=2352,freq=2.0), product of:
             0.06620813 = queryWeight, product of:
               1.0549334 = boost
               3.402088 = idf(docFreq=4002, maxDocs=44218)
               0.018447636 = queryNorm
             0.30070493 = fieldWeight in 2352, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.402088 = idf(docFreq=4002, maxDocs=44218)
               0.0625 = fieldNorm(doc=2352)
         0.015098871 = weight(abstract_txt:results in 2352) [ClassicSimilarity], result of:
           0.015098871 = score(doc=2352,freq=1.0), product of:
             0.06937181 = queryWeight, product of:
               1.0798438 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.018447636 = queryNorm
             0.21765138 = fieldWeight in 2352, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=2352)
         0.032277357 = weight(abstract_txt:evaluation in 2352) [ClassicSimilarity], result of:
           0.032277357 = score(doc=2352,freq=1.0), product of:
             0.11512033 = queryWeight, product of:
               1.3910586 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.018447636 = queryNorm
             0.2803793 = fieldWeight in 2352, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=2352)
         0.024167024 = weight(abstract_txt:research in 2352) [ClassicSimilarity], result of:
           0.024167024 = score(doc=2352,freq=2.0), product of:
             0.08624275 = queryWeight, product of:
               1.4746071 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.018447636 = queryNorm
             0.28022093 = fieldWeight in 2352, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=2352)
         0.05864607 = weight(abstract_txt:individual in 2352) [ClassicSimilarity], result of:
           0.05864607 = score(doc=2352,freq=2.0), product of:
             0.1360513 = queryWeight, product of:
               1.51224 = boost
               4.8768706 = idf(docFreq=915, maxDocs=44218)
               0.018447636 = queryNorm
             0.43105853 = fieldWeight in 2352, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8768706 = idf(docFreq=915, maxDocs=44218)
               0.0625 = fieldNorm(doc=2352)
         0.15423472 = weight(abstract_txt:citation in 2352) [ClassicSimilarity], result of:
           0.15423472 = score(doc=2352,freq=6.0), product of:
             0.2057413 = queryWeight, product of:
               2.2775912 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.018447636 = queryNorm
             0.7496537 = fieldWeight in 2352, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0625 = fieldNorm(doc=2352)
         0.13310501 = weight(abstract_txt:ranking in 2352) [ClassicSimilarity], result of:
           0.13310501 = score(doc=2352,freq=2.0), product of:
             0.26896974 = queryWeight, product of:
               2.6041546 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.018447636 = queryNorm
             0.49486983 = fieldWeight in 2352, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0625 = fieldNorm(doc=2352)
         0.13909861 = weight(abstract_txt:scholars in 2352) [ClassicSimilarity], result of:
           0.13909861 = score(doc=2352,freq=1.0), product of:
             0.38410085 = queryWeight, product of:
               3.5934122 = boost
               5.794254 = idf(docFreq=365, maxDocs=44218)
               0.018447636 = queryNorm
             0.36214086 = fieldWeight in 2352, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.794254 = idf(docFreq=365, maxDocs=44218)
               0.0625 = fieldNorm(doc=2352)
       0.36 = coord(9/25)
   

2. Sen, B.K.; Pandalai, T.A.; Karanjai, A.: Ranking of scientists - a new approach (1998) 0.20

   0.19932203 = sum of:
     0.19932203 = product of:
       0.99661016 = sum of:
         0.0858471 = weight(abstract_txt:peer in 5113) [ClassicSimilarity], result of:
           0.0858471 = score(doc=5113,freq=1.0), product of:
             0.12078188 = queryWeight, product of:
               1.0075238 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.018447636 = queryNorm
             0.7107614 = fieldWeight in 5113, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.109375 = fieldNorm(doc=5113)
         0.057049364 = weight(abstract_txt:method in 5113) [ClassicSimilarity], result of:
           0.057049364 = score(doc=5113,freq=1.0), product of:
             0.115885355 = queryWeight, product of:
               1.395673 = boost
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.018447636 = queryNorm
             0.4922914 = fieldWeight in 5113, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.50095 = idf(docFreq=1333, maxDocs=44218)
               0.109375 = fieldNorm(doc=5113)
         0.15583304 = weight(abstract_txt:citation in 5113) [ClassicSimilarity], result of:
           0.15583304 = score(doc=5113,freq=2.0), product of:
             0.2057413 = queryWeight, product of:
               2.2775912 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.018447636 = queryNorm
             0.75742227 = fieldWeight in 5113, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.109375 = fieldNorm(doc=5113)
         0.23293377 = weight(abstract_txt:ranking in 5113) [ClassicSimilarity], result of:
           0.23293377 = score(doc=5113,freq=2.0), product of:
             0.26896974 = queryWeight, product of:
               2.6041546 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.018447636 = queryNorm
             0.8660222 = fieldWeight in 5113, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.109375 = fieldNorm(doc=5113)
         0.46494684 = weight(abstract_txt:judgement in 5113) [ClassicSimilarity], result of:
           0.46494684 = score(doc=5113,freq=1.0), product of:
             0.5372305 = queryWeight, product of:
               3.680403 = boost
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.018447636 = queryNorm
             0.86545134 = fieldWeight in 5113, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.912698 = idf(docFreq=43, maxDocs=44218)
               0.109375 = fieldNorm(doc=5113)
       0.2 = coord(5/25)
   

3. Meho, L.I.; Sonnenwald, D.H.: Citation ranking versus peer evaluation of senior faculty research performance : a case study of Kurdish scholarship (2000) 0.19

   0.1908024 = sum of:
     0.1908024 = product of:
       0.79501 = sum of:
         0.12263872 = weight(abstract_txt:peer in 4382) [ClassicSimilarity], result of:
           0.12263872 = score(doc=4382,freq=4.0), product of:
             0.12078188 = queryWeight, product of:
               1.0075238 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.018447636 = queryNorm
             1.0153735 = fieldWeight in 4382, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.078125 = fieldNorm(doc=4382)
         0.07370559 = weight(abstract_txt:valid in 4382) [ClassicSimilarity], result of:
           0.07370559 = score(doc=4382,freq=1.0), product of:
             0.13654329 = queryWeight, product of:
               1.0712469 = boost
               6.9093957 = idf(docFreq=119, maxDocs=44218)
               0.018447636 = queryNorm
             0.53979653 = fieldWeight in 4382, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9093957 = idf(docFreq=119, maxDocs=44218)
               0.078125 = fieldNorm(doc=4382)
         0.080693394 = weight(abstract_txt:evaluation in 4382) [ClassicSimilarity], result of:
           0.080693394 = score(doc=4382,freq=4.0), product of:
             0.11512033 = queryWeight, product of:
               1.3910586 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.018447636 = queryNorm
             0.70094824 = fieldWeight in 4382, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=4382)
         0.036998045 = weight(abstract_txt:research in 4382) [ClassicSimilarity], result of:
           0.036998045 = score(doc=4382,freq=3.0), product of:
             0.08624275 = queryWeight, product of:
               1.4746071 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.018447636 = queryNorm
             0.42899892 = fieldWeight in 4382, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.078125 = fieldNorm(doc=4382)
         0.19279341 = weight(abstract_txt:citation in 4382) [ClassicSimilarity], result of:
           0.19279341 = score(doc=4382,freq=6.0), product of:
             0.2057413 = queryWeight, product of:
               2.2775912 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.018447636 = queryNorm
             0.93706715 = fieldWeight in 4382, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.078125 = fieldNorm(doc=4382)
         0.2881808 = weight(abstract_txt:ranking in 4382) [ClassicSimilarity], result of:
           0.2881808 = score(doc=4382,freq=6.0), product of:
             0.26896974 = queryWeight, product of:
               2.6041546 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.018447636 = queryNorm
             1.0714246 = fieldWeight in 4382, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.078125 = fieldNorm(doc=4382)
       0.24 = coord(6/25)
   

4. Serenko, A.; Bontis, N.: ¬A critical evaluation of expert survey-based journal rankings : the role of personal research interests (2018) 0.13

   0.13124765 = sum of:
     0.13124765 = product of:
       0.5468652 = sum of:
         0.017597334 = weight(abstract_txt:more in 4228) [ClassicSimilarity], result of:
           0.017597334 = score(doc=4228,freq=1.0), product of:
             0.06620813 = queryWeight, product of:
               1.0549334 = boost
               3.402088 = idf(docFreq=4002, maxDocs=44218)
               0.018447636 = queryNorm
             0.2657881 = fieldWeight in 4228, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.402088 = idf(docFreq=4002, maxDocs=44218)
               0.078125 = fieldNorm(doc=4228)
         0.026691284 = weight(abstract_txt:results in 4228) [ClassicSimilarity], result of:
           0.026691284 = score(doc=4228,freq=2.0), product of:
             0.06937181 = queryWeight, product of:
               1.0798438 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.018447636 = queryNorm
             0.38475692 = fieldWeight in 4228, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.078125 = fieldNorm(doc=4228)
         0.036998045 = weight(abstract_txt:research in 4228) [ClassicSimilarity], result of:
           0.036998045 = score(doc=4228,freq=3.0), product of:
             0.08624275 = queryWeight, product of:
               1.4746071 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.018447636 = queryNorm
             0.42899892 = fieldWeight in 4228, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.078125 = fieldNorm(doc=4228)
         0.16638125 = weight(abstract_txt:ranking in 4228) [ClassicSimilarity], result of:
           0.16638125 = score(doc=4228,freq=2.0), product of:
             0.26896974 = queryWeight, product of:
               2.6041546 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.018447636 = queryNorm
             0.61858726 = fieldWeight in 4228, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.078125 = fieldNorm(doc=4228)
         0.12532401 = weight(abstract_txt:expert in 4228) [ClassicSimilarity], result of:
           0.12532401 = score(doc=4228,freq=1.0), product of:
             0.28054336 = queryWeight, product of:
               2.659592 = boost
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.018447636 = queryNorm
             0.44671887 = fieldWeight in 4228, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.078125 = fieldNorm(doc=4228)
         0.17387328 = weight(abstract_txt:scholars in 4228) [ClassicSimilarity], result of:
           0.17387328 = score(doc=4228,freq=1.0), product of:
             0.38410085 = queryWeight, product of:
               3.5934122 = boost
               5.794254 = idf(docFreq=365, maxDocs=44218)
               0.018447636 = queryNorm
             0.4526761 = fieldWeight in 4228, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.794254 = idf(docFreq=365, maxDocs=44218)
               0.078125 = fieldNorm(doc=4228)
       0.24 = coord(6/25)
   

5. Zhu, J.; Song, D.; Rüger, S.: Integrating multiple windows and document features for expert finding (2009) 0.13

   0.12860352 = sum of:
     0.12860352 = product of:
       0.45929825 = sum of:
         0.014077867 = weight(abstract_txt:more in 2755) [ClassicSimilarity], result of:
           0.014077867 = score(doc=2755,freq=1.0), product of:
             0.06620813 = queryWeight, product of:
               1.0549334 = boost
               3.402088 = idf(docFreq=4002, maxDocs=44218)
               0.018447636 = queryNorm
             0.2126305 = fieldWeight in 2755, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.402088 = idf(docFreq=4002, maxDocs=44218)
               0.0625 = fieldNorm(doc=2755)
         0.015098871 = weight(abstract_txt:results in 2755) [ClassicSimilarity], result of:
           0.015098871 = score(doc=2755,freq=1.0), product of:
             0.06937181 = queryWeight, product of:
               1.0798438 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.018447636 = queryNorm
             0.21765138 = fieldWeight in 2755, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=2755)
         0.062449615 = weight(abstract_txt:prominent in 2755) [ClassicSimilarity], result of:
           0.062449615 = score(doc=2755,freq=1.0), product of:
             0.14187196 = queryWeight, product of:
               1.0919498 = boost
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.018447636 = queryNorm
             0.44018292 = fieldWeight in 2755, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.0625 = fieldNorm(doc=2755)
         0.032277357 = weight(abstract_txt:evaluation in 2755) [ClassicSimilarity], result of:
           0.032277357 = score(doc=2755,freq=1.0), product of:
             0.11512033 = queryWeight, product of:
               1.3910586 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.018447636 = queryNorm
             0.2803793 = fieldWeight in 2755, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=2755)
         0.017088667 = weight(abstract_txt:research in 2755) [ClassicSimilarity], result of:
           0.017088667 = score(doc=2755,freq=1.0), product of:
             0.08624275 = queryWeight, product of:
               1.4746071 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.018447636 = queryNorm
             0.19814612 = fieldWeight in 2755, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=2755)
         0.09411946 = weight(abstract_txt:ranking in 2755) [ClassicSimilarity], result of:
           0.09411946 = score(doc=2755,freq=1.0), product of:
             0.26896974 = queryWeight, product of:
               2.6041546 = boost
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.018447636 = queryNorm
             0.34992582 = fieldWeight in 2755, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.598813 = idf(docFreq=444, maxDocs=44218)
               0.0625 = fieldNorm(doc=2755)
         0.2241864 = weight(abstract_txt:expert in 2755) [ClassicSimilarity], result of:
           0.2241864 = score(doc=2755,freq=5.0), product of:
             0.28054336 = queryWeight, product of:
               2.659592 = boost
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.018447636 = queryNorm
             0.799115 = fieldWeight in 2755, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.0625 = fieldNorm(doc=2755)
       0.28 = coord(7/25)