Document (#43263)

Author

Sjögårde, P.
Ahlgren, P.
Waltman, L.

Title

Algorithmic labeling in hierarchical classifications of publications : evaluation of bibliographic fields and term weighting approaches

Source

Journal of the Association for Information Science and Technology. 72(2021) no.7, S.853-869

Year

2021

Abstract

Algorithmic classifications of research publications can be used to study many different aspects of the science system, such as the organization of science into fields, the growth of fields, interdisciplinarity, and emerging topics. How to label the classes in these classifications is a problem that has not been thoroughly addressed in the literature. In this study, we evaluate different approaches to label the classes in algorithmically constructed classifications of research publications. We focus on two important choices: the choice of (a) different bibliographic fields and (b) different approaches to weight the relevance of terms. To evaluate the different choices, we created two baselines: one based on the Medical Subject Headings in MEDLINE and another based on the Science-Metrix journal classification. We tested to what extent different approaches yield the desired labels for the classes in the two baselines. Based on our results, we recommend extracting terms from titles and keywords to label classes at high levels of granularity (e.g., topics). At low levels of granularity (e.g., disciplines) we recommend extracting terms from journal names and author addresses. We recommend the use of a new approach, term frequency to specificity ratio, to calculate the relevance of terms.

Content

Vgl.: https://asistdl.onlinelibrary.wiley.com/doi/10.1002/asi.24452.

Similar documents (author)

1. Ahlgren, P.; Kekäläinen, J.: Indexing strategies for Swedish full text retrieval under different user scenarios (2007) 1.86

   1.8576074 = sum of:
     1.8576074 = product of:
       3.7152147 = sum of:
         3.7152147 = weight(author_txt:ahlgren in 896) [ClassicSimilarity], result of:
           3.7152147 = score(doc=896,freq=1.0), product of:
             0.7620189 = queryWeight, product of:
               1.0847874 = boost
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.07203988 = queryNorm
             4.8754888 = fieldWeight in 896, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.5 = fieldNorm(doc=896)
       0.5 = coord(1/2)
   

2. Ahlgren, P.; Grönqvist, L.: Evaluation of retrieval effectiveness with incomplete relevance data : theoretical and experimental comparison of three measures (2008) 1.86

   1.8576074 = sum of:
     1.8576074 = product of:
       3.7152147 = sum of:
         3.7152147 = weight(author_txt:ahlgren in 2032) [ClassicSimilarity], result of:
           3.7152147 = score(doc=2032,freq=1.0), product of:
             0.7620189 = queryWeight, product of:
               1.0847874 = boost
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.07203988 = queryNorm
             4.8754888 = fieldWeight in 2032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.5 = fieldNorm(doc=2032)
       0.5 = coord(1/2)
   

3. Ahlgren, P.; Järvelin, K.: Measuring impact of twelve information scientists using the DCI index (2010) 1.86

   1.8576074 = sum of:
     1.8576074 = product of:
       3.7152147 = sum of:
         3.7152147 = weight(author_txt:ahlgren in 3593) [ClassicSimilarity], result of:
           3.7152147 = score(doc=3593,freq=1.0), product of:
             0.7620189 = queryWeight, product of:
               1.0847874 = boost
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.07203988 = queryNorm
             4.8754888 = fieldWeight in 3593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.7509775 = idf(docFreq=6, maxDocs=44218)
               0.5 = fieldNorm(doc=3593)
       0.5 = coord(1/2)
   

4. Waltman, L.; Schreiber, M.: On the calculation of percentile-based bibliometric indicators (2013) 1.46

   1.455191 = sum of:
     1.455191 = product of:
       2.910382 = sum of:
         2.910382 = weight(author_txt:waltman in 616) [ClassicSimilarity], result of:
           2.910382 = score(doc=616,freq=1.0), product of:
             0.64755476 = queryWeight, product of:
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.07203988 = queryNorm
             4.4944186 = fieldWeight in 616, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.5 = fieldNorm(doc=616)
       0.5 = coord(1/2)
   

5. Waltman, L.; Costas, R.: F1000 Recommendations as a potential new data source for research evaluation : a comparison with citations (2014) 1.46

   1.455191 = sum of:
     1.455191 = product of:
       2.910382 = sum of:
         2.910382 = weight(author_txt:waltman in 1212) [ClassicSimilarity], result of:
           2.910382 = score(doc=1212,freq=1.0), product of:
             0.64755476 = queryWeight, product of:
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.07203988 = queryNorm
             4.4944186 = fieldWeight in 1212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.988837 = idf(docFreq=14, maxDocs=44218)
               0.5 = fieldNorm(doc=1212)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Rafols, I.; Leydesdorff, L.: Content-based and algorithmic classifications of journals : perspectives on the dynamics of scientific communication and indexer effects (2009) 0.17

   0.17126432 = sum of:
     0.17126432 = product of:
       0.6116583 = sum of:
         0.019891534 = weight(abstract_txt:bibliographic in 3095) [ClassicSimilarity], result of:
           0.019891534 = score(doc=3095,freq=1.0), product of:
             0.07524846 = queryWeight, product of:
               1.0809317 = boost
               4.229516 = idf(docFreq=1749, maxDocs=44218)
               0.016459199 = queryNorm
             0.26434475 = fieldWeight in 3095, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.229516 = idf(docFreq=1749, maxDocs=44218)
               0.0625 = fieldNorm(doc=3095)
         0.08813633 = weight(abstract_txt:algorithmically in 3095) [ClassicSimilarity], result of:
           0.08813633 = score(doc=3095,freq=1.0), product of:
             0.16111849 = queryWeight, product of:
               1.1184257 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.016459199 = queryNorm
             0.547028 = fieldWeight in 3095, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.0625 = fieldNorm(doc=3095)
         0.028569195 = weight(abstract_txt:based in 3095) [ClassicSimilarity], result of:
           0.028569195 = score(doc=3095,freq=5.0), product of:
             0.06412458 = queryWeight, product of:
               1.2221017 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.016459199 = queryNorm
             0.44552645 = fieldWeight in 3095, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=3095)
         0.07176472 = weight(abstract_txt:journal in 3095) [ClassicSimilarity], result of:
           0.07176472 = score(doc=3095,freq=4.0), product of:
             0.11150802 = queryWeight, product of:
               1.3158382 = boost
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.016459199 = queryNorm
             0.64358354 = fieldWeight in 3095, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.1486683 = idf(docFreq=697, maxDocs=44218)
               0.0625 = fieldNorm(doc=3095)
         0.045392852 = weight(abstract_txt:science in 3095) [ClassicSimilarity], result of:
           0.045392852 = score(doc=3095,freq=4.0), product of:
             0.09405621 = queryWeight, product of:
               1.4800923 = boost
               3.8609126 = idf(docFreq=2529, maxDocs=44218)
               0.016459199 = queryNorm
             0.48261407 = fieldWeight in 3095, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.8609126 = idf(docFreq=2529, maxDocs=44218)
               0.0625 = fieldNorm(doc=3095)
         0.11629206 = weight(abstract_txt:algorithmic in 3095) [ClassicSimilarity], result of:
           0.11629206 = score(doc=3095,freq=1.0), product of:
             0.24420363 = queryWeight, product of:
               1.9472669 = boost
               7.61935 = idf(docFreq=58, maxDocs=44218)
               0.016459199 = queryNorm
             0.47620937 = fieldWeight in 3095, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.61935 = idf(docFreq=58, maxDocs=44218)
               0.0625 = fieldNorm(doc=3095)
         0.2416116 = weight(abstract_txt:classifications in 3095) [ClassicSimilarity], result of:
           0.2416116 = score(doc=3095,freq=4.0), product of:
             0.3155881 = queryWeight, product of:
               3.1305795 = boost
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.016459199 = queryNorm
             0.7655916 = fieldWeight in 3095, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.0625 = fieldNorm(doc=3095)
       0.28 = coord(7/25)
   

2. Petrovich, E.: Science mapping and science maps (2021) 0.13

   0.1275897 = sum of:
     0.1275897 = product of:
       0.39871782 = sum of:
         0.022358932 = weight(abstract_txt:based in 595) [ClassicSimilarity], result of:
           0.022358932 = score(doc=595,freq=4.0), product of:
             0.06412458 = queryWeight, product of:
               1.2221017 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.016459199 = queryNorm
             0.3486796 = fieldWeight in 595, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0546875 = fieldNorm(doc=595)
         0.0254598 = weight(abstract_txt:term in 595) [ClassicSimilarity], result of:
           0.0254598 = score(doc=595,freq=1.0), product of:
             0.09696538 = queryWeight, product of:
               1.2270374 = boost
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.016459199 = queryNorm
             0.26256588 = fieldWeight in 595, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.0546875 = fieldNorm(doc=595)
         0.030267907 = weight(abstract_txt:topics in 595) [ClassicSimilarity], result of:
           0.030267907 = score(doc=595,freq=1.0), product of:
             0.10881822 = queryWeight, product of:
               1.299871 = boost
               5.086191 = idf(docFreq=742, maxDocs=44218)
               0.016459199 = queryNorm
             0.2781511 = fieldWeight in 595, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.086191 = idf(docFreq=742, maxDocs=44218)
               0.0546875 = fieldNorm(doc=595)
         0.086565 = weight(abstract_txt:science in 595) [ClassicSimilarity], result of:
           0.086565 = score(doc=595,freq=19.0), product of:
             0.09405621 = queryWeight, product of:
               1.4800923 = boost
               3.8609126 = idf(docFreq=2529, maxDocs=44218)
               0.016459199 = queryNorm
             0.9203539 = fieldWeight in 595, product of:
               4.358899 = tf(freq=19.0), with freq of:
                 19.0 = termFreq=19.0
               3.8609126 = idf(docFreq=2529, maxDocs=44218)
               0.0546875 = fieldNorm(doc=595)
         0.087415196 = weight(abstract_txt:publications in 595) [ClassicSimilarity], result of:
           0.087415196 = score(doc=595,freq=3.0), product of:
             0.1751572 = queryWeight, product of:
               2.0198033 = boost
               5.268782 = idf(docFreq=618, maxDocs=44218)
               0.016459199 = queryNorm
             0.4990671 = fieldWeight in 595, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.268782 = idf(docFreq=618, maxDocs=44218)
               0.0546875 = fieldNorm(doc=595)
         0.04302688 = weight(abstract_txt:terms in 595) [ClassicSimilarity], result of:
           0.04302688 = score(doc=595,freq=2.0), product of:
             0.13757513 = queryWeight, product of:
               2.066971 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.016459199 = queryNorm
             0.31275186 = fieldWeight in 595, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.0546875 = fieldNorm(doc=595)
         0.045030527 = weight(abstract_txt:approaches in 595) [ClassicSimilarity], result of:
           0.045030527 = score(doc=595,freq=1.0), product of:
             0.17867401 = queryWeight, product of:
               2.3555653 = boost
               4.6084785 = idf(docFreq=1197, maxDocs=44218)
               0.016459199 = queryNorm
             0.25202617 = fieldWeight in 595, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6084785 = idf(docFreq=1197, maxDocs=44218)
               0.0546875 = fieldNorm(doc=595)
         0.058593564 = weight(abstract_txt:fields in 595) [ClassicSimilarity], result of:
           0.058593564 = score(doc=595,freq=1.0), product of:
             0.21295606 = queryWeight, product of:
               2.5716357 = boost
               5.0312033 = idf(docFreq=784, maxDocs=44218)
               0.016459199 = queryNorm
             0.27514392 = fieldWeight in 595, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0312033 = idf(docFreq=784, maxDocs=44218)
               0.0546875 = fieldNorm(doc=595)
       0.32 = coord(8/25)
   

3. Urbain, J.; Goharian, N.; Frieder, O.: Probabilistic passage models for semantic search of genomics literature (2008) 0.13

   0.12635285 = sum of:
     0.12635285 = product of:
       0.39485264 = sum of:
         0.012776532 = weight(abstract_txt:based in 2380) [ClassicSimilarity], result of:
           0.012776532 = score(doc=2380,freq=1.0), product of:
             0.06412458 = queryWeight, product of:
               1.2221017 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.016459199 = queryNorm
             0.19924548 = fieldWeight in 2380, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=2380)
         0.029096914 = weight(abstract_txt:term in 2380) [ClassicSimilarity], result of:
           0.029096914 = score(doc=2380,freq=1.0), product of:
             0.09696538 = queryWeight, product of:
               1.2270374 = boost
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.016459199 = queryNorm
             0.3000753 = fieldWeight in 2380, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8012047 = idf(docFreq=987, maxDocs=44218)
               0.0625 = fieldNorm(doc=2380)
         0.03153736 = weight(abstract_txt:relevance in 2380) [ClassicSimilarity], result of:
           0.03153736 = score(doc=2380,freq=1.0), product of:
             0.10231414 = queryWeight, product of:
               1.2604258 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.016459199 = queryNorm
             0.3082405 = fieldWeight in 2380, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=2380)
         0.06918378 = weight(abstract_txt:topics in 2380) [ClassicSimilarity], result of:
           0.06918378 = score(doc=2380,freq=4.0), product of:
             0.10881822 = queryWeight, product of:
               1.299871 = boost
               5.086191 = idf(docFreq=742, maxDocs=44218)
               0.016459199 = queryNorm
             0.6357739 = fieldWeight in 2380, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.086191 = idf(docFreq=742, maxDocs=44218)
               0.0625 = fieldNorm(doc=2380)
         0.037392676 = weight(abstract_txt:levels in 2380) [ClassicSimilarity], result of:
           0.037392676 = score(doc=2380,freq=1.0), product of:
             0.11461543 = queryWeight, product of:
               1.3340466 = boost
               5.219915 = idf(docFreq=649, maxDocs=44218)
               0.016459199 = queryNorm
             0.32624468 = fieldWeight in 2380, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.219915 = idf(docFreq=649, maxDocs=44218)
               0.0625 = fieldNorm(doc=2380)
         0.08767622 = weight(abstract_txt:extracting in 2380) [ClassicSimilarity], result of:
           0.08767622 = score(doc=2380,freq=1.0), product of:
             0.20228948 = queryWeight, product of:
               1.7722954 = boost
               6.9347134 = idf(docFreq=116, maxDocs=44218)
               0.016459199 = queryNorm
             0.4334196 = fieldWeight in 2380, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9347134 = idf(docFreq=116, maxDocs=44218)
               0.0625 = fieldNorm(doc=2380)
         0.060225084 = weight(abstract_txt:terms in 2380) [ClassicSimilarity], result of:
           0.060225084 = score(doc=2380,freq=3.0), product of:
             0.13757513 = queryWeight, product of:
               2.066971 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.016459199 = queryNorm
             0.4377614 = fieldWeight in 2380, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.0625 = fieldNorm(doc=2380)
         0.066964075 = weight(abstract_txt:fields in 2380) [ClassicSimilarity], result of:
           0.066964075 = score(doc=2380,freq=1.0), product of:
             0.21295606 = queryWeight, product of:
               2.5716357 = boost
               5.0312033 = idf(docFreq=784, maxDocs=44218)
               0.016459199 = queryNorm
             0.3144502 = fieldWeight in 2380, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0312033 = idf(docFreq=784, maxDocs=44218)
               0.0625 = fieldNorm(doc=2380)
       0.32 = coord(8/25)
   

4. Leydesdorff, L.: Patent classifications as indicators of intellectual organization (2008) 0.13

   0.1250571 = sum of:
     0.1250571 = product of:
       0.6252855 = sum of:
         0.046740845 = weight(abstract_txt:levels in 2002) [ClassicSimilarity], result of:
           0.046740845 = score(doc=2002,freq=1.0), product of:
             0.11461543 = queryWeight, product of:
               1.3340466 = boost
               5.219915 = idf(docFreq=649, maxDocs=44218)
               0.016459199 = queryNorm
             0.40780586 = fieldWeight in 2002, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.219915 = idf(docFreq=649, maxDocs=44218)
               0.078125 = fieldNorm(doc=2002)
         0.04346371 = weight(abstract_txt:terms in 2002) [ClassicSimilarity], result of:
           0.04346371 = score(doc=2002,freq=1.0), product of:
             0.13757513 = queryWeight, product of:
               2.066971 = boost
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.016459199 = queryNorm
             0.3159271 = fieldWeight in 2002, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.0438666 = idf(docFreq=2106, maxDocs=44218)
               0.078125 = fieldNorm(doc=2002)
         0.048554324 = weight(abstract_txt:different in 2002) [ClassicSimilarity], result of:
           0.048554324 = score(doc=2002,freq=1.0), product of:
             0.1695526 = queryWeight, product of:
               2.810362 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.016459199 = queryNorm
             0.28636733 = fieldWeight in 2002, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.078125 = fieldNorm(doc=2002)
         0.22497442 = weight(abstract_txt:classes in 2002) [ClassicSimilarity], result of:
           0.22497442 = score(doc=2002,freq=3.0), product of:
             0.2854327 = queryWeight, product of:
               2.977257 = boost
               5.8247695 = idf(docFreq=354, maxDocs=44218)
               0.016459199 = queryNorm
             0.78818727 = fieldWeight in 2002, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.8247695 = idf(docFreq=354, maxDocs=44218)
               0.078125 = fieldNorm(doc=2002)
         0.2615522 = weight(abstract_txt:classifications in 2002) [ClassicSimilarity], result of:
           0.2615522 = score(doc=2002,freq=3.0), product of:
             0.3155881 = queryWeight, product of:
               3.1305795 = boost
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.016459199 = queryNorm
             0.82877725 = fieldWeight in 2002, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.078125 = fieldNorm(doc=2002)
       0.2 = coord(5/25)
   

5. Gnoli, C.; Santis, R. de; Pusterla, L.: Commerce, see also Rhetoric : cross-discipline relationships as authority data for enhanced retrieval (2015) 0.12

   0.123411596 = sum of:
     0.123411596 = product of:
       0.514215 = sum of:
         0.019891534 = weight(abstract_txt:bibliographic in 2299) [ClassicSimilarity], result of:
           0.019891534 = score(doc=2299,freq=1.0), product of:
             0.07524846 = queryWeight, product of:
               1.0809317 = boost
               4.229516 = idf(docFreq=1749, maxDocs=44218)
               0.016459199 = queryNorm
             0.26434475 = fieldWeight in 2299, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.229516 = idf(docFreq=1749, maxDocs=44218)
               0.0625 = fieldNorm(doc=2299)
         0.012776532 = weight(abstract_txt:based in 2299) [ClassicSimilarity], result of:
           0.012776532 = score(doc=2299,freq=1.0), product of:
             0.06412458 = queryWeight, product of:
               1.2221017 = boost
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.016459199 = queryNorm
             0.19924548 = fieldWeight in 2299, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1879277 = idf(docFreq=4958, maxDocs=44218)
               0.0625 = fieldNorm(doc=2299)
         0.037392676 = weight(abstract_txt:levels in 2299) [ClassicSimilarity], result of:
           0.037392676 = score(doc=2299,freq=1.0), product of:
             0.11461543 = queryWeight, product of:
               1.3340466 = boost
               5.219915 = idf(docFreq=649, maxDocs=44218)
               0.016459199 = queryNorm
             0.32624468 = fieldWeight in 2299, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.219915 = idf(docFreq=649, maxDocs=44218)
               0.0625 = fieldNorm(doc=2299)
         0.054932944 = weight(abstract_txt:different in 2299) [ClassicSimilarity], result of:
           0.054932944 = score(doc=2299,freq=2.0), product of:
             0.1695526 = queryWeight, product of:
               2.810362 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.016459199 = queryNorm
             0.32398763 = fieldWeight in 2299, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0625 = fieldNorm(doc=2299)
         0.17997953 = weight(abstract_txt:classes in 2299) [ClassicSimilarity], result of:
           0.17997953 = score(doc=2299,freq=3.0), product of:
             0.2854327 = queryWeight, product of:
               2.977257 = boost
               5.8247695 = idf(docFreq=354, maxDocs=44218)
               0.016459199 = queryNorm
             0.6305498 = fieldWeight in 2299, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.8247695 = idf(docFreq=354, maxDocs=44218)
               0.0625 = fieldNorm(doc=2299)
         0.20924178 = weight(abstract_txt:classifications in 2299) [ClassicSimilarity], result of:
           0.20924178 = score(doc=2299,freq=3.0), product of:
             0.3155881 = queryWeight, product of:
               3.1305795 = boost
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.016459199 = queryNorm
             0.6630218 = fieldWeight in 2299, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.0625 = fieldNorm(doc=2299)
       0.24 = coord(6/25)