Document (#25602)

Author

Jones, S.
Paynter, G.W.

Title

Automatic extractionof document keyphrases for use in digital libraries : evaluations and applications

Source

Journal of the American Society for Information Science and technology. 53(2002) no.8, S.653-677

Year

2002

Abstract

This article describes an evaluation of the Kea automatic keyphrase extraction algorithm. Document keyphrases are conventionally used as concise descriptors of document content, and are increasingly used in novel ways, including document clustering, searching and browsing interfaces, and retrieval engines. However, it is costly and time consuming to manually assign keyphrases to documents, motivating the development of tools that automatically perform this function. Previous studies have evaluated Kea's performance by measuring its ability to identify author keywords and keyphrases, but this methodology has a number of well-known limitations. The results presented in this article are based on evaluations by human assessors of the quality and appropriateness of Kea keyphrases. The results indicate that, in general, Kea produces keyphrases that are rated positively by human assessors. However, typical Kea settings can degrade performance, particularly those relating to keyphrase length and domain specificity. We found that for some settings, Kea's performance is better than that of similar systems, and that Kea's ranking of extracted keyphrases is effective. We also determined that author-specified keyphrases appear to exhibit an inherent ranking, and that they are rated highly and therefore suitable for use in training and evaluation of automatic keyphrasing systems.

Theme

Automatisches Indexieren
Automatisches Abstracting

Similar documents (author)

1. Jones, M.H.: Year's work in cataloging and classification : 1978 (1979) 4.33

   4.334196 = sum of:
     4.334196 = weight(author_txt:jones in 308) [ClassicSimilarity], result of:
       4.334196 = fieldWeight in 308, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.9347134 = idf(docFreq=116, maxDocs=44218)
         0.625 = fieldNorm(doc=308)
   

2. Jones, K.P.: Natural-language processing and automatic indexing : a reply (1990) 4.33

   4.334196 = sum of:
     4.334196 = weight(author_txt:jones in 394) [ClassicSimilarity], result of:
       4.334196 = fieldWeight in 394, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.9347134 = idf(docFreq=116, maxDocs=44218)
         0.625 = fieldNorm(doc=394)
   

3. Jones, R.M.: Online catalogue research in Europe (1989) 4.33

   4.334196 = sum of:
     4.334196 = weight(author_txt:jones in 796) [ClassicSimilarity], result of:
       4.334196 = fieldWeight in 796, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.9347134 = idf(docFreq=116, maxDocs=44218)
         0.625 = fieldNorm(doc=796)
   

4. Jones, R.L.: Automatic document content analysis : the AIDA project (1992) 4.33

   4.334196 = sum of:
     4.334196 = weight(author_txt:jones in 2607) [ClassicSimilarity], result of:
       4.334196 = fieldWeight in 2607, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.9347134 = idf(docFreq=116, maxDocs=44218)
         0.625 = fieldNorm(doc=2607)
   

5. Jones, K.P.: How do we index? : a report of some Aslib Information Group activity (1983) 4.33

   4.334196 = sum of:
     4.334196 = weight(author_txt:jones in 2736) [ClassicSimilarity], result of:
       4.334196 = fieldWeight in 2736, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.9347134 = idf(docFreq=116, maxDocs=44218)
         0.625 = fieldNorm(doc=2736)
   

Similar documents (content)

1. Wu, Y.-f.B.; Li, Q.; Bot, R.S.; Chen, X.: Finding nuggets in documents : a machine learning approach (2006) 0.79

   0.7895538 = sum of:
     0.7895538 = product of:
       1.7944405 = sum of:
         0.035965666 = weight(abstract_txt:costly in 5290) [ClassicSimilarity], result of:
           0.035965666 = score(doc=5290,freq=1.0), product of:
             0.07429346 = queryWeight, product of:
               1.0399082 = boost
               7.7456436 = idf(docFreq=51, maxDocs=44218)
               0.009223549 = queryNorm
             0.48410273 = fieldWeight in 5290, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7456436 = idf(docFreq=51, maxDocs=44218)
               0.0625 = fieldNorm(doc=5290)
         0.03801751 = weight(abstract_txt:concise in 5290) [ClassicSimilarity], result of:
           0.03801751 = score(doc=5290,freq=1.0), product of:
             0.07709288 = queryWeight, product of:
               1.0593193 = boost
               7.890225 = idf(docFreq=44, maxDocs=44218)
               0.009223549 = queryNorm
             0.49313906 = fieldWeight in 5290, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.890225 = idf(docFreq=44, maxDocs=44218)
               0.0625 = fieldNorm(doc=5290)
         0.013974725 = weight(abstract_txt:evaluation in 5290) [ClassicSimilarity], result of:
           0.013974725 = score(doc=5290,freq=1.0), product of:
             0.049842216 = queryWeight, product of:
               1.2045738 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.009223549 = queryNorm
             0.2803793 = fieldWeight in 5290, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=5290)
         0.015988989 = weight(abstract_txt:human in 5290) [ClassicSimilarity], result of:
           0.015988989 = score(doc=5290,freq=1.0), product of:
             0.054523345 = queryWeight, product of:
               1.2598706 = boost
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.009223549 = queryNorm
             0.29325032 = fieldWeight in 5290, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.0625 = fieldNorm(doc=5290)
         0.006151371 = weight(abstract_txt:this in 5290) [ClassicSimilarity], result of:
           0.006151371 = score(doc=5290,freq=2.0), product of:
             0.028841408 = queryWeight, product of:
               1.2958596 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.009223549 = queryNorm
             0.21328263 = fieldWeight in 5290, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=5290)
         0.023051435 = weight(abstract_txt:performance in 5290) [ClassicSimilarity], result of:
           0.023051435 = score(doc=5290,freq=1.0), product of:
             0.07965216 = queryWeight, product of:
               1.8650012 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.009223549 = queryNorm
             0.28940126 = fieldWeight in 5290, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=5290)
         0.03256442 = weight(abstract_txt:automatic in 5290) [ClassicSimilarity], result of:
           0.03256442 = score(doc=5290,freq=1.0), product of:
             0.100283116 = queryWeight, product of:
               2.0926387 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.009223549 = queryNorm
             0.32472485 = fieldWeight in 5290, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0625 = fieldNorm(doc=5290)
         0.05475507 = weight(abstract_txt:document in 5290) [ClassicSimilarity], result of:
           0.05475507 = score(doc=5290,freq=5.0), product of:
             0.0912721 = queryWeight, product of:
               2.3052537 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.009223549 = queryNorm
             0.59991026 = fieldWeight in 5290, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.0625 = fieldNorm(doc=5290)
         0.20417145 = weight(abstract_txt:keyphrase in 5290) [ClassicSimilarity], result of:
           0.20417145 = score(doc=5290,freq=3.0), product of:
             0.20653394 = queryWeight, product of:
               2.4520562 = boost
               9.131938 = idf(docFreq=12, maxDocs=44218)
               0.009223549 = queryNorm
             0.9885613 = fieldWeight in 5290, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.131938 = idf(docFreq=12, maxDocs=44218)
               0.0625 = fieldNorm(doc=5290)
         0.0116486875 = weight(abstract_txt:that in 5290) [ClassicSimilarity], result of:
           0.0116486875 = score(doc=5290,freq=2.0), product of:
             0.05561985 = queryWeight, product of:
               2.5449522 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.009223549 = queryNorm
             0.20943399 = fieldWeight in 5290, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=5290)
         1.3581512 = weight(abstract_txt:keyphrases in 5290) [ClassicSimilarity], result of:
           1.3581512 = score(doc=5290,freq=7.0), product of:
             0.8742881 = queryWeight, product of:
               10.090019 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.009223549 = queryNorm
             1.5534366 = fieldWeight in 5290, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.0625 = fieldNorm(doc=5290)
       0.44 = coord(11/25)
   

2. Martín-Moncunill, D.; García-Barriocanal, E.; Sicilia, M.-A.; Sánchez-Alonso, S.: Evaluating the practical applicability of thesaurus-based keyphrase extraction in the agricultural domain : insights from the VOA3R project (2015) 0.38

   0.37520316 = sum of:
     0.37520316 = product of:
       1.3400112 = sum of:
         0.02794945 = weight(abstract_txt:evaluation in 2106) [ClassicSimilarity], result of:
           0.02794945 = score(doc=2106,freq=4.0), product of:
             0.049842216 = queryWeight, product of:
               1.2045738 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.009223549 = queryNorm
             0.5607586 = fieldWeight in 2106, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=2106)
         0.015988989 = weight(abstract_txt:human in 2106) [ClassicSimilarity], result of:
           0.015988989 = score(doc=2106,freq=1.0), product of:
             0.054523345 = queryWeight, product of:
               1.2598706 = boost
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.009223549 = queryNorm
             0.29325032 = fieldWeight in 2106, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.0625 = fieldNorm(doc=2106)
         0.00753386 = weight(abstract_txt:this in 2106) [ClassicSimilarity], result of:
           0.00753386 = score(doc=2106,freq=3.0), product of:
             0.028841408 = queryWeight, product of:
               1.2958596 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.009223549 = queryNorm
             0.2612168 = fieldWeight in 2106, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=2106)
         0.046053044 = weight(abstract_txt:automatic in 2106) [ClassicSimilarity], result of:
           0.046053044 = score(doc=2106,freq=2.0), product of:
             0.100283116 = queryWeight, product of:
               2.0926387 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.009223549 = queryNorm
             0.45923027 = fieldWeight in 2106, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0625 = fieldNorm(doc=2106)
         0.20417145 = weight(abstract_txt:keyphrase in 2106) [ClassicSimilarity], result of:
           0.20417145 = score(doc=2106,freq=3.0), product of:
             0.20653394 = queryWeight, product of:
               2.4520562 = boost
               9.131938 = idf(docFreq=12, maxDocs=44218)
               0.009223549 = queryNorm
             0.9885613 = fieldWeight in 2106, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.131938 = idf(docFreq=12, maxDocs=44218)
               0.0625 = fieldNorm(doc=2106)
         0.0116486875 = weight(abstract_txt:that in 2106) [ClassicSimilarity], result of:
           0.0116486875 = score(doc=2106,freq=2.0), product of:
             0.05561985 = queryWeight, product of:
               2.5449522 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.009223549 = queryNorm
             0.20943399 = fieldWeight in 2106, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=2106)
         1.0266658 = weight(abstract_txt:keyphrases in 2106) [ClassicSimilarity], result of:
           1.0266658 = score(doc=2106,freq=4.0), product of:
             0.8742881 = queryWeight, product of:
               10.090019 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.009223549 = queryNorm
             1.1742878 = fieldWeight in 2106, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.0625 = fieldNorm(doc=2106)
       0.28 = coord(7/25)
   

3. Martinez-Romo, J.; Araujo, L.; Fernandez, A.D.: SemGraph : extracting keyphrases following a novel semantic graph-based approach (2016) 0.33

   0.3274346 = sum of:
     0.3274346 = product of:
       1.3643109 = sum of:
         0.010651191 = weight(abstract_txt:article in 2832) [ClassicSimilarity], result of:
           0.010651191 = score(doc=2832,freq=1.0), product of:
             0.03583939 = queryWeight, product of:
               1.021445 = boost
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.009223549 = queryNorm
             0.2971923 = fieldWeight in 2832, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.078125 = fieldNorm(doc=2832)
         0.017468406 = weight(abstract_txt:evaluation in 2832) [ClassicSimilarity], result of:
           0.017468406 = score(doc=2832,freq=1.0), product of:
             0.049842216 = queryWeight, product of:
               1.2045738 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.009223549 = queryNorm
             0.35047412 = fieldWeight in 2832, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=2832)
         0.0076892143 = weight(abstract_txt:this in 2832) [ClassicSimilarity], result of:
           0.0076892143 = score(doc=2832,freq=2.0), product of:
             0.028841408 = queryWeight, product of:
               1.2958596 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.009223549 = queryNorm
             0.2666033 = fieldWeight in 2832, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.078125 = fieldNorm(doc=2832)
         0.030609014 = weight(abstract_txt:document in 2832) [ClassicSimilarity], result of:
           0.030609014 = score(doc=2832,freq=1.0), product of:
             0.0912721 = queryWeight, product of:
               2.3052537 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.009223549 = queryNorm
             0.33536002 = fieldWeight in 2832, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.078125 = fieldNorm(doc=2832)
         0.014560859 = weight(abstract_txt:that in 2832) [ClassicSimilarity], result of:
           0.014560859 = score(doc=2832,freq=2.0), product of:
             0.05561985 = queryWeight, product of:
               2.5449522 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.009223549 = queryNorm
             0.26179248 = fieldWeight in 2832, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=2832)
         1.2833322 = weight(abstract_txt:keyphrases in 2832) [ClassicSimilarity], result of:
           1.2833322 = score(doc=2832,freq=4.0), product of:
             0.8742881 = queryWeight, product of:
               10.090019 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.009223549 = queryNorm
             1.4678597 = fieldWeight in 2832, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.078125 = fieldNorm(doc=2832)
       0.24 = coord(6/25)
   

4. Zhang, Y.; Zhang, C.: Enhancing keyphrase extraction from microblogs using human reading time (2021) 0.27

   0.27166617 = sum of:
     0.27166617 = product of:
       0.8489568 = sum of:
         0.008520953 = weight(abstract_txt:article in 237) [ClassicSimilarity], result of:
           0.008520953 = score(doc=237,freq=1.0), product of:
             0.03583939 = queryWeight, product of:
               1.021445 = boost
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.009223549 = queryNorm
             0.23775385 = fieldWeight in 237, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.0625 = fieldNorm(doc=237)
         0.0116035035 = weight(abstract_txt:however in 237) [ClassicSimilarity], result of:
           0.0116035035 = score(doc=237,freq=1.0), product of:
             0.044031274 = queryWeight, product of:
               1.1321796 = boost
               4.216459 = idf(docFreq=1772, maxDocs=44218)
               0.009223549 = queryNorm
             0.26352867 = fieldWeight in 237, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.216459 = idf(docFreq=1772, maxDocs=44218)
               0.0625 = fieldNorm(doc=237)
         0.042302888 = weight(abstract_txt:human in 237) [ClassicSimilarity], result of:
           0.042302888 = score(doc=237,freq=7.0), product of:
             0.054523345 = queryWeight, product of:
               1.2598706 = boost
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.009223549 = queryNorm
             0.7758674 = fieldWeight in 237, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.692005 = idf(docFreq=1101, maxDocs=44218)
               0.0625 = fieldNorm(doc=237)
         0.006151371 = weight(abstract_txt:this in 237) [ClassicSimilarity], result of:
           0.006151371 = score(doc=237,freq=2.0), product of:
             0.028841408 = queryWeight, product of:
               1.2958596 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.009223549 = queryNorm
             0.21328263 = fieldWeight in 237, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=237)
         0.023051435 = weight(abstract_txt:performance in 237) [ClassicSimilarity], result of:
           0.023051435 = score(doc=237,freq=1.0), product of:
             0.07965216 = queryWeight, product of:
               1.8650012 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.009223549 = queryNorm
             0.28940126 = fieldWeight in 237, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=237)
         0.23575689 = weight(abstract_txt:keyphrase in 237) [ClassicSimilarity], result of:
           0.23575689 = score(doc=237,freq=4.0), product of:
             0.20653394 = queryWeight, product of:
               2.4520562 = boost
               9.131938 = idf(docFreq=12, maxDocs=44218)
               0.009223549 = queryNorm
             1.1414922 = fieldWeight in 237, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.131938 = idf(docFreq=12, maxDocs=44218)
               0.0625 = fieldNorm(doc=237)
         0.0082368655 = weight(abstract_txt:that in 237) [ClassicSimilarity], result of:
           0.0082368655 = score(doc=237,freq=1.0), product of:
             0.05561985 = queryWeight, product of:
               2.5449522 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.009223549 = queryNorm
             0.1480922 = fieldWeight in 237, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=237)
         0.5133329 = weight(abstract_txt:keyphrases in 237) [ClassicSimilarity], result of:
           0.5133329 = score(doc=237,freq=1.0), product of:
             0.8742881 = queryWeight, product of:
               10.090019 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.009223549 = queryNorm
             0.5871439 = fieldWeight in 237, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.0625 = fieldNorm(doc=237)
       0.32 = coord(8/25)
   

5. Jiang, Y.; Meng, R.; Huang, Y.; Lu, W.; Liu, J.: Generating keyphrases for readers : a controllable keyphrase generation framework (2023) 0.27

   0.26853096 = sum of:
     0.26853096 = product of:
       1.3426548 = sum of:
         0.0116035035 = weight(abstract_txt:however in 1012) [ClassicSimilarity], result of:
           0.0116035035 = score(doc=1012,freq=1.0), product of:
             0.044031274 = queryWeight, product of:
               1.1321796 = boost
               4.216459 = idf(docFreq=1772, maxDocs=44218)
               0.009223549 = queryNorm
             0.26352867 = fieldWeight in 1012, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.216459 = idf(docFreq=1772, maxDocs=44218)
               0.0625 = fieldNorm(doc=1012)
         0.03256442 = weight(abstract_txt:automatic in 1012) [ClassicSimilarity], result of:
           0.03256442 = score(doc=1012,freq=1.0), product of:
             0.100283116 = queryWeight, product of:
               2.0926387 = boost
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.009223549 = queryNorm
             0.32472485 = fieldWeight in 1012, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.1955976 = idf(docFreq=665, maxDocs=44218)
               0.0625 = fieldNorm(doc=1012)
         0.26358423 = weight(abstract_txt:keyphrase in 1012) [ClassicSimilarity], result of:
           0.26358423 = score(doc=1012,freq=5.0), product of:
             0.20653394 = queryWeight, product of:
               2.4520562 = boost
               9.131938 = idf(docFreq=12, maxDocs=44218)
               0.009223549 = queryNorm
             1.2762271 = fieldWeight in 1012, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               9.131938 = idf(docFreq=12, maxDocs=44218)
               0.0625 = fieldNorm(doc=1012)
         0.0082368655 = weight(abstract_txt:that in 1012) [ClassicSimilarity], result of:
           0.0082368655 = score(doc=1012,freq=1.0), product of:
             0.05561985 = queryWeight, product of:
               2.5449522 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.009223549 = queryNorm
             0.1480922 = fieldWeight in 1012, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=1012)
         1.0266658 = weight(abstract_txt:keyphrases in 1012) [ClassicSimilarity], result of:
           1.0266658 = score(doc=1012,freq=4.0), product of:
             0.8742881 = queryWeight, product of:
               10.090019 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.009223549 = queryNorm
             1.1742878 = fieldWeight in 1012, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.0625 = fieldNorm(doc=1012)
       0.2 = coord(5/25)