Document (#27885)

Author

Vakkari, P.
Sormunen, E.

Title

¬The influence of relevance levels an the effectiveness of interactive information retrieval

Source

Journal of the American Society for Information Science and Technology. 55(2004) no.11, S.963-969

Year

2004

Abstract

In this paper, we focus an the effect of graded relevance an the results of interactive information retrieval (IR) experiments based an assigned search tasks in a test collection. A group of 26 subjects searched for four Text REtrieval Conference (TREC) topics using automatic and interactive query expansion based an relevance feedback. The TREC- and user-suggested pools of relevant documents were reassessed an a four-level relevance scale. The results show that the users could identify nearly all highly relevant documents and about half of the marginal ones. Users also selected a fair number of irrelevant documents for query expansion. The findings suggest that the effectiveness of query expansion is closely related to the searchers' success in retrieving and identifying highly relevant documents for feedback. The implications of the results an interpreting the findings of past experiments with liberal relevance thresholds are also discussed.

Theme

Retrievalstudien

Object

TREC

Similar documents (author)

1. Vakkari, P.; Jones, S.; MacFarlane, A.; Sormunen, E.: Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion (2004) 3.88

   3.8808508 = sum of:
     3.8808508 = sum of:
       1.6001446 = weight(author_txt:vakkari in 4435) [ClassicSimilarity], result of:
         1.6001446 = score(doc=4435,freq=1.0), product of:
           0.61969316 = queryWeight, product of:
             8.2629 = idf(docFreq=30, maxDocs=44218)
             0.07499705 = queryNorm
           2.5821564 = fieldWeight in 4435, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.2629 = idf(docFreq=30, maxDocs=44218)
             0.3125 = fieldNorm(doc=4435)
       2.2807062 = weight(author_txt:sormunen in 4435) [ClassicSimilarity], result of:
         2.2807062 = score(doc=4435,freq=1.0), product of:
           0.78484416 = queryWeight, product of:
             1.1253908 = boost
             9.298992 = idf(docFreq=10, maxDocs=44218)
             0.07499705 = queryNorm
           2.905935 = fieldWeight in 4435, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.298992 = idf(docFreq=10, maxDocs=44218)
             0.3125 = fieldNorm(doc=4435)
   

2. Sormunen, E.: Free-text searching in full-text databases : probing system limits (1993) 2.28

   2.2807062 = sum of:
     2.2807062 = product of:
       4.5614123 = sum of:
         4.5614123 = weight(author_txt:sormunen in 7120) [ClassicSimilarity], result of:
           4.5614123 = score(doc=7120,freq=1.0), product of:
             0.78484416 = queryWeight, product of:
               1.1253908 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.07499705 = queryNorm
             5.81187 = fieldWeight in 7120, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.625 = fieldNorm(doc=7120)
       0.5 = coord(1/2)
   

3. Halttunen, K.; Sormunen, E.: Learning information retrieval through an educational game : is gaming sufficient for learning? (2000) 1.82

   1.8245649 = sum of:
     1.8245649 = product of:
       3.6491299 = sum of:
         3.6491299 = weight(author_txt:sormunen in 3865) [ClassicSimilarity], result of:
           3.6491299 = score(doc=3865,freq=1.0), product of:
             0.78484416 = queryWeight, product of:
               1.1253908 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.07499705 = queryNorm
             4.649496 = fieldWeight in 3865, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.5 = fieldNorm(doc=3865)
       0.5 = coord(1/2)
   

4. Alkula, R.; Sormunen, E.: Problems and guidelines for database descriptions (1989) 1.82

   1.8245649 = sum of:
     1.8245649 = product of:
       3.6491299 = sum of:
         3.6491299 = weight(author_txt:sormunen in 2397) [ClassicSimilarity], result of:
           3.6491299 = score(doc=2397,freq=1.0), product of:
             0.78484416 = queryWeight, product of:
               1.1253908 = boost
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.07499705 = queryNorm
             4.649496 = fieldWeight in 2397, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.5 = fieldNorm(doc=2397)
       0.5 = coord(1/2)
   

5. Vakkari, P.: Information seeking in context : a challenging metatheory (1997) 1.60

   1.6001446 = sum of:
     1.6001446 = product of:
       3.2002892 = sum of:
         3.2002892 = weight(author_txt:vakkari in 302) [ClassicSimilarity], result of:
           3.2002892 = score(doc=302,freq=1.0), product of:
             0.61969316 = queryWeight, product of:
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.07499705 = queryNorm
             5.164313 = fieldWeight in 302, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.625 = fieldNorm(doc=302)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Vakkari, P.; Jones, S.; MacFarlane, A.; Sormunen, E.: Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion (2004) 0.71

   0.70536876 = sum of:
     0.70536876 = product of:
       1.3564785 = sum of:
         0.036577158 = weight(abstract_txt:users in 4435) [ClassicSimilarity], result of:
           0.036577158 = score(doc=4435,freq=5.0), product of:
             0.073316835 = queryWeight, product of:
               1.0504452 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.019551905 = queryNorm
             0.49889165 = fieldWeight in 4435, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.122795835 = weight(abstract_txt:liberal in 4435) [ClassicSimilarity], result of:
           0.122795835 = score(doc=4435,freq=1.0), product of:
             0.22309996 = queryWeight, product of:
               1.2957056 = boost
               8.806516 = idf(docFreq=17, maxDocs=44218)
               0.019551905 = queryNorm
             0.55040723 = fieldWeight in 4435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.806516 = idf(docFreq=17, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.050301414 = weight(abstract_txt:four in 4435) [ClassicSimilarity], result of:
           0.050301414 = score(doc=4435,freq=1.0), product of:
             0.15503885 = queryWeight, product of:
               1.5275373 = boost
               5.191103 = idf(docFreq=668, maxDocs=44218)
               0.019551905 = queryNorm
             0.32444394 = fieldWeight in 4435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.191103 = idf(docFreq=668, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.02277911 = weight(abstract_txt:results in 4435) [ClassicSimilarity], result of:
           0.02277911 = score(doc=4435,freq=1.0), product of:
             0.1046587 = queryWeight, product of:
               1.5371097 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.019551905 = queryNorm
             0.21765138 = fieldWeight in 4435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.05835865 = weight(abstract_txt:highly in 4435) [ClassicSimilarity], result of:
           0.05835865 = score(doc=4435,freq=1.0), product of:
             0.17118166 = queryWeight, product of:
               1.6050929 = boost
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.019551905 = queryNorm
             0.34091648 = fieldWeight in 4435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.07552777 = weight(abstract_txt:feedback in 4435) [ClassicSimilarity], result of:
           0.07552777 = score(doc=4435,freq=1.0), product of:
             0.20329414 = queryWeight, product of:
               1.7491779 = boost
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.019551905 = queryNorm
             0.37151965 = fieldWeight in 4435, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.15292467 = weight(abstract_txt:trec in 4435) [ClassicSimilarity], result of:
           0.15292467 = score(doc=4435,freq=2.0), product of:
             0.25824314 = queryWeight, product of:
               1.9714508 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.019551905 = queryNorm
             0.5921732 = fieldWeight in 4435, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.10745512 = weight(abstract_txt:relevant in 4435) [ClassicSimilarity], result of:
           0.10745512 = score(doc=4435,freq=4.0), product of:
             0.18544519 = queryWeight, product of:
               2.046091 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.019551905 = queryNorm
             0.5794441 = fieldWeight in 4435, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.10036128 = weight(abstract_txt:query in 4435) [ClassicSimilarity], result of:
           0.10036128 = score(doc=4435,freq=3.0), product of:
             0.19502392 = queryWeight, product of:
               2.0982687 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.019551905 = queryNorm
             0.5146101 = fieldWeight in 4435, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.07119504 = weight(abstract_txt:documents in 4435) [ClassicSimilarity], result of:
           0.07119504 = score(doc=4435,freq=2.0), product of:
             0.19544306 = queryWeight, product of:
               2.4254744 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.019551905 = queryNorm
             0.36427513 = fieldWeight in 4435, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.16012903 = weight(abstract_txt:interactive in 4435) [ClassicSimilarity], result of:
           0.16012903 = score(doc=4435,freq=3.0), product of:
             0.26629138 = queryWeight, product of:
               2.4518604 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.019551905 = queryNorm
             0.6013301 = fieldWeight in 4435, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.24556793 = weight(abstract_txt:expansion in 4435) [ClassicSimilarity], result of:
           0.24556793 = score(doc=4435,freq=4.0), product of:
             0.3217451 = queryWeight, product of:
               2.6950893 = boost
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.019551905 = queryNorm
             0.76323754 = fieldWeight in 4435, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
         0.15250544 = weight(abstract_txt:relevance in 4435) [ClassicSimilarity], result of:
           0.15250544 = score(doc=4435,freq=2.0), product of:
             0.34984902 = queryWeight, product of:
               3.628122 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.019551905 = queryNorm
             0.43591788 = fieldWeight in 4435, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=4435)
       0.52 = coord(13/25)
   

2. Efthimiadis, E.N.: Interactive query expansion : a user-based evaluation in a relevance feedback environment (2000) 0.65

   0.65483224 = sum of:
     0.65483224 = product of:
       1.3642339 = sum of:
         0.028626151 = weight(abstract_txt:users in 5701) [ClassicSimilarity], result of:
           0.028626151 = score(doc=5701,freq=4.0), product of:
             0.073316835 = queryWeight, product of:
               1.0504452 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.019551905 = queryNorm
             0.39044446 = fieldWeight in 5701, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5701)
         0.058968555 = weight(abstract_txt:effectiveness in 5701) [ClassicSimilarity], result of:
           0.058968555 = score(doc=5701,freq=2.0), product of:
             0.14954965 = queryWeight, product of:
               1.5002521 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.019551905 = queryNorm
             0.39430755 = fieldWeight in 5701, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5701)
         0.034306612 = weight(abstract_txt:retrieval in 5701) [ClassicSimilarity], result of:
           0.034306612 = score(doc=5701,freq=3.0), product of:
             0.10422141 = queryWeight, product of:
               1.5338951 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.019551905 = queryNorm
             0.3291705 = fieldWeight in 5701, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5701)
         0.034522757 = weight(abstract_txt:results in 5701) [ClassicSimilarity], result of:
           0.034522757 = score(doc=5701,freq=3.0), product of:
             0.1046587 = queryWeight, product of:
               1.5371097 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.019551905 = queryNorm
             0.32986036 = fieldWeight in 5701, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5701)
         0.07221515 = weight(abstract_txt:highly in 5701) [ClassicSimilarity], result of:
           0.07221515 = score(doc=5701,freq=2.0), product of:
             0.17118166 = queryWeight, product of:
               1.6050929 = boost
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.019551905 = queryNorm
             0.42186263 = fieldWeight in 5701, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5701)
         0.0660868 = weight(abstract_txt:feedback in 5701) [ClassicSimilarity], result of:
           0.0660868 = score(doc=5701,freq=1.0), product of:
             0.20329414 = queryWeight, product of:
               1.7491779 = boost
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.019551905 = queryNorm
             0.3250797 = fieldWeight in 5701, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5701)
         0.066484466 = weight(abstract_txt:relevant in 5701) [ClassicSimilarity], result of:
           0.066484466 = score(doc=5701,freq=2.0), product of:
             0.18544519 = queryWeight, product of:
               2.046091 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.019551905 = queryNorm
             0.35851276 = fieldWeight in 5701, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5701)
         0.20904417 = weight(abstract_txt:query in 5701) [ClassicSimilarity], result of:
           0.20904417 = score(doc=5701,freq=17.0), product of:
             0.19502392 = queryWeight, product of:
               2.0982687 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.019551905 = queryNorm
             1.0718899 = fieldWeight in 5701, product of:
               4.1231055 = tf(freq=17.0), with freq of:
                 17.0 = termFreq=17.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5701)
         0.062295664 = weight(abstract_txt:documents in 5701) [ClassicSimilarity], result of:
           0.062295664 = score(doc=5701,freq=2.0), product of:
             0.19544306 = queryWeight, product of:
               2.4254744 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.019551905 = queryNorm
             0.31874073 = fieldWeight in 5701, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5701)
         0.18088497 = weight(abstract_txt:interactive in 5701) [ClassicSimilarity], result of:
           0.18088497 = score(doc=5701,freq=5.0), product of:
             0.26629138 = queryWeight, product of:
               2.4518604 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.019551905 = queryNorm
             0.6792746 = fieldWeight in 5701, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5701)
         0.3873659 = weight(abstract_txt:expansion in 5701) [ClassicSimilarity], result of:
           0.3873659 = score(doc=5701,freq=13.0), product of:
             0.3217451 = queryWeight, product of:
               2.6950893 = boost
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.019551905 = queryNorm
             1.2039528 = fieldWeight in 5701, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5701)
         0.16343273 = weight(abstract_txt:relevance in 5701) [ClassicSimilarity], result of:
           0.16343273 = score(doc=5701,freq=3.0), product of:
             0.34984902 = queryWeight, product of:
               3.628122 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.019551905 = queryNorm
             0.46715218 = fieldWeight in 5701, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5701)
       0.48 = coord(12/25)
   

3. Ruthven, T.; Lalmas, M.; Rijsbergen, K.van: Incorporating user research behavior into relevance feedback (2003) 0.54

   0.5397383 = sum of:
     0.5397383 = product of:
       1.2266779 = sum of:
         0.06739264 = weight(abstract_txt:effectiveness in 5169) [ClassicSimilarity], result of:
           0.06739264 = score(doc=5169,freq=2.0), product of:
             0.14954965 = queryWeight, product of:
               1.5002521 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.019551905 = queryNorm
             0.45063722 = fieldWeight in 5169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.022636496 = weight(abstract_txt:retrieval in 5169) [ClassicSimilarity], result of:
           0.022636496 = score(doc=5169,freq=1.0), product of:
             0.10422141 = queryWeight, product of:
               1.5338951 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.019551905 = queryNorm
             0.21719621 = fieldWeight in 5169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.077019334 = weight(abstract_txt:experiments in 5169) [ClassicSimilarity], result of:
           0.077019334 = score(doc=5169,freq=2.0), product of:
             0.16347209 = queryWeight, product of:
               1.5685319 = boost
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.019551905 = queryNorm
             0.4711467 = fieldWeight in 5169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.1068124 = weight(abstract_txt:feedback in 5169) [ClassicSimilarity], result of:
           0.1068124 = score(doc=5169,freq=2.0), product of:
             0.20329414 = queryWeight, product of:
               1.7491779 = boost
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.019551905 = queryNorm
             0.52540815 = fieldWeight in 5169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.15292467 = weight(abstract_txt:trec in 5169) [ClassicSimilarity], result of:
           0.15292467 = score(doc=5169,freq=2.0), product of:
             0.25824314 = queryWeight, product of:
               1.9714508 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.019551905 = queryNorm
             0.5921732 = fieldWeight in 5169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.09305886 = weight(abstract_txt:relevant in 5169) [ClassicSimilarity], result of:
           0.09305886 = score(doc=5169,freq=3.0), product of:
             0.18544519 = queryWeight, product of:
               2.046091 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.019551905 = queryNorm
             0.5018133 = fieldWeight in 5169, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.081944644 = weight(abstract_txt:query in 5169) [ClassicSimilarity], result of:
           0.081944644 = score(doc=5169,freq=2.0), product of:
             0.19502392 = queryWeight, product of:
               2.0982687 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.019551905 = queryNorm
             0.4201774 = fieldWeight in 5169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.07119504 = weight(abstract_txt:documents in 5169) [ClassicSimilarity], result of:
           0.07119504 = score(doc=5169,freq=2.0), product of:
             0.19544306 = queryWeight, product of:
               2.4254744 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.019551905 = queryNorm
             0.36427513 = fieldWeight in 5169, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.09245054 = weight(abstract_txt:interactive in 5169) [ClassicSimilarity], result of:
           0.09245054 = score(doc=5169,freq=1.0), product of:
             0.26629138 = queryWeight, product of:
               2.4518604 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.019551905 = queryNorm
             0.3471781 = fieldWeight in 5169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.24556793 = weight(abstract_txt:expansion in 5169) [ClassicSimilarity], result of:
           0.24556793 = score(doc=5169,freq=4.0), product of:
             0.3217451 = queryWeight, product of:
               2.6950893 = boost
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.019551905 = queryNorm
             0.76323754 = fieldWeight in 5169, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
         0.21567528 = weight(abstract_txt:relevance in 5169) [ClassicSimilarity], result of:
           0.21567528 = score(doc=5169,freq=4.0), product of:
             0.34984902 = queryWeight, product of:
               3.628122 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.019551905 = queryNorm
             0.616481 = fieldWeight in 5169, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=5169)
       0.44 = coord(11/25)
   

4. He, D.; Wu, D.: Enhancing query translation with relevance feedback in translingual information retrieval : a study of the medication process (2011) 0.47

   0.4741866 = sum of:
     0.4741866 = product of:
       1.0776968 = sum of:
         0.014112524 = weight(abstract_txt:also in 4244) [ClassicSimilarity], result of:
           0.014112524 = score(doc=4244,freq=1.0), product of:
             0.066444166 = queryWeight, product of:
               3.3983476 = idf(docFreq=4017, maxDocs=44218)
               0.019551905 = queryNorm
             0.21239673 = fieldWeight in 4244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3983476 = idf(docFreq=4017, maxDocs=44218)
               0.0625 = fieldNorm(doc=4244)
         0.04765379 = weight(abstract_txt:effectiveness in 4244) [ClassicSimilarity], result of:
           0.04765379 = score(doc=4244,freq=1.0), product of:
             0.14954965 = queryWeight, product of:
               1.5002521 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.019551905 = queryNorm
             0.31864864 = fieldWeight in 4244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=4244)
         0.03201284 = weight(abstract_txt:retrieval in 4244) [ClassicSimilarity], result of:
           0.03201284 = score(doc=4244,freq=2.0), product of:
             0.10422141 = queryWeight, product of:
               1.5338951 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.019551905 = queryNorm
             0.3071618 = fieldWeight in 4244, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=4244)
         0.02277911 = weight(abstract_txt:results in 4244) [ClassicSimilarity], result of:
           0.02277911 = score(doc=4244,freq=1.0), product of:
             0.1046587 = queryWeight, product of:
               1.5371097 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.019551905 = queryNorm
             0.21765138 = fieldWeight in 4244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=4244)
         0.16888523 = weight(abstract_txt:feedback in 4244) [ClassicSimilarity], result of:
           0.16888523 = score(doc=4244,freq=5.0), product of:
             0.20329414 = queryWeight, product of:
               1.7491779 = boost
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.019551905 = queryNorm
             0.8307432 = fieldWeight in 4244, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.9443145 = idf(docFreq=314, maxDocs=44218)
               0.0625 = fieldNorm(doc=4244)
         0.05372756 = weight(abstract_txt:relevant in 4244) [ClassicSimilarity], result of:
           0.05372756 = score(doc=4244,freq=1.0), product of:
             0.18544519 = queryWeight, product of:
               2.046091 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.019551905 = queryNorm
             0.28972206 = fieldWeight in 4244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=4244)
         0.1419323 = weight(abstract_txt:query in 4244) [ClassicSimilarity], result of:
           0.1419323 = score(doc=4244,freq=6.0), product of:
             0.19502392 = queryWeight, product of:
               2.0982687 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.019551905 = queryNorm
             0.72776866 = fieldWeight in 4244, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=4244)
         0.0503425 = weight(abstract_txt:documents in 4244) [ClassicSimilarity], result of:
           0.0503425 = score(doc=4244,freq=1.0), product of:
             0.19544306 = queryWeight, product of:
               2.4254744 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.019551905 = queryNorm
             0.2575814 = fieldWeight in 4244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=4244)
         0.09245054 = weight(abstract_txt:interactive in 4244) [ClassicSimilarity], result of:
           0.09245054 = score(doc=4244,freq=1.0), product of:
             0.26629138 = queryWeight, product of:
               2.4518604 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.019551905 = queryNorm
             0.3471781 = fieldWeight in 4244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.0625 = fieldNorm(doc=4244)
         0.21266806 = weight(abstract_txt:expansion in 4244) [ClassicSimilarity], result of:
           0.21266806 = score(doc=4244,freq=3.0), product of:
             0.3217451 = queryWeight, product of:
               2.6950893 = boost
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.019551905 = queryNorm
             0.6609831 = fieldWeight in 4244, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.0625 = fieldNorm(doc=4244)
         0.24113229 = weight(abstract_txt:relevance in 4244) [ClassicSimilarity], result of:
           0.24113229 = score(doc=4244,freq=5.0), product of:
             0.34984902 = queryWeight, product of:
               3.628122 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.019551905 = queryNorm
             0.6892467 = fieldWeight in 4244, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=4244)
       0.44 = coord(11/25)
   

5. Kekäläinen, J.; Järvelin, K.: Using graded relevance assessments in IR evaluation (2002) 0.45

   0.45420665 = sum of:
     0.45420665 = product of:
       1.0322878 = sum of:
         0.099145524 = weight(abstract_txt:marginal in 5225) [ClassicSimilarity], result of:
           0.099145524 = score(doc=5225,freq=1.0), product of:
             0.19344573 = queryWeight, product of:
               1.2065245 = boost
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.019551905 = queryNorm
             0.5125237 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.11645973 = weight(abstract_txt:graded in 5225) [ClassicSimilarity], result of:
           0.11645973 = score(doc=5225,freq=1.0), product of:
             0.21535796 = queryWeight, product of:
               1.2730253 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.019551905 = queryNorm
             0.5407728 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.071136944 = weight(abstract_txt:four in 5225) [ClassicSimilarity], result of:
           0.071136944 = score(doc=5225,freq=2.0), product of:
             0.15503885 = queryWeight, product of:
               1.5275373 = boost
               5.191103 = idf(docFreq=668, maxDocs=44218)
               0.019551905 = queryNorm
             0.458833 = fieldWeight in 5225, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.191103 = idf(docFreq=668, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.022636496 = weight(abstract_txt:retrieval in 5225) [ClassicSimilarity], result of:
           0.022636496 = score(doc=5225,freq=1.0), product of:
             0.10422141 = queryWeight, product of:
               1.5338951 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.019551905 = queryNorm
             0.21719621 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.032214526 = weight(abstract_txt:results in 5225) [ClassicSimilarity], result of:
           0.032214526 = score(doc=5225,freq=2.0), product of:
             0.1046587 = queryWeight, product of:
               1.5371097 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.019551905 = queryNorm
             0.30780554 = fieldWeight in 5225, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.05835865 = weight(abstract_txt:highly in 5225) [ClassicSimilarity], result of:
           0.05835865 = score(doc=5225,freq=1.0), product of:
             0.17118166 = queryWeight, product of:
               1.6050929 = boost
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.019551905 = queryNorm
             0.34091648 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4546638 = idf(docFreq=513, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.05372756 = weight(abstract_txt:relevant in 5225) [ClassicSimilarity], result of:
           0.05372756 = score(doc=5225,freq=1.0), product of:
             0.18544519 = queryWeight, product of:
               2.046091 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.019551905 = queryNorm
             0.28972206 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.057943616 = weight(abstract_txt:query in 5225) [ClassicSimilarity], result of:
           0.057943616 = score(doc=5225,freq=1.0), product of:
             0.19502392 = queryWeight, product of:
               2.0982687 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.019551905 = queryNorm
             0.2971103 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.11256926 = weight(abstract_txt:documents in 5225) [ClassicSimilarity], result of:
           0.11256926 = score(doc=5225,freq=5.0), product of:
             0.19544306 = queryWeight, product of:
               2.4254744 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.019551905 = queryNorm
             0.5759696 = fieldWeight in 5225, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.12278397 = weight(abstract_txt:expansion in 5225) [ClassicSimilarity], result of:
           0.12278397 = score(doc=5225,freq=1.0), product of:
             0.3217451 = queryWeight, product of:
               2.6950893 = boost
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.019551905 = queryNorm
             0.38161877 = fieldWeight in 5225, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
         0.28531155 = weight(abstract_txt:relevance in 5225) [ClassicSimilarity], result of:
           0.28531155 = score(doc=5225,freq=7.0), product of:
             0.34984902 = queryWeight, product of:
               3.628122 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.019551905 = queryNorm
             0.8155277 = fieldWeight in 5225, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=5225)
       0.44 = coord(11/25)