Document (#40923)

Author

Koopman, B.
Zuccon, G.
Bruza, P.
Nguyen, A.

Title

What makes an effective clinical query and querier?

Source

Journal of the Association for Information Science and Technology. 68(2017) no.11, S.2557-2571

Year

2017

Abstract

In this paper, we perform an in-depth study into how clinicians represent their information needs and the influence this has on information retrieval (IR) effectiveness. While much research in IR has considered the effectiveness of IR systems, there is still a significant gap in the understanding of how users contribute to the effectiveness of these systems. The paper aims to contribute to this by studying how clinicians search for information. Multiple representations of an information need-from verbose patient case descriptions to ad-hoc queries-were considered in order to understand their effect on retrieval. Four clinicians provided queries and performed relevance assessment to form a test collection used in this study. The different query formulation strategies of each clinician, and their effectiveness, were investigated. The results show that query formulation had more impact on retrieval effectiveness than the particular retrieval systems used. The most effective queries were short, ad-hoc keyword queries. Different clinicians were observed to consistently adopt specific query formulation strategies. The most effective queriers were those who, given their information need, inferred novel keywords most likely to appear in relevant documents. This study reveals aspects of how people search within the clinical domain. This can help inform the development of new models and methods that specifically focus on the query formulation process to improve retrieval effectiveness.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23959/full.

Footnote

Beitrag in einem Special issue on biomedical information retrieval.

Field

Medizin

Similar documents (author)

1. Koopman, B.; Zuccon, G.; Bruza, P.; Sitbon, L.; Lawley, M.: Information retrieval as semantic inference : a graph Inference model applied to medical search (2016) 3.39

   3.3934457 = sum of:
     3.3934457 = product of:
       4.5245943 = sum of:
         1.3695532 = weight(author_txt:bruza in 3260) [ClassicSimilarity], result of:
           1.3695532 = score(doc=3260,freq=1.0), product of:
             0.47574675 = queryWeight, product of:
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.051644348 = queryNorm
             2.8787441 = fieldWeight in 3260, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.3125 = fieldNorm(doc=3260)
         1.4524908 = weight(author_txt:koopman in 3260) [ClassicSimilarity], result of:
           1.4524908 = score(doc=3260,freq=1.0), product of:
             0.49476486 = queryWeight, product of:
               1.0197918 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.051644348 = queryNorm
             2.9357195 = fieldWeight in 3260, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.3125 = fieldNorm(doc=3260)
         1.7025506 = weight(author_txt:zuccon in 3260) [ClassicSimilarity], result of:
           1.7025506 = score(doc=3260,freq=1.0), product of:
             0.5500345 = queryWeight, product of:
               1.0752441 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.051644348 = queryNorm
             3.0953524 = fieldWeight in 3260, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.3125 = fieldNorm(doc=3260)
       0.75 = coord(3/4)
   

2. Symonds, M.; Bruza, P.; Zuccon, G.; Koopman, B.; Sitbon, L.; Turner, I.: Automatic query expansion : a structural linguistic perspective (2014) 2.71

   2.7147567 = sum of:
     2.7147567 = product of:
       3.6196756 = sum of:
         1.0956424 = weight(author_txt:bruza in 1338) [ClassicSimilarity], result of:
           1.0956424 = score(doc=1338,freq=1.0), product of:
             0.47574675 = queryWeight, product of:
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.051644348 = queryNorm
             2.3029952 = fieldWeight in 1338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.25 = fieldNorm(doc=1338)
         1.1619927 = weight(author_txt:koopman in 1338) [ClassicSimilarity], result of:
           1.1619927 = score(doc=1338,freq=1.0), product of:
             0.49476486 = queryWeight, product of:
               1.0197918 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.051644348 = queryNorm
             2.3485756 = fieldWeight in 1338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.25 = fieldNorm(doc=1338)
         1.3620405 = weight(author_txt:zuccon in 1338) [ClassicSimilarity], result of:
           1.3620405 = score(doc=1338,freq=1.0), product of:
             0.5500345 = queryWeight, product of:
               1.0752441 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.051644348 = queryNorm
             2.476282 = fieldWeight in 1338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.25 = fieldNorm(doc=1338)
       0.75 = coord(3/4)
   

3. Vegt, A. van der; Zuccon, G.; Koopman, B.: Do better search engines really equate to better clinical decisions? : If not, why not? (2021) 1.58

   1.5775207 = sum of:
     1.5775207 = product of:
       3.1550415 = sum of:
         1.4524908 = weight(author_txt:koopman in 150) [ClassicSimilarity], result of:
           1.4524908 = score(doc=150,freq=1.0), product of:
             0.49476486 = queryWeight, product of:
               1.0197918 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.051644348 = queryNorm
             2.9357195 = fieldWeight in 150, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.3125 = fieldNorm(doc=150)
         1.7025506 = weight(author_txt:zuccon in 150) [ClassicSimilarity], result of:
           1.7025506 = score(doc=150,freq=1.0), product of:
             0.5500345 = queryWeight, product of:
               1.0752441 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.051644348 = queryNorm
             3.0953524 = fieldWeight in 150, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.3125 = fieldNorm(doc=150)
       0.5 = coord(2/4)
   

4. Kholghi, M.; Vine, L.D.; Sitbon, L.; Zuccon, G.; Nguyen, A.: Clinical information extraction using small data : an active learning approach based on sequence representations and word embeddings (2017) 1.54

   1.536052 = sum of:
     1.536052 = product of:
       3.072104 = sum of:
         1.3695532 = weight(author_txt:nguyen in 3920) [ClassicSimilarity], result of:
           1.3695532 = score(doc=3920,freq=1.0), product of:
             0.47574675 = queryWeight, product of:
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.051644348 = queryNorm
             2.8787441 = fieldWeight in 3920, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.211981 = idf(docFreq=11, maxDocs=44218)
               0.3125 = fieldNorm(doc=3920)
         1.7025506 = weight(author_txt:zuccon in 3920) [ClassicSimilarity], result of:
           1.7025506 = score(doc=3920,freq=1.0), product of:
             0.5500345 = queryWeight, product of:
               1.0752441 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.051644348 = queryNorm
             3.0953524 = fieldWeight in 3920, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.3125 = fieldNorm(doc=3920)
       0.5 = coord(2/4)
   

5. Koopman, R.: ¬The Pica Micro OPC (1995) 0.73

   0.7262454 = sum of:
     0.7262454 = product of:
       2.9049816 = sum of:
         2.9049816 = weight(author_txt:koopman in 4105) [ClassicSimilarity], result of:
           2.9049816 = score(doc=4105,freq=1.0), product of:
             0.49476486 = queryWeight, product of:
               1.0197918 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.051644348 = queryNorm
             5.871439 = fieldWeight in 4105, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.625 = fieldNorm(doc=4105)
       0.25 = coord(1/4)
   

Similar documents (content)

1. Sahib, N.G.; Tombros, A.; Stockman, T.: ¬A comparative analysis of the information-seeking behavior of visually impaired and sighted searchers (2012) 0.36

   0.36345428 = sum of:
     0.36345428 = product of:
       0.6989506 = sum of:
         0.040935818 = weight(abstract_txt:search in 4989) [ClassicSimilarity], result of:
           0.040935818 = score(doc=4989,freq=11.0), product of:
             0.053985506 = queryWeight, product of:
               1.0287102 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.014346111 = queryNorm
             0.75827426 = fieldWeight in 4989, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=4989)
         0.012418171 = weight(abstract_txt:different in 4989) [ClassicSimilarity], result of:
           0.012418171 = score(doc=4989,freq=1.0), product of:
             0.054205604 = queryWeight, product of:
               1.0308051 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.014346111 = queryNorm
             0.22909386 = fieldWeight in 4989, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0625 = fieldNorm(doc=4989)
         0.01502205 = weight(abstract_txt:systems in 4989) [ClassicSimilarity], result of:
           0.01502205 = score(doc=4989,freq=1.0), product of:
             0.07044589 = queryWeight, product of:
               1.4392225 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.014346111 = queryNorm
             0.2132424 = fieldWeight in 4989, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=4989)
         0.033906505 = weight(abstract_txt:strategies in 4989) [ClassicSimilarity], result of:
           0.033906505 = score(doc=4989,freq=1.0), product of:
             0.1058915 = queryWeight, product of:
               1.4407381 = boost
               5.123207 = idf(docFreq=715, maxDocs=44218)
               0.014346111 = queryNorm
             0.32020044 = fieldWeight in 4989, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.123207 = idf(docFreq=715, maxDocs=44218)
               0.0625 = fieldNorm(doc=4989)
         0.02146797 = weight(abstract_txt:study in 4989) [ClassicSimilarity], result of:
           0.02146797 = score(doc=4989,freq=2.0), product of:
             0.07093929 = queryWeight, product of:
               1.4442538 = boost
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.014346111 = queryNorm
             0.30262455 = fieldWeight in 4989, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.0625 = fieldNorm(doc=4989)
         0.017888868 = weight(abstract_txt:information in 4989) [ClassicSimilarity], result of:
           0.017888868 = score(doc=4989,freq=4.0), product of:
             0.059113637 = queryWeight, product of:
               1.7020344 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.014346111 = queryNorm
             0.3026183 = fieldWeight in 4989, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=4989)
         0.015030555 = weight(abstract_txt:this in 4989) [ClassicSimilarity], result of:
           0.015030555 = score(doc=4989,freq=2.0), product of:
             0.07047248 = queryWeight, product of:
               2.035752 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.014346111 = queryNorm
             0.21328263 = fieldWeight in 4989, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=4989)
         0.042782653 = weight(abstract_txt:effective in 4989) [ClassicSimilarity], result of:
           0.042782653 = score(doc=4989,freq=1.0), product of:
             0.14154069 = queryWeight, product of:
               2.0400498 = boost
               4.8362236 = idf(docFreq=953, maxDocs=44218)
               0.014346111 = queryNorm
             0.30226398 = fieldWeight in 4989, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8362236 = idf(docFreq=953, maxDocs=44218)
               0.0625 = fieldNorm(doc=4989)
         0.02645538 = weight(abstract_txt:retrieval in 4989) [ClassicSimilarity], result of:
           0.02645538 = score(doc=4989,freq=1.0), product of:
             0.12180406 = queryWeight, product of:
               2.4431794 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.014346111 = queryNorm
             0.21719621 = fieldWeight in 4989, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=4989)
         0.031161489 = weight(abstract_txt:were in 4989) [ClassicSimilarity], result of:
           0.031161489 = score(doc=4989,freq=1.0), product of:
             0.13585155 = queryWeight, product of:
               2.5802202 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.014346111 = queryNorm
             0.22937898 = fieldWeight in 4989, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=4989)
         0.067155145 = weight(abstract_txt:queries in 4989) [ClassicSimilarity], result of:
           0.067155145 = score(doc=4989,freq=1.0), product of:
             0.21041109 = queryWeight, product of:
               2.872128 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.014346111 = queryNorm
             0.31916162 = fieldWeight in 4989, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0625 = fieldNorm(doc=4989)
         0.16587694 = weight(abstract_txt:query in 4989) [ClassicSimilarity], result of:
           0.16587694 = score(doc=4989,freq=6.0), product of:
             0.22792538 = queryWeight, product of:
               3.3421106 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.014346111 = queryNorm
             0.72776866 = fieldWeight in 4989, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=4989)
         0.208849 = weight(abstract_txt:formulation in 4989) [ClassicSimilarity], result of:
           0.208849 = score(doc=4989,freq=2.0), product of:
             0.35581756 = queryWeight, product of:
               3.734936 = boost
               6.640641 = idf(docFreq=156, maxDocs=44218)
               0.014346111 = queryNorm
             0.5869553 = fieldWeight in 4989, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.640641 = idf(docFreq=156, maxDocs=44218)
               0.0625 = fieldNorm(doc=4989)
       0.52 = coord(13/25)
   

2. Pluye, P.; Grad, R.; Repchinsky, C.; Jovaisas, B.; Johnson-Lafleur, J.; Carrier, M.-E.; Granikov, V.; Farrell, B.; Rodriguez, C.; Bartlett, G.; Loiselle, C.; Légaré, F.: Four levels of outcomes of information-seeking : a mixed methods study in primary health care (2013) 0.35

   0.3490363 = sum of:
     0.3490363 = product of:
       0.8725908 = sum of:
         0.017455092 = weight(abstract_txt:search in 534) [ClassicSimilarity], result of:
           0.017455092 = score(doc=534,freq=2.0), product of:
             0.053985506 = queryWeight, product of:
               1.0287102 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.014346111 = queryNorm
             0.3233292 = fieldWeight in 534, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=534)
         0.120004885 = weight(abstract_txt:patient in 534) [ClassicSimilarity], result of:
           0.120004885 = score(doc=534,freq=5.0), product of:
             0.11414889 = queryWeight, product of:
               1.0577313 = boost
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.014346111 = queryNorm
             1.0513014 = fieldWeight in 534, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.0625 = fieldNorm(doc=534)
         0.01842161 = weight(abstract_txt:need in 534) [ClassicSimilarity], result of:
           0.01842161 = score(doc=534,freq=1.0), product of:
             0.070505686 = queryWeight, product of:
               1.1756189 = boost
               4.180454 = idf(docFreq=1837, maxDocs=44218)
               0.014346111 = queryNorm
             0.26127836 = fieldWeight in 534, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.180454 = idf(docFreq=1837, maxDocs=44218)
               0.0625 = fieldNorm(doc=534)
         0.026292786 = weight(abstract_txt:study in 534) [ClassicSimilarity], result of:
           0.026292786 = score(doc=534,freq=3.0), product of:
             0.07093929 = queryWeight, product of:
               1.4442538 = boost
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.014346111 = queryNorm
             0.37063786 = fieldWeight in 534, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.0625 = fieldNorm(doc=534)
         0.026833303 = weight(abstract_txt:information in 534) [ClassicSimilarity], result of:
           0.026833303 = score(doc=534,freq=9.0), product of:
             0.059113637 = queryWeight, product of:
               1.7020344 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.014346111 = queryNorm
             0.45392746 = fieldWeight in 534, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=534)
         0.01590531 = weight(abstract_txt:their in 534) [ClassicSimilarity], result of:
           0.01590531 = score(doc=534,freq=1.0), product of:
             0.08054598 = queryWeight, product of:
               1.7770163 = boost
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.014346111 = queryNorm
             0.19746871 = fieldWeight in 534, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.0625 = fieldNorm(doc=534)
         0.010628208 = weight(abstract_txt:this in 534) [ClassicSimilarity], result of:
           0.010628208 = score(doc=534,freq=1.0), product of:
             0.07047248 = queryWeight, product of:
               2.035752 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.014346111 = queryNorm
             0.1508136 = fieldWeight in 534, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=534)
         0.21629234 = weight(abstract_txt:clinical in 534) [ClassicSimilarity], result of:
           0.21629234 = score(doc=534,freq=5.0), product of:
             0.2129985 = queryWeight, product of:
               2.04335 = boost
               7.2660704 = idf(docFreq=83, maxDocs=44218)
               0.014346111 = queryNorm
             1.0154642 = fieldWeight in 534, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.2660704 = idf(docFreq=83, maxDocs=44218)
               0.0625 = fieldNorm(doc=534)
         0.062322978 = weight(abstract_txt:were in 534) [ClassicSimilarity], result of:
           0.062322978 = score(doc=534,freq=4.0), product of:
             0.13585155 = queryWeight, product of:
               2.5802202 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.014346111 = queryNorm
             0.45875797 = fieldWeight in 534, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=534)
         0.3584343 = weight(abstract_txt:clinicians in 534) [ClassicSimilarity], result of:
           0.3584343 = score(doc=534,freq=1.0), product of:
             0.6426218 = queryWeight, product of:
               5.0193467 = boost
               8.924298 = idf(docFreq=15, maxDocs=44218)
               0.014346111 = queryNorm
             0.55776864 = fieldWeight in 534, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.924298 = idf(docFreq=15, maxDocs=44218)
               0.0625 = fieldNorm(doc=534)
       0.4 = coord(10/25)
   

3. Symonds, M.; Bruza, P.; Zuccon, G.; Koopman, B.; Sitbon, L.; Turner, I.: Automatic query expansion : a structural linguistic perspective (2014) 0.35

   0.34528887 = sum of:
     0.34528887 = product of:
       0.7847474 = sum of:
         0.012342613 = weight(abstract_txt:search in 1338) [ClassicSimilarity], result of:
           0.012342613 = score(doc=1338,freq=1.0), product of:
             0.053985506 = queryWeight, product of:
               1.0287102 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.014346111 = queryNorm
             0.22862828 = fieldWeight in 1338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=1338)
         0.01842161 = weight(abstract_txt:need in 1338) [ClassicSimilarity], result of:
           0.01842161 = score(doc=1338,freq=1.0), product of:
             0.070505686 = queryWeight, product of:
               1.1756189 = boost
               4.180454 = idf(docFreq=1837, maxDocs=44218)
               0.014346111 = queryNorm
             0.26127836 = fieldWeight in 1338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.180454 = idf(docFreq=1837, maxDocs=44218)
               0.0625 = fieldNorm(doc=1338)
         0.031918656 = weight(abstract_txt:considered in 1338) [ClassicSimilarity], result of:
           0.031918656 = score(doc=1338,freq=1.0), product of:
             0.10171121 = queryWeight, product of:
               1.4120136 = boost
               5.021064 = idf(docFreq=792, maxDocs=44218)
               0.014346111 = queryNorm
             0.3138165 = fieldWeight in 1338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.021064 = idf(docFreq=792, maxDocs=44218)
               0.0625 = fieldNorm(doc=1338)
         0.017888868 = weight(abstract_txt:information in 1338) [ClassicSimilarity], result of:
           0.017888868 = score(doc=1338,freq=4.0), product of:
             0.059113637 = queryWeight, product of:
               1.7020344 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.014346111 = queryNorm
             0.3026183 = fieldWeight in 1338, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=1338)
         0.01590531 = weight(abstract_txt:their in 1338) [ClassicSimilarity], result of:
           0.01590531 = score(doc=1338,freq=1.0), product of:
             0.08054598 = queryWeight, product of:
               1.7770163 = boost
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.014346111 = queryNorm
             0.19746871 = fieldWeight in 1338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.0625 = fieldNorm(doc=1338)
         0.010628208 = weight(abstract_txt:this in 1338) [ClassicSimilarity], result of:
           0.010628208 = score(doc=1338,freq=1.0), product of:
             0.07047248 = queryWeight, product of:
               2.035752 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.014346111 = queryNorm
             0.1508136 = fieldWeight in 1338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=1338)
         0.05915603 = weight(abstract_txt:retrieval in 1338) [ClassicSimilarity], result of:
           0.05915603 = score(doc=1338,freq=5.0), product of:
             0.12180406 = queryWeight, product of:
               2.4431794 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.014346111 = queryNorm
             0.4856655 = fieldWeight in 1338, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=1338)
         0.067155145 = weight(abstract_txt:queries in 1338) [ClassicSimilarity], result of:
           0.067155145 = score(doc=1338,freq=1.0), product of:
             0.21041109 = queryWeight, product of:
               2.872128 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.014346111 = queryNorm
             0.31916162 = fieldWeight in 1338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0625 = fieldNorm(doc=1338)
         0.20315692 = weight(abstract_txt:query in 1338) [ClassicSimilarity], result of:
           0.20315692 = score(doc=1338,freq=9.0), product of:
             0.22792538 = queryWeight, product of:
               3.3421106 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.014346111 = queryNorm
             0.89133084 = fieldWeight in 1338, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=1338)
         0.14767854 = weight(abstract_txt:formulation in 1338) [ClassicSimilarity], result of:
           0.14767854 = score(doc=1338,freq=1.0), product of:
             0.35581756 = queryWeight, product of:
               3.734936 = boost
               6.640641 = idf(docFreq=156, maxDocs=44218)
               0.014346111 = queryNorm
             0.41504008 = fieldWeight in 1338, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.640641 = idf(docFreq=156, maxDocs=44218)
               0.0625 = fieldNorm(doc=1338)
         0.20049556 = weight(abstract_txt:effectiveness in 1338) [ClassicSimilarity], result of:
           0.20049556 = score(doc=1338,freq=4.0), product of:
             0.31460288 = queryWeight, product of:
               4.3012676 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.014346111 = queryNorm
             0.6372973 = fieldWeight in 1338, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=1338)
       0.44 = coord(11/25)
   

4. Friman, J.; Kangaspunta, J.; Leppäniemi, S.; Rasi, P.; Virrankoski, A.: Query performance analyser : a tool for teaching information retrieval skills through an educational game (2005) 0.34

   0.34417522 = sum of:
     0.34417522 = product of:
       0.7170317 = sum of:
         0.012342613 = weight(abstract_txt:search in 3010) [ClassicSimilarity], result of:
           0.012342613 = score(doc=3010,freq=1.0), product of:
             0.053985506 = queryWeight, product of:
               1.0287102 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.014346111 = queryNorm
             0.22862828 = fieldWeight in 3010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=3010)
         0.017561946 = weight(abstract_txt:different in 3010) [ClassicSimilarity], result of:
           0.017561946 = score(doc=3010,freq=2.0), product of:
             0.054205604 = queryWeight, product of:
               1.0308051 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.014346111 = queryNorm
             0.32398763 = fieldWeight in 3010, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0625 = fieldNorm(doc=3010)
         0.01842161 = weight(abstract_txt:need in 3010) [ClassicSimilarity], result of:
           0.01842161 = score(doc=3010,freq=1.0), product of:
             0.070505686 = queryWeight, product of:
               1.1756189 = boost
               4.180454 = idf(docFreq=1837, maxDocs=44218)
               0.014346111 = queryNorm
             0.26127836 = fieldWeight in 3010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.180454 = idf(docFreq=1837, maxDocs=44218)
               0.0625 = fieldNorm(doc=3010)
         0.01502205 = weight(abstract_txt:systems in 3010) [ClassicSimilarity], result of:
           0.01502205 = score(doc=3010,freq=1.0), product of:
             0.07044589 = queryWeight, product of:
               1.4392225 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.014346111 = queryNorm
             0.2132424 = fieldWeight in 3010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=3010)
         0.04795104 = weight(abstract_txt:strategies in 3010) [ClassicSimilarity], result of:
           0.04795104 = score(doc=3010,freq=2.0), product of:
             0.1058915 = queryWeight, product of:
               1.4407381 = boost
               5.123207 = idf(docFreq=715, maxDocs=44218)
               0.014346111 = queryNorm
             0.4528318 = fieldWeight in 3010, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.123207 = idf(docFreq=715, maxDocs=44218)
               0.0625 = fieldNorm(doc=3010)
         0.020000363 = weight(abstract_txt:information in 3010) [ClassicSimilarity], result of:
           0.020000363 = score(doc=3010,freq=5.0), product of:
             0.059113637 = queryWeight, product of:
               1.7020344 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.014346111 = queryNorm
             0.33833754 = fieldWeight in 3010, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=3010)
         0.01590531 = weight(abstract_txt:their in 3010) [ClassicSimilarity], result of:
           0.01590531 = score(doc=3010,freq=1.0), product of:
             0.08054598 = queryWeight, product of:
               1.7770163 = boost
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.014346111 = queryNorm
             0.19746871 = fieldWeight in 3010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1594994 = idf(docFreq=5101, maxDocs=44218)
               0.0625 = fieldNorm(doc=3010)
         0.010628208 = weight(abstract_txt:this in 3010) [ClassicSimilarity], result of:
           0.010628208 = score(doc=3010,freq=1.0), product of:
             0.07047248 = queryWeight, product of:
               2.035752 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.014346111 = queryNorm
             0.1508136 = fieldWeight in 3010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=3010)
         0.13431029 = weight(abstract_txt:queries in 3010) [ClassicSimilarity], result of:
           0.13431029 = score(doc=3010,freq=4.0), product of:
             0.21041109 = queryWeight, product of:
               2.872128 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.014346111 = queryNorm
             0.63832325 = fieldWeight in 3010, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0625 = fieldNorm(doc=3010)
         0.13543795 = weight(abstract_txt:query in 3010) [ClassicSimilarity], result of:
           0.13543795 = score(doc=3010,freq=4.0), product of:
             0.22792538 = queryWeight, product of:
               3.3421106 = boost
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.014346111 = queryNorm
             0.5942206 = fieldWeight in 3010, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.7537646 = idf(docFreq=1035, maxDocs=44218)
               0.0625 = fieldNorm(doc=3010)
         0.14767854 = weight(abstract_txt:formulation in 3010) [ClassicSimilarity], result of:
           0.14767854 = score(doc=3010,freq=1.0), product of:
             0.35581756 = queryWeight, product of:
               3.734936 = boost
               6.640641 = idf(docFreq=156, maxDocs=44218)
               0.014346111 = queryNorm
             0.41504008 = fieldWeight in 3010, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.640641 = idf(docFreq=156, maxDocs=44218)
               0.0625 = fieldNorm(doc=3010)
         0.14177176 = weight(abstract_txt:effectiveness in 3010) [ClassicSimilarity], result of:
           0.14177176 = score(doc=3010,freq=2.0), product of:
             0.31460288 = queryWeight, product of:
               4.3012676 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.014346111 = queryNorm
             0.45063722 = fieldWeight in 3010, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=3010)
       0.48 = coord(12/25)
   

5. Vegt, A. van der; Zuccon, G.; Koopman, B.: Do better search engines really equate to better clinical decisions? : If not, why not? (2021) 0.32

   0.31716493 = sum of:
     0.31716493 = product of:
       0.88101363 = sum of:
         0.03702784 = weight(abstract_txt:search in 150) [ClassicSimilarity], result of:
           0.03702784 = score(doc=150,freq=9.0), product of:
             0.053985506 = queryWeight, product of:
               1.0287102 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.014346111 = queryNorm
             0.68588483 = fieldWeight in 150, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.01842161 = weight(abstract_txt:need in 150) [ClassicSimilarity], result of:
           0.01842161 = score(doc=150,freq=1.0), product of:
             0.070505686 = queryWeight, product of:
               1.1756189 = boost
               4.180454 = idf(docFreq=1837, maxDocs=44218)
               0.014346111 = queryNorm
             0.26127836 = fieldWeight in 150, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.180454 = idf(docFreq=1837, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.01264934 = weight(abstract_txt:information in 150) [ClassicSimilarity], result of:
           0.01264934 = score(doc=150,freq=2.0), product of:
             0.059113637 = queryWeight, product of:
               1.7020344 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.014346111 = queryNorm
             0.21398345 = fieldWeight in 150, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.042782653 = weight(abstract_txt:effective in 150) [ClassicSimilarity], result of:
           0.042782653 = score(doc=150,freq=1.0), product of:
             0.14154069 = queryWeight, product of:
               2.0400498 = boost
               4.8362236 = idf(docFreq=953, maxDocs=44218)
               0.014346111 = queryNorm
             0.30226398 = fieldWeight in 150, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8362236 = idf(docFreq=953, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.16753933 = weight(abstract_txt:clinical in 150) [ClassicSimilarity], result of:
           0.16753933 = score(doc=150,freq=3.0), product of:
             0.2129985 = queryWeight, product of:
               2.04335 = boost
               7.2660704 = idf(docFreq=83, maxDocs=44218)
               0.014346111 = queryNorm
             0.7865752 = fieldWeight in 150, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.2660704 = idf(docFreq=83, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.02645538 = weight(abstract_txt:retrieval in 150) [ClassicSimilarity], result of:
           0.02645538 = score(doc=150,freq=1.0), product of:
             0.12180406 = queryWeight, product of:
               2.4431794 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.014346111 = queryNorm
             0.21719621 = fieldWeight in 150, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.044069 = weight(abstract_txt:were in 150) [ClassicSimilarity], result of:
           0.044069 = score(doc=150,freq=2.0), product of:
             0.13585155 = queryWeight, product of:
               2.5802202 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.014346111 = queryNorm
             0.32439086 = fieldWeight in 150, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.17363425 = weight(abstract_txt:effectiveness in 150) [ClassicSimilarity], result of:
           0.17363425 = score(doc=150,freq=3.0), product of:
             0.31460288 = queryWeight, product of:
               4.3012676 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.014346111 = queryNorm
             0.55191565 = fieldWeight in 150, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
         0.3584343 = weight(abstract_txt:clinicians in 150) [ClassicSimilarity], result of:
           0.3584343 = score(doc=150,freq=1.0), product of:
             0.6426218 = queryWeight, product of:
               5.0193467 = boost
               8.924298 = idf(docFreq=15, maxDocs=44218)
               0.014346111 = queryNorm
             0.55776864 = fieldWeight in 150, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.924298 = idf(docFreq=15, maxDocs=44218)
               0.0625 = fieldNorm(doc=150)
       0.36 = coord(9/25)