Document (#7303)

Author

Smithson, S.

Title

Information retrieval evaluation in practice : a case study approach

Source

Information processing and management. 30(1994) no.2, S.205-221

Year

1994

Abstract

The evaluation of information retrieval systems is an important yet difficult operation. This paper describes an exploratory evaluation study that takes an interpretive approach to evaluation. The longitudinal study examines evaluation through the information-seeking behaviour of 22 case studies of 'real' users. The eclectic approach to data collection produced behavioral data that is compared with relevance judgements and satisfaction ratings. The study demonstrates considerable variations among the cases, among different evaluation measures within the same case, and among the same measures at different stages within a single case. It is argued that those involved in evaluation should be aware of the difficulties, and base any evaluation on a good understanding of the cases in question

Theme

Retrievalstudien

Similar documents (content)

1. Lopatovska, I.; Mokros, H.B.: Willingness to pay and experienced utility as measures of affective value of information objects : users' accounts (2008) 0.31

   0.30702487 = sum of:
     0.30702487 = product of:
       0.76756215 = sum of:
         0.021953957 = weight(abstract_txt:retrieval in 2025) [ClassicSimilarity], result of:
           0.021953957 = score(doc=2025,freq=1.0), product of:
             0.08086313 = queryWeight, product of:
               1.0713502 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.021719353 = queryNorm
             0.27149525 = fieldWeight in 2025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=2025)
         0.019284286 = weight(abstract_txt:information in 2025) [ClassicSimilarity], result of:
           0.019284286 = score(doc=2025,freq=3.0), product of:
             0.058866434 = queryWeight, product of:
               1.1195298 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.021719353 = queryNorm
             0.32759392 = fieldWeight in 2025, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=2025)
         0.025763003 = weight(abstract_txt:different in 2025) [ClassicSimilarity], result of:
           0.025763003 = score(doc=2025,freq=1.0), product of:
             0.08996488 = queryWeight, product of:
               1.1300371 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.021719353 = queryNorm
             0.28636733 = fieldWeight in 2025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.078125 = fieldNorm(doc=2025)
         0.14864291 = weight(abstract_txt:ratings in 2025) [ClassicSimilarity], result of:
           0.14864291 = score(doc=2025,freq=2.0), product of:
             0.18231322 = queryWeight, product of:
               1.1374971 = boost
               7.3793993 = idf(docFreq=74, maxDocs=44218)
               0.021719353 = queryNorm
             0.81531614 = fieldWeight in 2025, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3793993 = idf(docFreq=74, maxDocs=44218)
               0.078125 = fieldNorm(doc=2025)
         0.038640443 = weight(abstract_txt:within in 2025) [ClassicSimilarity], result of:
           0.038640443 = score(doc=2025,freq=1.0), product of:
             0.117879085 = queryWeight, product of:
               1.2935241 = boost
               4.195805 = idf(docFreq=1809, maxDocs=44218)
               0.021719353 = queryNorm
             0.32779726 = fieldWeight in 2025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.195805 = idf(docFreq=1809, maxDocs=44218)
               0.078125 = fieldNorm(doc=2025)
         0.055755403 = weight(abstract_txt:same in 2025) [ClassicSimilarity], result of:
           0.055755403 = score(doc=2025,freq=1.0), product of:
             0.15052201 = queryWeight, product of:
               1.461693 = boost
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.021719353 = queryNorm
             0.37041363 = fieldWeight in 2025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.078125 = fieldNorm(doc=2025)
         0.16800402 = weight(abstract_txt:measures in 2025) [ClassicSimilarity], result of:
           0.16800402 = score(doc=2025,freq=4.0), product of:
             0.19781922 = queryWeight, product of:
               1.6756774 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.021719353 = queryNorm
             0.8492806 = fieldWeight in 2025, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.078125 = fieldNorm(doc=2025)
         0.041224647 = weight(abstract_txt:approach in 2025) [ClassicSimilarity], result of:
           0.041224647 = score(doc=2025,freq=1.0), product of:
             0.140889 = queryWeight, product of:
               1.73197 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.021719353 = queryNorm
             0.29260373 = fieldWeight in 2025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.078125 = fieldNorm(doc=2025)
         0.059383888 = weight(abstract_txt:study in 2025) [ClassicSimilarity], result of:
           0.059383888 = score(doc=2025,freq=2.0), product of:
             0.15698366 = queryWeight, product of:
               2.1110494 = boost
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.021719353 = queryNorm
             0.3782807 = fieldWeight in 2025, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.078125 = fieldNorm(doc=2025)
         0.18890958 = weight(abstract_txt:evaluation in 2025) [ClassicSimilarity], result of:
           0.18890958 = score(doc=2025,freq=1.0), product of:
             0.5390115 = queryWeight, product of:
               5.532038 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.021719353 = queryNorm
             0.35047412 = fieldWeight in 2025, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=2025)
       0.4 = coord(10/25)
   

2. Burgin, R.: Variations in relevance judgements and the evaluation of retrieval performance (1992) 0.26

   0.26413876 = sum of:
     0.26413876 = product of:
       0.9433527 = sum of:
         0.16447975 = weight(abstract_txt:variations in 3308) [ClassicSimilarity], result of:
           0.16447975 = score(doc=3308,freq=3.0), product of:
             0.15088488 = queryWeight, product of:
               1.0348182 = boost
               6.7132807 = idf(docFreq=145, maxDocs=44218)
               0.021719353 = queryNorm
             1.0901009 = fieldWeight in 3308, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.7132807 = idf(docFreq=145, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.052689496 = weight(abstract_txt:retrieval in 3308) [ClassicSimilarity], result of:
           0.052689496 = score(doc=3308,freq=4.0), product of:
             0.08086313 = queryWeight, product of:
               1.0713502 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.021719353 = queryNorm
             0.6515886 = fieldWeight in 3308, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.013360545 = weight(abstract_txt:information in 3308) [ClassicSimilarity], result of:
           0.013360545 = score(doc=3308,freq=1.0), product of:
             0.058866434 = queryWeight, product of:
               1.1195298 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.021719353 = queryNorm
             0.22696373 = fieldWeight in 3308, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.25939703 = weight(abstract_txt:judgements in 3308) [ClassicSimilarity], result of:
           0.25939703 = score(doc=3308,freq=4.0), product of:
             0.18573818 = queryWeight, product of:
               1.1481318 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.021719353 = queryNorm
             1.3965735 = fieldWeight in 3308, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.08725508 = weight(abstract_txt:among in 3308) [ClassicSimilarity], result of:
           0.08725508 = score(doc=3308,freq=1.0), product of:
             0.20567371 = queryWeight, product of:
               2.092624 = boost
               4.5252304 = idf(docFreq=1301, maxDocs=44218)
               0.021719353 = queryNorm
             0.42424035 = fieldWeight in 3308, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5252304 = idf(docFreq=1301, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.13947937 = weight(abstract_txt:case in 3308) [ClassicSimilarity], result of:
           0.13947937 = score(doc=3308,freq=1.0), product of:
             0.30948374 = queryWeight, product of:
               2.9640813 = boost
               4.807296 = idf(docFreq=981, maxDocs=44218)
               0.021719353 = queryNorm
             0.45068398 = fieldWeight in 3308, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.807296 = idf(docFreq=981, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
         0.22669148 = weight(abstract_txt:evaluation in 3308) [ClassicSimilarity], result of:
           0.22669148 = score(doc=3308,freq=1.0), product of:
             0.5390115 = queryWeight, product of:
               5.532038 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.021719353 = queryNorm
             0.42056894 = fieldWeight in 3308, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.09375 = fieldNorm(doc=3308)
       0.28 = coord(7/25)
   

3. Morse, E.; Lewis, M.; Olsen, K.A.: Testing visual information retrieval methodologies case study : comparative analysis of textual, icon, graphical, and "spring" displays (2002) 0.25

   0.24727643 = sum of:
     0.24727643 = product of:
       0.6868789 = sum of:
         0.023312634 = weight(abstract_txt:data in 191) [ClassicSimilarity], result of:
           0.023312634 = score(doc=191,freq=1.0), product of:
             0.07453302 = queryWeight, product of:
               1.0285622 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.021719353 = queryNorm
             0.31278262 = fieldWeight in 191, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.09375 = fieldNorm(doc=191)
         0.026344748 = weight(abstract_txt:retrieval in 191) [ClassicSimilarity], result of:
           0.026344748 = score(doc=191,freq=1.0), product of:
             0.08086313 = queryWeight, product of:
               1.0713502 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.021719353 = queryNorm
             0.3257943 = fieldWeight in 191, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=191)
         0.012526365 = weight(abstract_txt:that in 191) [ClassicSimilarity], result of:
           0.012526365 = score(doc=191,freq=1.0), product of:
             0.056389943 = queryWeight, product of:
               1.0957277 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.021719353 = queryNorm
             0.22213829 = fieldWeight in 191, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.09375 = fieldNorm(doc=191)
         0.013360545 = weight(abstract_txt:information in 191) [ClassicSimilarity], result of:
           0.013360545 = score(doc=191,freq=1.0), product of:
             0.058866434 = queryWeight, product of:
               1.1195298 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.021719353 = queryNorm
             0.22696373 = fieldWeight in 191, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=191)
         0.030915605 = weight(abstract_txt:different in 191) [ClassicSimilarity], result of:
           0.030915605 = score(doc=191,freq=1.0), product of:
             0.08996488 = queryWeight, product of:
               1.1300371 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.021719353 = queryNorm
             0.3436408 = fieldWeight in 191, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.09375 = fieldNorm(doc=191)
         0.06996055 = weight(abstract_txt:approach in 191) [ClassicSimilarity], result of:
           0.06996055 = score(doc=191,freq=2.0), product of:
             0.140889 = queryWeight, product of:
               1.73197 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.021719353 = queryNorm
             0.49656498 = fieldWeight in 191, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.09375 = fieldNorm(doc=191)
         0.0503889 = weight(abstract_txt:study in 191) [ClassicSimilarity], result of:
           0.0503889 = score(doc=191,freq=1.0), product of:
             0.15698366 = queryWeight, product of:
               2.1110494 = boost
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.021719353 = queryNorm
             0.3209818 = fieldWeight in 191, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.09375 = fieldNorm(doc=191)
         0.13947937 = weight(abstract_txt:case in 191) [ClassicSimilarity], result of:
           0.13947937 = score(doc=191,freq=1.0), product of:
             0.30948374 = queryWeight, product of:
               2.9640813 = boost
               4.807296 = idf(docFreq=981, maxDocs=44218)
               0.021719353 = queryNorm
             0.45068398 = fieldWeight in 191, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.807296 = idf(docFreq=981, maxDocs=44218)
               0.09375 = fieldNorm(doc=191)
         0.32059017 = weight(abstract_txt:evaluation in 191) [ClassicSimilarity], result of:
           0.32059017 = score(doc=191,freq=2.0), product of:
             0.5390115 = queryWeight, product of:
               5.532038 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.021719353 = queryNorm
             0.5947743 = fieldWeight in 191, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.09375 = fieldNorm(doc=191)
       0.36 = coord(9/25)
   

4. Borlund, P.; Ruthven, I.: Introduction to the special issue on evaluating interactive information retrieval systems (2008) 0.23

   0.23208582 = sum of:
     0.23208582 = product of:
       0.58021456 = sum of:
         0.022815222 = weight(abstract_txt:retrieval in 2019) [ClassicSimilarity], result of:
           0.022815222 = score(doc=2019,freq=3.0), product of:
             0.08086313 = queryWeight, product of:
               1.0713502 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.021719353 = queryNorm
             0.28214616 = fieldWeight in 2019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.01084815 = weight(abstract_txt:that in 2019) [ClassicSimilarity], result of:
           0.01084815 = score(doc=2019,freq=3.0), product of:
             0.056389943 = queryWeight, product of:
               1.0957277 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.021719353 = queryNorm
             0.19237739 = fieldWeight in 2019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.0066802725 = weight(abstract_txt:information in 2019) [ClassicSimilarity], result of:
           0.0066802725 = score(doc=2019,freq=1.0), product of:
             0.058866434 = queryWeight, product of:
               1.1195298 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.021719353 = queryNorm
             0.113481864 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.015457802 = weight(abstract_txt:different in 2019) [ClassicSimilarity], result of:
           0.015457802 = score(doc=2019,freq=1.0), product of:
             0.08996488 = queryWeight, product of:
               1.1300371 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.021719353 = queryNorm
             0.1718204 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.040156323 = weight(abstract_txt:within in 2019) [ClassicSimilarity], result of:
           0.040156323 = score(doc=2019,freq=3.0), product of:
             0.117879085 = queryWeight, product of:
               1.2935241 = boost
               4.195805 = idf(docFreq=1809, maxDocs=44218)
               0.021719353 = queryNorm
             0.3406569 = fieldWeight in 2019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.195805 = idf(docFreq=1809, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.03345324 = weight(abstract_txt:same in 2019) [ClassicSimilarity], result of:
           0.03345324 = score(doc=2019,freq=1.0), product of:
             0.15052201 = queryWeight, product of:
               1.461693 = boost
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.021719353 = queryNorm
             0.22224817 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7412944 = idf(docFreq=1048, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.050401203 = weight(abstract_txt:measures in 2019) [ClassicSimilarity], result of:
           0.050401203 = score(doc=2019,freq=1.0), product of:
             0.19781922 = queryWeight, product of:
               1.6756774 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.021719353 = queryNorm
             0.25478417 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.02473479 = weight(abstract_txt:approach in 2019) [ClassicSimilarity], result of:
           0.02473479 = score(doc=2019,freq=1.0), product of:
             0.140889 = queryWeight, product of:
               1.73197 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.021719353 = queryNorm
             0.17556225 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.03563033 = weight(abstract_txt:study in 2019) [ClassicSimilarity], result of:
           0.03563033 = score(doc=2019,freq=2.0), product of:
             0.15698366 = queryWeight, product of:
               2.1110494 = boost
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.021719353 = queryNorm
             0.22696841 = fieldWeight in 2019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.34003723 = weight(abstract_txt:evaluation in 2019) [ClassicSimilarity], result of:
           0.34003723 = score(doc=2019,freq=9.0), product of:
             0.5390115 = queryWeight, product of:
               5.532038 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.021719353 = queryNorm
             0.6308534 = fieldWeight in 2019, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
       0.4 = coord(10/25)
   

5. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Analysis of change in users' assessment of search results over time (2017) 0.23

   0.22662322 = sum of:
     0.22662322 = product of:
       0.7081976 = sum of:
         0.008350911 = weight(abstract_txt:that in 3593) [ClassicSimilarity], result of:
           0.008350911 = score(doc=3593,freq=1.0), product of:
             0.056389943 = queryWeight, product of:
               1.0957277 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.021719353 = queryNorm
             0.1480922 = fieldWeight in 3593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=3593)
         0.020610403 = weight(abstract_txt:different in 3593) [ClassicSimilarity], result of:
           0.020610403 = score(doc=3593,freq=1.0), product of:
             0.08996488 = queryWeight, product of:
               1.1300371 = boost
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.021719353 = queryNorm
             0.22909386 = fieldWeight in 3593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6655018 = idf(docFreq=3075, maxDocs=44218)
               0.0625 = fieldNorm(doc=3593)
         0.19334312 = weight(abstract_txt:judgements in 3593) [ClassicSimilarity], result of:
           0.19334312 = score(doc=3593,freq=5.0), product of:
             0.18573818 = queryWeight, product of:
               1.1481318 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.021719353 = queryNorm
             1.0409445 = fieldWeight in 3593, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.0625 = fieldNorm(doc=3593)
         0.06720161 = weight(abstract_txt:measures in 3593) [ClassicSimilarity], result of:
           0.06720161 = score(doc=3593,freq=1.0), product of:
             0.19781922 = queryWeight, product of:
               1.6756774 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.021719353 = queryNorm
             0.33971223 = fieldWeight in 3593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=3593)
         0.1073925 = weight(abstract_txt:cases in 3593) [ClassicSimilarity], result of:
           0.1073925 = score(doc=3593,freq=2.0), product of:
             0.21461233 = queryWeight, product of:
               1.7453539 = boost
               5.6614056 = idf(docFreq=417, maxDocs=44218)
               0.021719353 = queryNorm
             0.5004023 = fieldWeight in 3593, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.6614056 = idf(docFreq=417, maxDocs=44218)
               0.0625 = fieldNorm(doc=3593)
         0.0671852 = weight(abstract_txt:study in 3593) [ClassicSimilarity], result of:
           0.0671852 = score(doc=3593,freq=4.0), product of:
             0.15698366 = queryWeight, product of:
               2.1110494 = boost
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.021719353 = queryNorm
             0.42797574 = fieldWeight in 3593, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.423806 = idf(docFreq=3916, maxDocs=44218)
               0.0625 = fieldNorm(doc=3593)
         0.09298624 = weight(abstract_txt:case in 3593) [ClassicSimilarity], result of:
           0.09298624 = score(doc=3593,freq=1.0), product of:
             0.30948374 = queryWeight, product of:
               2.9640813 = boost
               4.807296 = idf(docFreq=981, maxDocs=44218)
               0.021719353 = queryNorm
             0.300456 = fieldWeight in 3593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.807296 = idf(docFreq=981, maxDocs=44218)
               0.0625 = fieldNorm(doc=3593)
         0.15112765 = weight(abstract_txt:evaluation in 3593) [ClassicSimilarity], result of:
           0.15112765 = score(doc=3593,freq=1.0), product of:
             0.5390115 = queryWeight, product of:
               5.532038 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.021719353 = queryNorm
             0.2803793 = fieldWeight in 3593, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=3593)
       0.32 = coord(8/25)