Document (#35892)

Author

Carterette, B.

Title

Test collections

Source

Encyclopedia of library and information sciences. 3rd ed. Ed.: M.J. Bates

Imprint

London : Taylor & Francis

Year

2009

Pages

S.xx-xx

Abstract

Research and development of search engines and other information retrieval (IR) systems proceeds by a cycle of design, implementation, and experimentation, with the results of each experiment influencing design decisions in the next iteration of the cycle. Batch experiments on test collections help ensure that this process goes as smoothly and as quickly as possible. A test collection comprises a collection of documents, a set of information needs, and judgments of the relevance of documents to those needs.

Footnote

Vgl.: http://www.tandfonline.com/doi/book/10.1081/E-ELIS3.

Theme

Retrievalstudien

Similar documents (content)

1. Keen, E.M.: Designing and testing an interactive ranked retrieval system for professional searchers (1994) 0.14

   0.14076924 = sum of:
     0.14076924 = product of:
       0.58653855 = sum of:
         0.09429725 = weight(abstract_txt:experiment in 1066) [ClassicSimilarity], result of:
           0.09429725 = score(doc=1066,freq=5.0), product of:
             0.11918175 = queryWeight, product of:
               1.1479278 = boost
               5.6614056 = idf(docFreq=417, maxDocs=44218)
               0.018338801 = queryNorm
             0.79120547 = fieldWeight in 1066, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.6614056 = idf(docFreq=417, maxDocs=44218)
               0.0625 = fieldNorm(doc=1066)
         0.048522886 = weight(abstract_txt:design in 1066) [ClassicSimilarity], result of:
           0.048522886 = score(doc=1066,freq=3.0), product of:
             0.114323206 = queryWeight, product of:
               1.5899808 = boost
               3.9207718 = idf(docFreq=2382, maxDocs=44218)
               0.018338801 = queryNorm
             0.424436 = fieldWeight in 1066, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.9207718 = idf(docFreq=2382, maxDocs=44218)
               0.0625 = fieldNorm(doc=1066)
         0.13966316 = weight(abstract_txt:batch in 1066) [ClassicSimilarity], result of:
           0.13966316 = score(doc=1066,freq=1.0), product of:
             0.26480225 = queryWeight, product of:
               1.7110808 = boost
               8.43879 = idf(docFreq=25, maxDocs=44218)
               0.018338801 = queryNorm
             0.5274244 = fieldWeight in 1066, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.43879 = idf(docFreq=25, maxDocs=44218)
               0.0625 = fieldNorm(doc=1066)
         0.08086687 = weight(abstract_txt:collection in 1066) [ClassicSimilarity], result of:
           0.08086687 = score(doc=1066,freq=3.0), product of:
             0.16070046 = queryWeight, product of:
               1.885095 = boost
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.018338801 = queryNorm
             0.50321496 = fieldWeight in 1066, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.0625 = fieldNorm(doc=1066)
         0.067977645 = weight(abstract_txt:collections in 1066) [ClassicSimilarity], result of:
           0.067977645 = score(doc=1066,freq=2.0), product of:
             0.16384926 = queryWeight, product of:
               1.9034739 = boost
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.018338801 = queryNorm
             0.41487914 = fieldWeight in 1066, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.0625 = fieldNorm(doc=1066)
         0.15521078 = weight(abstract_txt:test in 1066) [ClassicSimilarity], result of:
           0.15521078 = score(doc=1066,freq=3.0), product of:
             0.28410682 = queryWeight, product of:
               3.0698075 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.018338801 = queryNorm
             0.5463113 = fieldWeight in 1066, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0625 = fieldNorm(doc=1066)
       0.24 = coord(6/25)
   

2. Spina, D.; Trippas, J.R.; Cavedon, L.; Sanderson, M.: Extracting audio summaries to support effective spoken document search (2017) 0.14

   0.13690475 = sum of:
     0.13690475 = product of:
       0.4889455 = sum of:
         0.0492828 = weight(abstract_txt:relevance in 3788) [ClassicSimilarity], result of:
           0.0492828 = score(doc=3788,freq=2.0), product of:
             0.090444185 = queryWeight, product of:
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.018338801 = queryNorm
             0.5448974 = fieldWeight in 3788, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
         0.052713767 = weight(abstract_txt:experiment in 3788) [ClassicSimilarity], result of:
           0.052713767 = score(doc=3788,freq=1.0), product of:
             0.11918175 = queryWeight, product of:
               1.1479278 = boost
               5.6614056 = idf(docFreq=417, maxDocs=44218)
               0.018338801 = queryNorm
             0.4422973 = fieldWeight in 3788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6614056 = idf(docFreq=417, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
         0.05659251 = weight(abstract_txt:decisions in 3788) [ClassicSimilarity], result of:
           0.05659251 = score(doc=3788,freq=1.0), product of:
             0.124958664 = queryWeight, product of:
               1.1754194 = boost
               5.79699 = idf(docFreq=364, maxDocs=44218)
               0.018338801 = queryNorm
             0.45288983 = fieldWeight in 3788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.79699 = idf(docFreq=364, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
         0.095137306 = weight(abstract_txt:judgments in 3788) [ClassicSimilarity], result of:
           0.095137306 = score(doc=3788,freq=1.0), product of:
             0.17666924 = queryWeight, product of:
               1.3976234 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.018338801 = queryNorm
             0.5385052 = fieldWeight in 3788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
         0.040670995 = weight(abstract_txt:documents in 3788) [ClassicSimilarity], result of:
           0.040670995 = score(doc=3788,freq=1.0), product of:
             0.12631655 = queryWeight, product of:
               1.6713015 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.018338801 = queryNorm
             0.32197678 = fieldWeight in 3788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
         0.08253441 = weight(abstract_txt:collection in 3788) [ClassicSimilarity], result of:
           0.08253441 = score(doc=3788,freq=2.0), product of:
             0.16070046 = queryWeight, product of:
               1.885095 = boost
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.018338801 = queryNorm
             0.51359165 = fieldWeight in 3788, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
         0.11201373 = weight(abstract_txt:test in 3788) [ClassicSimilarity], result of:
           0.11201373 = score(doc=3788,freq=1.0), product of:
             0.28410682 = queryWeight, product of:
               3.0698075 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.018338801 = queryNorm
             0.39426625 = fieldWeight in 3788, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.078125 = fieldNorm(doc=3788)
       0.28 = coord(7/25)
   

3. Losada, D.E.; Parapar, J.; Barreiro, A.: When to stop making relevance judgments? : a study of stopping methods for building information retrieval test collections (2019) 0.13

   0.12616429 = sum of:
     0.12616429 = product of:
       0.52568454 = sum of:
         0.048287086 = weight(abstract_txt:relevance in 4674) [ClassicSimilarity], result of:
           0.048287086 = score(doc=4674,freq=3.0), product of:
             0.090444185 = queryWeight, product of:
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.018338801 = queryNorm
             0.5338882 = fieldWeight in 4674, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=4674)
         0.1318261 = weight(abstract_txt:judgments in 4674) [ClassicSimilarity], result of:
           0.1318261 = score(doc=4674,freq=3.0), product of:
             0.17666924 = queryWeight, product of:
               1.3976234 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.018338801 = queryNorm
             0.74617463 = fieldWeight in 4674, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.0625 = fieldNorm(doc=4674)
         0.05635538 = weight(abstract_txt:documents in 4674) [ClassicSimilarity], result of:
           0.05635538 = score(doc=4674,freq=3.0), product of:
             0.12631655 = queryWeight, product of:
               1.6713015 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.018338801 = queryNorm
             0.44614407 = fieldWeight in 4674, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=4674)
         0.06602752 = weight(abstract_txt:collection in 4674) [ClassicSimilarity], result of:
           0.06602752 = score(doc=4674,freq=2.0), product of:
             0.16070046 = queryWeight, product of:
               1.885095 = boost
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.018338801 = queryNorm
             0.4108733 = fieldWeight in 4674, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.0625 = fieldNorm(doc=4674)
         0.067977645 = weight(abstract_txt:collections in 4674) [ClassicSimilarity], result of:
           0.067977645 = score(doc=4674,freq=2.0), product of:
             0.16384926 = queryWeight, product of:
               1.9034739 = boost
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.018338801 = queryNorm
             0.41487914 = fieldWeight in 4674, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.0625 = fieldNorm(doc=4674)
         0.15521078 = weight(abstract_txt:test in 4674) [ClassicSimilarity], result of:
           0.15521078 = score(doc=4674,freq=3.0), product of:
             0.28410682 = queryWeight, product of:
               3.0698075 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.018338801 = queryNorm
             0.5463113 = fieldWeight in 4674, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0625 = fieldNorm(doc=4674)
       0.24 = coord(6/25)
   

4. Campos, L.M. de; Fernández-Luna, J.M.; Huete, J.F.: Implementing relevance feedback in the Bayesian network retrieval model (2003) 0.11

   0.1144346 = sum of:
     0.1144346 = product of:
       0.47681084 = sum of:
         0.069696404 = weight(abstract_txt:relevance in 825) [ClassicSimilarity], result of:
           0.069696404 = score(doc=825,freq=4.0), product of:
             0.090444185 = queryWeight, product of:
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.018338801 = queryNorm
             0.7706013 = fieldWeight in 825, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
         0.095137306 = weight(abstract_txt:judgments in 825) [ClassicSimilarity], result of:
           0.095137306 = score(doc=825,freq=1.0), product of:
             0.17666924 = queryWeight, product of:
               1.3976234 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.018338801 = queryNorm
             0.5385052 = fieldWeight in 825, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
         0.13601473 = weight(abstract_txt:experimentation in 825) [ClassicSimilarity], result of:
           0.13601473 = score(doc=825,freq=1.0), product of:
             0.22420797 = queryWeight, product of:
               1.5744729 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.018338801 = queryNorm
             0.6066454 = fieldWeight in 825, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
         0.05751747 = weight(abstract_txt:documents in 825) [ClassicSimilarity], result of:
           0.05751747 = score(doc=825,freq=2.0), product of:
             0.12631655 = queryWeight, product of:
               1.6713015 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.018338801 = queryNorm
             0.4553439 = fieldWeight in 825, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
         0.05836064 = weight(abstract_txt:collection in 825) [ClassicSimilarity], result of:
           0.05836064 = score(doc=825,freq=1.0), product of:
             0.16070046 = queryWeight, product of:
               1.885095 = boost
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.018338801 = queryNorm
             0.36316413 = fieldWeight in 825, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
         0.060084317 = weight(abstract_txt:collections in 825) [ClassicSimilarity], result of:
           0.060084317 = score(doc=825,freq=1.0), product of:
             0.16384926 = queryWeight, product of:
               1.9034739 = boost
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.018338801 = queryNorm
             0.36670482 = fieldWeight in 825, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.078125 = fieldNorm(doc=825)
       0.24 = coord(6/25)
   

5. Ravana, S.D.; Rajagopal, P.; Balakrishnan, V.: Ranking retrieval systems using pseudo relevance judgments (2015) 0.11

   0.11183881 = sum of:
     0.11183881 = product of:
       0.46599504 = sum of:
         0.073759735 = weight(abstract_txt:relevance in 2591) [ClassicSimilarity], result of:
           0.073759735 = score(doc=2591,freq=7.0), product of:
             0.090444185 = queryWeight, product of:
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.018338801 = queryNorm
             0.8155277 = fieldWeight in 2591, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
         0.17018677 = weight(abstract_txt:judgments in 2591) [ClassicSimilarity], result of:
           0.17018677 = score(doc=2591,freq=5.0), product of:
             0.17666924 = queryWeight, product of:
               1.3976234 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.018338801 = queryNorm
             0.9633073 = fieldWeight in 2591, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
         0.0280147 = weight(abstract_txt:design in 2591) [ClassicSimilarity], result of:
           0.0280147 = score(doc=2591,freq=1.0), product of:
             0.114323206 = queryWeight, product of:
               1.5899808 = boost
               3.9207718 = idf(docFreq=2382, maxDocs=44218)
               0.018338801 = queryNorm
             0.24504824 = fieldWeight in 2591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9207718 = idf(docFreq=2382, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
         0.05635538 = weight(abstract_txt:documents in 2591) [ClassicSimilarity], result of:
           0.05635538 = score(doc=2591,freq=3.0), product of:
             0.12631655 = queryWeight, product of:
               1.6713015 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.018338801 = queryNorm
             0.44614407 = fieldWeight in 2591, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
         0.048067454 = weight(abstract_txt:collections in 2591) [ClassicSimilarity], result of:
           0.048067454 = score(doc=2591,freq=1.0), product of:
             0.16384926 = queryWeight, product of:
               1.9034739 = boost
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.018338801 = queryNorm
             0.29336387 = fieldWeight in 2591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
         0.08961099 = weight(abstract_txt:test in 2591) [ClassicSimilarity], result of:
           0.08961099 = score(doc=2591,freq=1.0), product of:
             0.28410682 = queryWeight, product of:
               3.0698075 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.018338801 = queryNorm
             0.315413 = fieldWeight in 2591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
       0.24 = coord(6/25)