Document (#30046)

Author

Lin, J.
Katz, B.

Title

Building a reusable test collection for question answering

Source

Journal of the American Society for Information Science and Technology. 57(2006) no.7, S.851-861

Year

2006

Abstract

In contrast to traditional information retrieval systems, which return ranked lists of documents that users must manually browse through, a question answering system attempts to directly answer natural language questions posed by the user. Although such systems possess language-processing capabilities, they still rely on traditional document retrieval techniques to generate an initial candidate set of documents. In this article, the authors argue that document retrieval for question answering represents a task different from retrieving documents in response to more general retrospective information needs. Thus, to guide future system development, specialized question answering test collections must be constructed. They show that the current evaluation resources have major shortcomings; to remedy the situation, they have manually created a small, reusable question answering test collection for research purposes. In this article they describe their methodology for building this test collection and discuss issues they encountered regarding the notion of "answer correctness."

Theme

Retrievalalgorithmen
Sprachretrieval

Similar documents (author)

1. Katz, M.: Multimedia: the future of information delivery to homes and business (1993) 5.54

   5.5397964 = sum of:
     5.5397964 = weight(author_txt:katz in 6646) [ClassicSimilarity], result of:
       5.5397964 = fieldWeight in 6646, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.863674 = idf(docFreq=16, maxDocs=44218)
         0.625 = fieldNorm(doc=6646)
   

2. Katz, B.: Community college reference services : a working guide for and by librarians (1992) 5.54

   5.5397964 = sum of:
     5.5397964 = weight(author_txt:katz in 661) [ClassicSimilarity], result of:
       5.5397964 = fieldWeight in 661, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.863674 = idf(docFreq=16, maxDocs=44218)
         0.625 = fieldNorm(doc=661)
   

3. Katz, J.S.: Bibliometric standards : personal experience and lessons learned (1996) 5.54

   5.5397964 = sum of:
     5.5397964 = weight(author_txt:katz in 5058) [ClassicSimilarity], result of:
       5.5397964 = fieldWeight in 5058, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.863674 = idf(docFreq=16, maxDocs=44218)
         0.625 = fieldNorm(doc=5058)
   

4. Katz, W.A.: Introduction to reference work (1997) 5.54

   5.5397964 = sum of:
     5.5397964 = weight(author_txt:katz in 1188) [ClassicSimilarity], result of:
       5.5397964 = fieldWeight in 1188, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.863674 = idf(docFreq=16, maxDocs=44218)
         0.625 = fieldNorm(doc=1188)
   

5. Katz, W.A.: Introduction to reference work : Vol.1: Basic information sources; vol.2: Reference services and reference processes (1992) 5.54

   5.5397964 = sum of:
     5.5397964 = weight(author_txt:katz in 3364) [ClassicSimilarity], result of:
       5.5397964 = fieldWeight in 3364, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.863674 = idf(docFreq=16, maxDocs=44218)
         0.625 = fieldNorm(doc=3364)
   

Similar documents (content)

1. Radev, D.; Fan, W.; Qu, H.; Wu, H.; Grewal, A.: Probabilistic question answering on the Web (2005) 0.49

   0.4923865 = sum of:
     0.4923865 = product of:
       1.0258052 = sum of:
         0.01335479 = weight(abstract_txt:that in 3455) [ClassicSimilarity], result of:
           0.01335479 = score(doc=3455,freq=3.0), product of:
             0.04165185 = queryWeight, product of:
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.017578512 = queryNorm
             0.320629 = fieldWeight in 3455, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.008143319 = weight(abstract_txt:this in 3455) [ClassicSimilarity], result of:
           0.008143319 = score(doc=3455,freq=1.0), product of:
             0.043196738 = queryWeight, product of:
               1.0183765 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.017578512 = queryNorm
             0.18851699 = fieldWeight in 3455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.07339584 = weight(abstract_txt:return in 3455) [ClassicSimilarity], result of:
           0.07339584 = score(doc=3455,freq=1.0), product of:
             0.1297151 = queryWeight, product of:
               1.018867 = boost
               7.24254 = idf(docFreq=85, maxDocs=44218)
               0.017578512 = queryNorm
             0.56582344 = fieldWeight in 3455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.24254 = idf(docFreq=85, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.021270191 = weight(abstract_txt:article in 3455) [ClassicSimilarity], result of:
           0.021270191 = score(doc=3455,freq=1.0), product of:
             0.07157046 = queryWeight, product of:
               1.0702966 = boost
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.017578512 = queryNorm
             0.2971923 = fieldWeight in 3455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.028262336 = weight(abstract_txt:language in 3455) [ClassicSimilarity], result of:
           0.028262336 = score(doc=3455,freq=1.0), product of:
             0.086501755 = queryWeight, product of:
               1.1766565 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.017578512 = queryNorm
             0.32672557 = fieldWeight in 3455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.043222267 = weight(abstract_txt:document in 3455) [ClassicSimilarity], result of:
           0.043222267 = score(doc=3455,freq=2.0), product of:
             0.09113417 = queryWeight, product of:
               1.2077522 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.017578512 = queryNorm
             0.4742707 = fieldWeight in 3455, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.024324093 = weight(abstract_txt:retrieval in 3455) [ClassicSimilarity], result of:
           0.024324093 = score(doc=3455,freq=1.0), product of:
             0.08959307 = queryWeight, product of:
               1.4666283 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017578512 = queryNorm
             0.27149525 = fieldWeight in 3455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.08001012 = weight(abstract_txt:answer in 3455) [ClassicSimilarity], result of:
           0.08001012 = score(doc=3455,freq=1.0), product of:
             0.17310762 = queryWeight, product of:
               1.6645442 = boost
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.017578512 = queryNorm
             0.46219873 = fieldWeight in 3455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.040571734 = weight(abstract_txt:documents in 3455) [ClassicSimilarity], result of:
           0.040571734 = score(doc=3455,freq=1.0), product of:
             0.12600826 = queryWeight, product of:
               1.7393315 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.017578512 = queryNorm
             0.32197678 = fieldWeight in 3455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.051023632 = weight(abstract_txt:they in 3455) [ClassicSimilarity], result of:
           0.051023632 = score(doc=3455,freq=1.0), product of:
             0.17406595 = queryWeight, product of:
               2.6391504 = boost
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.017578512 = queryNorm
             0.29312816 = fieldWeight in 3455, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.7520406 = idf(docFreq=2820, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.2362995 = weight(abstract_txt:question in 3455) [ClassicSimilarity], result of:
           0.2362995 = score(doc=3455,freq=3.0), product of:
             0.33532634 = queryWeight, product of:
               3.663035 = boost
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.017578512 = queryNorm
             0.70468515 = fieldWeight in 3455, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
         0.40592745 = weight(abstract_txt:answering in 3455) [ClassicSimilarity], result of:
           0.40592745 = score(doc=3455,freq=2.0), product of:
             0.55058175 = queryWeight, product of:
               4.6937304 = boost
               6.6730065 = idf(docFreq=151, maxDocs=44218)
               0.017578512 = queryNorm
             0.73727006 = fieldWeight in 3455, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.6730065 = idf(docFreq=151, maxDocs=44218)
               0.078125 = fieldNorm(doc=3455)
       0.48 = coord(12/25)
   

2. Belbachir, F.; Boughanem, M.: Using language models to improve opinion detection (2018) 0.31

   0.3079513 = sum of:
     0.3079513 = product of:
       0.6998893 = sum of:
         0.0076328986 = weight(abstract_txt:that in 5044) [ClassicSimilarity], result of:
           0.0076328986 = score(doc=5044,freq=2.0), product of:
             0.04165185 = queryWeight, product of:
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.017578512 = queryNorm
             0.18325473 = fieldWeight in 5044, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5044)
         0.008061475 = weight(abstract_txt:this in 5044) [ClassicSimilarity], result of:
           0.008061475 = score(doc=5044,freq=2.0), product of:
             0.043196738 = queryWeight, product of:
               1.0183765 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.017578512 = queryNorm
             0.1866223 = fieldWeight in 5044, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5044)
         0.044237554 = weight(abstract_txt:language in 5044) [ClassicSimilarity], result of:
           0.044237554 = score(doc=5044,freq=5.0), product of:
             0.086501755 = queryWeight, product of:
               1.1766565 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.017578512 = queryNorm
             0.5114064 = fieldWeight in 5044, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5044)
         0.04783828 = weight(abstract_txt:document in 5044) [ClassicSimilarity], result of:
           0.04783828 = score(doc=5044,freq=5.0), product of:
             0.09113417 = queryWeight, product of:
               1.2077522 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.017578512 = queryNorm
             0.5249215 = fieldWeight in 5044, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5044)
         0.035447508 = weight(abstract_txt:must in 5044) [ClassicSimilarity], result of:
           0.035447508 = score(doc=5044,freq=1.0), product of:
             0.12760803 = queryWeight, product of:
               1.4291449 = boost
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.017578512 = queryNorm
             0.27778432 = fieldWeight in 5044, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5044)
         0.041707136 = weight(abstract_txt:retrieval in 5044) [ClassicSimilarity], result of:
           0.041707136 = score(doc=5044,freq=6.0), product of:
             0.08959307 = queryWeight, product of:
               1.4666283 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017578512 = queryNorm
             0.46551743 = fieldWeight in 5044, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5044)
         0.049190607 = weight(abstract_txt:documents in 5044) [ClassicSimilarity], result of:
           0.049190607 = score(doc=5044,freq=3.0), product of:
             0.12600826 = queryWeight, product of:
               1.7393315 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.017578512 = queryNorm
             0.39037606 = fieldWeight in 5044, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5044)
         0.09982342 = weight(abstract_txt:collection in 5044) [ClassicSimilarity], result of:
           0.09982342 = score(doc=5044,freq=6.0), product of:
             0.16030824 = queryWeight, product of:
               1.9618274 = boost
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.017578512 = queryNorm
             0.62269676 = fieldWeight in 5044, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5044)
         0.06952732 = weight(abstract_txt:test in 5044) [ClassicSimilarity], result of:
           0.06952732 = score(doc=5044,freq=1.0), product of:
             0.25192302 = queryWeight, product of:
               2.8397896 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.017578512 = queryNorm
             0.27598637 = fieldWeight in 5044, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5044)
         0.0954993 = weight(abstract_txt:question in 5044) [ClassicSimilarity], result of:
           0.0954993 = score(doc=5044,freq=1.0), product of:
             0.33532634 = queryWeight, product of:
               3.663035 = boost
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.017578512 = queryNorm
             0.2847951 = fieldWeight in 5044, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5044)
         0.20092382 = weight(abstract_txt:answering in 5044) [ClassicSimilarity], result of:
           0.20092382 = score(doc=5044,freq=1.0), product of:
             0.55058175 = queryWeight, product of:
               4.6937304 = boost
               6.6730065 = idf(docFreq=151, maxDocs=44218)
               0.017578512 = queryNorm
             0.36493003 = fieldWeight in 5044, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6730065 = idf(docFreq=151, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5044)
       0.44 = coord(11/25)
   

3. Saint-Dizier, P.; Moens, M.-F.: Knowledge and reasoning for question answering : research perspectives (2011) 0.30

   0.29848227 = sum of:
     0.29848227 = product of:
       1.2436762 = sum of:
         0.00925247 = weight(abstract_txt:that in 2746) [ClassicSimilarity], result of:
           0.00925247 = score(doc=2746,freq=1.0), product of:
             0.04165185 = queryWeight, product of:
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.017578512 = queryNorm
             0.22213829 = fieldWeight in 2746, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.09375 = fieldNorm(doc=2746)
         0.009771983 = weight(abstract_txt:this in 2746) [ClassicSimilarity], result of:
           0.009771983 = score(doc=2746,freq=1.0), product of:
             0.043196738 = queryWeight, product of:
               1.0183765 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.017578512 = queryNorm
             0.2262204 = fieldWeight in 2746, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.09375 = fieldNorm(doc=2746)
         0.033914804 = weight(abstract_txt:language in 2746) [ClassicSimilarity], result of:
           0.033914804 = score(doc=2746,freq=1.0), product of:
             0.086501755 = queryWeight, product of:
               1.1766565 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.017578512 = queryNorm
             0.3920707 = fieldWeight in 2746, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.09375 = fieldNorm(doc=2746)
         0.13578168 = weight(abstract_txt:answer in 2746) [ClassicSimilarity], result of:
           0.13578168 = score(doc=2746,freq=2.0), product of:
             0.17310762 = queryWeight, product of:
               1.6645442 = boost
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.017578512 = queryNorm
             0.7843772 = fieldWeight in 2746, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.09375 = fieldNorm(doc=2746)
         0.36607364 = weight(abstract_txt:question in 2746) [ClassicSimilarity], result of:
           0.36607364 = score(doc=2746,freq=5.0), product of:
             0.33532634 = queryWeight, product of:
               3.663035 = boost
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.017578512 = queryNorm
             1.0916936 = fieldWeight in 2746, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.09375 = fieldNorm(doc=2746)
         0.6888817 = weight(abstract_txt:answering in 2746) [ClassicSimilarity], result of:
           0.6888817 = score(doc=2746,freq=4.0), product of:
             0.55058175 = queryWeight, product of:
               4.6937304 = boost
               6.6730065 = idf(docFreq=151, maxDocs=44218)
               0.017578512 = queryNorm
             1.2511888 = fieldWeight in 2746, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.6730065 = idf(docFreq=151, maxDocs=44218)
               0.09375 = fieldNorm(doc=2746)
       0.24 = coord(6/25)
   

4. Ferret, O.; Grau, B.; Hurault-Plantet, M.; Illouz, G.; Jacquemin, C.; Monceaux, L.; Robba, I.; Vilnat, A.: How NLP can improve question answering (2002) 0.29

   0.2921166 = sum of:
     0.2921166 = product of:
       0.91286445 = sum of:
         0.007710392 = weight(abstract_txt:that in 1850) [ClassicSimilarity], result of:
           0.007710392 = score(doc=1850,freq=1.0), product of:
             0.04165185 = queryWeight, product of:
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.017578512 = queryNorm
             0.18511525 = fieldWeight in 1850, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=1850)
         0.008143319 = weight(abstract_txt:this in 1850) [ClassicSimilarity], result of:
           0.008143319 = score(doc=1850,freq=1.0), product of:
             0.043196738 = queryWeight, product of:
               1.0183765 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.017578512 = queryNorm
             0.18851699 = fieldWeight in 1850, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.078125 = fieldNorm(doc=1850)
         0.028262336 = weight(abstract_txt:language in 1850) [ClassicSimilarity], result of:
           0.028262336 = score(doc=1850,freq=1.0), product of:
             0.086501755 = queryWeight, product of:
               1.1766565 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.017578512 = queryNorm
             0.32672557 = fieldWeight in 1850, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.078125 = fieldNorm(doc=1850)
         0.030562757 = weight(abstract_txt:document in 1850) [ClassicSimilarity], result of:
           0.030562757 = score(doc=1850,freq=1.0), product of:
             0.09113417 = queryWeight, product of:
               1.2077522 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.017578512 = queryNorm
             0.33536002 = fieldWeight in 1850, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.078125 = fieldNorm(doc=1850)
         0.1385816 = weight(abstract_txt:answer in 1850) [ClassicSimilarity], result of:
           0.1385816 = score(doc=1850,freq=3.0), product of:
             0.17310762 = queryWeight, product of:
               1.6645442 = boost
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.017578512 = queryNorm
             0.8005517 = fieldWeight in 1850, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.078125 = fieldNorm(doc=1850)
         0.057377093 = weight(abstract_txt:documents in 1850) [ClassicSimilarity], result of:
           0.057377093 = score(doc=1850,freq=2.0), product of:
             0.12600826 = queryWeight, product of:
               1.7393315 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.017578512 = queryNorm
             0.4553439 = fieldWeight in 1850, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.078125 = fieldNorm(doc=1850)
         0.2362995 = weight(abstract_txt:question in 1850) [ClassicSimilarity], result of:
           0.2362995 = score(doc=1850,freq=3.0), product of:
             0.33532634 = queryWeight, product of:
               3.663035 = boost
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.017578512 = queryNorm
             0.70468515 = fieldWeight in 1850, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.078125 = fieldNorm(doc=1850)
         0.40592745 = weight(abstract_txt:answering in 1850) [ClassicSimilarity], result of:
           0.40592745 = score(doc=1850,freq=2.0), product of:
             0.55058175 = queryWeight, product of:
               4.6937304 = boost
               6.6730065 = idf(docFreq=151, maxDocs=44218)
               0.017578512 = queryNorm
             0.73727006 = fieldWeight in 1850, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.6730065 = idf(docFreq=151, maxDocs=44218)
               0.078125 = fieldNorm(doc=1850)
       0.32 = coord(8/25)
   

5. Galitsky, B.: Can many agents answer questions better than one? (2005) 0.29

   0.2913376 = sum of:
     0.2913376 = product of:
       1.2139068 = sum of:
         0.010904141 = weight(abstract_txt:that in 3094) [ClassicSimilarity], result of:
           0.010904141 = score(doc=3094,freq=2.0), product of:
             0.04165185 = queryWeight, product of:
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.017578512 = queryNorm
             0.26179248 = fieldWeight in 3094, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=3094)
         0.028262336 = weight(abstract_txt:language in 3094) [ClassicSimilarity], result of:
           0.028262336 = score(doc=3094,freq=1.0), product of:
             0.086501755 = queryWeight, product of:
               1.1766565 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.017578512 = queryNorm
             0.32672557 = fieldWeight in 3094, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.078125 = fieldNorm(doc=3094)
         0.024324093 = weight(abstract_txt:retrieval in 3094) [ClassicSimilarity], result of:
           0.024324093 = score(doc=3094,freq=1.0), product of:
             0.08959307 = queryWeight, product of:
               1.4666283 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.017578512 = queryNorm
             0.27149525 = fieldWeight in 3094, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=3094)
         0.1131514 = weight(abstract_txt:answer in 3094) [ClassicSimilarity], result of:
           0.1131514 = score(doc=3094,freq=2.0), product of:
             0.17310762 = queryWeight, product of:
               1.6645442 = boost
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.017578512 = queryNorm
             0.6536477 = fieldWeight in 3094, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.916144 = idf(docFreq=323, maxDocs=44218)
               0.078125 = fieldNorm(doc=3094)
         0.33417797 = weight(abstract_txt:question in 3094) [ClassicSimilarity], result of:
           0.33417797 = score(doc=3094,freq=6.0), product of:
             0.33532634 = queryWeight, product of:
               3.663035 = boost
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.017578512 = queryNorm
             0.99657536 = fieldWeight in 3094, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.207682 = idf(docFreq=657, maxDocs=44218)
               0.078125 = fieldNorm(doc=3094)
         0.7030869 = weight(abstract_txt:answering in 3094) [ClassicSimilarity], result of:
           0.7030869 = score(doc=3094,freq=6.0), product of:
             0.55058175 = queryWeight, product of:
               4.6937304 = boost
               6.6730065 = idf(docFreq=151, maxDocs=44218)
               0.017578512 = queryNorm
             1.2769891 = fieldWeight in 3094, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.6730065 = idf(docFreq=151, maxDocs=44218)
               0.078125 = fieldNorm(doc=3094)
       0.24 = coord(6/25)