Document (#34085)

Author
Wong, W.S.
Luk, R.W.P.
Leong, H.V.
Ho, K.S.
Lee, D.L.
Title
Re-examining the effects of adding relevance information in a relevance feedback environment
Source
Information processing and management. 44(2008) no.3, S.1086-1116
Year
2008
Abstract
This paper presents an investigation about how to automatically formulate effective queries using full or partial relevance information (i.e., the terms that are in relevant documents) in the context of relevance feedback (RF). The effects of adding relevance information in the RF environment are studied via controlled experiments. The conditions of these controlled experiments are formalized into a set of assumptions that form the framework of our study. This framework is called idealized relevance feedback (IRF) framework. In our IRF settings, we confirm the previous findings of relevance feedback studies. In addition, our experiments show that better retrieval effectiveness can be obtained when (i) we normalize the term weights by their ranks, (ii) we select weighted terms in the top K retrieved documents, (iii) we include terms in the initial title queries, and (iv) we use the best query sizes for each topic instead of the average best query size where they produce at most five percentage points improvement in the mean average precision (MAP) value. We have also achieved a new level of retrieval effectiveness which is about 55-60% MAP instead of 40+% in the previous findings. This new level of retrieval effectiveness was found to be similar to a level using a TREC ad hoc test collection that is about double the number of documents in the TREC-3 test collection used in previous works.

Similar documents (author)

  1. Lan, K.C.; Ho, K.S.; Luk, R.W.P.; Leong, H.V.: Dialogue act recognition using maximum entropy (2008) 2.50 
    2.5039487 = sum of:
  2.5039487 = product of:
    3.755923 = sum of:
      1.7730998 = weight(author_txt:r.w.p in 1717) [ClassicSimilarity], result of:
        1.7730998 = score(doc=1717,freq=1.0), product of:
          0.6039745 = queryWeight, product of:
            1.1455936 = boost
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.05612075 = queryNorm
          2.9357195 = fieldWeight in 1717, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.3125 = fieldNorm(doc=1717)
      1.9828233 = weight(author_txt:leong in 1717) [ClassicSimilarity], result of:
        1.9828233 = score(doc=1717,freq=1.0), product of:
          0.65070754 = queryWeight, product of:
            1.1890886 = boost
            9.7509775 = idf(docFreq=6, maxDocs=44218)
            0.05612075 = queryNorm
          3.0471804 = fieldWeight in 1717, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.7509775 = idf(docFreq=6, maxDocs=44218)
            0.3125 = fieldNorm(doc=1717)
    0.6666667 = coord(2/3)
  2. Luk, R.W.P.; Leong, H.V.; Dillon, T.S.; Chan, A.T.S.; Croft, W.B.; Allen, J.: ¬A survey in indexing and searching XML documents (2002) 2.00 
    2.003159 = sum of:
  2.003159 = product of:
    3.0047383 = sum of:
      1.4184798 = weight(author_txt:r.w.p in 460) [ClassicSimilarity], result of:
        1.4184798 = score(doc=460,freq=1.0), product of:
          0.6039745 = queryWeight, product of:
            1.1455936 = boost
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.05612075 = queryNorm
          2.3485756 = fieldWeight in 460, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.25 = fieldNorm(doc=460)
      1.5862586 = weight(author_txt:leong in 460) [ClassicSimilarity], result of:
        1.5862586 = score(doc=460,freq=1.0), product of:
          0.65070754 = queryWeight, product of:
            1.1890886 = boost
            9.7509775 = idf(docFreq=6, maxDocs=44218)
            0.05612075 = queryNorm
          2.4377444 = fieldWeight in 460, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.7509775 = idf(docFreq=6, maxDocs=44218)
            0.25 = fieldNorm(doc=460)
    0.6666667 = coord(2/3)
  3. Wu, H.C.; Luk, R.W.P.; Wong, K.F,; Kwok, K.L.: ¬A retrospective study of a hybrid document-context based retrieval model (2007) 1.97 
    1.9682974 = sum of:
  1.9682974 = product of:
    2.952446 = sum of:
      1.1793463 = weight(author_txt:wong in 936) [ClassicSimilarity], result of:
        1.1793463 = score(doc=936,freq=1.0), product of:
          0.46021143 = queryWeight, product of:
            8.200379 = idf(docFreq=32, maxDocs=44218)
            0.05612075 = queryNorm
          2.5626185 = fieldWeight in 936, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.200379 = idf(docFreq=32, maxDocs=44218)
            0.3125 = fieldNorm(doc=936)
      1.7730998 = weight(author_txt:r.w.p in 936) [ClassicSimilarity], result of:
        1.7730998 = score(doc=936,freq=1.0), product of:
          0.6039745 = queryWeight, product of:
            1.1455936 = boost
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.05612075 = queryNorm
          2.9357195 = fieldWeight in 936, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.394302 = idf(docFreq=9, maxDocs=44218)
            0.3125 = fieldNorm(doc=936)
    0.6666667 = coord(2/3)
  4. Leong, J.H.-t.: ¬The convergence of metadata and bibliographic control? : trends and patterns in addressing the current issues and challenges of providing subject access (2010) 1.06 
    1.0575058 = sum of:
  1.0575058 = product of:
    3.1725173 = sum of:
      3.1725173 = weight(author_txt:leong in 3355) [ClassicSimilarity], result of:
        3.1725173 = score(doc=3355,freq=1.0), product of:
          0.65070754 = queryWeight, product of:
            1.1890886 = boost
            9.7509775 = idf(docFreq=6, maxDocs=44218)
            0.05612075 = queryNorm
          4.8754888 = fieldWeight in 3355, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.7509775 = idf(docFreq=6, maxDocs=44218)
            0.5 = fieldNorm(doc=3355)
    0.33333334 = coord(1/3)
  5. Yang, L.; Ji, D.; Leong, M.: Document reranking by term distribution and maximal marginal relevance for chinese information retrieval (2007) 0.79 
    0.7931294 = sum of:
  0.7931294 = product of:
    2.379388 = sum of:
      2.379388 = weight(author_txt:leong in 907) [ClassicSimilarity], result of:
        2.379388 = score(doc=907,freq=1.0), product of:
          0.65070754 = queryWeight, product of:
            1.1890886 = boost
            9.7509775 = idf(docFreq=6, maxDocs=44218)
            0.05612075 = queryNorm
          3.6566167 = fieldWeight in 907, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.7509775 = idf(docFreq=6, maxDocs=44218)
            0.375 = fieldNorm(doc=907)
    0.33333334 = coord(1/3)

Similar documents (content)

  1. Vakkari, P.; Sormunen, E.: ¬The influence of relevance levels an the effectiveness of interactive information retrieval (2004) 0.71 
    0.707189 = sum of:
  0.707189 = product of:
    1.3599789 = sum of:
      0.04068347 = weight(abstract_txt:collection in 2884) [ClassicSimilarity], result of:
        0.04068347 = score(doc=2884,freq=1.0), product of:
          0.11202503 = queryWeight, product of:
            4.648501 = idf(docFreq=1150, maxDocs=44218)
            0.024099173 = queryNorm
          0.36316413 = fieldWeight in 2884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.648501 = idf(docFreq=1150, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.015239849 = weight(abstract_txt:that in 2884) [ClassicSimilarity], result of:
        0.015239849 = score(doc=2884,freq=2.0), product of:
          0.05821347 = queryWeight, product of:
            1.0194577 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.024099173 = queryNorm
          0.26179248 = fieldWeight in 2884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.07536208 = weight(abstract_txt:query in 2884) [ClassicSimilarity], result of:
        0.07536208 = score(doc=2884,freq=3.0), product of:
          0.11715601 = queryWeight, product of:
            1.0226446 = boost
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.024099173 = queryNorm
          0.6432626 = fieldWeight in 2884, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.052056856 = weight(abstract_txt:test in 2884) [ClassicSimilarity], result of:
        0.052056856 = score(doc=2884,freq=1.0), product of:
          0.13203478 = queryWeight, product of:
            1.085642 = boost
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.024099173 = queryNorm
          0.39426625 = fieldWeight in 2884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.036058042 = weight(abstract_txt:retrieval in 2884) [ClassicSimilarity], result of:
        0.036058042 = score(doc=2884,freq=2.0), product of:
          0.093912825 = queryWeight, product of:
            1.1213741 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.024099173 = queryNorm
          0.38395226 = fieldWeight in 2884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.036628965 = weight(abstract_txt:about in 2884) [ClassicSimilarity], result of:
        0.036628965 = score(doc=2884,freq=1.0), product of:
          0.119568445 = queryWeight, product of:
            1.2653084 = boost
            3.9211915 = idf(docFreq=2381, maxDocs=44218)
            0.024099173 = queryNorm
          0.30634308 = fieldWeight in 2884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.9211915 = idf(docFreq=2381, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.08505581 = weight(abstract_txt:documents in 2884) [ClassicSimilarity], result of:
        0.08505581 = score(doc=2884,freq=4.0), product of:
          0.13208377 = queryWeight, product of:
            1.3298812 = boost
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.024099173 = queryNorm
          0.64395356 = fieldWeight in 2884, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.1722485 = weight(abstract_txt:trec in 2884) [ClassicSimilarity], result of:
        0.1722485 = score(doc=2884,freq=2.0), product of:
          0.23270017 = queryWeight, product of:
            1.441255 = boost
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.024099173 = queryNorm
          0.7402165 = fieldWeight in 2884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.05528612 = weight(abstract_txt:level in 2884) [ClassicSimilarity], result of:
        0.05528612 = score(doc=2884,freq=1.0), product of:
          0.15732977 = queryWeight, product of:
            1.4514215 = boost
            4.497956 = idf(docFreq=1337, maxDocs=44218)
            0.024099173 = queryNorm
          0.3514028 = fieldWeight in 2884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.497956 = idf(docFreq=1337, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.08051312 = weight(abstract_txt:effectiveness in 2884) [ClassicSimilarity], result of:
        0.08051312 = score(doc=2884,freq=1.0), product of:
          0.20213643 = queryWeight, product of:
            1.6451685 = boost
            5.098378 = idf(docFreq=733, maxDocs=44218)
            0.024099173 = queryNorm
          0.39831078 = fieldWeight in 2884, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.098378 = idf(docFreq=733, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.13012746 = weight(abstract_txt:experiments in 2884) [ClassicSimilarity], result of:
        0.13012746 = score(doc=2884,freq=2.0), product of:
          0.22095448 = queryWeight, product of:
            1.7200438 = boost
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.024099173 = queryNorm
          0.58893335 = fieldWeight in 2884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.24061882 = weight(abstract_txt:feedback in 2884) [ClassicSimilarity], result of:
        0.24061882 = score(doc=2884,freq=2.0), product of:
          0.3663724 = queryWeight, product of:
            2.557519 = boost
            5.9443145 = idf(docFreq=314, maxDocs=44218)
            0.024099173 = queryNorm
          0.6567602 = fieldWeight in 2884, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.9443145 = idf(docFreq=314, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
      0.34009978 = weight(abstract_txt:relevance in 2884) [ClassicSimilarity], result of:
        0.34009978 = score(doc=2884,freq=4.0), product of:
          0.4413434 = queryWeight, product of:
            3.713341 = boost
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.024099173 = queryNorm
          0.7706013 = fieldWeight in 2884, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.078125 = fieldNorm(doc=2884)
    0.52 = coord(13/25)
  2. Dang, E.K.F.; Luk, R.W.P.; Allan, J.: ¬A context-dependent relevance model (2016) 0.56 
    0.5595756 = sum of:
  0.5595756 = product of:
    1.1657826 = sum of:
      0.012191879 = weight(abstract_txt:that in 2778) [ClassicSimilarity], result of:
        0.012191879 = score(doc=2778,freq=2.0), product of:
          0.05821347 = queryWeight, product of:
            1.0194577 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.024099173 = queryNorm
          0.20943399 = fieldWeight in 2778, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.0625 = fieldNorm(doc=2778)
      0.060289666 = weight(abstract_txt:query in 2778) [ClassicSimilarity], result of:
        0.060289666 = score(doc=2778,freq=3.0), product of:
          0.11715601 = queryWeight, product of:
            1.0226446 = boost
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.024099173 = queryNorm
          0.5146101 = fieldWeight in 2778, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.0625 = fieldNorm(doc=2778)
      0.04079502 = weight(abstract_txt:retrieval in 2778) [ClassicSimilarity], result of:
        0.04079502 = score(doc=2778,freq=4.0), product of:
          0.093912825 = queryWeight, product of:
            1.1213741 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.024099173 = queryNorm
          0.43439242 = fieldWeight in 2778, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0625 = fieldNorm(doc=2778)
      0.04545336 = weight(abstract_txt:terms in 2778) [ClassicSimilarity], result of:
        0.04545336 = score(doc=2778,freq=2.0), product of:
          0.12716691 = queryWeight, product of:
            1.3048937 = boost
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.024099173 = queryNorm
          0.3574307 = fieldWeight in 2778, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.0625 = fieldNorm(doc=2778)
      0.034022324 = weight(abstract_txt:documents in 2778) [ClassicSimilarity], result of:
        0.034022324 = score(doc=2778,freq=1.0), product of:
          0.13208377 = queryWeight, product of:
            1.3298812 = boost
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.024099173 = queryNorm
          0.2575814 = fieldWeight in 2778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.0625 = fieldNorm(doc=2778)
      0.09743847 = weight(abstract_txt:trec in 2778) [ClassicSimilarity], result of:
        0.09743847 = score(doc=2778,freq=1.0), product of:
          0.23270017 = queryWeight, product of:
            1.441255 = boost
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.024099173 = queryNorm
          0.4187297 = fieldWeight in 2778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.0625 = fieldNorm(doc=2778)
      0.06478406 = weight(abstract_txt:framework in 2778) [ClassicSimilarity], result of:
        0.06478406 = score(doc=2778,freq=2.0), product of:
          0.1610555 = queryWeight, product of:
            1.4685066 = boost
            4.550903 = idf(docFreq=1268, maxDocs=44218)
            0.024099173 = queryNorm
          0.40224677 = fieldWeight in 2778, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.550903 = idf(docFreq=1268, maxDocs=44218)
            0.0625 = fieldNorm(doc=2778)
      0.091090195 = weight(abstract_txt:effectiveness in 2778) [ClassicSimilarity], result of:
        0.091090195 = score(doc=2778,freq=2.0), product of:
          0.20213643 = queryWeight, product of:
            1.6451685 = boost
            5.098378 = idf(docFreq=733, maxDocs=44218)
            0.024099173 = queryNorm
          0.45063722 = fieldWeight in 2778, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.098378 = idf(docFreq=733, maxDocs=44218)
            0.0625 = fieldNorm(doc=2778)
      0.069682896 = weight(abstract_txt:previous in 2778) [ClassicSimilarity], result of:
        0.069682896 = score(doc=2778,freq=1.0), product of:
          0.21302192 = queryWeight, product of:
            1.6888856 = boost
            5.2338576 = idf(docFreq=640, maxDocs=44218)
            0.024099173 = queryNorm
          0.3271161 = fieldWeight in 2778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.2338576 = idf(docFreq=640, maxDocs=44218)
            0.0625 = fieldNorm(doc=2778)
      0.073611215 = weight(abstract_txt:experiments in 2778) [ClassicSimilarity], result of:
        0.073611215 = score(doc=2778,freq=1.0), product of:
          0.22095448 = queryWeight, product of:
            1.7200438 = boost
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.024099173 = queryNorm
          0.33315104 = fieldWeight in 2778, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.0625 = fieldNorm(doc=2778)
      0.2722291 = weight(abstract_txt:feedback in 2778) [ClassicSimilarity], result of:
        0.2722291 = score(doc=2778,freq=4.0), product of:
          0.3663724 = queryWeight, product of:
            2.557519 = boost
            5.9443145 = idf(docFreq=314, maxDocs=44218)
            0.024099173 = queryNorm
          0.7430393 = fieldWeight in 2778, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            5.9443145 = idf(docFreq=314, maxDocs=44218)
            0.0625 = fieldNorm(doc=2778)
      0.30419448 = weight(abstract_txt:relevance in 2778) [ClassicSimilarity], result of:
        0.30419448 = score(doc=2778,freq=5.0), product of:
          0.4413434 = queryWeight, product of:
            3.713341 = boost
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.024099173 = queryNorm
          0.6892467 = fieldWeight in 2778, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.0625 = fieldNorm(doc=2778)
    0.48 = coord(12/25)
  3. Meij, E.; Rijke, M. de: Thesaurus-based feedback to support mixed search and browsing environments (2007) 0.55 
    0.55413735 = sum of:
  0.55413735 = product of:
    0.989531 = sum of:
      0.008620961 = weight(abstract_txt:that in 2432) [ClassicSimilarity], result of:
        0.008620961 = score(doc=2432,freq=1.0), product of:
          0.05821347 = queryWeight, product of:
            1.0194577 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.024099173 = queryNorm
          0.1480922 = fieldWeight in 2432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.0625 = fieldNorm(doc=2432)
      0.049226306 = weight(abstract_txt:query in 2432) [ClassicSimilarity], result of:
        0.049226306 = score(doc=2432,freq=2.0), product of:
          0.11715601 = queryWeight, product of:
            1.0226446 = boost
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.024099173 = queryNorm
          0.4201774 = fieldWeight in 2432, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.0625 = fieldNorm(doc=2432)
      0.041645486 = weight(abstract_txt:test in 2432) [ClassicSimilarity], result of:
        0.041645486 = score(doc=2432,freq=1.0), product of:
          0.13203478 = queryWeight, product of:
            1.085642 = boost
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.024099173 = queryNorm
          0.315413 = fieldWeight in 2432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.0625 = fieldNorm(doc=2432)
      0.043148052 = weight(abstract_txt:queries in 2432) [ClassicSimilarity], result of:
        0.043148052 = score(doc=2432,freq=1.0), product of:
          0.13519186 = queryWeight, product of:
            1.0985447 = boost
            5.106586 = idf(docFreq=727, maxDocs=44218)
            0.024099173 = queryNorm
          0.31916162 = fieldWeight in 2432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.106586 = idf(docFreq=727, maxDocs=44218)
            0.0625 = fieldNorm(doc=2432)
      0.02039751 = weight(abstract_txt:retrieval in 2432) [ClassicSimilarity], result of:
        0.02039751 = score(doc=2432,freq=1.0), product of:
          0.093912825 = queryWeight, product of:
            1.1213741 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.024099173 = queryNorm
          0.21719621 = fieldWeight in 2432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0625 = fieldNorm(doc=2432)
      0.052418247 = weight(abstract_txt:controlled in 2432) [ClassicSimilarity], result of:
        0.052418247 = score(doc=2432,freq=1.0), product of:
          0.15392107 = queryWeight, product of:
            1.1721724 = boost
            5.4488444 = idf(docFreq=516, maxDocs=44218)
            0.024099173 = queryNorm
          0.34055278 = fieldWeight in 2432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.4488444 = idf(docFreq=516, maxDocs=44218)
            0.0625 = fieldNorm(doc=2432)
      0.066885106 = weight(abstract_txt:average in 2432) [ClassicSimilarity], result of:
        0.066885106 = score(doc=2432,freq=1.0), product of:
          0.18107675 = queryWeight, product of:
            1.2713754 = boost
            5.90999 = idf(docFreq=325, maxDocs=44218)
            0.024099173 = queryNorm
          0.36937436 = fieldWeight in 2432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.90999 = idf(docFreq=325, maxDocs=44218)
            0.0625 = fieldNorm(doc=2432)
      0.032140378 = weight(abstract_txt:terms in 2432) [ClassicSimilarity], result of:
        0.032140378 = score(doc=2432,freq=1.0), product of:
          0.12716691 = queryWeight, product of:
            1.3048937 = boost
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.024099173 = queryNorm
          0.25274166 = fieldWeight in 2432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.0625 = fieldNorm(doc=2432)
      0.034022324 = weight(abstract_txt:documents in 2432) [ClassicSimilarity], result of:
        0.034022324 = score(doc=2432,freq=1.0), product of:
          0.13208377 = queryWeight, product of:
            1.3298812 = boost
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.024099173 = queryNorm
          0.2575814 = fieldWeight in 2432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.0625 = fieldNorm(doc=2432)
      0.09743847 = weight(abstract_txt:trec in 2432) [ClassicSimilarity], result of:
        0.09743847 = score(doc=2432,freq=1.0), product of:
          0.23270017 = queryWeight, product of:
            1.441255 = boost
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.024099173 = queryNorm
          0.4187297 = fieldWeight in 2432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.0625 = fieldNorm(doc=2432)
      0.044228896 = weight(abstract_txt:level in 2432) [ClassicSimilarity], result of:
        0.044228896 = score(doc=2432,freq=1.0), product of:
          0.15732977 = queryWeight, product of:
            1.4514215 = boost
            4.497956 = idf(docFreq=1337, maxDocs=44218)
            0.024099173 = queryNorm
          0.28112224 = fieldWeight in 2432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.497956 = idf(docFreq=1337, maxDocs=44218)
            0.0625 = fieldNorm(doc=2432)
      0.091090195 = weight(abstract_txt:effectiveness in 2432) [ClassicSimilarity], result of:
        0.091090195 = score(doc=2432,freq=2.0), product of:
          0.20213643 = queryWeight, product of:
            1.6451685 = boost
            5.098378 = idf(docFreq=733, maxDocs=44218)
            0.024099173 = queryNorm
          0.45063722 = fieldWeight in 2432, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.098378 = idf(docFreq=733, maxDocs=44218)
            0.0625 = fieldNorm(doc=2432)
      0.2722291 = weight(abstract_txt:feedback in 2432) [ClassicSimilarity], result of:
        0.2722291 = score(doc=2432,freq=4.0), product of:
          0.3663724 = queryWeight, product of:
            2.557519 = boost
            5.9443145 = idf(docFreq=314, maxDocs=44218)
            0.024099173 = queryNorm
          0.7430393 = fieldWeight in 2432, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            5.9443145 = idf(docFreq=314, maxDocs=44218)
            0.0625 = fieldNorm(doc=2432)
      0.13603991 = weight(abstract_txt:relevance in 2432) [ClassicSimilarity], result of:
        0.13603991 = score(doc=2432,freq=1.0), product of:
          0.4413434 = queryWeight, product of:
            3.713341 = boost
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.024099173 = queryNorm
          0.3082405 = fieldWeight in 2432, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.0625 = fieldNorm(doc=2432)
    0.56 = coord(14/25)
  4. Ye, Z.; Huang, J.X.: ¬A learning to rank approach for quality-aware pseudo-relevance feedback (2016) 0.54 
    0.5370253 = sum of:
  0.5370253 = product of:
    1.1188027 = sum of:
      0.008620961 = weight(abstract_txt:that in 2855) [ClassicSimilarity], result of:
        0.008620961 = score(doc=2855,freq=1.0), product of:
          0.05821347 = queryWeight, product of:
            1.0194577 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.024099173 = queryNorm
          0.1480922 = fieldWeight in 2855, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.0625 = fieldNorm(doc=2855)
      0.041645486 = weight(abstract_txt:test in 2855) [ClassicSimilarity], result of:
        0.041645486 = score(doc=2855,freq=1.0), product of:
          0.13203478 = queryWeight, product of:
            1.085642 = boost
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.024099173 = queryNorm
          0.315413 = fieldWeight in 2855, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.046608 = idf(docFreq=772, maxDocs=44218)
            0.0625 = fieldNorm(doc=2855)
      0.028846433 = weight(abstract_txt:retrieval in 2855) [ClassicSimilarity], result of:
        0.028846433 = score(doc=2855,freq=2.0), product of:
          0.093912825 = queryWeight, product of:
            1.1213741 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.024099173 = queryNorm
          0.3071618 = fieldWeight in 2855, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0625 = fieldNorm(doc=2855)
      0.032140378 = weight(abstract_txt:terms in 2855) [ClassicSimilarity], result of:
        0.032140378 = score(doc=2855,freq=1.0), product of:
          0.12716691 = queryWeight, product of:
            1.3048937 = boost
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.024099173 = queryNorm
          0.25274166 = fieldWeight in 2855, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.0625 = fieldNorm(doc=2855)
      0.058928393 = weight(abstract_txt:documents in 2855) [ClassicSimilarity], result of:
        0.058928393 = score(doc=2855,freq=3.0), product of:
          0.13208377 = queryWeight, product of:
            1.3298812 = boost
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.024099173 = queryNorm
          0.44614407 = fieldWeight in 2855, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.0625 = fieldNorm(doc=2855)
      0.09743847 = weight(abstract_txt:trec in 2855) [ClassicSimilarity], result of:
        0.09743847 = score(doc=2855,freq=1.0), product of:
          0.23270017 = queryWeight, product of:
            1.441255 = boost
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.024099173 = queryNorm
          0.4187297 = fieldWeight in 2855, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.0625 = fieldNorm(doc=2855)
      0.06254911 = weight(abstract_txt:level in 2855) [ClassicSimilarity], result of:
        0.06254911 = score(doc=2855,freq=2.0), product of:
          0.15732977 = queryWeight, product of:
            1.4514215 = boost
            4.497956 = idf(docFreq=1337, maxDocs=44218)
            0.024099173 = queryNorm
          0.39756688 = fieldWeight in 2855, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.497956 = idf(docFreq=1337, maxDocs=44218)
            0.0625 = fieldNorm(doc=2855)
      0.045809247 = weight(abstract_txt:framework in 2855) [ClassicSimilarity], result of:
        0.045809247 = score(doc=2855,freq=1.0), product of:
          0.1610555 = queryWeight, product of:
            1.4685066 = boost
            4.550903 = idf(docFreq=1268, maxDocs=44218)
            0.024099173 = queryNorm
          0.28443143 = fieldWeight in 2855, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.550903 = idf(docFreq=1268, maxDocs=44218)
            0.0625 = fieldNorm(doc=2855)
      0.069682896 = weight(abstract_txt:previous in 2855) [ClassicSimilarity], result of:
        0.069682896 = score(doc=2855,freq=1.0), product of:
          0.21302192 = queryWeight, product of:
            1.6888856 = boost
            5.2338576 = idf(docFreq=640, maxDocs=44218)
            0.024099173 = queryNorm
          0.3271161 = fieldWeight in 2855, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.2338576 = idf(docFreq=640, maxDocs=44218)
            0.0625 = fieldNorm(doc=2855)
      0.10410197 = weight(abstract_txt:experiments in 2855) [ClassicSimilarity], result of:
        0.10410197 = score(doc=2855,freq=2.0), product of:
          0.22095448 = queryWeight, product of:
            1.7200438 = boost
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.024099173 = queryNorm
          0.4711467 = fieldWeight in 2855, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.0625 = fieldNorm(doc=2855)
      0.33341122 = weight(abstract_txt:feedback in 2855) [ClassicSimilarity], result of:
        0.33341122 = score(doc=2855,freq=6.0), product of:
          0.3663724 = queryWeight, product of:
            2.557519 = boost
            5.9443145 = idf(docFreq=314, maxDocs=44218)
            0.024099173 = queryNorm
          0.91003364 = fieldWeight in 2855, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            5.9443145 = idf(docFreq=314, maxDocs=44218)
            0.0625 = fieldNorm(doc=2855)
      0.23562804 = weight(abstract_txt:relevance in 2855) [ClassicSimilarity], result of:
        0.23562804 = score(doc=2855,freq=3.0), product of:
          0.4413434 = queryWeight, product of:
            3.713341 = boost
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.024099173 = queryNorm
          0.5338882 = fieldWeight in 2855, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.0625 = fieldNorm(doc=2855)
    0.48 = coord(12/25)
  5. Wu, H.C.; Luk, R.W.P.; Wong, K.F,; Kwok, K.L.: ¬A retrospective study of a hybrid document-context based retrieval model (2007) 0.49 
    0.49292213 = sum of:
  0.49292213 = product of:
    0.9479272 = sum of:
      0.02847843 = weight(abstract_txt:collection in 936) [ClassicSimilarity], result of:
        0.02847843 = score(doc=936,freq=1.0), product of:
          0.11202503 = queryWeight, product of:
            4.648501 = idf(docFreq=1150, maxDocs=44218)
            0.024099173 = queryNorm
          0.25421488 = fieldWeight in 936, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.648501 = idf(docFreq=1150, maxDocs=44218)
            0.0546875 = fieldNorm(doc=936)
      0.018477336 = weight(abstract_txt:that in 936) [ClassicSimilarity], result of:
        0.018477336 = score(doc=936,freq=6.0), product of:
          0.05821347 = queryWeight, product of:
            1.0194577 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.024099173 = queryNorm
          0.31740654 = fieldWeight in 936, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.0546875 = fieldNorm(doc=936)
      0.043073017 = weight(abstract_txt:query in 936) [ClassicSimilarity], result of:
        0.043073017 = score(doc=936,freq=2.0), product of:
          0.11715601 = queryWeight, product of:
            1.0226446 = boost
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.024099173 = queryNorm
          0.36765522 = fieldWeight in 936, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.7537646 = idf(docFreq=1035, maxDocs=44218)
            0.0546875 = fieldNorm(doc=936)
      0.03091333 = weight(abstract_txt:retrieval in 936) [ClassicSimilarity], result of:
        0.03091333 = score(doc=936,freq=3.0), product of:
          0.093912825 = queryWeight, product of:
            1.1213741 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.024099173 = queryNorm
          0.3291705 = fieldWeight in 936, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0546875 = fieldNorm(doc=936)
      0.025640275 = weight(abstract_txt:about in 936) [ClassicSimilarity], result of:
        0.025640275 = score(doc=936,freq=1.0), product of:
          0.119568445 = queryWeight, product of:
            1.2653084 = boost
            3.9211915 = idf(docFreq=2381, maxDocs=44218)
            0.024099173 = queryNorm
          0.21444015 = fieldWeight in 936, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.9211915 = idf(docFreq=2381, maxDocs=44218)
            0.0546875 = fieldNorm(doc=936)
      0.058524475 = weight(abstract_txt:average in 936) [ClassicSimilarity], result of:
        0.058524475 = score(doc=936,freq=1.0), product of:
          0.18107675 = queryWeight, product of:
            1.2713754 = boost
            5.90999 = idf(docFreq=325, maxDocs=44218)
            0.024099173 = queryNorm
          0.32320258 = fieldWeight in 936, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.90999 = idf(docFreq=325, maxDocs=44218)
            0.0546875 = fieldNorm(doc=936)
      0.039771687 = weight(abstract_txt:terms in 936) [ClassicSimilarity], result of:
        0.039771687 = score(doc=936,freq=2.0), product of:
          0.12716691 = queryWeight, product of:
            1.3048937 = boost
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.024099173 = queryNorm
          0.31275186 = fieldWeight in 936, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.0438666 = idf(docFreq=2106, maxDocs=44218)
            0.0546875 = fieldNorm(doc=936)
      0.06612923 = weight(abstract_txt:instead in 936) [ClassicSimilarity], result of:
        0.06612923 = score(doc=936,freq=1.0), product of:
          0.19644155 = queryWeight, product of:
            1.324217 = boost
            6.155624 = idf(docFreq=254, maxDocs=44218)
            0.024099173 = queryNorm
          0.33663568 = fieldWeight in 936, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.155624 = idf(docFreq=254, maxDocs=44218)
            0.0546875 = fieldNorm(doc=936)
      0.051562343 = weight(abstract_txt:documents in 936) [ClassicSimilarity], result of:
        0.051562343 = score(doc=936,freq=3.0), product of:
          0.13208377 = queryWeight, product of:
            1.3298812 = boost
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.024099173 = queryNorm
          0.39037606 = fieldWeight in 936, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.0546875 = fieldNorm(doc=936)
      0.085258655 = weight(abstract_txt:trec in 936) [ClassicSimilarity], result of:
        0.085258655 = score(doc=936,freq=1.0), product of:
          0.23270017 = queryWeight, product of:
            1.441255 = boost
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.024099173 = queryNorm
          0.36638847 = fieldWeight in 936, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.699675 = idf(docFreq=147, maxDocs=44218)
            0.0546875 = fieldNorm(doc=936)
      0.07970392 = weight(abstract_txt:effectiveness in 936) [ClassicSimilarity], result of:
        0.07970392 = score(doc=936,freq=2.0), product of:
          0.20213643 = queryWeight, product of:
            1.6451685 = boost
            5.098378 = idf(docFreq=733, maxDocs=44218)
            0.024099173 = queryNorm
          0.39430755 = fieldWeight in 936, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.098378 = idf(docFreq=733, maxDocs=44218)
            0.0546875 = fieldNorm(doc=936)
      0.12881963 = weight(abstract_txt:experiments in 936) [ClassicSimilarity], result of:
        0.12881963 = score(doc=936,freq=4.0), product of:
          0.22095448 = queryWeight, product of:
            1.7200438 = boost
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.024099173 = queryNorm
          0.5830143 = fieldWeight in 936, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            5.3304167 = idf(docFreq=581, maxDocs=44218)
            0.0546875 = fieldNorm(doc=936)
      0.29157484 = weight(abstract_txt:relevance in 936) [ClassicSimilarity], result of:
        0.29157484 = score(doc=936,freq=6.0), product of:
          0.4413434 = queryWeight, product of:
            3.713341 = boost
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.024099173 = queryNorm
          0.660653 = fieldWeight in 936, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            4.931848 = idf(docFreq=866, maxDocs=44218)
            0.0546875 = fieldNorm(doc=936)
    0.52 = coord(13/25)