Document (#33069)

Author

Bar-Ilan, J.

Title

Comparing rankings of search results on the Web

Source

Information processing and management. 41(2005) no.6, S.1511-1519

Year

2005

Abstract

The Web has become an information source for professional data gathering. Because of the vast amounts of information on almost all topics, one cannot systematically go over the whole set of results, and therefore must rely on the ordering of the results by the search engine. It is well known that search engines on the Web have low overlap in terms of coverage. In this study we measure how similar are the rankings of search engines on the overlapping results. We compare rankings of results for identical queries retrieved from several search engines. The method is based only on the set of URLs that appear in the answer sets of the engines being compared. For comparing the similarity of rankings of two search engines, the Spearman correlation coefficient is computed. When comparing more than two sets Kendall's W is used. These are well-known measures and the statistical significance of the results can be computed. The methods are demonstrated on a set of 15 queries that were submitted to four large Web search engines. The findings indicate that the large public search engines on the Web employ considerably different ranking algorithms.

Footnote

Beitrag in einem "Special Issue on Infometrics"

Theme

Suchmaschinen

Similar documents (author)

1. Ilan, J. Bar- => Bar-Ilan, J.: 4.29

   4.2882323 = sum of:
     4.2882323 = weight(author_txt:ilan in 3392) [ClassicSimilarity], result of:
       4.2882323 = fieldWeight in 3392, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         8.085969 = idf(docFreq=36, maxDocs=44218)
         0.375 = fieldNorm(doc=3392)
   

2. Ilan, E. Bar- => Bar-Ilan, E.: 4.29

   4.2882323 = sum of:
     4.2882323 = weight(author_txt:ilan in 3393) [ClassicSimilarity], result of:
       4.2882323 = fieldWeight in 3393, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         8.085969 = idf(docFreq=36, maxDocs=44218)
         0.375 = fieldNorm(doc=3393)
   

3. Bar-Ilan, J.: Information hub blogs (2005) 4.04

   4.0429845 = sum of:
     4.0429845 = weight(author_txt:ilan in 193) [ClassicSimilarity], result of:
       4.0429845 = fieldWeight in 193, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.085969 = idf(docFreq=36, maxDocs=44218)
         0.5 = fieldNorm(doc=193)
   

4. Bar-Ilan, J.: Evaluating the stability of the search tools Hotbot and Snap : a case study (2000) 4.04

   4.0429845 = sum of:
     4.0429845 = weight(author_txt:ilan in 1180) [ClassicSimilarity], result of:
       4.0429845 = fieldWeight in 1180, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.085969 = idf(docFreq=36, maxDocs=44218)
         0.5 = fieldNorm(doc=1180)
   

5. Bar-Ilan, J.: On the overlap, the precision and estimated recall of search engines : a case study of the query 'Erdös' (1998) 4.04

   4.0429845 = sum of:
     4.0429845 = weight(author_txt:ilan in 3753) [ClassicSimilarity], result of:
       4.0429845 = fieldWeight in 3753, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.085969 = idf(docFreq=36, maxDocs=44218)
         0.5 = fieldNorm(doc=3753)
   

Similar documents (content)

1. Bar-Ilan, J.; Levene, M.; Mat-Hassan, M.: Methods for evaluating dynamic changes in search engine rankings : a case study (2006) 0.60

   0.5994794 = sum of:
     0.5994794 = product of:
       1.4986984 = sum of:
         0.06335357 = weight(abstract_txt:overlap in 616) [ClassicSimilarity], result of:
           0.06335357 = score(doc=616,freq=2.0), product of:
             0.11797835 = queryWeight, product of:
               1.010879 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.016808826 = queryNorm
             0.5369932 = fieldWeight in 616, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.0546875 = fieldNorm(doc=616)
         0.054677606 = weight(abstract_txt:identical in 616) [ClassicSimilarity], result of:
           0.054677606 = score(doc=616,freq=1.0), product of:
             0.13474248 = queryWeight, product of:
               1.0803148 = boost
               7.4202213 = idf(docFreq=71, maxDocs=44218)
               0.016808826 = queryNorm
             0.40579337 = fieldWeight in 616, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4202213 = idf(docFreq=71, maxDocs=44218)
               0.0546875 = fieldNorm(doc=616)
         0.012334909 = weight(abstract_txt:that in 616) [ClassicSimilarity], result of:
           0.012334909 = score(doc=616,freq=3.0), product of:
             0.054958533 = queryWeight, product of:
               1.3798935 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.016808826 = queryNorm
             0.22444029 = fieldWeight in 616, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0546875 = fieldNorm(doc=616)
         0.050407577 = weight(abstract_txt:queries in 616) [ClassicSimilarity], result of:
           0.050407577 = score(doc=616,freq=2.0), product of:
             0.12763274 = queryWeight, product of:
               1.4869422 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.016808826 = queryNorm
             0.39494237 = fieldWeight in 616, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0546875 = fieldNorm(doc=616)
         0.11839753 = weight(abstract_txt:computed in 616) [ClassicSimilarity], result of:
           0.11839753 = score(doc=616,freq=1.0), product of:
             0.2841428 = queryWeight, product of:
               2.218612 = boost
               7.61935 = idf(docFreq=58, maxDocs=44218)
               0.016808826 = queryNorm
             0.4166832 = fieldWeight in 616, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.61935 = idf(docFreq=58, maxDocs=44218)
               0.0546875 = fieldNorm(doc=616)
         0.08912886 = weight(abstract_txt:comparing in 616) [ClassicSimilarity], result of:
           0.08912886 = score(doc=616,freq=1.0), product of:
             0.26916435 = queryWeight, product of:
               2.6446452 = boost
               6.0549803 = idf(docFreq=281, maxDocs=44218)
               0.016808826 = queryNorm
             0.33113173 = fieldWeight in 616, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0549803 = idf(docFreq=281, maxDocs=44218)
               0.0546875 = fieldNorm(doc=616)
         0.08972293 = weight(abstract_txt:results in 616) [ClassicSimilarity], result of:
           0.08972293 = score(doc=616,freq=7.0), product of:
             0.17806761 = queryWeight, product of:
               3.0420485 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.016808826 = queryNorm
             0.50387 = fieldWeight in 616, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0546875 = fieldNorm(doc=616)
         0.49410522 = weight(abstract_txt:rankings in 616) [ClassicSimilarity], result of:
           0.49410522 = score(doc=616,freq=8.0), product of:
             0.46398208 = queryWeight, product of:
               4.0093927 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.016808826 = queryNorm
             1.064923 = fieldWeight in 616, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0546875 = fieldNorm(doc=616)
         0.15722439 = weight(abstract_txt:search in 616) [ClassicSimilarity], result of:
           0.15722439 = score(doc=616,freq=9.0), product of:
             0.2619755 = queryWeight, product of:
               4.2606254 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.016808826 = queryNorm
             0.6001492 = fieldWeight in 616, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0546875 = fieldNorm(doc=616)
         0.3693458 = weight(abstract_txt:engines in 616) [ClassicSimilarity], result of:
           0.3693458 = score(doc=616,freq=7.0), product of:
             0.48148972 = queryWeight, product of:
               5.4030695 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.016808826 = queryNorm
             0.7670897 = fieldWeight in 616, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0546875 = fieldNorm(doc=616)
       0.4 = coord(10/25)
   

2. Bar-Ilan, J.; Keenoy, K.; Yaari, E.; Levene, M.: User rankings of search engine results (2007) 0.54

   0.5418262 = sum of:
     0.5418262 = product of:
       1.3545654 = sum of:
         0.08139474 = weight(abstract_txt:urls in 470) [ClassicSimilarity], result of:
           0.08139474 = score(doc=470,freq=2.0), product of:
             0.12755314 = queryWeight, product of:
               1.051099 = boost
               7.2195506 = idf(docFreq=87, maxDocs=44218)
               0.016808826 = queryNorm
             0.63812417 = fieldWeight in 470, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.2195506 = idf(docFreq=87, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.06248869 = weight(abstract_txt:identical in 470) [ClassicSimilarity], result of:
           0.06248869 = score(doc=470,freq=1.0), product of:
             0.13474248 = queryWeight, product of:
               1.0803148 = boost
               7.4202213 = idf(docFreq=71, maxDocs=44218)
               0.016808826 = queryNorm
             0.46376383 = fieldWeight in 470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4202213 = idf(docFreq=71, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.027030718 = weight(abstract_txt:large in 470) [ClassicSimilarity], result of:
           0.027030718 = score(doc=470,freq=1.0), product of:
             0.09709987 = queryWeight, product of:
               1.2969474 = boost
               4.454089 = idf(docFreq=1397, maxDocs=44218)
               0.016808826 = queryNorm
             0.27838057 = fieldWeight in 470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.454089 = idf(docFreq=1397, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.016277859 = weight(abstract_txt:that in 470) [ClassicSimilarity], result of:
           0.016277859 = score(doc=470,freq=4.0), product of:
             0.054958533 = queryWeight, product of:
               1.3798935 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.016808826 = queryNorm
             0.2961844 = fieldWeight in 470, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.057608657 = weight(abstract_txt:queries in 470) [ClassicSimilarity], result of:
           0.057608657 = score(doc=470,freq=2.0), product of:
             0.12763274 = queryWeight, product of:
               1.4869422 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.016808826 = queryNorm
             0.4513627 = fieldWeight in 470, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.13531145 = weight(abstract_txt:computed in 470) [ClassicSimilarity], result of:
           0.13531145 = score(doc=470,freq=1.0), product of:
             0.2841428 = queryWeight, product of:
               2.218612 = boost
               7.61935 = idf(docFreq=58, maxDocs=44218)
               0.016808826 = queryNorm
             0.47620937 = fieldWeight in 470, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.61935 = idf(docFreq=58, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.08666253 = weight(abstract_txt:results in 470) [ClassicSimilarity], result of:
           0.08666253 = score(doc=470,freq=5.0), product of:
             0.17806761 = queryWeight, product of:
               3.0420485 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.016808826 = queryNorm
             0.48668328 = fieldWeight in 470, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.39929733 = weight(abstract_txt:rankings in 470) [ClassicSimilarity], result of:
           0.39929733 = score(doc=470,freq=4.0), product of:
             0.46398208 = queryWeight, product of:
               4.0093927 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.016808826 = queryNorm
             0.86058784 = fieldWeight in 470, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.16940866 = weight(abstract_txt:search in 470) [ClassicSimilarity], result of:
           0.16940866 = score(doc=470,freq=8.0), product of:
             0.2619755 = queryWeight, product of:
               4.2606254 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.016808826 = queryNorm
             0.6466584 = fieldWeight in 470, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
         0.3190848 = weight(abstract_txt:engines in 470) [ClassicSimilarity], result of:
           0.3190848 = score(doc=470,freq=4.0), product of:
             0.48148972 = queryWeight, product of:
               5.4030695 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.016808826 = queryNorm
             0.6627032 = fieldWeight in 470, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0625 = fieldNorm(doc=470)
       0.4 = coord(10/25)
   

3. Spink, A.; Jansen, B.J.; Blakely, C.; Koshman, S.: ¬A study of results overlap and uniqueness among major Web search engines (2006) 0.42

   0.41831282 = sum of:
     0.41831282 = product of:
       1.16198 = sum of:
         0.08959548 = weight(abstract_txt:overlap in 993) [ClassicSimilarity], result of:
           0.08959548 = score(doc=993,freq=4.0), product of:
             0.11797835 = queryWeight, product of:
               1.010879 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.016808826 = queryNorm
             0.7594231 = fieldWeight in 993, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.04601333 = weight(abstract_txt:submitted in 993) [ClassicSimilarity], result of:
           0.04601333 = score(doc=993,freq=1.0), product of:
             0.12010304 = queryWeight, product of:
               1.019941 = boost
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.016808826 = queryNorm
             0.38311544 = fieldWeight in 993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.040966254 = weight(abstract_txt:large in 993) [ClassicSimilarity], result of:
           0.040966254 = score(doc=993,freq=3.0), product of:
             0.09709987 = queryWeight, product of:
               1.2969474 = boost
               4.454089 = idf(docFreq=1397, maxDocs=44218)
               0.016808826 = queryNorm
             0.42189813 = fieldWeight in 993, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.454089 = idf(docFreq=1397, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.007121564 = weight(abstract_txt:that in 993) [ClassicSimilarity], result of:
           0.007121564 = score(doc=993,freq=1.0), product of:
             0.054958533 = queryWeight, product of:
               1.3798935 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.016808826 = queryNorm
             0.12958068 = fieldWeight in 993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.100815155 = weight(abstract_txt:queries in 993) [ClassicSimilarity], result of:
           0.100815155 = score(doc=993,freq=8.0), product of:
             0.12763274 = queryWeight, product of:
               1.4869422 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.016808826 = queryNorm
             0.78988475 = fieldWeight in 993, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.037313923 = weight(abstract_txt:sets in 993) [ClassicSimilarity], result of:
           0.037313923 = score(doc=993,freq=1.0), product of:
             0.13158979 = queryWeight, product of:
               1.5098163 = boost
               5.185142 = idf(docFreq=672, maxDocs=44218)
               0.016808826 = queryNorm
             0.28356245 = fieldWeight in 993, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.185142 = idf(docFreq=672, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.10173624 = weight(abstract_txt:results in 993) [ClassicSimilarity], result of:
           0.10173624 = score(doc=993,freq=9.0), product of:
             0.17806761 = queryWeight, product of:
               3.0420485 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.016808826 = queryNorm
             0.5713349 = fieldWeight in 993, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.21608427 = weight(abstract_txt:search in 993) [ClassicSimilarity], result of:
           0.21608427 = score(doc=993,freq=17.0), product of:
             0.2619755 = queryWeight, product of:
               4.2606254 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.016808826 = queryNorm
             0.82482624 = fieldWeight in 993, product of:
               4.1231055 = tf(freq=17.0), with freq of:
                 17.0 = termFreq=17.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
         0.52233386 = weight(abstract_txt:engines in 993) [ClassicSimilarity], result of:
           0.52233386 = score(doc=993,freq=14.0), product of:
             0.48148972 = queryWeight, product of:
               5.4030695 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.016808826 = queryNorm
             1.0848287 = fieldWeight in 993, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0546875 = fieldNorm(doc=993)
       0.36 = coord(9/25)
   

4. Zhitomirsky-Geffet, M.; Bar-Ilan, J.; Levene, M.: Testing the stability of "wisdom of crowds" judgments of search results over time and their similarity with the search engine rankings (2016) 0.27

   0.2694272 = sum of:
     0.2694272 = product of:
       0.7484089 = sum of:
         0.023651877 = weight(abstract_txt:large in 3071) [ClassicSimilarity], result of:
           0.023651877 = score(doc=3071,freq=1.0), product of:
             0.09709987 = queryWeight, product of:
               1.2969474 = boost
               4.454089 = idf(docFreq=1397, maxDocs=44218)
               0.016808826 = queryNorm
             0.243583 = fieldWeight in 3071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.454089 = idf(docFreq=1397, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3071)
         0.014243128 = weight(abstract_txt:that in 3071) [ClassicSimilarity], result of:
           0.014243128 = score(doc=3071,freq=4.0), product of:
             0.054958533 = queryWeight, product of:
               1.3798935 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.016808826 = queryNorm
             0.25916135 = fieldWeight in 3071, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3071)
         0.035643537 = weight(abstract_txt:queries in 3071) [ClassicSimilarity], result of:
           0.035643537 = score(doc=3071,freq=1.0), product of:
             0.12763274 = queryWeight, product of:
               1.4869422 = boost
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.016808826 = queryNorm
             0.27926642 = fieldWeight in 3071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.106586 = idf(docFreq=727, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3071)
         0.037313923 = weight(abstract_txt:sets in 3071) [ClassicSimilarity], result of:
           0.037313923 = score(doc=3071,freq=1.0), product of:
             0.13158979 = queryWeight, product of:
               1.5098163 = boost
               5.185142 = idf(docFreq=672, maxDocs=44218)
               0.016808826 = queryNorm
             0.28356245 = fieldWeight in 3071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.185142 = idf(docFreq=672, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3071)
         0.053507887 = weight(abstract_txt:known in 3071) [ClassicSimilarity], result of:
           0.053507887 = score(doc=3071,freq=2.0), product of:
             0.13281387 = queryWeight, product of:
               1.5168225 = boost
               5.2092032 = idf(docFreq=656, maxDocs=44218)
               0.016808826 = queryNorm
             0.40287876 = fieldWeight in 3071, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.2092032 = idf(docFreq=656, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3071)
         0.058737446 = weight(abstract_txt:results in 3071) [ClassicSimilarity], result of:
           0.058737446 = score(doc=3071,freq=3.0), product of:
             0.17806761 = queryWeight, product of:
               3.0420485 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.016808826 = queryNorm
             0.32986036 = fieldWeight in 3071, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3071)
         0.24705261 = weight(abstract_txt:rankings in 3071) [ClassicSimilarity], result of:
           0.24705261 = score(doc=3071,freq=2.0), product of:
             0.46398208 = queryWeight, product of:
               4.0093927 = boost
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.016808826 = queryNorm
             0.5324615 = fieldWeight in 3071, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.8847027 = idf(docFreq=122, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3071)
         0.13865888 = weight(abstract_txt:search in 3071) [ClassicSimilarity], result of:
           0.13865888 = score(doc=3071,freq=7.0), product of:
             0.2619755 = queryWeight, product of:
               4.2606254 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.016808826 = queryNorm
             0.52928185 = fieldWeight in 3071, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3071)
         0.13959959 = weight(abstract_txt:engines in 3071) [ClassicSimilarity], result of:
           0.13959959 = score(doc=3071,freq=1.0), product of:
             0.48148972 = queryWeight, product of:
               5.4030695 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.016808826 = queryNorm
             0.28993267 = fieldWeight in 3071, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3071)
       0.36 = coord(9/25)
   

5. Clarke, S.J.; Willett, P.: Estimating the recall performance of Web search engines (1997) 0.26

   0.2574072 = sum of:
     0.2574072 = product of:
       1.07253 = sum of:
         0.10935521 = weight(abstract_txt:identical in 760) [ClassicSimilarity], result of:
           0.10935521 = score(doc=760,freq=1.0), product of:
             0.13474248 = queryWeight, product of:
               1.0803148 = boost
               7.4202213 = idf(docFreq=71, maxDocs=44218)
               0.016808826 = queryNorm
             0.81158674 = fieldWeight in 760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4202213 = idf(docFreq=71, maxDocs=44218)
               0.109375 = fieldNorm(doc=760)
         0.014243128 = weight(abstract_txt:that in 760) [ClassicSimilarity], result of:
           0.014243128 = score(doc=760,freq=1.0), product of:
             0.054958533 = queryWeight, product of:
               1.3798935 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.016808826 = queryNorm
             0.25916135 = fieldWeight in 760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.109375 = fieldNorm(doc=760)
         0.10553971 = weight(abstract_txt:sets in 760) [ClassicSimilarity], result of:
           0.10553971 = score(doc=760,freq=2.0), product of:
             0.13158979 = queryWeight, product of:
               1.5098163 = boost
               5.185142 = idf(docFreq=672, maxDocs=44218)
               0.016808826 = queryNorm
             0.80203575 = fieldWeight in 760, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.185142 = idf(docFreq=672, maxDocs=44218)
               0.109375 = fieldNorm(doc=760)
         0.17825772 = weight(abstract_txt:comparing in 760) [ClassicSimilarity], result of:
           0.17825772 = score(doc=760,freq=1.0), product of:
             0.26916435 = queryWeight, product of:
               2.6446452 = boost
               6.0549803 = idf(docFreq=281, maxDocs=44218)
               0.016808826 = queryNorm
             0.66226345 = fieldWeight in 760, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0549803 = idf(docFreq=281, maxDocs=44218)
               0.109375 = fieldNorm(doc=760)
         0.18154709 = weight(abstract_txt:search in 760) [ClassicSimilarity], result of:
           0.18154709 = score(doc=760,freq=3.0), product of:
             0.2619755 = queryWeight, product of:
               4.2606254 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.016808826 = queryNorm
             0.6929926 = fieldWeight in 760, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.109375 = fieldNorm(doc=760)
         0.48358715 = weight(abstract_txt:engines in 760) [ClassicSimilarity], result of:
           0.48358715 = score(doc=760,freq=3.0), product of:
             0.48148972 = queryWeight, product of:
               5.4030695 = boost
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.016808826 = queryNorm
             1.0043561 = fieldWeight in 760, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.3016257 = idf(docFreq=598, maxDocs=44218)
               0.109375 = fieldNorm(doc=760)
       0.24 = coord(6/25)