Document (#12073)

Author

Ellis, D.

Title

¬The dilemma of measurement in information retrieval research

Source

Journal of the American Society for Information Science. 47(1996) no.1, S.23-36

Year

1996

Abstract

The problem of measurement in information retrieval research is traced to its source in the first retrieval tests. The problem is seen as presenting a chronic dilemma for the field. This dilemma has taken 3 forms as the discipline has evloved: (1) the dilemma of measurement in the archetypal approach: stated relevance versus user relevance; (2) the dilemma of measurement in the probabilistic approach: realism versus formalism; and (3) the dilemma of measurement in the Information Retrieval-Expert System (IR-ES) approach: linear measures of relevance versus logarithmic measures of knowledge. It is argued that the dilemma of measurement has remained intractable even given the different assumptions of the different approaches for 3 connecte reasons - the nature of the subject matter of the field; the nature of relevance jidgement; and the nature of cognition and knowledge. Finally, it is concluded that the original vision of information retrieval research as a discipline founded on quantification proved restricting for its theoretical and methodological development and that increasing recognition of this is reflected in growing interest in qualitative methods in information retrieval research in relation to cognitive, behavioral, and affective aspects of the information retrieval interaction

Theme

Retrievalstudien

Similar documents (author)

1. Ellis, D.: ¬A behavioral approach to information system design (1989) 4.90

   4.9042125 = sum of:
     4.9042125 = weight(author_txt:ellis in 2706) [ClassicSimilarity], result of:
       4.9042125 = fieldWeight in 2706, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.84674 = idf(docFreq=46, maxDocs=44218)
         0.625 = fieldNorm(doc=2706)
   

2. Ellis, D.: ¬A behavioral model for information retrieval system design (1989) 4.90

   4.9042125 = sum of:
     4.9042125 = weight(author_txt:ellis in 2707) [ClassicSimilarity], result of:
       4.9042125 = fieldWeight in 2707, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.84674 = idf(docFreq=46, maxDocs=44218)
         0.625 = fieldNorm(doc=2707)
   

3. Ellis, D.: Hypertext; origins and use (1991) 4.90

   4.9042125 = sum of:
     4.9042125 = weight(author_txt:ellis in 4916) [ClassicSimilarity], result of:
       4.9042125 = fieldWeight in 4916, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.84674 = idf(docFreq=46, maxDocs=44218)
         0.625 = fieldNorm(doc=4916)
   

4. Ellis, D.: Theory and explanation in information retrieval research (1984) 4.90

   4.9042125 = sum of:
     4.9042125 = weight(author_txt:ellis in 5337) [ClassicSimilarity], result of:
       4.9042125 = fieldWeight in 5337, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.84674 = idf(docFreq=46, maxDocs=44218)
         0.625 = fieldNorm(doc=5337)
   

5. Ellis, D.: ¬The physical and cognitive paradigms in information retrieval research (1992) 4.90

   4.9042125 = sum of:
     4.9042125 = weight(author_txt:ellis in 8161) [ClassicSimilarity], result of:
       4.9042125 = fieldWeight in 8161, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.84674 = idf(docFreq=46, maxDocs=44218)
         0.625 = fieldNorm(doc=8161)
   

Similar documents (content)

1. Thornley, C.: Dilemmas in information science (IS) and information retrieval (IR) : recurring challenges or new solutions? (2009) 0.25

   0.2489964 = sum of:
     0.2489964 = product of:
       0.69165665 = sum of:
         0.024456246 = weight(abstract_txt:problem in 2964) [ClassicSimilarity], result of:
           0.024456246 = score(doc=2964,freq=2.0), product of:
             0.062030684 = queryWeight, product of:
               1.2395442 = boost
               4.460548 = idf(docFreq=1388, maxDocs=44218)
               0.011219057 = queryNorm
             0.39426047 = fieldWeight in 2964, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.460548 = idf(docFreq=1388, maxDocs=44218)
               0.0625 = fieldNorm(doc=2964)
         0.017661514 = weight(abstract_txt:field in 2964) [ClassicSimilarity], result of:
           0.017661514 = score(doc=2964,freq=1.0), product of:
             0.0629084 = queryWeight, product of:
               1.248283 = boost
               4.491995 = idf(docFreq=1345, maxDocs=44218)
               0.011219057 = queryNorm
             0.28074968 = fieldWeight in 2964, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.491995 = idf(docFreq=1345, maxDocs=44218)
               0.0625 = fieldNorm(doc=2964)
         0.14466561 = weight(abstract_txt:intractable in 2964) [ClassicSimilarity], result of:
           0.14466561 = score(doc=2964,freq=3.0), product of:
             0.14067486 = queryWeight, product of:
               1.3199333 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.011219057 = queryNorm
             1.0283686 = fieldWeight in 2964, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.0625 = fieldNorm(doc=2964)
         0.015355749 = weight(abstract_txt:approach in 2964) [ClassicSimilarity], result of:
           0.015355749 = score(doc=2964,freq=1.0), product of:
             0.06559959 = queryWeight, product of:
               1.5611869 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.011219057 = queryNorm
             0.234083 = fieldWeight in 2964, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.0625 = fieldNorm(doc=2964)
         0.017561913 = weight(abstract_txt:research in 2964) [ClassicSimilarity], result of:
           0.017561913 = score(doc=2964,freq=2.0), product of:
             0.06267167 = queryWeight, product of:
               1.762014 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.011219057 = queryNorm
             0.28022093 = fieldWeight in 2964, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=2964)
         0.046847217 = weight(abstract_txt:nature in 2964) [ClassicSimilarity], result of:
           0.046847217 = score(doc=2964,freq=2.0), product of:
             0.109521575 = queryWeight, product of:
               2.0172243 = boost
               4.839373 = idf(docFreq=950, maxDocs=44218)
               0.011219057 = queryNorm
             0.42774418 = fieldWeight in 2964, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.839373 = idf(docFreq=950, maxDocs=44218)
               0.0625 = fieldNorm(doc=2964)
         0.016588876 = weight(abstract_txt:information in 2964) [ClassicSimilarity], result of:
           0.016588876 = score(doc=2964,freq=4.0), product of:
             0.054817826 = queryWeight, product of:
               2.0182745 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.011219057 = queryNorm
             0.3026183 = fieldWeight in 2964, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=2964)
         0.040477145 = weight(abstract_txt:retrieval in 2964) [ClassicSimilarity], result of:
           0.040477145 = score(doc=2964,freq=2.0), product of:
             0.13177793 = queryWeight, product of:
               3.3799796 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.011219057 = queryNorm
             0.3071618 = fieldWeight in 2964, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=2964)
         0.36804238 = weight(abstract_txt:dilemma in 2964) [ClassicSimilarity], result of:
           0.36804238 = score(doc=2964,freq=1.0), product of:
             0.723288 = queryWeight, product of:
               7.9185996 = boost
               8.14154 = idf(docFreq=34, maxDocs=44218)
               0.011219057 = queryNorm
             0.5088462 = fieldWeight in 2964, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.14154 = idf(docFreq=34, maxDocs=44218)
               0.0625 = fieldNorm(doc=2964)
       0.36 = coord(9/25)
   

2. Harter, S.P.: Variations in relevance assessments and the measurement of retrieval effectiveness (1996) 0.12

   0.123957634 = sum of:
     0.123957634 = product of:
       0.51649016 = sum of:
         0.017293178 = weight(abstract_txt:problem in 3004) [ClassicSimilarity], result of:
           0.017293178 = score(doc=3004,freq=1.0), product of:
             0.062030684 = queryWeight, product of:
               1.2395442 = boost
               4.460548 = idf(docFreq=1388, maxDocs=44218)
               0.011219057 = queryNorm
             0.27878425 = fieldWeight in 3004, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.460548 = idf(docFreq=1388, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.04425055 = weight(abstract_txt:measures in 3004) [ClassicSimilarity], result of:
           0.04425055 = score(doc=3004,freq=2.0), product of:
             0.092106976 = queryWeight, product of:
               1.5104452 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.011219057 = queryNorm
             0.48042563 = fieldWeight in 3004, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.0117301075 = weight(abstract_txt:information in 3004) [ClassicSimilarity], result of:
           0.0117301075 = score(doc=3004,freq=2.0), product of:
             0.054817826 = queryWeight, product of:
               2.0182745 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.011219057 = queryNorm
             0.21398345 = fieldWeight in 3004, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.104533195 = weight(abstract_txt:relevance in 3004) [ClassicSimilarity], result of:
           0.104533195 = score(doc=3004,freq=5.0), product of:
             0.15166296 = queryWeight, product of:
               2.741028 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.011219057 = queryNorm
             0.6892467 = fieldWeight in 3004, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.063999996 = weight(abstract_txt:retrieval in 3004) [ClassicSimilarity], result of:
           0.063999996 = score(doc=3004,freq=5.0), product of:
             0.13177793 = queryWeight, product of:
               3.3799796 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.011219057 = queryNorm
             0.4856655 = fieldWeight in 3004, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.27468315 = weight(abstract_txt:measurement in 3004) [ClassicSimilarity], result of:
           0.27468315 = score(doc=3004,freq=2.0), product of:
             0.44868526 = queryWeight, product of:
               5.774179 = boost
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.011219057 = queryNorm
             0.6121956 = fieldWeight in 3004, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
       0.24 = coord(6/25)
   

3. Hjoerland, B.: Arguments for philosophical realism in library and information science (2004) 0.11

   0.113769405 = sum of:
     0.113769405 = product of:
       0.3555294 = sum of:
         0.036320247 = weight(abstract_txt:founded in 832) [ClassicSimilarity], result of:
           0.036320247 = score(doc=832,freq=1.0), product of:
             0.08074443 = queryWeight, product of:
               7.1970778 = idf(docFreq=89, maxDocs=44218)
               0.011219057 = queryNorm
             0.44981736 = fieldWeight in 832, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1970778 = idf(docFreq=89, maxDocs=44218)
               0.0625 = fieldNorm(doc=832)
         0.036835916 = weight(abstract_txt:behavioral in 832) [ClassicSimilarity], result of:
           0.036835916 = score(doc=832,freq=1.0), product of:
             0.0815069 = queryWeight, product of:
               1.0047104 = boost
               7.230979 = idf(docFreq=86, maxDocs=44218)
               0.011219057 = queryNorm
             0.4519362 = fieldWeight in 832, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.230979 = idf(docFreq=86, maxDocs=44218)
               0.0625 = fieldNorm(doc=832)
         0.12227663 = weight(abstract_txt:realism in 832) [ClassicSimilarity], result of:
           0.12227663 = score(doc=832,freq=4.0), product of:
             0.11425863 = queryWeight, product of:
               1.1895652 = boost
               8.561393 = idf(docFreq=22, maxDocs=44218)
               0.011219057 = queryNorm
             1.0701741 = fieldWeight in 832, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.561393 = idf(docFreq=22, maxDocs=44218)
               0.0625 = fieldNorm(doc=832)
         0.017561913 = weight(abstract_txt:research in 832) [ClassicSimilarity], result of:
           0.017561913 = score(doc=832,freq=2.0), product of:
             0.06267167 = queryWeight, product of:
               1.762014 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.011219057 = queryNorm
             0.28022093 = fieldWeight in 832, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=832)
         0.046847217 = weight(abstract_txt:nature in 832) [ClassicSimilarity], result of:
           0.046847217 = score(doc=832,freq=2.0), product of:
             0.109521575 = queryWeight, product of:
               2.0172243 = boost
               4.839373 = idf(docFreq=950, maxDocs=44218)
               0.011219057 = queryNorm
             0.42774418 = fieldWeight in 832, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.839373 = idf(docFreq=950, maxDocs=44218)
               0.0625 = fieldNorm(doc=832)
         0.020317143 = weight(abstract_txt:information in 832) [ClassicSimilarity], result of:
           0.020317143 = score(doc=832,freq=6.0), product of:
             0.054817826 = queryWeight, product of:
               2.0182745 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.011219057 = queryNorm
             0.3706302 = fieldWeight in 832, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=832)
         0.046748668 = weight(abstract_txt:relevance in 832) [ClassicSimilarity], result of:
           0.046748668 = score(doc=832,freq=1.0), product of:
             0.15166296 = queryWeight, product of:
               2.741028 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.011219057 = queryNorm
             0.3082405 = fieldWeight in 832, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=832)
         0.028621666 = weight(abstract_txt:retrieval in 832) [ClassicSimilarity], result of:
           0.028621666 = score(doc=832,freq=1.0), product of:
             0.13177793 = queryWeight, product of:
               3.3799796 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.011219057 = queryNorm
             0.21719621 = fieldWeight in 832, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=832)
       0.32 = coord(8/25)
   

4. Skyrme, D.J.: Valuing information : is it worth it? (1998) 0.11

   0.106804825 = sum of:
     0.106804825 = product of:
       0.6675302 = sum of:
         0.035323028 = weight(abstract_txt:field in 1752) [ClassicSimilarity], result of:
           0.035323028 = score(doc=1752,freq=1.0), product of:
             0.0629084 = queryWeight, product of:
               1.248283 = boost
               4.491995 = idf(docFreq=1345, maxDocs=44218)
               0.011219057 = queryNorm
             0.56149936 = fieldWeight in 1752, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.491995 = idf(docFreq=1345, maxDocs=44218)
               0.125 = fieldNorm(doc=1752)
         0.06625197 = weight(abstract_txt:nature in 1752) [ClassicSimilarity], result of:
           0.06625197 = score(doc=1752,freq=1.0), product of:
             0.109521575 = queryWeight, product of:
               2.0172243 = boost
               4.839373 = idf(docFreq=950, maxDocs=44218)
               0.011219057 = queryNorm
             0.60492164 = fieldWeight in 1752, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.839373 = idf(docFreq=950, maxDocs=44218)
               0.125 = fieldNorm(doc=1752)
         0.016588876 = weight(abstract_txt:information in 1752) [ClassicSimilarity], result of:
           0.016588876 = score(doc=1752,freq=1.0), product of:
             0.054817826 = queryWeight, product of:
               2.0182745 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.011219057 = queryNorm
             0.3026183 = fieldWeight in 1752, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.125 = fieldNorm(doc=1752)
         0.5493663 = weight(abstract_txt:measurement in 1752) [ClassicSimilarity], result of:
           0.5493663 = score(doc=1752,freq=2.0), product of:
             0.44868526 = queryWeight, product of:
               5.774179 = boost
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.011219057 = queryNorm
             1.2243912 = fieldWeight in 1752, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.125 = fieldNorm(doc=1752)
       0.16 = coord(4/25)
   

5. Houston, R.D.; Harmon, E.G.: Re-envisioning the information concept : systematic definitions (2002) 0.11

   0.105168186 = sum of:
     0.105168186 = product of:
       0.6573012 = sum of:
         0.035323028 = weight(abstract_txt:field in 136) [ClassicSimilarity], result of:
           0.035323028 = score(doc=136,freq=1.0), product of:
             0.0629084 = queryWeight, product of:
               1.248283 = boost
               4.491995 = idf(docFreq=1345, maxDocs=44218)
               0.011219057 = queryNorm
             0.56149936 = fieldWeight in 136, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.491995 = idf(docFreq=1345, maxDocs=44218)
               0.125 = fieldNorm(doc=136)
         0.20478478 = weight(abstract_txt:quantification in 136) [ClassicSimilarity], result of:
           0.20478478 = score(doc=136,freq=2.0), product of:
             0.12789351 = queryWeight, product of:
               1.2585428 = boost
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.011219057 = queryNorm
             1.6012132 = fieldWeight in 136, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.05783 = idf(docFreq=13, maxDocs=44218)
               0.125 = fieldNorm(doc=136)
         0.028732777 = weight(abstract_txt:information in 136) [ClassicSimilarity], result of:
           0.028732777 = score(doc=136,freq=3.0), product of:
             0.054817826 = queryWeight, product of:
               2.0182745 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.011219057 = queryNorm
             0.52415025 = fieldWeight in 136, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.125 = fieldNorm(doc=136)
         0.38846064 = weight(abstract_txt:measurement in 136) [ClassicSimilarity], result of:
           0.38846064 = score(doc=136,freq=1.0), product of:
             0.44868526 = queryWeight, product of:
               5.774179 = boost
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.011219057 = queryNorm
             0.86577535 = fieldWeight in 136, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.926203 = idf(docFreq=117, maxDocs=44218)
               0.125 = fieldNorm(doc=136)
       0.16 = coord(4/25)