Document (#27535)

Author

Toms, E.G.
Freund, L.
Li, C.

Title

WilRE: the Web Interactive information retrieval experimentation system prototype

Source

Information processing and management. 40(2004) no.4, S.655-676

Year

2004

Abstract

We introduce WiIRE, a prototype system for conducting interactive information retrieval (IIR) experiments via the Internet. We conceived Wi IRE to increase validity while streamlining procedures and adding efficiencies to the conduct of IIR experiments. The system incorporates password-controlled access, online questionnaires, study instructions and tutorials, conditional interface assignment, and conditional query assignment as well as provision for data collection. As an initial evaluation, we used WiIRE inhouse to conduct a Web-based IIR experiment using an external search engine with customized search interfaces and the TREC 11 Interactive Track search queries. Our evaluation of the prototype indicated significant cost efficiencies in the conduct of IIR studies, and additionally had some novel findings about the human perspective: about half participants would have preferred some personal contact with the researcher, and participants spent a significantly decreasing amount of time on tasks over the course of a session.

Similar documents (author)

1. Freund, L.; Toms, E.G.: Interacting with archival finding aids (2016) 6.48

   6.4767632 = sum of:
     6.4767632 = sum of:
       2.7556508 = weight(author_txt:toms in 2851) [ClassicSimilarity], result of:
         2.7556508 = score(doc=2851,freq=1.0), product of:
           0.6333989 = queryWeight, product of:
             8.701155 = idf(docFreq=19, maxDocs=44218)
             0.07279481 = queryNorm
           4.3505774 = fieldWeight in 2851, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.701155 = idf(docFreq=19, maxDocs=44218)
             0.5 = fieldNorm(doc=2851)
       3.7211125 = weight(author_txt:freund in 2851) [ClassicSimilarity], result of:
         3.7211125 = score(doc=2851,freq=1.0), product of:
           0.7738255 = queryWeight, product of:
             1.1053069 = boost
             9.617446 = idf(docFreq=7, maxDocs=44218)
             0.07279481 = queryNorm
           4.808723 = fieldWeight in 2851, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.617446 = idf(docFreq=7, maxDocs=44218)
             0.5 = fieldNorm(doc=2851)
   

2. Wildemuth, B.; Freund, L.; Toms, E.G.: Untangling search task complexity and difficulty in the context of interactive information retrieval studies (2014) 4.86

   4.8575726 = sum of:
     4.8575726 = sum of:
       2.0667381 = weight(author_txt:toms in 1786) [ClassicSimilarity], result of:
         2.0667381 = score(doc=1786,freq=1.0), product of:
           0.6333989 = queryWeight, product of:
             8.701155 = idf(docFreq=19, maxDocs=44218)
             0.07279481 = queryNorm
           3.262933 = fieldWeight in 1786, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.701155 = idf(docFreq=19, maxDocs=44218)
             0.375 = fieldNorm(doc=1786)
       2.7908344 = weight(author_txt:freund in 1786) [ClassicSimilarity], result of:
         2.7908344 = score(doc=1786,freq=1.0), product of:
           0.7738255 = queryWeight, product of:
             1.1053069 = boost
             9.617446 = idf(docFreq=7, maxDocs=44218)
             0.07279481 = queryNorm
           3.606542 = fieldWeight in 1786, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.617446 = idf(docFreq=7, maxDocs=44218)
             0.375 = fieldNorm(doc=1786)
   

3. Freund, L.: Contextualizing the information-seeking behavior of software engineers (2015) 2.33

   2.3256955 = sum of:
     2.3256955 = product of:
       4.651391 = sum of:
         4.651391 = weight(author_txt:freund in 2120) [ClassicSimilarity], result of:
           4.651391 = score(doc=2120,freq=1.0), product of:
             0.7738255 = queryWeight, product of:
               1.1053069 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.07279481 = queryNorm
             6.010904 = fieldWeight in 2120, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.625 = fieldNorm(doc=2120)
       0.5 = coord(1/2)
   

4. Parra Freund, G. => Freund, G.P.: 2.30

   2.302321 = sum of:
     2.302321 = product of:
       4.604642 = sum of:
         4.604642 = weight(author_txt:freund in 5822) [ClassicSimilarity], result of:
           4.604642 = score(doc=5822,freq=2.0), product of:
             0.7738255 = queryWeight, product of:
               1.1053069 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.07279481 = queryNorm
             5.950491 = fieldWeight in 5822, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.4375 = fieldNorm(doc=5822)
       0.5 = coord(1/2)
   

5. Toms, E.G.: Free-Neets : delivering information to the community (1994) 1.72

   1.7222818 = sum of:
     1.7222818 = product of:
       3.4445636 = sum of:
         3.4445636 = weight(author_txt:toms in 579) [ClassicSimilarity], result of:
           3.4445636 = score(doc=579,freq=1.0), product of:
             0.6333989 = queryWeight, product of:
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.07279481 = queryNorm
             5.438222 = fieldWeight in 579, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.701155 = idf(docFreq=19, maxDocs=44218)
               0.625 = fieldNorm(doc=579)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Morgan, E.L.: Creating user-friendly electronic information systems (1997) 0.13

   0.13180606 = sum of:
     0.13180606 = product of:
       0.6590303 = sum of:
         0.14667691 = weight(abstract_txt:customized in 1829) [ClassicSimilarity], result of:
           0.14667691 = score(doc=1829,freq=1.0), product of:
             0.15186706 = queryWeight, product of:
               1.0801 = boost
               7.7265954 = idf(docFreq=52, maxDocs=44218)
               0.018197488 = queryNorm
             0.9658244 = fieldWeight in 1829, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7265954 = idf(docFreq=52, maxDocs=44218)
               0.125 = fieldNorm(doc=1829)
         0.036584772 = weight(abstract_txt:system in 1829) [ClassicSimilarity], result of:
           0.036584772 = score(doc=1829,freq=1.0), product of:
             0.08678867 = queryWeight, product of:
               1.4142439 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.018197488 = queryNorm
             0.42153856 = fieldWeight in 1829, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.125 = fieldNorm(doc=1829)
         0.046694774 = weight(abstract_txt:search in 1829) [ClassicSimilarity], result of:
           0.046694774 = score(doc=1829,freq=1.0), product of:
             0.102119416 = queryWeight, product of:
               1.5340763 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.018197488 = queryNorm
             0.45725656 = fieldWeight in 1829, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.125 = fieldNorm(doc=1829)
         0.23123333 = weight(abstract_txt:interactive in 1829) [ClassicSimilarity], result of:
           0.23123333 = score(doc=1829,freq=2.0), product of:
             0.23547952 = queryWeight, product of:
               2.3295357 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.018197488 = queryNorm
             0.9819679 = fieldWeight in 1829, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.125 = fieldNorm(doc=1829)
         0.1978405 = weight(abstract_txt:prototype in 1829) [ClassicSimilarity], result of:
           0.1978405 = score(doc=1829,freq=1.0), product of:
             0.2673866 = queryWeight, product of:
               2.4823477 = boost
               5.9192348 = idf(docFreq=322, maxDocs=44218)
               0.018197488 = queryNorm
             0.73990434 = fieldWeight in 1829, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9192348 = idf(docFreq=322, maxDocs=44218)
               0.125 = fieldNorm(doc=1829)
       0.2 = coord(5/25)
   

2. Blandford, A.; Adams, A.; Attfield, S.; Buchanan, G.; Gow, J.; Makri, S.; Rimmer, J.; Warwick, C.: ¬The PRET A Rapporter framework : evaluating digital libraries from the perspective of information work (2008) 0.11

   0.11066992 = sum of:
     0.11066992 = product of:
       0.46112466 = sum of:
         0.01977509 = weight(abstract_txt:some in 2021) [ClassicSimilarity], result of:
           0.01977509 = score(doc=2021,freq=1.0), product of:
             0.068821594 = queryWeight, product of:
               1.0282756 = boost
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.018197488 = queryNorm
             0.28733847 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.023964114 = weight(abstract_txt:about in 2021) [ClassicSimilarity], result of:
           0.023964114 = score(doc=2021,freq=1.0), product of:
             0.078226395 = queryWeight, product of:
               1.0962859 = boost
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.018197488 = queryNorm
             0.30634308 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.10149626 = weight(abstract_txt:evaluation in 2021) [ClassicSimilarity], result of:
           0.10149626 = score(doc=2021,freq=8.0), product of:
             0.102388 = queryWeight, product of:
               1.2542142 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.018197488 = queryNorm
             0.9912905 = fieldWeight in 2021, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.039604176 = weight(abstract_txt:system in 2021) [ClassicSimilarity], result of:
           0.039604176 = score(doc=2021,freq=3.0), product of:
             0.08678867 = queryWeight, product of:
               1.4142439 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.018197488 = queryNorm
             0.45632887 = fieldWeight in 2021, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.102191664 = weight(abstract_txt:interactive in 2021) [ClassicSimilarity], result of:
           0.102191664 = score(doc=2021,freq=1.0), product of:
             0.23547952 = queryWeight, product of:
               2.3295357 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.018197488 = queryNorm
             0.43397263 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
         0.17409338 = weight(abstract_txt:conduct in 2021) [ClassicSimilarity], result of:
           0.17409338 = score(doc=2021,freq=1.0), product of:
             0.33589044 = queryWeight, product of:
               2.782221 = boost
               6.634292 = idf(docFreq=157, maxDocs=44218)
               0.018197488 = queryNorm
             0.51830405 = fieldWeight in 2021, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.634292 = idf(docFreq=157, maxDocs=44218)
               0.078125 = fieldNorm(doc=2021)
       0.24 = coord(6/25)
   

3. Balatsoukas, P.; Demian, P.: Effects of granularity of search results on the relevance judgment behavior of engineers : building systems for retrieval and understanding of context (2010) 0.08

   0.084047064 = sum of:
     0.084047064 = product of:
       0.35019612 = sum of:
         0.015820073 = weight(abstract_txt:some in 3419) [ClassicSimilarity], result of:
           0.015820073 = score(doc=3419,freq=1.0), product of:
             0.068821594 = queryWeight, product of:
               1.0282756 = boost
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.018197488 = queryNorm
             0.22987078 = fieldWeight in 3419, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.0625 = fieldNorm(doc=3419)
         0.019171292 = weight(abstract_txt:about in 3419) [ClassicSimilarity], result of:
           0.019171292 = score(doc=3419,freq=1.0), product of:
             0.078226395 = queryWeight, product of:
               1.0962859 = boost
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.018197488 = queryNorm
             0.24507447 = fieldWeight in 3419, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.0625 = fieldNorm(doc=3419)
         0.02586934 = weight(abstract_txt:system in 3419) [ClassicSimilarity], result of:
           0.02586934 = score(doc=3419,freq=2.0), product of:
             0.08678867 = queryWeight, product of:
               1.4142439 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.018197488 = queryNorm
             0.2980728 = fieldWeight in 3419, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=3419)
         0.084982365 = weight(abstract_txt:participants in 3419) [ClassicSimilarity], result of:
           0.084982365 = score(doc=3419,freq=3.0), product of:
             0.14636298 = queryWeight, product of:
               1.4995563 = boost
               5.3636074 = idf(docFreq=562, maxDocs=44218)
               0.018197488 = queryNorm
             0.5806275 = fieldWeight in 3419, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.3636074 = idf(docFreq=562, maxDocs=44218)
               0.0625 = fieldNorm(doc=3419)
         0.03301819 = weight(abstract_txt:search in 3419) [ClassicSimilarity], result of:
           0.03301819 = score(doc=3419,freq=2.0), product of:
             0.102119416 = queryWeight, product of:
               1.5340763 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.018197488 = queryNorm
             0.3233292 = fieldWeight in 3419, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=3419)
         0.17133488 = weight(abstract_txt:prototype in 3419) [ClassicSimilarity], result of:
           0.17133488 = score(doc=3419,freq=3.0), product of:
             0.2673866 = queryWeight, product of:
               2.4823477 = boost
               5.9192348 = idf(docFreq=322, maxDocs=44218)
               0.018197488 = queryNorm
             0.6407759 = fieldWeight in 3419, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.9192348 = idf(docFreq=322, maxDocs=44218)
               0.0625 = fieldNorm(doc=3419)
       0.24 = coord(6/25)
   

4. Hancock-Beaulieu, M.; Robertson, S.; Neilson, C.: Evaluation of online catalogues : eliciting information from the user (1991) 0.08

   0.08194461 = sum of:
     0.08194461 = product of:
       0.409723 = sum of:
         0.087303385 = weight(abstract_txt:questionnaires in 2766) [ClassicSimilarity], result of:
           0.087303385 = score(doc=2766,freq=1.0), product of:
             0.13017741 = queryWeight, product of:
               7.1535926 = idf(docFreq=93, maxDocs=44218)
               0.018197488 = queryNorm
             0.6706493 = fieldWeight in 2766, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.1535926 = idf(docFreq=93, maxDocs=44218)
               0.09375 = fieldNorm(doc=2766)
         0.060897753 = weight(abstract_txt:evaluation in 2766) [ClassicSimilarity], result of:
           0.060897753 = score(doc=2766,freq=2.0), product of:
             0.102388 = queryWeight, product of:
               1.2542142 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.018197488 = queryNorm
             0.5947743 = fieldWeight in 2766, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.09375 = fieldNorm(doc=2766)
         0.027438577 = weight(abstract_txt:system in 2766) [ClassicSimilarity], result of:
           0.027438577 = score(doc=2766,freq=1.0), product of:
             0.08678867 = queryWeight, product of:
               1.4142439 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.018197488 = queryNorm
             0.3161539 = fieldWeight in 2766, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.09375 = fieldNorm(doc=2766)
         0.060658287 = weight(abstract_txt:search in 2766) [ClassicSimilarity], result of:
           0.060658287 = score(doc=2766,freq=3.0), product of:
             0.102119416 = queryWeight, product of:
               1.5340763 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.018197488 = queryNorm
             0.59399366 = fieldWeight in 2766, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.09375 = fieldNorm(doc=2766)
         0.173425 = weight(abstract_txt:interactive in 2766) [ClassicSimilarity], result of:
           0.173425 = score(doc=2766,freq=2.0), product of:
             0.23547952 = queryWeight, product of:
               2.3295357 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.018197488 = queryNorm
             0.73647594 = fieldWeight in 2766, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.09375 = fieldNorm(doc=2766)
       0.2 = coord(5/25)
   

5. Wong, S.K.M.; Butz, C.J.; Xiang, X.: Automated database schema design using mined data dependencies (1998) 0.08

   0.08177263 = sum of:
     0.08177263 = product of:
       0.51107895 = sum of:
         0.027438577 = weight(abstract_txt:system in 2897) [ClassicSimilarity], result of:
           0.027438577 = score(doc=2897,freq=1.0), product of:
             0.08678867 = queryWeight, product of:
               1.4142439 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.018197488 = queryNorm
             0.3161539 = fieldWeight in 2897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.09375 = fieldNorm(doc=2897)
         0.07223904 = weight(abstract_txt:experiments in 2897) [ClassicSimilarity], result of:
           0.07223904 = score(doc=2897,freq=1.0), product of:
             0.14455713 = queryWeight, product of:
               1.4902768 = boost
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.018197488 = queryNorm
             0.49972656 = fieldWeight in 2897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.09375 = fieldNorm(doc=2897)
         0.26302096 = weight(abstract_txt:conditional in 2897) [ClassicSimilarity], result of:
           0.26302096 = score(doc=2897,freq=1.0), product of:
             0.34212527 = queryWeight, product of:
               2.2926605 = boost
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.018197488 = queryNorm
             0.7687856 = fieldWeight in 2897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.09375 = fieldNorm(doc=2897)
         0.14838037 = weight(abstract_txt:prototype in 2897) [ClassicSimilarity], result of:
           0.14838037 = score(doc=2897,freq=1.0), product of:
             0.2673866 = queryWeight, product of:
               2.4823477 = boost
               5.9192348 = idf(docFreq=322, maxDocs=44218)
               0.018197488 = queryNorm
             0.55492824 = fieldWeight in 2897, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9192348 = idf(docFreq=322, maxDocs=44218)
               0.09375 = fieldNorm(doc=2897)
       0.16 = coord(4/25)