Document (#34361)

Author

Zhang, Y.

Title

Developing a holistic model for digital library evaluation

Source

Journal of the American Society for Information Science and Technology. 61(2010) no.1, S.88-110

Year

2010

Abstract

This article reports the author's recent research in developing a holistic model for various levels of digital library (DL) evaluation in which perceived important criteria from heterogeneous stakeholder groups are organized and presented. To develop such a model, the author applied a three-stage research approach: exploration, confirmation, and verification. During the exploration stage, a literature review was conducted followed by an interview, along with a card sorting technique, to collect important criteria perceived by DL experts. Then the criteria identified were used for developing an online survey during the confirmation stage. Survey respondents (431 in total) from 22 countries rated the importance of the criteria. A holistic DL evaluation model was constructed using statistical techniques. Eventually, the verification stage was devised to test the reliability of the model in the context of searching and evaluating an operational DL. The proposed model fills two lacunae in the DL domain: (a) the lack of a comprehensive and flexible framework to guide and benchmark evaluations, and (b) the uncertainty about what divergence exists among heterogeneous DL stakeholders, including general users.

Similar documents (author)

1. Zhang, M.; Zhang, Y.: Professional organizations in Twittersphere : an empirical study of U.S. library and information science professional organizations-related Tweets (2020) 4.54

   4.5423746 = sum of:
     4.5423746 = weight(author_txt:zhang in 5775) [ClassicSimilarity], result of:
       4.5423746 = fieldWeight in 5775, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         6.4238877 = idf(docFreq=194, maxDocs=44218)
         0.5 = fieldNorm(doc=5775)
   

2. Zhang, Y.; Zhang, C.: Enhancing keyphrase extraction from microblogs using human reading time (2021) 4.54

   4.5423746 = sum of:
     4.5423746 = weight(author_txt:zhang in 237) [ClassicSimilarity], result of:
       4.5423746 = fieldWeight in 237, product of:
         1.4142135 = tf(freq=2.0), with freq of:
           2.0 = termFreq=2.0
         6.4238877 = idf(docFreq=194, maxDocs=44218)
         0.5 = fieldNorm(doc=237)
   

3. Zhang, J.: TOFIR: A tool of facilitating information retrieval : introduce a visual retrieval model (2001) 4.01

   4.01493 = sum of:
     4.01493 = weight(author_txt:zhang in 7711) [ClassicSimilarity], result of:
       4.01493 = fieldWeight in 7711, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.4238877 = idf(docFreq=194, maxDocs=44218)
         0.625 = fieldNorm(doc=7711)
   

4. Zhang, A.: Multimedia file formats on the Internet : a beginner's guide for PC users (1995) 4.01

   4.01493 = sum of:
     4.01493 = weight(author_txt:zhang in 3212) [ClassicSimilarity], result of:
       4.01493 = fieldWeight in 3212, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.4238877 = idf(docFreq=194, maxDocs=44218)
         0.625 = fieldNorm(doc=3212)
   

5. Zhang, J.: ¬A representational analysis of relational information displays (1996) 4.01

   4.01493 = sum of:
     4.01493 = weight(author_txt:zhang in 6403) [ClassicSimilarity], result of:
       4.01493 = fieldWeight in 6403, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         6.4238877 = idf(docFreq=194, maxDocs=44218)
         0.625 = fieldNorm(doc=6403)
   

Similar documents (content)

1. Xie, H.I.: Users' evaluation of digital libraries (DLs) : their uses, their criteria, and their assessment (2008) 0.14

   0.14333336 = sum of:
     0.14333336 = product of:
       0.7166668 = sum of:
         0.03915163 = weight(abstract_txt:important in 2083) [ClassicSimilarity], result of:
           0.03915163 = score(doc=2083,freq=2.0), product of:
             0.08407582 = queryWeight, product of:
               1.2140539 = boost
               4.2147684 = idf(docFreq=1775, maxDocs=44218)
               0.016430829 = queryNorm
             0.46567053 = fieldWeight in 2083, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2147684 = idf(docFreq=1775, maxDocs=44218)
               0.078125 = fieldNorm(doc=2083)
         0.104198776 = weight(abstract_txt:digital in 2083) [ClassicSimilarity], result of:
           0.104198776 = score(doc=2083,freq=12.0), product of:
             0.08885787 = queryWeight, product of:
               1.2481028 = boost
               4.332974 = idf(docFreq=1577, maxDocs=44218)
               0.016430829 = queryNorm
             1.1726454 = fieldWeight in 2083, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               4.332974 = idf(docFreq=1577, maxDocs=44218)
               0.078125 = fieldNorm(doc=2083)
         0.14525667 = weight(abstract_txt:perceived in 2083) [ClassicSimilarity], result of:
           0.14525667 = score(doc=2083,freq=3.0), product of:
             0.17602116 = queryWeight, product of:
               1.7566483 = boost
               6.0984654 = idf(docFreq=269, maxDocs=44218)
               0.016430829 = queryNorm
             0.8252228 = fieldWeight in 2083, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.0984654 = idf(docFreq=269, maxDocs=44218)
               0.078125 = fieldNorm(doc=2083)
         0.14162758 = weight(abstract_txt:evaluation in 2083) [ClassicSimilarity], result of:
           0.14162758 = score(doc=2083,freq=8.0), product of:
             0.14287192 = queryWeight, product of:
               1.938302 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.016430829 = queryNorm
             0.9912905 = fieldWeight in 2083, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=2083)
         0.28643218 = weight(abstract_txt:criteria in 2083) [ClassicSimilarity], result of:
           0.28643218 = score(doc=2083,freq=5.0), product of:
             0.2941366 = queryWeight, product of:
               3.2113817 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.016430829 = queryNorm
             0.9738066 = fieldWeight in 2083, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.078125 = fieldNorm(doc=2083)
       0.2 = coord(5/25)
   

2. Bateman, J.: Modelling the importance of end-user relevance criteria (1999) 0.14

   0.13508451 = sum of:
     0.13508451 = product of:
       0.56285214 = sum of:
         0.08702154 = weight(abstract_txt:rated in 6606) [ClassicSimilarity], result of:
           0.08702154 = score(doc=6606,freq=2.0), product of:
             0.14416076 = queryWeight, product of:
               1.1241155 = boost
               7.805067 = idf(docFreq=48, maxDocs=44218)
               0.016430829 = queryNorm
             0.60364234 = fieldWeight in 6606, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.805067 = idf(docFreq=48, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6606)
         0.027406143 = weight(abstract_txt:important in 6606) [ClassicSimilarity], result of:
           0.027406143 = score(doc=6606,freq=2.0), product of:
             0.08407582 = queryWeight, product of:
               1.2140539 = boost
               4.2147684 = idf(docFreq=1775, maxDocs=44218)
               0.016430829 = queryNorm
             0.32596937 = fieldWeight in 6606, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2147684 = idf(docFreq=1775, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6606)
         0.044631284 = weight(abstract_txt:survey in 6606) [ClassicSimilarity], result of:
           0.044631284 = score(doc=6606,freq=2.0), product of:
             0.11637654 = queryWeight, product of:
               1.4283515 = boost
               4.9587345 = idf(docFreq=843, maxDocs=44218)
               0.016430829 = queryNorm
             0.38350755 = fieldWeight in 6606, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9587345 = idf(docFreq=843, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6606)
         0.035051037 = weight(abstract_txt:evaluation in 6606) [ClassicSimilarity], result of:
           0.035051037 = score(doc=6606,freq=1.0), product of:
             0.14287192 = queryWeight, product of:
               1.938302 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.016430829 = queryNorm
             0.24533188 = fieldWeight in 6606, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6606)
         0.2835534 = weight(abstract_txt:criteria in 6606) [ClassicSimilarity], result of:
           0.2835534 = score(doc=6606,freq=10.0), product of:
             0.2941366 = queryWeight, product of:
               3.2113817 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.016430829 = queryNorm
             0.96401936 = fieldWeight in 6606, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6606)
         0.08518872 = weight(abstract_txt:model in 6606) [ClassicSimilarity], result of:
           0.08518872 = score(doc=6606,freq=3.0), product of:
             0.22561635 = queryWeight, product of:
               3.4446754 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.016430829 = queryNorm
             0.3775822 = fieldWeight in 6606, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.0546875 = fieldNorm(doc=6606)
       0.24 = coord(6/25)
   

3. Tang, R.; Solomon, P.: Use of relevance criteria across stages of document evaluation : on the complementarity of experimental and naturalistic studies (2001) 0.13

   0.13427058 = sum of:
     0.13427058 = product of:
       0.67135286 = sum of:
         0.033565532 = weight(abstract_txt:important in 5213) [ClassicSimilarity], result of:
           0.033565532 = score(doc=5213,freq=3.0), product of:
             0.08407582 = queryWeight, product of:
               1.2140539 = boost
               4.2147684 = idf(docFreq=1775, maxDocs=44218)
               0.016430829 = queryNorm
             0.3992293 = fieldWeight in 5213, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.2147684 = idf(docFreq=1775, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5213)
         0.035051037 = weight(abstract_txt:evaluation in 5213) [ClassicSimilarity], result of:
           0.035051037 = score(doc=5213,freq=1.0), product of:
             0.14287192 = queryWeight, product of:
               1.938302 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.016430829 = queryNorm
             0.24533188 = fieldWeight in 5213, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5213)
         0.21963952 = weight(abstract_txt:criteria in 5213) [ClassicSimilarity], result of:
           0.21963952 = score(doc=5213,freq=6.0), product of:
             0.2941366 = queryWeight, product of:
               3.2113817 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.016430829 = queryNorm
             0.7467262 = fieldWeight in 5213, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5213)
         0.049183726 = weight(abstract_txt:model in 5213) [ClassicSimilarity], result of:
           0.049183726 = score(doc=5213,freq=1.0), product of:
             0.22561635 = queryWeight, product of:
               3.4446754 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.016430829 = queryNorm
             0.21799716 = fieldWeight in 5213, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5213)
         0.333913 = weight(abstract_txt:stage in 5213) [ClassicSimilarity], result of:
           0.333913 = score(doc=5213,freq=8.0), product of:
             0.35333344 = queryWeight, product of:
               3.5197334 = boost
               6.1096387 = idf(docFreq=266, maxDocs=44218)
               0.016430829 = queryNorm
             0.94503653 = fieldWeight in 5213, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.1096387 = idf(docFreq=266, maxDocs=44218)
               0.0546875 = fieldNorm(doc=5213)
       0.2 = coord(5/25)
   

4. Kuhlthau, C.C.: Information search process (ISP) model (2009) 0.10

   0.104616195 = sum of:
     0.104616195 = product of:
       0.6538512 = sum of:
         0.12376874 = weight(abstract_txt:uncertainty in 3819) [ClassicSimilarity], result of:
           0.12376874 = score(doc=3819,freq=4.0), product of:
             0.114084125 = queryWeight, product of:
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.016430829 = queryNorm
             1.0848901 = fieldWeight in 3819, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.078125 = fieldNorm(doc=3819)
         0.19220705 = weight(abstract_txt:holistic in 3819) [ClassicSimilarity], result of:
           0.19220705 = score(doc=3819,freq=1.0), product of:
             0.3502605 = queryWeight, product of:
               3.0348945 = boost
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.016430829 = queryNorm
             0.5487546 = fieldWeight in 3819, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.078125 = fieldNorm(doc=3819)
         0.09936613 = weight(abstract_txt:model in 3819) [ClassicSimilarity], result of:
           0.09936613 = score(doc=3819,freq=2.0), product of:
             0.22561635 = queryWeight, product of:
               3.4446754 = boost
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.016430829 = queryNorm
             0.44042078 = fieldWeight in 3819, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.986234 = idf(docFreq=2231, maxDocs=44218)
               0.078125 = fieldNorm(doc=3819)
         0.2385093 = weight(abstract_txt:stage in 3819) [ClassicSimilarity], result of:
           0.2385093 = score(doc=3819,freq=2.0), product of:
             0.35333344 = queryWeight, product of:
               3.5197334 = boost
               6.1096387 = idf(docFreq=266, maxDocs=44218)
               0.016430829 = queryNorm
             0.6750261 = fieldWeight in 3819, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.1096387 = idf(docFreq=266, maxDocs=44218)
               0.078125 = fieldNorm(doc=3819)
       0.16 = coord(4/25)
   

5. Park, J.-R.; Tosaka, Y.: Metadata quality control in digital repositories and collections : criteria, semantics, and mechanisms (2010) 0.09

   0.08842627 = sum of:
     0.08842627 = product of:
       0.44213134 = sum of:
         0.04253897 = weight(abstract_txt:digital in 4163) [ClassicSimilarity], result of:
           0.04253897 = score(doc=4163,freq=2.0), product of:
             0.08885787 = queryWeight, product of:
               1.2481028 = boost
               4.332974 = idf(docFreq=1577, maxDocs=44218)
               0.016430829 = queryNorm
             0.4787305 = fieldWeight in 4163, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.332974 = idf(docFreq=1577, maxDocs=44218)
               0.078125 = fieldNorm(doc=4163)
         0.06375898 = weight(abstract_txt:survey in 4163) [ClassicSimilarity], result of:
           0.06375898 = score(doc=4163,freq=2.0), product of:
             0.11637654 = queryWeight, product of:
               1.4283515 = boost
               4.9587345 = idf(docFreq=843, maxDocs=44218)
               0.016430829 = queryNorm
             0.54786795 = fieldWeight in 4163, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9587345 = idf(docFreq=843, maxDocs=44218)
               0.078125 = fieldNorm(doc=4163)
         0.08386398 = weight(abstract_txt:perceived in 4163) [ClassicSimilarity], result of:
           0.08386398 = score(doc=4163,freq=1.0), product of:
             0.17602116 = queryWeight, product of:
               1.7566483 = boost
               6.0984654 = idf(docFreq=269, maxDocs=44218)
               0.016430829 = queryNorm
             0.4764426 = fieldWeight in 4163, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0984654 = idf(docFreq=269, maxDocs=44218)
               0.078125 = fieldNorm(doc=4163)
         0.07081379 = weight(abstract_txt:evaluation in 4163) [ClassicSimilarity], result of:
           0.07081379 = score(doc=4163,freq=2.0), product of:
             0.14287192 = queryWeight, product of:
               1.938302 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.016430829 = queryNorm
             0.49564525 = fieldWeight in 4163, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=4163)
         0.1811556 = weight(abstract_txt:criteria in 4163) [ClassicSimilarity], result of:
           0.1811556 = score(doc=4163,freq=2.0), product of:
             0.2941366 = queryWeight, product of:
               3.2113817 = boost
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.016430829 = queryNorm
             0.6158894 = fieldWeight in 4163, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.574394 = idf(docFreq=455, maxDocs=44218)
               0.078125 = fieldNorm(doc=4163)
       0.2 = coord(5/25)