Document (#36200)

Author

Devaul, H.
Diekema, A.R.
Ostwald, J.

Title

Computer-assisted assignment of educational standards using natural language processing

Source

Journal of the American Society for Information Science and Technology. 62(2011) no.2, S.395-405

Year

2011

Abstract

Educational standards are a central focus of the current educational system in the United States, underpinning educational practice, curriculum design, teacher professional development, and high-stakes testing and assessment. Digital library users have requested that this information be accessible in association with digital learning resources to support teaching and learning as well as accountability requirements. Providing this information is complex because of the variability and number of standards documents in use at the national, state, and local level. This article describes a cataloging tool that aids catalogers in the assignment of standards metadata to digital library resources, using natural language processing techniques. The research explores whether the standards suggestor service would suggest the same standards as a human, whether relevant standards are ranked appropriately in the result set, and whether the relevance of the suggested assignments improve when, in addition to resource content, metadata is included in the query to the cataloging tool. The article also discusses how this service might streamline the cataloging workflow.

Theme

Computer Based Training
Formalerschließung

Location

USA

Similar documents (content)

1. Sutton, S.A.; Golder, D.: Achievement Standards Network (ASN) : an application profile for mapping K-12 educational resources to achievement (2008) 0.25

   0.2523221 = sum of:
     0.2523221 = product of:
       0.90115035 = sum of:
         0.038473286 = weight(abstract_txt:resources in 2636) [ClassicSimilarity], result of:
           0.038473286 = score(doc=2636,freq=1.0), product of:
             0.09718508 = queryWeight, product of:
               1.1100458 = boost
               4.2226825 = idf(docFreq=1761, maxDocs=44218)
               0.02073339 = queryNorm
             0.39587647 = fieldWeight in 2636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2226825 = idf(docFreq=1761, maxDocs=44218)
               0.09375 = fieldNorm(doc=2636)
         0.054791648 = weight(abstract_txt:learning in 2636) [ClassicSimilarity], result of:
           0.054791648 = score(doc=2636,freq=1.0), product of:
             0.12301829 = queryWeight, product of:
               1.2488949 = boost
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.02073339 = queryNorm
             0.44539434 = fieldWeight in 2636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.09375 = fieldNorm(doc=2636)
         0.01435838 = weight(abstract_txt:this in 2636) [ClassicSimilarity], result of:
           0.01435838 = score(doc=2636,freq=1.0), product of:
             0.06347076 = queryWeight, product of:
               1.2686532 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.02073339 = queryNorm
             0.2262204 = fieldWeight in 2636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.09375 = fieldNorm(doc=2636)
         0.102931194 = weight(abstract_txt:metadata in 2636) [ClassicSimilarity], result of:
           0.102931194 = score(doc=2636,freq=3.0), product of:
             0.12986267 = queryWeight, product of:
               1.2831671 = boost
               4.881247 = idf(docFreq=911, maxDocs=44218)
               0.02073339 = queryNorm
             0.7926158 = fieldWeight in 2636, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.881247 = idf(docFreq=911, maxDocs=44218)
               0.09375 = fieldNorm(doc=2636)
         0.062351026 = weight(abstract_txt:digital in 2636) [ClassicSimilarity], result of:
           0.062351026 = score(doc=2636,freq=1.0), product of:
             0.15349217 = queryWeight, product of:
               1.7085583 = boost
               4.332974 = idf(docFreq=1577, maxDocs=44218)
               0.02073339 = queryNorm
             0.40621632 = fieldWeight in 2636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.332974 = idf(docFreq=1577, maxDocs=44218)
               0.09375 = fieldNorm(doc=2636)
         0.23263398 = weight(abstract_txt:educational in 2636) [ClassicSimilarity], result of:
           0.23263398 = score(doc=2636,freq=1.0), product of:
             0.40639856 = queryWeight, product of:
               3.2102005 = boost
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.02073339 = queryNorm
             0.57242817 = fieldWeight in 2636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.09375 = fieldNorm(doc=2636)
         0.3956108 = weight(abstract_txt:standards in 2636) [ClassicSimilarity], result of:
           0.3956108 = score(doc=2636,freq=4.0), product of:
             0.4395499 = queryWeight, product of:
               4.4165096 = boost
               4.800193 = idf(docFreq=988, maxDocs=44218)
               0.02073339 = queryNorm
             0.90003616 = fieldWeight in 2636, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.800193 = idf(docFreq=988, maxDocs=44218)
               0.09375 = fieldNorm(doc=2636)
       0.28 = coord(7/25)
   

2. Alcaraz-García, I.; Bueno-de-la-Fuente, G.: Best practices for current learning repositories : the case of agrega (2014) 0.21

   0.20765698 = sum of:
     0.20765698 = product of:
       0.74163204 = sum of:
         0.032061074 = weight(abstract_txt:resources in 1585) [ClassicSimilarity], result of:
           0.032061074 = score(doc=1585,freq=1.0), product of:
             0.09718508 = queryWeight, product of:
               1.1100458 = boost
               4.2226825 = idf(docFreq=1761, maxDocs=44218)
               0.02073339 = queryNorm
             0.32989708 = fieldWeight in 1585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2226825 = idf(docFreq=1761, maxDocs=44218)
               0.078125 = fieldNorm(doc=1585)
         0.040726542 = weight(abstract_txt:service in 1585) [ClassicSimilarity], result of:
           0.040726542 = score(doc=1585,freq=1.0), product of:
             0.11398978 = queryWeight, product of:
               1.2021925 = boost
               4.5732145 = idf(docFreq=1240, maxDocs=44218)
               0.02073339 = queryNorm
             0.3572824 = fieldWeight in 1585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5732145 = idf(docFreq=1240, maxDocs=44218)
               0.078125 = fieldNorm(doc=1585)
         0.09131942 = weight(abstract_txt:learning in 1585) [ClassicSimilarity], result of:
           0.09131942 = score(doc=1585,freq=4.0), product of:
             0.12301829 = queryWeight, product of:
               1.2488949 = boost
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.02073339 = queryNorm
             0.74232394 = fieldWeight in 1585, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.078125 = fieldNorm(doc=1585)
         0.020724535 = weight(abstract_txt:this in 1585) [ClassicSimilarity], result of:
           0.020724535 = score(doc=1585,freq=3.0), product of:
             0.06347076 = queryWeight, product of:
               1.2686532 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.02073339 = queryNorm
             0.32652098 = fieldWeight in 1585, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.078125 = fieldNorm(doc=1585)
         0.04952279 = weight(abstract_txt:metadata in 1585) [ClassicSimilarity], result of:
           0.04952279 = score(doc=1585,freq=1.0), product of:
             0.12986267 = queryWeight, product of:
               1.2831671 = boost
               4.881247 = idf(docFreq=911, maxDocs=44218)
               0.02073339 = queryNorm
             0.38134742 = fieldWeight in 1585, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.881247 = idf(docFreq=911, maxDocs=44218)
               0.078125 = fieldNorm(doc=1585)
         0.2741618 = weight(abstract_txt:educational in 1585) [ClassicSimilarity], result of:
           0.2741618 = score(doc=1585,freq=2.0), product of:
             0.40639856 = queryWeight, product of:
               3.2102005 = boost
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.02073339 = queryNorm
             0.67461306 = fieldWeight in 1585, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.078125 = fieldNorm(doc=1585)
         0.2331159 = weight(abstract_txt:standards in 1585) [ClassicSimilarity], result of:
           0.2331159 = score(doc=1585,freq=2.0), product of:
             0.4395499 = queryWeight, product of:
               4.4165096 = boost
               4.800193 = idf(docFreq=988, maxDocs=44218)
               0.02073339 = queryNorm
             0.5303514 = fieldWeight in 1585, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.800193 = idf(docFreq=988, maxDocs=44218)
               0.078125 = fieldNorm(doc=1585)
       0.28 = coord(7/25)
   

3. Sutton, S.A.: Metadata quality, utility and the Semantic Web : the case of learning resources and achievement standards (2008) 0.19

   0.1924246 = sum of:
     0.1924246 = product of:
       0.80176914 = sum of:
         0.028127858 = weight(abstract_txt:article in 801) [ClassicSimilarity], result of:
           0.028127858 = score(doc=801,freq=1.0), product of:
             0.07887109 = queryWeight, product of:
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.02073339 = queryNorm
             0.35663077 = fieldWeight in 801, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.09375 = fieldNorm(doc=801)
         0.038473286 = weight(abstract_txt:resources in 801) [ClassicSimilarity], result of:
           0.038473286 = score(doc=801,freq=1.0), product of:
             0.09718508 = queryWeight, product of:
               1.1100458 = boost
               4.2226825 = idf(docFreq=1761, maxDocs=44218)
               0.02073339 = queryNorm
             0.39587647 = fieldWeight in 801, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2226825 = idf(docFreq=1761, maxDocs=44218)
               0.09375 = fieldNorm(doc=801)
         0.01435838 = weight(abstract_txt:this in 801) [ClassicSimilarity], result of:
           0.01435838 = score(doc=801,freq=1.0), product of:
             0.06347076 = queryWeight, product of:
               1.2686532 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.02073339 = queryNorm
             0.2262204 = fieldWeight in 801, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.09375 = fieldNorm(doc=801)
         0.14556669 = weight(abstract_txt:metadata in 801) [ClassicSimilarity], result of:
           0.14556669 = score(doc=801,freq=6.0), product of:
             0.12986267 = queryWeight, product of:
               1.2831671 = boost
               4.881247 = idf(docFreq=911, maxDocs=44218)
               0.02073339 = queryNorm
             1.1209279 = fieldWeight in 801, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.881247 = idf(docFreq=911, maxDocs=44218)
               0.09375 = fieldNorm(doc=801)
         0.23263398 = weight(abstract_txt:educational in 801) [ClassicSimilarity], result of:
           0.23263398 = score(doc=801,freq=1.0), product of:
             0.40639856 = queryWeight, product of:
               3.2102005 = boost
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.02073339 = queryNorm
             0.57242817 = fieldWeight in 801, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.09375 = fieldNorm(doc=801)
         0.34260896 = weight(abstract_txt:standards in 801) [ClassicSimilarity], result of:
           0.34260896 = score(doc=801,freq=3.0), product of:
             0.4395499 = queryWeight, product of:
               4.4165096 = boost
               4.800193 = idf(docFreq=988, maxDocs=44218)
               0.02073339 = queryNorm
             0.7794541 = fieldWeight in 801, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.800193 = idf(docFreq=988, maxDocs=44218)
               0.09375 = fieldNorm(doc=801)
       0.24 = coord(6/25)
   

4. Bartolo, L.M.; Lowe, C.S.; Sadoway, D.R.; Powell, A.C.; Glotzer, S.C.: NSDL MatDL : exploring digital library roles (2005) 0.19

   0.18861698 = sum of:
     0.18861698 = product of:
       0.58942807 = sum of:
         0.035236854 = weight(abstract_txt:language in 1181) [ClassicSimilarity], result of:
           0.035236854 = score(doc=1181,freq=2.0), product of:
             0.095325485 = queryWeight, product of:
               1.0993743 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.02073339 = queryNorm
             0.3696478 = fieldWeight in 1181, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=1181)
         0.036527768 = weight(abstract_txt:learning in 1181) [ClassicSimilarity], result of:
           0.036527768 = score(doc=1181,freq=1.0), product of:
             0.12301829 = queryWeight, product of:
               1.2488949 = boost
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.02073339 = queryNorm
             0.29692957 = fieldWeight in 1181, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.0625 = fieldNorm(doc=1181)
         0.009572254 = weight(abstract_txt:this in 1181) [ClassicSimilarity], result of:
           0.009572254 = score(doc=1181,freq=1.0), product of:
             0.06347076 = queryWeight, product of:
               1.2686532 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.02073339 = queryNorm
             0.1508136 = fieldWeight in 1181, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=1181)
         0.039618235 = weight(abstract_txt:metadata in 1181) [ClassicSimilarity], result of:
           0.039618235 = score(doc=1181,freq=1.0), product of:
             0.12986267 = queryWeight, product of:
               1.2831671 = boost
               4.881247 = idf(docFreq=911, maxDocs=44218)
               0.02073339 = queryNorm
             0.30507794 = fieldWeight in 1181, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.881247 = idf(docFreq=911, maxDocs=44218)
               0.0625 = fieldNorm(doc=1181)
         0.05848815 = weight(abstract_txt:tool in 1181) [ClassicSimilarity], result of:
           0.05848815 = score(doc=1181,freq=2.0), product of:
             0.1336358 = queryWeight, product of:
               1.3016747 = boost
               4.951651 = idf(docFreq=849, maxDocs=44218)
               0.02073339 = queryNorm
             0.43766826 = fieldWeight in 1181, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.951651 = idf(docFreq=849, maxDocs=44218)
               0.0625 = fieldNorm(doc=1181)
         0.058785107 = weight(abstract_txt:digital in 1181) [ClassicSimilarity], result of:
           0.058785107 = score(doc=1181,freq=2.0), product of:
             0.15349217 = queryWeight, product of:
               1.7085583 = boost
               4.332974 = idf(docFreq=1577, maxDocs=44218)
               0.02073339 = queryNorm
             0.3829844 = fieldWeight in 1181, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.332974 = idf(docFreq=1577, maxDocs=44218)
               0.0625 = fieldNorm(doc=1181)
         0.21932942 = weight(abstract_txt:educational in 1181) [ClassicSimilarity], result of:
           0.21932942 = score(doc=1181,freq=2.0), product of:
             0.40639856 = queryWeight, product of:
               3.2102005 = boost
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.02073339 = queryNorm
             0.53969043 = fieldWeight in 1181, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.1059003 = idf(docFreq=267, maxDocs=44218)
               0.0625 = fieldNorm(doc=1181)
         0.13187027 = weight(abstract_txt:standards in 1181) [ClassicSimilarity], result of:
           0.13187027 = score(doc=1181,freq=1.0), product of:
             0.4395499 = queryWeight, product of:
               4.4165096 = boost
               4.800193 = idf(docFreq=988, maxDocs=44218)
               0.02073339 = queryNorm
             0.30001205 = fieldWeight in 1181, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.800193 = idf(docFreq=988, maxDocs=44218)
               0.0625 = fieldNorm(doc=1181)
       0.32 = coord(8/25)
   

5. Christel, M.G.: Automated metadata in multimedia information systems : creation, refinement, use in surrogates, and evaluation (2009) 0.17

   0.17286941 = sum of:
     0.17286941 = product of:
       0.4801928 = sum of:
         0.024916219 = weight(abstract_txt:language in 3086) [ClassicSimilarity], result of:
           0.024916219 = score(doc=3086,freq=1.0), product of:
             0.095325485 = queryWeight, product of:
               1.0993743 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.02073339 = queryNorm
             0.26138046 = fieldWeight in 3086, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=3086)
         0.044425126 = weight(abstract_txt:resources in 3086) [ClassicSimilarity], result of:
           0.044425126 = score(doc=3086,freq=3.0), product of:
             0.09718508 = queryWeight, product of:
               1.1100458 = boost
               4.2226825 = idf(docFreq=1761, maxDocs=44218)
               0.02073339 = queryNorm
             0.45711878 = fieldWeight in 3086, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.2226825 = idf(docFreq=1761, maxDocs=44218)
               0.0625 = fieldNorm(doc=3086)
         0.036527768 = weight(abstract_txt:learning in 3086) [ClassicSimilarity], result of:
           0.036527768 = score(doc=3086,freq=1.0), product of:
             0.12301829 = queryWeight, product of:
               1.2488949 = boost
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.02073339 = queryNorm
             0.29692957 = fieldWeight in 3086, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.750873 = idf(docFreq=1038, maxDocs=44218)
               0.0625 = fieldNorm(doc=3086)
         0.009572254 = weight(abstract_txt:this in 3086) [ClassicSimilarity], result of:
           0.009572254 = score(doc=3086,freq=1.0), product of:
             0.06347076 = queryWeight, product of:
               1.2686532 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.02073339 = queryNorm
             0.1508136 = fieldWeight in 3086, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=3086)
         0.08858907 = weight(abstract_txt:metadata in 3086) [ClassicSimilarity], result of:
           0.08858907 = score(doc=3086,freq=5.0), product of:
             0.12986267 = queryWeight, product of:
               1.2831671 = boost
               4.881247 = idf(docFreq=911, maxDocs=44218)
               0.02073339 = queryNorm
             0.68217504 = fieldWeight in 3086, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.881247 = idf(docFreq=911, maxDocs=44218)
               0.0625 = fieldNorm(doc=3086)
         0.04086315 = weight(abstract_txt:processing in 3086) [ClassicSimilarity], result of:
           0.04086315 = score(doc=3086,freq=1.0), product of:
             0.13256904 = queryWeight, product of:
               1.296469 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.02073339 = queryNorm
             0.3082405 = fieldWeight in 3086, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=3086)
         0.04464386 = weight(abstract_txt:natural in 3086) [ClassicSimilarity], result of:
           0.04464386 = score(doc=3086,freq=1.0), product of:
             0.14062485 = queryWeight, product of:
               1.3352792 = boost
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.02073339 = queryNorm
             0.31746778 = fieldWeight in 3086, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0794845 = idf(docFreq=747, maxDocs=44218)
               0.0625 = fieldNorm(doc=3086)
         0.058785107 = weight(abstract_txt:digital in 3086) [ClassicSimilarity], result of:
           0.058785107 = score(doc=3086,freq=2.0), product of:
             0.15349217 = queryWeight, product of:
               1.7085583 = boost
               4.332974 = idf(docFreq=1577, maxDocs=44218)
               0.02073339 = queryNorm
             0.3829844 = fieldWeight in 3086, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.332974 = idf(docFreq=1577, maxDocs=44218)
               0.0625 = fieldNorm(doc=3086)
         0.13187027 = weight(abstract_txt:standards in 3086) [ClassicSimilarity], result of:
           0.13187027 = score(doc=3086,freq=1.0), product of:
             0.4395499 = queryWeight, product of:
               4.4165096 = boost
               4.800193 = idf(docFreq=988, maxDocs=44218)
               0.02073339 = queryNorm
             0.30001205 = fieldWeight in 3086, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.800193 = idf(docFreq=988, maxDocs=44218)
               0.0625 = fieldNorm(doc=3086)
       0.36 = coord(9/25)