Document (#16041)

Author

Sanderson, M.

Title

¬The Reuters test collection

Source

Information retrieval: new systems and current research. Proceedings of the 16th Research Colloquium of the British Computer Society Information Retrieval Specialist Group, Drymen, Scotland, 22-23 Mar 94. Ed.: R. Leon

Imprint

London : Taylor Graham

Year

1996

Pages

S.219-227

Abstract

Describes the Reuters test collection, which at 22.173 references is significantly larger than most traditional test collections. In addition, Reuters has none of the recall calculation problems normally associated with some of the larger test collections available. Explains the method derived by D.D. Lewis to perform retrieval experiments on the Reuters collection and illustrates the use of the Reuters collection using some simple retrieval experiments that compare the performance of stemming algorithms

Theme

Retrievalstudien

Similar documents (author)

1. Sanderson, M.: Revisiting h measured on UK LIS and IR academics (2008) 5.38

   5.378652 = sum of:
     5.378652 = weight(author_txt:sanderson in 1867) [ClassicSimilarity], result of:
       5.378652 = score(doc=1867,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.1162001 = queryNorm
         5.3786526 = fieldWeight in 1867, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.625 = fieldNorm(doc=1867)
   

2. Purves, R.S.; Sanderson, M.: ¬A methodology to allow avalanche forecasting on an information retrieval system (1998) 4.30

   4.302922 = sum of:
     4.302922 = weight(author_txt:sanderson in 1073) [ClassicSimilarity], result of:
       4.302922 = score(doc=1073,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.1162001 = queryNorm
         4.3029222 = fieldWeight in 1073, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.5 = fieldNorm(doc=1073)
   

3. Sanderson, M.; Ruthven, I.: Report on the Glasgow IR group (glair4) submission (1997) 4.30

   4.302922 = sum of:
     4.302922 = weight(author_txt:sanderson in 3088) [ClassicSimilarity], result of:
       4.302922 = score(doc=3088,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.1162001 = queryNorm
         4.3029222 = fieldWeight in 3088, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.5 = fieldNorm(doc=3088)
   

4. Sanderson, M.; Lawrie, D.: Building, testing, and applying concept hierarchies (2000) 4.30

   4.302922 = sum of:
     4.302922 = weight(author_txt:sanderson in 37) [ClassicSimilarity], result of:
       4.302922 = score(doc=37,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.1162001 = queryNorm
         4.3029222 = fieldWeight in 37, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.5 = fieldNorm(doc=37)
   

5. Clough, P.; Sanderson, M.: User experiments with the Eurovision Cross-Language Image Retrieval System (2006) 4.30

   4.302922 = sum of:
     4.302922 = weight(author_txt:sanderson in 5052) [ClassicSimilarity], result of:
       4.302922 = score(doc=5052,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.1162001 = queryNorm
         4.3029222 = fieldWeight in 5052, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           8.6058445 = idf(docFreq=21, maxDocs=44218)
           0.5 = fieldNorm(doc=5052)
   

Similar documents (content)

1. Debole, F.; Sebastiani, F.: ¬An analysis of the relative hardness of Reuters-21578 subsets (2005) 0.17

   0.16733843 = sum of:
     0.16733843 = product of:
       0.83669215 = sum of:
         0.029039796 = weight(abstract_txt:compare in 3456) [ClassicSimilarity], result of:
           0.029039796 = score(doc=3456,freq=1.0), product of:
             0.08275408 = queryWeight, product of:
               1.1041963 = boost
               5.6146684 = idf(docFreq=437, maxDocs=44218)
               0.013348087 = queryNorm
             0.35091677 = fieldWeight in 3456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.6146684 = idf(docFreq=437, maxDocs=44218)
               0.0625 = fieldNorm(doc=3456)
         0.013771079 = weight(abstract_txt:retrieval in 3456) [ClassicSimilarity], result of:
           0.013771079 = score(doc=3456,freq=1.0), product of:
             0.06340386 = queryWeight, product of:
               1.3668612 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.013348087 = queryNorm
             0.21719621 = fieldWeight in 3456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=3456)
         0.09322555 = weight(abstract_txt:collection in 3456) [ClassicSimilarity], result of:
           0.09322555 = score(doc=3456,freq=2.0), product of:
             0.2268961 = queryWeight, product of:
               3.6567485 = boost
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.013348087 = queryNorm
             0.4108733 = fieldWeight in 3456, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.0625 = fieldNorm(doc=3456)
         0.084349 = weight(abstract_txt:test in 3456) [ClassicSimilarity], result of:
           0.084349 = score(doc=3456,freq=1.0), product of:
             0.267424 = queryWeight, product of:
               3.96992 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.013348087 = queryNorm
             0.315413 = fieldWeight in 3456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0625 = fieldNorm(doc=3456)
         0.6163067 = weight(abstract_txt:reuters in 3456) [ClassicSimilarity], result of:
           0.6163067 = score(doc=3456,freq=3.0), product of:
             0.75209826 = queryWeight, product of:
               7.4434433 = boost
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.013348087 = queryNorm
             0.8194497 = fieldWeight in 3456, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.5697527 = idf(docFreq=61, maxDocs=44218)
               0.0625 = fieldNorm(doc=3456)
       0.2 = coord(5/25)
   

2. Frei, H.P.; Stieger, D.: ¬The use of semantic links in hypertext information retrieval (1995) 0.16

   0.16406526 = sum of:
     0.16406526 = product of:
       0.58594733 = sum of:
         0.044636395 = weight(abstract_txt:addition in 1169) [ClassicSimilarity], result of:
           0.044636395 = score(doc=1169,freq=1.0), product of:
             0.069433086 = queryWeight, product of:
               1.0114276 = boost
               5.142954 = idf(docFreq=701, maxDocs=44218)
               0.013348087 = queryNorm
             0.64286923 = fieldWeight in 1169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.142954 = idf(docFreq=701, maxDocs=44218)
               0.125 = fieldNorm(doc=1169)
         0.06102196 = weight(abstract_txt:algorithms in 1169) [ClassicSimilarity], result of:
           0.06102196 = score(doc=1169,freq=1.0), product of:
             0.08552594 = queryWeight, product of:
               1.1225367 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.013348087 = queryNorm
             0.7134907 = fieldWeight in 1169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.125 = fieldNorm(doc=1169)
         0.047704414 = weight(abstract_txt:retrieval in 1169) [ClassicSimilarity], result of:
           0.047704414 = score(doc=1169,freq=3.0), product of:
             0.06340386 = queryWeight, product of:
               1.3668612 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.013348087 = queryNorm
             0.7523897 = fieldWeight in 1169, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.125 = fieldNorm(doc=1169)
         0.032650698 = weight(abstract_txt:some in 1169) [ClassicSimilarity], result of:
           0.032650698 = score(doc=1169,freq=1.0), product of:
             0.07101968 = queryWeight, product of:
               1.4466249 = boost
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.013348087 = queryNorm
             0.45974156 = fieldWeight in 1169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.125 = fieldNorm(doc=1169)
         0.09939504 = weight(abstract_txt:experiments in 1169) [ClassicSimilarity], result of:
           0.09939504 = score(doc=1169,freq=1.0), product of:
             0.14917414 = queryWeight, product of:
               2.0965893 = boost
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.013348087 = queryNorm
             0.6663021 = fieldWeight in 1169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.125 = fieldNorm(doc=1169)
         0.13184084 = weight(abstract_txt:collection in 1169) [ClassicSimilarity], result of:
           0.13184084 = score(doc=1169,freq=1.0), product of:
             0.2268961 = queryWeight, product of:
               3.6567485 = boost
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.013348087 = queryNorm
             0.5810626 = fieldWeight in 1169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.125 = fieldNorm(doc=1169)
         0.168698 = weight(abstract_txt:test in 1169) [ClassicSimilarity], result of:
           0.168698 = score(doc=1169,freq=1.0), product of:
             0.267424 = queryWeight, product of:
               3.96992 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.013348087 = queryNorm
             0.630826 = fieldWeight in 1169, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.125 = fieldNorm(doc=1169)
       0.28 = coord(7/25)
   

3. Cathey, R.J.; Jensen, E.C.; Beitzel, S.M.; Frieder, O.; Grossman, D.: Exploiting parallelism to support scalable hierarchical clustering (2007) 0.15

   0.14511016 = sum of:
     0.14511016 = product of:
       0.45346928 = sum of:
         0.027364068 = weight(abstract_txt:significantly in 448) [ClassicSimilarity], result of:
           0.027364068 = score(doc=448,freq=1.0), product of:
             0.07953913 = queryWeight, product of:
               1.0825351 = boost
               5.5045247 = idf(docFreq=488, maxDocs=44218)
               0.013348087 = queryNorm
             0.3440328 = fieldWeight in 448, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5045247 = idf(docFreq=488, maxDocs=44218)
               0.0625 = fieldNorm(doc=448)
         0.043149043 = weight(abstract_txt:algorithms in 448) [ClassicSimilarity], result of:
           0.043149043 = score(doc=448,freq=2.0), product of:
             0.08552594 = queryWeight, product of:
               1.1225367 = boost
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.013348087 = queryNorm
             0.5045141 = fieldWeight in 448, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.0625 = fieldNorm(doc=448)
         0.013771079 = weight(abstract_txt:retrieval in 448) [ClassicSimilarity], result of:
           0.013771079 = score(doc=448,freq=1.0), product of:
             0.06340386 = queryWeight, product of:
               1.3668612 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.013348087 = queryNorm
             0.21719621 = fieldWeight in 448, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=448)
         0.04798948 = weight(abstract_txt:collections in 448) [ClassicSimilarity], result of:
           0.04798948 = score(doc=448,freq=2.0), product of:
             0.11567099 = queryWeight, product of:
               1.8462002 = boost
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.013348087 = queryNorm
             0.41487914 = fieldWeight in 448, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.0625 = fieldNorm(doc=448)
         0.04969752 = weight(abstract_txt:experiments in 448) [ClassicSimilarity], result of:
           0.04969752 = score(doc=448,freq=1.0), product of:
             0.14917414 = queryWeight, product of:
               2.0965893 = boost
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.013348087 = queryNorm
             0.33315104 = fieldWeight in 448, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.0625 = fieldNorm(doc=448)
         0.07297155 = weight(abstract_txt:larger in 448) [ClassicSimilarity], result of:
           0.07297155 = score(doc=448,freq=1.0), product of:
             0.19271083 = queryWeight, product of:
               2.3829758 = boost
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.013348087 = queryNorm
             0.3786583 = fieldWeight in 448, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0585327 = idf(docFreq=280, maxDocs=44218)
               0.0625 = fieldNorm(doc=448)
         0.11417752 = weight(abstract_txt:collection in 448) [ClassicSimilarity], result of:
           0.11417752 = score(doc=448,freq=3.0), product of:
             0.2268961 = queryWeight, product of:
               3.6567485 = boost
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.013348087 = queryNorm
             0.50321496 = fieldWeight in 448, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.0625 = fieldNorm(doc=448)
         0.084349 = weight(abstract_txt:test in 448) [ClassicSimilarity], result of:
           0.084349 = score(doc=448,freq=1.0), product of:
             0.267424 = queryWeight, product of:
               3.96992 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.013348087 = queryNorm
             0.315413 = fieldWeight in 448, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0625 = fieldNorm(doc=448)
       0.32 = coord(8/25)
   

4. Witschel, H.F.: Global term weights in distributed environments (2008) 0.12

   0.1216036 = sum of:
     0.1216036 = product of:
       0.43429857 = sum of:
         0.027897747 = weight(abstract_txt:addition in 2096) [ClassicSimilarity], result of:
           0.027897747 = score(doc=2096,freq=1.0), product of:
             0.069433086 = queryWeight, product of:
               1.0114276 = boost
               5.142954 = idf(docFreq=701, maxDocs=44218)
               0.013348087 = queryNorm
             0.40179327 = fieldWeight in 2096, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.142954 = idf(docFreq=701, maxDocs=44218)
               0.078125 = fieldNorm(doc=2096)
         0.038912006 = weight(abstract_txt:derived in 2096) [ClassicSimilarity], result of:
           0.038912006 = score(doc=2096,freq=1.0), product of:
             0.08667812 = queryWeight, product of:
               1.1300726 = boost
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.013348087 = queryNorm
             0.44892538 = fieldWeight in 2096, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.078125 = fieldNorm(doc=2096)
         0.034427695 = weight(abstract_txt:retrieval in 2096) [ClassicSimilarity], result of:
           0.034427695 = score(doc=2096,freq=4.0), product of:
             0.06340386 = queryWeight, product of:
               1.3668612 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.013348087 = queryNorm
             0.5429905 = fieldWeight in 2096, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=2096)
         0.020406686 = weight(abstract_txt:some in 2096) [ClassicSimilarity], result of:
           0.020406686 = score(doc=2096,freq=1.0), product of:
             0.07101968 = queryWeight, product of:
               1.4466249 = boost
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.013348087 = queryNorm
             0.28733847 = fieldWeight in 2096, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6779325 = idf(docFreq=3037, maxDocs=44218)
               0.078125 = fieldNorm(doc=2096)
         0.04241711 = weight(abstract_txt:collections in 2096) [ClassicSimilarity], result of:
           0.04241711 = score(doc=2096,freq=1.0), product of:
             0.11567099 = queryWeight, product of:
               1.8462002 = boost
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.013348087 = queryNorm
             0.36670482 = fieldWeight in 2096, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.078125 = fieldNorm(doc=2096)
         0.16480105 = weight(abstract_txt:collection in 2096) [ClassicSimilarity], result of:
           0.16480105 = score(doc=2096,freq=4.0), product of:
             0.2268961 = queryWeight, product of:
               3.6567485 = boost
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.013348087 = queryNorm
             0.72632825 = fieldWeight in 2096, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.078125 = fieldNorm(doc=2096)
         0.10543625 = weight(abstract_txt:test in 2096) [ClassicSimilarity], result of:
           0.10543625 = score(doc=2096,freq=1.0), product of:
             0.267424 = queryWeight, product of:
               3.96992 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.013348087 = queryNorm
             0.39426625 = fieldWeight in 2096, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.078125 = fieldNorm(doc=2096)
       0.28 = coord(7/25)
   

5. Sparck Jones, K.; Rijsbergen, C.J. van: Progress in documentation : Information retrieval test collection (1976) 0.12

   0.12148755 = sum of:
     0.12148755 = product of:
       0.60743773 = sum of:
         0.029212866 = weight(abstract_txt:retrieval in 4161) [ClassicSimilarity], result of:
           0.029212866 = score(doc=4161,freq=2.0), product of:
             0.06340386 = queryWeight, product of:
               1.3668612 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.013348087 = queryNorm
             0.4607427 = fieldWeight in 4161, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=4161)
         0.11381705 = weight(abstract_txt:collections in 4161) [ClassicSimilarity], result of:
           0.11381705 = score(doc=4161,freq=5.0), product of:
             0.11567099 = queryWeight, product of:
               1.8462002 = boost
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.013348087 = queryNorm
             0.9839723 = fieldWeight in 4161, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.09375 = fieldNorm(doc=4161)
         0.10542435 = weight(abstract_txt:experiments in 4161) [ClassicSimilarity], result of:
           0.10542435 = score(doc=4161,freq=2.0), product of:
             0.14917414 = queryWeight, product of:
               2.0965893 = boost
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.013348087 = queryNorm
             0.70672005 = fieldWeight in 4161, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.3304167 = idf(docFreq=581, maxDocs=44218)
               0.09375 = fieldNorm(doc=4161)
         0.13983832 = weight(abstract_txt:collection in 4161) [ClassicSimilarity], result of:
           0.13983832 = score(doc=4161,freq=2.0), product of:
             0.2268961 = queryWeight, product of:
               3.6567485 = boost
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.013348087 = queryNorm
             0.61630994 = fieldWeight in 4161, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.09375 = fieldNorm(doc=4161)
         0.21914512 = weight(abstract_txt:test in 4161) [ClassicSimilarity], result of:
           0.21914512 = score(doc=4161,freq=3.0), product of:
             0.267424 = queryWeight, product of:
               3.96992 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.013348087 = queryNorm
             0.81946695 = fieldWeight in 4161, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.09375 = fieldNorm(doc=4161)
       0.2 = coord(5/25)