Document (#37133)

Author

Town, C.

Title

Ontological inference for image and video analysis

Source

Journal machine vision and spplications archive. 17(2006) no.2, S.94-115

Year

2006

Abstract

This paper presents an approach to designing and implementing extensible computational models for perceiving systems based on a knowledge-driven joint inference approach. These models can integrate different sources of information both horizontally (multi-modal and temporal fusion) and vertically (bottom-up, top-down) by incorporating prior hierarchical knowledge expressed as an extensible ontology.Two implementations of this approach are presented. The first consists of a content-based image retrieval system that allows users to search image databases using an ontological query language. Queries are parsed using a probabilistic grammar and Bayesian networks to map high-level concepts onto low-level image descriptors, thereby bridging the 'semantic gap' between users and the retrieval system. The second application extends the notion of ontological languages to video event detection. It is shown how effective high-level state and event recognition mechanisms can be learned from a set of annotated training sequences by incorporating syntactic and semantic constraints represented by an ontology.

Content

Vgl.: doi:10.1007/s00138-006-0017-3.

Theme

Wissensrepräsentation

Form

Bilder
Videos

Similar documents (content)

1. AAAI 1997 Spring symposium series reports (1997) 0.15

   0.15093938 = sum of:
     0.15093938 = product of:
       0.75469685 = sum of:
         0.030374972 = weight(abstract_txt:knowledge in 2742) [ClassicSimilarity], result of:
           0.030374972 = score(doc=2742,freq=1.0), product of:
             0.06839691 = queryWeight, product of:
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.019251613 = queryNorm
             0.4440986 = fieldWeight in 2742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.125 = fieldNorm(doc=2742)
         0.067733526 = weight(abstract_txt:models in 2742) [ClassicSimilarity], result of:
           0.067733526 = score(doc=2742,freq=1.0), product of:
             0.116742335 = queryWeight, product of:
               1.3064594 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.019251613 = queryNorm
             0.5801968 = fieldWeight in 2742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.125 = fieldNorm(doc=2742)
         0.15620397 = weight(abstract_txt:video in 2742) [ClassicSimilarity], result of:
           0.15620397 = score(doc=2742,freq=1.0), product of:
             0.20377643 = queryWeight, product of:
               1.7260712 = boost
               6.1323667 = idf(docFreq=260, maxDocs=44218)
               0.019251613 = queryNorm
             0.76654583 = fieldWeight in 2742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.1323667 = idf(docFreq=260, maxDocs=44218)
               0.125 = fieldNorm(doc=2742)
         0.29009914 = weight(abstract_txt:ontological in 2742) [ClassicSimilarity], result of:
           0.29009914 = score(doc=2742,freq=1.0), product of:
             0.3524417 = queryWeight, product of:
               2.7801678 = boost
               6.5848994 = idf(docFreq=165, maxDocs=44218)
               0.019251613 = queryNorm
             0.8231124 = fieldWeight in 2742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5848994 = idf(docFreq=165, maxDocs=44218)
               0.125 = fieldNorm(doc=2742)
         0.21028523 = weight(abstract_txt:image in 2742) [ClassicSimilarity], result of:
           0.21028523 = score(doc=2742,freq=1.0), product of:
             0.31302217 = queryWeight, product of:
               3.0254104 = boost
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.019251613 = queryNorm
             0.67179024 = fieldWeight in 2742, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.125 = fieldNorm(doc=2742)
       0.2 = coord(5/25)
   

2. Wang, X.; Erdelez, S.; Allen, C.; Anderson, B.; Cao, H.; Shyu, C.-R.: Role of domain knowledge in developing user-centered medical-image indexing (2012) 0.15

   0.1503695 = sum of:
     0.1503695 = product of:
       0.6265396 = sum of:
         0.026305499 = weight(abstract_txt:knowledge in 4977) [ClassicSimilarity], result of:
           0.026305499 = score(doc=4977,freq=3.0), product of:
             0.06839691 = queryWeight, product of:
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.019251613 = queryNorm
             0.38460067 = fieldWeight in 4977, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.0625 = fieldNorm(doc=4977)
         0.030812817 = weight(abstract_txt:users in 4977) [ClassicSimilarity], result of:
           0.030812817 = score(doc=4977,freq=4.0), product of:
             0.06905262 = queryWeight, product of:
               1.004782 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.019251613 = queryNorm
             0.44622225 = fieldWeight in 4977, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.0625 = fieldNorm(doc=4977)
         0.042901672 = weight(abstract_txt:semantic in 4977) [ClassicSimilarity], result of:
           0.042901672 = score(doc=4977,freq=2.0), product of:
             0.108480595 = queryWeight, product of:
               1.2593828 = boost
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.019251613 = queryNorm
             0.39547786 = fieldWeight in 4977, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4743214 = idf(docFreq=1369, maxDocs=44218)
               0.0625 = fieldNorm(doc=4977)
         0.05496448 = weight(abstract_txt:high in 4977) [ClassicSimilarity], result of:
           0.05496448 = score(doc=4977,freq=2.0), product of:
             0.12796484 = queryWeight, product of:
               1.3678141 = boost
               4.8595543 = idf(docFreq=931, maxDocs=44218)
               0.019251613 = queryNorm
             0.42952797 = fieldWeight in 4977, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8595543 = idf(docFreq=931, maxDocs=44218)
               0.0625 = fieldNorm(doc=4977)
         0.092458025 = weight(abstract_txt:level in 4977) [ClassicSimilarity], result of:
           0.092458025 = score(doc=4977,freq=4.0), product of:
             0.16444452 = queryWeight, product of:
               1.899053 = boost
               4.497956 = idf(docFreq=1337, maxDocs=44218)
               0.019251613 = queryNorm
             0.5622445 = fieldWeight in 4977, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.497956 = idf(docFreq=1337, maxDocs=44218)
               0.0625 = fieldNorm(doc=4977)
         0.3790971 = weight(abstract_txt:image in 4977) [ClassicSimilarity], result of:
           0.3790971 = score(doc=4977,freq=13.0), product of:
             0.31302217 = queryWeight, product of:
               3.0254104 = boost
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.019251613 = queryNorm
             1.2110871 = fieldWeight in 4977, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.0625 = fieldNorm(doc=4977)
       0.24 = coord(6/25)
   

3. Nie, J.-Y.; Brisebois, M.: ¬An inferential approach to information retrieval and its implementation using a manual thesaurus (1996) 0.15

   0.1478858 = sum of:
     0.1478858 = product of:
       0.739429 = sum of:
         0.026578102 = weight(abstract_txt:knowledge in 7706) [ClassicSimilarity], result of:
           0.026578102 = score(doc=7706,freq=1.0), product of:
             0.06839691 = queryWeight, product of:
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.019251613 = queryNorm
             0.38858628 = fieldWeight in 7706, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.109375 = fieldNorm(doc=7706)
         0.1986893 = weight(abstract_txt:modal in 7706) [ClassicSimilarity], result of:
           0.1986893 = score(doc=7706,freq=1.0), product of:
             0.20755197 = queryWeight, product of:
               1.2317716 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.019251613 = queryNorm
             0.957299 = fieldWeight in 7706, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.109375 = fieldNorm(doc=7706)
         0.046706427 = weight(abstract_txt:approach in 7706) [ClassicSimilarity], result of:
           0.046706427 = score(doc=7706,freq=1.0), product of:
             0.114016764 = queryWeight, product of:
               1.5812907 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.019251613 = queryNorm
             0.40964526 = fieldWeight in 7706, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.109375 = fieldNorm(doc=7706)
         0.1868937 = weight(abstract_txt:incorporating in 7706) [ClassicSimilarity], result of:
           0.1868937 = score(doc=7706,freq=1.0), product of:
             0.25104427 = queryWeight, product of:
               1.9158297 = boost
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.019251613 = queryNorm
             0.7444651 = fieldWeight in 7706, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.109375 = fieldNorm(doc=7706)
         0.28056148 = weight(abstract_txt:inference in 7706) [ClassicSimilarity], result of:
           0.28056148 = score(doc=7706,freq=2.0), product of:
             0.26123372 = queryWeight, product of:
               1.954323 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.019251613 = queryNorm
             1.0739864 = fieldWeight in 7706, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.109375 = fieldNorm(doc=7706)
       0.2 = coord(5/25)
   

4. Zhu, B.; Chen, H.: Validating a geographical image retrieval system (2000) 0.14

   0.14096077 = sum of:
     0.14096077 = product of:
       0.58733654 = sum of:
         0.018984357 = weight(abstract_txt:knowledge in 4769) [ClassicSimilarity], result of:
           0.018984357 = score(doc=4769,freq=1.0), product of:
             0.06839691 = queryWeight, product of:
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.019251613 = queryNorm
             0.2775616 = fieldWeight in 4769, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.078125 = fieldNorm(doc=4769)
         0.019258011 = weight(abstract_txt:users in 4769) [ClassicSimilarity], result of:
           0.019258011 = score(doc=4769,freq=1.0), product of:
             0.06905262 = queryWeight, product of:
               1.004782 = boost
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.019251613 = queryNorm
             0.2788889 = fieldWeight in 4769, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.569778 = idf(docFreq=3384, maxDocs=44218)
               0.078125 = fieldNorm(doc=4769)
         0.042333458 = weight(abstract_txt:models in 4769) [ClassicSimilarity], result of:
           0.042333458 = score(doc=4769,freq=1.0), product of:
             0.116742335 = queryWeight, product of:
               1.3064594 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.019251613 = queryNorm
             0.362623 = fieldWeight in 4769, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.078125 = fieldNorm(doc=4769)
         0.03336173 = weight(abstract_txt:approach in 4769) [ClassicSimilarity], result of:
           0.03336173 = score(doc=4769,freq=1.0), product of:
             0.114016764 = queryWeight, product of:
               1.5812907 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.019251613 = queryNorm
             0.29260373 = fieldWeight in 4769, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.078125 = fieldNorm(doc=4769)
         0.057786264 = weight(abstract_txt:level in 4769) [ClassicSimilarity], result of:
           0.057786264 = score(doc=4769,freq=1.0), product of:
             0.16444452 = queryWeight, product of:
               1.899053 = boost
               4.497956 = idf(docFreq=1337, maxDocs=44218)
               0.019251613 = queryNorm
             0.3514028 = fieldWeight in 4769, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.497956 = idf(docFreq=1337, maxDocs=44218)
               0.078125 = fieldNorm(doc=4769)
         0.4156127 = weight(abstract_txt:image in 4769) [ClassicSimilarity], result of:
           0.4156127 = score(doc=4769,freq=10.0), product of:
             0.31302217 = queryWeight, product of:
               3.0254104 = boost
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.019251613 = queryNorm
             1.3277421 = fieldWeight in 4769, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.078125 = fieldNorm(doc=4769)
       0.24 = coord(6/25)
   

5. Schank, R.C.; Fano, A.: Memory and expectations in learning, language, and visual understanding (1995) 0.13

   0.12691733 = sum of:
     0.12691733 = product of:
       0.52882224 = sum of:
         0.018984357 = weight(abstract_txt:knowledge in 3882) [ClassicSimilarity], result of:
           0.018984357 = score(doc=3882,freq=1.0), product of:
             0.06839691 = queryWeight, product of:
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.019251613 = queryNorm
             0.2775616 = fieldWeight in 3882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.078125 = fieldNorm(doc=3882)
         0.042333458 = weight(abstract_txt:models in 3882) [ClassicSimilarity], result of:
           0.042333458 = score(doc=3882,freq=1.0), product of:
             0.116742335 = queryWeight, product of:
               1.3064594 = boost
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.019251613 = queryNorm
             0.362623 = fieldWeight in 3882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6415744 = idf(docFreq=1158, maxDocs=44218)
               0.078125 = fieldNorm(doc=3882)
         0.048582193 = weight(abstract_txt:high in 3882) [ClassicSimilarity], result of:
           0.048582193 = score(doc=3882,freq=1.0), product of:
             0.12796484 = queryWeight, product of:
               1.3678141 = boost
               4.8595543 = idf(docFreq=931, maxDocs=44218)
               0.019251613 = queryNorm
             0.37965268 = fieldWeight in 3882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8595543 = idf(docFreq=931, maxDocs=44218)
               0.078125 = fieldNorm(doc=3882)
         0.057786264 = weight(abstract_txt:level in 3882) [ClassicSimilarity], result of:
           0.057786264 = score(doc=3882,freq=1.0), product of:
             0.16444452 = queryWeight, product of:
               1.899053 = boost
               4.497956 = idf(docFreq=1337, maxDocs=44218)
               0.019251613 = queryNorm
             0.3514028 = fieldWeight in 3882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.497956 = idf(docFreq=1337, maxDocs=44218)
               0.078125 = fieldNorm(doc=3882)
         0.13349551 = weight(abstract_txt:incorporating in 3882) [ClassicSimilarity], result of:
           0.13349551 = score(doc=3882,freq=1.0), product of:
             0.25104427 = queryWeight, product of:
               1.9158297 = boost
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.019251613 = queryNorm
             0.5317608 = fieldWeight in 3882, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.806538 = idf(docFreq=132, maxDocs=44218)
               0.078125 = fieldNorm(doc=3882)
         0.22764044 = weight(abstract_txt:image in 3882) [ClassicSimilarity], result of:
           0.22764044 = score(doc=3882,freq=3.0), product of:
             0.31302217 = queryWeight, product of:
               3.0254104 = boost
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.019251613 = queryNorm
             0.72723424 = fieldWeight in 3882, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.374322 = idf(docFreq=556, maxDocs=44218)
               0.078125 = fieldNorm(doc=3882)
       0.24 = coord(6/25)