Document (#33266)

Author

Shirky, C.

Title

Ontology is overrated : categories, links, and tags

Source

http://www.shirky.com/writings/ontology_overrated.html

Year

2005

Series

Clay Shirky's writings about the Internet

Abstract

Today I want to talk about categorization, and I want to convince you that a lot of what we think we know about categorization is wrong. In particular, I want to convince you that many of the ways we're attempting to apply categorization to the electronic world are actually a bad fit, because we've adopted habits of mind that are left over from earlier strategies. I also want to convince you that what we're seeing when we see the Web is actually a radical break with previous categorization strategies, rather than an extension of them. The second part of the talk is more speculative, because it is often the case that old systems get broken before people know what's going to take their place. (Anyone watching the music industry can see this at work today.) That's what I think is happening with categorization. What I think is coming instead are much more organic ways of organizing information than our current categorization schemes allow, based on two units -- the link, which can point to anything, and the tag, which is a way of attaching labels to links. The strategy of tagging -- free-form labeling, without regard to categorical constraints -- seems like a recipe for disaster, but as the Web has shown us, you can extract a surprising amount of value from big messy data sets.

Footnote

This piece is based on two talks I gave in the spring of 2005 -- one at the O'Reilly ETech conference in March, entitled "Ontology Is Overrated", and one at the IMCExpo in April entitled "Folksonomies & Tags: The rise of user-developed classification." The written version is a heavily edited concatenation of those two talks.

Theme

Folksonomies
Social tagging

Similar documents (content)

1. Pioneers in library and information science (2004) 0.11

   0.11224528 = sum of:
     0.11224528 = product of:
       0.400876 = sum of:
         0.07402443 = weight(abstract_txt:happening in 24) [ClassicSimilarity], result of:
           0.07402443 = score(doc=24,freq=1.0), product of:
             0.1344903 = queryWeight, product of:
               1.0482637 = boost
               8.806516 = idf(docFreq=17, maxDocs=44218)
               0.01456855 = queryNorm
             0.55040723 = fieldWeight in 24, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.806516 = idf(docFreq=17, maxDocs=44218)
               0.0625 = fieldNorm(doc=24)
         0.02490909 = weight(abstract_txt:because in 24) [ClassicSimilarity], result of:
           0.02490909 = score(doc=24,freq=1.0), product of:
             0.08197652 = queryWeight, product of:
               1.1574035 = boost
               4.8617024 = idf(docFreq=929, maxDocs=44218)
               0.01456855 = queryNorm
             0.3038564 = fieldWeight in 24, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8617024 = idf(docFreq=929, maxDocs=44218)
               0.0625 = fieldNorm(doc=24)
         0.010195399 = weight(abstract_txt:that in 24) [ClassicSimilarity], result of:
           0.010195399 = score(doc=24,freq=2.0), product of:
             0.048680726 = queryWeight, product of:
               1.4102255 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01456855 = queryNorm
             0.20943399 = fieldWeight in 24, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=24)
         0.04980285 = weight(abstract_txt:know in 24) [ClassicSimilarity], result of:
           0.04980285 = score(doc=24,freq=1.0), product of:
             0.13010292 = queryWeight, product of:
               1.4580874 = boost
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.01456855 = queryNorm
             0.3827958 = fieldWeight in 24, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.0625 = fieldNorm(doc=24)
         0.06223522 = weight(abstract_txt:actually in 24) [ClassicSimilarity], result of:
           0.06223522 = score(doc=24,freq=1.0), product of:
             0.1509414 = queryWeight, product of:
               1.5705228 = boost
               6.5970206 = idf(docFreq=163, maxDocs=44218)
               0.01456855 = queryNorm
             0.4123138 = fieldWeight in 24, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5970206 = idf(docFreq=163, maxDocs=44218)
               0.0625 = fieldNorm(doc=24)
         0.085303955 = weight(abstract_txt:what in 24) [ClassicSimilarity], result of:
           0.085303955 = score(doc=24,freq=6.0), product of:
             0.12913875 = queryWeight, product of:
               2.054392 = boost
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.01456855 = queryNorm
             0.6605605 = fieldWeight in 24, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.0625 = fieldNorm(doc=24)
         0.09440504 = weight(abstract_txt:think in 24) [ClassicSimilarity], result of:
           0.09440504 = score(doc=24,freq=1.0), product of:
             0.22811024 = queryWeight, product of:
               2.364602 = boost
               6.6217136 = idf(docFreq=159, maxDocs=44218)
               0.01456855 = queryNorm
             0.4138571 = fieldWeight in 24, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6217136 = idf(docFreq=159, maxDocs=44218)
               0.0625 = fieldNorm(doc=24)
       0.28 = coord(7/25)
   

2. Müller, J.F.: ¬A librarian's guide to the Internet : a guide to searching and evaluating information (2003) 0.11

   0.10779686 = sum of:
     0.10779686 = product of:
       0.4491536 = sum of:
         0.043722976 = weight(abstract_txt:strategies in 4502) [ClassicSimilarity], result of:
           0.043722976 = score(doc=4502,freq=1.0), product of:
             0.09103251 = queryWeight, product of:
               1.2196586 = boost
               5.123207 = idf(docFreq=715, maxDocs=44218)
               0.01456855 = queryNorm
             0.48030066 = fieldWeight in 4502, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.123207 = idf(docFreq=715, maxDocs=44218)
               0.09375 = fieldNorm(doc=4502)
         0.04674304 = weight(abstract_txt:links in 4502) [ClassicSimilarity], result of:
           0.04674304 = score(doc=4502,freq=1.0), product of:
             0.09517758 = queryWeight, product of:
               1.2471175 = boost
               5.2385488 = idf(docFreq=637, maxDocs=44218)
               0.01456855 = queryNorm
             0.49111396 = fieldWeight in 4502, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2385488 = idf(docFreq=637, maxDocs=44218)
               0.09375 = fieldNorm(doc=4502)
         0.010813853 = weight(abstract_txt:that in 4502) [ClassicSimilarity], result of:
           0.010813853 = score(doc=4502,freq=1.0), product of:
             0.048680726 = queryWeight, product of:
               1.4102255 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01456855 = queryNorm
             0.22213829 = fieldWeight in 4502, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.09375 = fieldNorm(doc=4502)
         0.074704275 = weight(abstract_txt:know in 4502) [ClassicSimilarity], result of:
           0.074704275 = score(doc=4502,freq=1.0), product of:
             0.13010292 = queryWeight, product of:
               1.4580874 = boost
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.01456855 = queryNorm
             0.5741937 = fieldWeight in 4502, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.09375 = fieldNorm(doc=4502)
         0.09047851 = weight(abstract_txt:what in 4502) [ClassicSimilarity], result of:
           0.09047851 = score(doc=4502,freq=3.0), product of:
             0.12913875 = queryWeight, product of:
               2.054392 = boost
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.01456855 = queryNorm
             0.7006302 = fieldWeight in 4502, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.09375 = fieldNorm(doc=4502)
         0.18269096 = weight(abstract_txt:want in 4502) [ClassicSimilarity], result of:
           0.18269096 = score(doc=4502,freq=1.0), product of:
             0.2975396 = queryWeight, product of:
               3.1183684 = boost
               6.5493927 = idf(docFreq=171, maxDocs=44218)
               0.01456855 = queryNorm
             0.61400557 = fieldWeight in 4502, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5493927 = idf(docFreq=171, maxDocs=44218)
               0.09375 = fieldNorm(doc=4502)
       0.24 = coord(6/25)
   

3. Allo, P.; Baumgaertner, B.; D'Alfonso, S.; Fresco, N.; Gobbo, F.; Grubaugh, C.; Iliadis, A.; Illari, P.; Kerr, E.; Primiero, G.; Russo, F.; Schulz, C.; Taddeo, M.; Turilli, M.; Vakarelov, O.; Zenil, H.: ¬The philosophy of information : an introduction (2013) 0.09

   0.09171366 = sum of:
     0.09171366 = product of:
       0.38214025 = sum of:
         0.015568181 = weight(abstract_txt:because in 3380) [ClassicSimilarity], result of:
           0.015568181 = score(doc=3380,freq=1.0), product of:
             0.08197652 = queryWeight, product of:
               1.1574035 = boost
               4.8617024 = idf(docFreq=929, maxDocs=44218)
               0.01456855 = queryNorm
             0.18991025 = fieldWeight in 3380, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8617024 = idf(docFreq=929, maxDocs=44218)
               0.0390625 = fieldNorm(doc=3380)
         0.007804226 = weight(abstract_txt:that in 3380) [ClassicSimilarity], result of:
           0.007804226 = score(doc=3380,freq=3.0), product of:
             0.048680726 = queryWeight, product of:
               1.4102255 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01456855 = queryNorm
             0.1603145 = fieldWeight in 3380, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0390625 = fieldNorm(doc=3380)
         0.05535072 = weight(abstract_txt:talk in 3380) [ClassicSimilarity], result of:
           0.05535072 = score(doc=3380,freq=1.0), product of:
             0.19096176 = queryWeight, product of:
               1.7664984 = boost
               7.4202213 = idf(docFreq=71, maxDocs=44218)
               0.01456855 = queryNorm
             0.28985238 = fieldWeight in 3380, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.4202213 = idf(docFreq=71, maxDocs=44218)
               0.0390625 = fieldNorm(doc=3380)
         0.11232239 = weight(abstract_txt:we're in 3380) [ClassicSimilarity], result of:
           0.11232239 = score(doc=3380,freq=1.0), product of:
             0.3060848 = queryWeight, product of:
               2.236459 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.01456855 = queryNorm
             0.36696494 = fieldWeight in 3380, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.0390625 = fieldNorm(doc=3380)
         0.08344306 = weight(abstract_txt:think in 3380) [ClassicSimilarity], result of:
           0.08344306 = score(doc=3380,freq=2.0), product of:
             0.22811024 = queryWeight, product of:
               2.364602 = boost
               6.6217136 = idf(docFreq=159, maxDocs=44218)
               0.01456855 = queryNorm
             0.36580145 = fieldWeight in 3380, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.6217136 = idf(docFreq=159, maxDocs=44218)
               0.0390625 = fieldNorm(doc=3380)
         0.10765167 = weight(abstract_txt:want in 3380) [ClassicSimilarity], result of:
           0.10765167 = score(doc=3380,freq=2.0), product of:
             0.2975396 = queryWeight, product of:
               3.1183684 = boost
               6.5493927 = idf(docFreq=171, maxDocs=44218)
               0.01456855 = queryNorm
             0.3618062 = fieldWeight in 3380, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.5493927 = idf(docFreq=171, maxDocs=44218)
               0.0390625 = fieldNorm(doc=3380)
       0.24 = coord(6/25)
   

4. Stephens, O.: Introduction to OpenRefine (2014) 0.09

   0.08719652 = sum of:
     0.08719652 = product of:
       0.43598258 = sum of:
         0.023357753 = weight(abstract_txt:ways in 2884) [ClassicSimilarity], result of:
           0.023357753 = score(doc=2884,freq=1.0), product of:
             0.07853651 = queryWeight, product of:
               1.132859 = boost
               4.7586026 = idf(docFreq=1030, maxDocs=44218)
               0.01456855 = queryNorm
             0.29741266 = fieldWeight in 2884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7586026 = idf(docFreq=1030, maxDocs=44218)
               0.0625 = fieldNorm(doc=2884)
         0.096414424 = weight(abstract_txt:messy in 2884) [ClassicSimilarity], result of:
           0.096414424 = score(doc=2884,freq=1.0), product of:
             0.16039921 = queryWeight, product of:
               1.1447909 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.01456855 = queryNorm
             0.6010904 = fieldWeight in 2884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.0625 = fieldNorm(doc=2884)
         0.070431866 = weight(abstract_txt:know in 2884) [ClassicSimilarity], result of:
           0.070431866 = score(doc=2884,freq=2.0), product of:
             0.13010292 = queryWeight, product of:
               1.4580874 = boost
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.01456855 = queryNorm
             0.541355 = fieldWeight in 2884, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.124733 = idf(docFreq=262, maxDocs=44218)
               0.0625 = fieldNorm(doc=2884)
         0.034825195 = weight(abstract_txt:what in 2884) [ClassicSimilarity], result of:
           0.034825195 = score(doc=2884,freq=1.0), product of:
             0.12913875 = queryWeight, product of:
               2.054392 = boost
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.01456855 = queryNorm
             0.2696727 = fieldWeight in 2884, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.314763 = idf(docFreq=1606, maxDocs=44218)
               0.0625 = fieldNorm(doc=2884)
         0.21095335 = weight(abstract_txt:want in 2884) [ClassicSimilarity], result of:
           0.21095335 = score(doc=2884,freq=3.0), product of:
             0.2975396 = queryWeight, product of:
               3.1183684 = boost
               6.5493927 = idf(docFreq=171, maxDocs=44218)
               0.01456855 = queryNorm
             0.70899254 = fieldWeight in 2884, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.5493927 = idf(docFreq=171, maxDocs=44218)
               0.0625 = fieldNorm(doc=2884)
       0.2 = coord(5/25)
   

5. Goren-Bar, D.; Kuflik, T.: Supporting user-subjective categorization with self-organizing maps and learning vector quantization (2005) 0.08

   0.084440075 = sum of:
     0.084440075 = product of:
       0.7036673 = sum of:
         0.012486761 = weight(abstract_txt:that in 3325) [ClassicSimilarity], result of:
           0.012486761 = score(doc=3325,freq=3.0), product of:
             0.048680726 = queryWeight, product of:
               1.4102255 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.01456855 = queryNorm
             0.2565032 = fieldWeight in 3325, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=3325)
         0.046199378 = weight(abstract_txt:today in 3325) [ClassicSimilarity], result of:
           0.046199378 = score(doc=3325,freq=1.0), product of:
             0.12374899 = queryWeight, product of:
               1.4220369 = boost
               5.973302 = idf(docFreq=305, maxDocs=44218)
               0.01456855 = queryNorm
             0.37333137 = fieldWeight in 3325, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.973302 = idf(docFreq=305, maxDocs=44218)
               0.0625 = fieldNorm(doc=3325)
         0.64498115 = weight(abstract_txt:categorization in 3325) [ClassicSimilarity], result of:
           0.64498115 = score(doc=3325,freq=12.0), product of:
             0.4519901 = queryWeight, product of:
               4.7072268 = boost
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.01456855 = queryNorm
             1.4269807 = fieldWeight in 3325, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.0625 = fieldNorm(doc=3325)
       0.12 = coord(3/25)