Tutorial: Knowledge Bases for Web Content Analytics Johannes Hoffart Max Planck Institute for Inf. http://mpi-inf.mpg.de/~weikum Nicoleta Preda University of Versailles http://preda.fr Fabian Suchanek Télécom ParisTech Univ. http://suchanek.name/ Gerhard Weikum Max Planck Institute for Inf. http://mpi-inf.mpg.de/~weikum http://resources.mpi-inf.mpg.de/yago-naga/www2015-tutorial/
As for Fabian… I am a great fan of Elvis Presley! Is Elvis still alive? 2
Bing => YES 3 ask>
Ask.com => YES 4
Google => NO 5
Wolfram Alpha 6
Wolfram Alpha: How do they know? "Elvis Presley, the first and greatest American rock-and roll star, died yesterday at the age of 42." 7
A knowledge base Content Information analytics Extraction this knowledge base, YAGO, as an example only "Elvis Presley, the first and greatest American rock-and roll star, died yesterday at the age of 42." 8
Knowledge Bases: a Pragmatic Definition For us, a knowledge base (KB) is a comprehensive semantically organized machine-readable collection of universally relevant or domain-specific entities, classes, and facts (attributes, relations) plus spatial and temporal dimensions plus commonsense properties and rules plus contexts of entities and facts (textual & visual witnesses, descriptors, statistics) plus ….. 9
History of Digital Knowledge Bases Cyc x: human(x) ( y: mother(x,y) z: father(x,z)) WordNet guitarist {player,musician} artist from humans for humans from algorithms for machines Wikipedia 4.5 Mio. English articles 20 Mio. contributors 1985 1990 2000 2005 2010 10
Today's knowledge bases > 60 Bio. subject-predicate-object triples from > 1000 sources + Web tables Cyc TextRunner/ ReVerb WikiTaxonomy/ WikiNet SUMO ConceptNet 5 BabelNet ReadTheWeb 11 Cloud diagram from http://lod-cloud.net/ details>
Today's knowledge bases Elvis Presley type American singer Elvis Presley type Baritone American singer subclassOf singer Elvis Presley sang All Shook Up Elvis Presley bornIn Tupelo id11: Elvis Presley marriedTo Priscilla Presley id11 validDuring [1967, 1977] Elvis Presley „has twin brother“ Jesse Garon Elvis Presley „possibly has origin“ Cherokee Elvis Presley knownAs „The King of R&R“ taxonomic knowledge factual knowledge temporal knowledge emerging knowledge terminological knowledge 12 Cloud diagram from http://lod-cloud.net/
Freely available knowledge bases YAGO: yago-knowledge.org Dbpedia: dbpedia.org Freebase / Wikidata: freebase.com, wikidata.org Entitycube: entitycube.research.microsoft.com renlifang.msra.cn NELL: rtw.ml.cmu.edu DeepDive: deepdive.stanford.edu Probase: research.microsoft.com/en-us/projects/probase/ KnowItAll / ReVerb: openie.cs.washington.edu reverb.cs.washington.edu BabelNet: babelnet.org WikiNet: www.h-its.org/english/research/nlp/download/ ConceptNet: conceptnet5.media.mit.edu WordNet: wordnet.princeton.edu Linked Open Data: linkeddata.org 13
Use-Case: Internet Search 14
Google Knowledge Graph (Google Blog: „Things, not Strings“, 16 May 2012) 15
Use Case: Question Answering This town is known as "Sin City" & its downtown is "Glitter Gulch" question classification & decomposition IBM Watson System + KBs Las Vegas [Ferrucci et al., AI Magazine 2010] 16 history>
Use Case: Analysis of History https://www.recordedfuture.com/
Turn Web into Knowledge Base more knowledge, analytics, insight knowledge acquisition Web Contents Knowledge intelligent interpretation
This Tutorial Introduction Harvesting Classes Harvesting Facts Common Sense Knowledge Knowledge Consolidation Web Content Analytics Wrap-Up