1. Cyc Representing, Acquiring and Using Knowledge Dr. Michael Witbrock Cycorp, RER d.o.o. http://cycorp.eu witbrock@cycorp.eu May 24 th, 2007 “People have silly reasons why computers don’t really think. The answer is we haven’t programmed them right; they just don’t have much common sense. There’s been only one large project to do something about that, that’s the famous Cyc project…” - Prof. Marvin Minsky MIT, May, 2001

2. witbrock@cyc.com Cycorp Corporate Mission 1984: Increase human capabilities by building the first true Artificial Intelligence. Revised: Increase human capabilities by teaching the first true Artificial Intelligence to build itself.

3. witbrock@cyc.com Cycorp d.o.o Corporate Mission 1984: Increase human capabilities by building the first true Artificial Intelligence. Further Revised: Increase human capabilities by teaching the first true Artificial Intelligence to parts of itself in Slovenia.

4. witbrock@cyc.com Thing Intangible Thing Individual Temporal Thing Spatial Thing Partially Tangible Thing Paths Sets Relations Logic Math Human Artifacts Social Relations, Culture Human Anatomy & Physiology Emotion Perception Belief Human Behavior & Actions Products Devices Conceptual Works Vehicles Buildings Weapons Mechanical & Electrical Devices Software Literature Works of Art Language Agent Organizations Organizational Actions Organizational Plans Types of Organizations Human Organizations Nations Governments Geo-Politics Business, Military Organizations Law Business & Commerce Politics Warfare Professions Occupations Purchasing Shopping Travel Communication Transportation & Logistics Social Activities Everyday Living Sports Recreation Entertainment Artifacts Movement State Change Dynamics Materials Parts Statics Physical Agents Borders Geometry Events Scripts Spatial Paths Actors Actions Plans Goals Time Agents Space Physical Objects Human Beings Organ- ization Human Activities Living Things Social Behavior Life Forms Animals Plants Ecology Natural Geography Earth & Solar System Political Geography Weather Tens of thousands of Predicates between, owns, isa, beliefs Hundreds of thousands of Concepts CityOfLjubljanaSlovenia, Witbrock, Slovenia, SlovenianLanguage Millions of Assertions “Causes precede effects” (Forall x (Forall y (implies (causes x y) (startsAfterStartOf y x)))) The Cyc Ontology and Content General Knowledge various domains Specific data, facts, and observations about those domains

5. Cycorp © 2007 Cyc is…  The typical bird has 1 beak, 1 heart, lots of feathers,…  Hearts are internal organs; feathers are external protrusions  Most vehicles are steered by an awake, sane, adult,… human  Tangible objects can’t be in 2 (disjoint) places at once  Badly injuring a child is much worse than killing a dog  Causes temporally precede (i.e., start before) their effects  A stabbing requires 2 co-temporal and proximate actors ◦etc., etc., etc., etc., … Millions of facts, rules of thumb, etc. that capture human common sense about our everyday world

6. Cycorp © 2007 Cyc Reasons via Formal Logic Very specific information (some indirect, via SKSI) Upper Ontology Core Theories Domain-Specific Theories EVENT  TEMPORAL-THING  PARTIALLY-TANGIBLE-THING (  a, b ) a  EVENT  b  EVENT  causes( a, b )  precedes( a, b ) (  m, a ) m  MAMMAL  a  ANTHRAX   causes( exposed-to( m, a ), infected-by( m, a ) ) (ist FtLaudHolyCrossERCase#403921 (caused CutaneousAnthrax (SkinLesions Ahmed_al-Haznawit))) First Order Predicate Calculus: unambiguous; enable mechanical reasoning Every Slovene has a president. Every Slovene has a mother. Every Slovene has a president. Every Slovene has a mother. y.x. Slov(x)  president(x,y) x.y. Slov(x)  mother(x,y) y.x. Slov(x)  president(x,y) x.y. Slov(x)  mother(x,y) Higher Order Logic (n th -order predicate calculus): contexts, predicates as variables, nested modals, reflection,…

7. Cycorp © 2007 The Cyc Knowledge Base Thing Intangible Thing Intangible Thing Individual Temporal Thing Temporal Thing Spatial Thing Spatial Thing Partially Tangible Thing Partially Tangible Thing Paths Sets Relations Sets Relations Logic Math Logic Math Human Artifacts Human Artifacts Social Relations, Culture Social Relations, Culture Human Anatomy & Physiology Human Anatomy & Physiology Emotion Perception Belief Emotion Perception Belief Human Behavior & Actions Human Behavior & Actions Products Devices Products Devices Conceptual Works Conceptual Works Vehicles Buildings Weapons Vehicles Buildings Weapons Mechanical & Electrical Devices Mechanical & Electrical Devices Software Literature Works of Art Software Literature Works of Art Language Agent Organizations Agent Organizations Organizational Actions Organizational Actions Organizational Plans Organizational Plans Types of Organizations Types of Organizations Human Organizations Human Organizations Nations Governments Geo-Politics Nations Governments Geo-Politics Business, Military Organizations Business, Military Organizations Law Business & Commerce Business & Commerce Politics Warfare Politics Warfare Professions Occupations Professions Occupations Purchasing Shopping Purchasing Shopping Travel Communication Travel Communication Transportation & Logistics Transportation & Logistics Social Activities Social Activities Everyday Living Everyday Living Sports Recreation Entertainment Sports Recreation Entertainment Artifacts Movement State Change Dynamics State Change Dynamics Materials Parts Statics Materials Parts Statics Physical Agents Physical Agents Borders Geometry Borders Geometry Events Scripts Events Scripts Spatial Paths Spatial Paths Actors Actions Actors Actions Plans Goals Plans Goals Time Agents Space Physical Objects Physical Objects Human Beings Human Beings Organ- ization Organ- ization Human Activities Human Activities Living Things Living Things Social Behavior Social Behavior Life Forms Life Forms Animals Plants Ecology Natural Geography Natural Geography Earth & Solar System Earth & Solar System Political Geography Political Geography Weather General Knowledge about Various Domains Specific data, facts, and observations

8. Cycorp © 2007

9. Thing Intangible Thing Intangible Thing Individual Temporal Thing Temporal Thing Spatial Thing Spatial Thing Partially Tangible Thing Partially Tangible Thing Paths Sets Relations Sets Relations Logic Math Logic Math Human Artifacts Human Artifacts Social Relations, Culture Social Relations, Culture Human Anatomy & Physiology Human Anatomy & Physiology Emotion Perception Belief Emotion Perception Belief Human Behavior & Actions Human Behavior & Actions Products Devices Products Devices Conceptual Works Conceptual Works Vehicles Buildings Weapons Vehicles Buildings Weapons Mechanical & Electrical Devices Mechanical & Electrical Devices Software Literature Works of Art Software Literature Works of Art Language Agent Organizations Agent Organizations Organizational Actions Organizational Actions Organizational Plans Organizational Plans Types of Organizations Types of Organizations Human Organizations Human Organizations Nations Governments Geo-Politics Nations Governments Geo-Politics Business, Military Organizations Business, Military Organizations Law Business & Commerce Business & Commerce Politics Warfare Politics Warfare Professions Occupations Professions Occupations Purchasing Shopping Purchasing Shopping Travel Communication Travel Communication Transportation & Logistics Transportation & Logistics Social Activities Social Activities Everyday Living Everyday Living Sports Recreation Entertainment Sports Recreation Entertainment Artifacts Movement State Change Dynamics State Change Dynamics Materials Parts Statics Materials Parts Statics Physical Agents Physical Agents Borders Geometry Borders Geometry Events Scripts Events Scripts Spatial Paths Spatial Paths Actors Actions Actors Actions Plans Goals Plans Goals Time Agents Space Physical Objects Physical Objects Human Beings Human Beings Organ- ization Organ- ization Human Activities Human Activities Living Things Living Things Social Behavior Social Behavior Life Forms Life Forms Animals Plants Ecology Natural Geography Natural Geography Earth & Solar System Earth & Solar System Political Geography Political Geography Weather General Knowledge about Terrorism Specific data, facts, and observations about terrorist groups and activities Specific data, facts, and observations about terrorist groups and activities General Knowledge about Terrorism: Terrorist groups are capable of directing assassinations: (implies (isa ?GROUP TerroristGroup) (behaviorCapable ?GROUP AssassinatingSomeone directingAgent)) … If a terrorist group considers an agent an enemy, that agent is vulnerable to an attack by that group: (implies (and (isa ?GROUP TerroristGroup) (considersAsEnemy ?GROUP ?TARGET)) (vulnerableTo ?GROUP ?TARGET TerroristAttack)) General Knowledge about Terrorism: Terrorist groups are capable of directing assassinations: (implies (isa ?GROUP TerroristGroup) (behaviorCapable ?GROUP AssassinatingSomeone directingAgent)) … If a terrorist group considers an agent an enemy, that agent is vulnerable to an attack by that group: (implies (and (isa ?GROUP TerroristGroup) (considersAsEnemy ?GROUP ?TARGET)) (vulnerableTo ?GROUP ?TARGET TerroristAttack)) Cyc KB Extended w/Domain Knowledge

10. Cycorp © 2007 Thing Intangible Thing Intangible Thing Individual Temporal Thing Temporal Thing Spatial Thing Spatial Thing Partially Tangible Thing Partially Tangible Thing Paths Sets Relations Sets Relations Logic Math Logic Math Human Artifacts Human Artifacts Social Relations, Culture Social Relations, Culture Human Anatomy & Physiology Human Anatomy & Physiology Emotion Perception Belief Emotion Perception Belief Human Behavior & Actions Human Behavior & Actions Products Devices Products Devices Conceptual Works Conceptual Works Vehicles Buildings Weapons Vehicles Buildings Weapons Mechanical & Electrical Devices Mechanical & Electrical Devices Software Literature Works of Art Software Literature Works of Art Language Agent Organizations Agent Organizations Organizational Actions Organizational Actions Organizational Plans Organizational Plans Types of Organizations Types of Organizations Human Organizations Human Organizations Nations Governments Geo-Politics Nations Governments Geo-Politics Business, Military Organizations Business, Military Organizations Law Business & Commerce Business & Commerce Politics Warfare Politics Warfare Professions Occupations Professions Occupations Purchasing Shopping Purchasing Shopping Travel Communication Travel Communication Transportation & Logistics Transportation & Logistics Social Activities Social Activities Everyday Living Everyday Living Sports Recreation Entertainment Sports Recreation Entertainment Artifacts Movement State Change Dynamics State Change Dynamics Materials Parts Statics Materials Parts Statics Physical Agents Physical Agents Borders Geometry Borders Geometry Events Scripts Events Scripts Spatial Paths Spatial Paths Actors Actions Actors Actions Plans Goals Plans Goals Time Agents Space Physical Objects Physical Objects Human Beings Human Beings Organ- ization Organ- ization Human Activities Human Activities Living Things Living Things Social Behavior Social Behavior Life Forms Life Forms Animals Plants Ecology Natural Geography Natural Geography Earth & Solar System Earth & Solar System Political Geography Political Geography Weather General Knowledge about Terrorism Specific data, facts, and observations about terrorist groups and activities Specific data, facts, and observations about terrorist groups and activities Specific Facts about Al Qaida: (basedInRegion AlQaida Afghanistan) Al-Qaida is based in Afghanistan. (hasBeliefSystems AlQaida IslamicFundamentalistBeliefs) Al-Qaida has Islamic fundamentalist beliefs. (hasLeaders AlQaida OsamaBinLaden) Al-Qaida is led by Osama bin Laden. … (affiliatedWith AlQaida AlQudsMosqueOrganization) Al-Qaida is affiliated with the Al Quds Mosque. (affiliatedWith AlQaida SudaneseIntelligenceService) Al-Qaida is affiliated with the Sudanese Intell Service … (sponsors AlQaida HarakatUlAnsar) Al-Qaida sponsors Harakat ul-Ansar. (sponsors AlQaida LaskarJihad) Al-Qaida sponsors Laskar Jihad. … (performedBy EmbassyBombingInNairobi AlQaida) Al-Qaida bombed the Embassy in Nairobi. (performedBy EmbassyBombingInTanzania AlQaida) Al-Qaida bombed the Embassy in Tanzania. Specific Facts about Al Qaida: (basedInRegion AlQaida Afghanistan) Al-Qaida is based in Afghanistan. (hasBeliefSystems AlQaida IslamicFundamentalistBeliefs) Al-Qaida has Islamic fundamentalist beliefs. (hasLeaders AlQaida OsamaBinLaden) Al-Qaida is led by Osama bin Laden. … (affiliatedWith AlQaida AlQudsMosqueOrganization) Al-Qaida is affiliated with the Al Quds Mosque. (affiliatedWith AlQaida SudaneseIntelligenceService) Al-Qaida is affiliated with the Sudanese Intell Service … (sponsors AlQaida HarakatUlAnsar) Al-Qaida sponsors Harakat ul-Ansar. (sponsors AlQaida LaskarJihad) Al-Qaida sponsors Laskar Jihad. … (performedBy EmbassyBombingInNairobi AlQaida) Al-Qaida bombed the Embassy in Nairobi. (performedBy EmbassyBombingInTanzania AlQaida) Al-Qaida bombed the Embassy in Tanzania. Cyc KB Extended w/Domain Knowledge

11. Cycorp © 2007 Cyc Reasoning Modules Reasoning Modules Interface to External Data Sources Cyc API KnowledgeEntry Tools User Interface (with Natural Language Dialog) Data Bases Data Bases Web Pages Web Pages Text Sources Other KBs Cyc Ontology & Knowledge Base Cyc High-level Architecture

12. Cycorp © 2007 Multiple Contexts and Reasoners The Knowledge Base is divided into thousands of contexts by: granularity, topic, culture, geospatial place, time,... Cyc is not monolithic The inference engine has more than 1,000 “agents” that attack every problem and, recursively, every sub-problem. They have specialised representations and methods to quickly solve common problems. Cyc is not committed to any one reasoning mechanism Soon: Distributed, Parallel Reasoning

13. Cycorp © 2007 Additional reasoning modules can include any manner of external databases, simulators, translators… Cyc is not committed to its own reasoning mechanisms 98% of its content is marked as merely being usually true. Reasoning in Cyc is default (gather up pro/con arguments, and compare them). Cyc is not monotonic Multiple Contexts and Reasoners Soon: Probabilistic Reasoning

14. witbrock@cyc.com Google books project finished Today: Acquiring Knowledge amount known rate of learning learning by discovery learning via natural language codify & enter each piece of knowledge, by hand Frontier of human knowledge CYC In this area, empirical discovery and learning via NL come together. Crossover Point: Cyc learns faster by itself than by manual knowledge entry

15. witbrock@cyc.com Cyc Today Reasoning via deduction, abduction, and induction; access to other reasoning capabilities (through heuristic modules) Growing ability to support Knowledge Acquisition and use via Natural Language General-purpose platform: Supports applications involving search, question answering, knowledge management, scenario generation, situation reporting, (re-)planning, etc. Research Platform: OpenCyc, ResearchCyc

16. Cyc Analytical Environment Michael Witbrock © Cycorp 2007

17. Content and Representation Drill-down Michael Witbrock © Cycorp 2007

18. Cycorp © 2007 Cyc KB Sampler Temporal Relations Senses of “x is a physical part of y” Senses of “x is physically in y” Events and their performers (role types) Organizations Propositional Attitudes Biology Materials Devices Weather

19. Cycorp © 2007 Temporal Relations 37 Relations Between Temporal Things #$temporalBoundsIntersect #$temporallyIntersects #$startsAfterStartingOf #$endsAfterEndingOf #$startingDate #$temporallyContains #$temporallyCooriginating #$temporalBoundsContain #$temporalBoundsIdentical #$startsDuring #$overlapsStart #$startingPoint #$simultaneousWith #$after

20. Cycorp © 2007 Temporal Relations #$temporallyIntersects Some of these Relations are very General, such as: Such relations are particularly useful when they are known not to hold between a pair of individuals: (#$not (#$temporallyIntersects ?X ?Y)) That implies all of these: (#$not (#$spouse PERSON-X PERSON-Y)) (#$not (#$consultant AGENT-X AGENT-Y)) (#$not (#$accountHolder ACCOUNT-X AGENT-Y)) (#$not (#$residesInRegion AGENT-X REGION-Y)) (#$not (#$officiator EVENT-X PERSON-Y))

21. Cycorp © 2007 Senses of ‘Part’ #$parts #$intangibleParts #$subInformation #$subEvents #$physicalDecompositions #$physicalPortions #$physicalParts #$externalParts #$internalParts #$anatomicalParts #$constituents #$functionalPart

22. Cycorp © 2007 Senses of ‘In’ Can the inner object leave by passing between members of the outer group? Yes -- Try #$in-Among

23. Cycorp © 2007 Senses of ‘In’ Does part of the inner object stick out of the container? ◦None of it. -- Try #$in-ContCompletely ◦Yes -- Try #$in-ContPartially ◦ No -- Try #$in-ContClosed ◦If the container were turned around could the contained object fall out? – Yes -- Try #$in-ContOpen

24. Cycorp © 2007 Senses of ‘In’ Can it be removed by pulling, if enough force is used, without damaging either object? –No -- Try #$in-Snugly or #$screwedIn Is it attached to the inside of the outer object ? –Yes -- Try #$connectedToInside Does the inner object stick into the outer object? –Yes – Try #$sticksInto

25. Cycorp © 2007 Event Types #$PhysicalStateChangeEvent #$TemperatureChangingProcess #$BiologicalDevelopmentEvent #$ShapeChangeEvent #$MovementEvent #$ChangingDeviceState #$GivingSomething #$DiscoveryEvent #$Cracking #$Carving #$Buying #$Thinking #$Mixing #$Singing #$CuttingNails #$PumpingFluid 11,000 more

26. Cycorp © 2007 #$performedBy #$causes-EventEvent #$objectPlaced #$objectOfStateChange #$outputsCreated #$inputsDestroyed #$assistingAgent #$beneficiary #$fromLocation #$toLocation #$deviceUsed #$driverActor #$damages #$vehicle #$providerOfMotiveForce #$transportees Over 400 more. Relations Between Events and Participants

27. Cycorp © 2007 Here are some roles for Attack874 isa: TerroristAttack. performedBy: JihadGroup. deviceUsed: Bomb8388. eventOccursAt: CityOfLondonEngland. victim: Person9399. victim: Person52666. assistingAgent: AlQaeda. objectsDestroyed: Structure2990. objectsDestroyed: Vehicle523452. Representation of A Sample Event

28. Natural Language Drill-down Michael Witbrock © Cycorp 2007 日本語 中文 РусскийDeutsch English Español Français Italiano Nederlands Polski Português العربية فارسی বাংলা 한국 어 עברית ქართული Ελληνικά Български (x) (isa x LivingLanguage)  (y) (isa y Person)  (languageSpoken y x)

29. Cycorp © 2007 Cyc NL Lexicon

30. Cycorp © 2007 Constant : Coke-TheWord isa : EnglishWord Mt : EnglishMt singular : “coke”pnSingular : “Coke” massNumber : “coke”pnMassNumber : “Coke” (denotation Coke-TheWord ProperCountNoun 0 (ServingFn CocaCola) ) (denotation Coke-TheWord ProperMassNoun 0 CocaCola) (denotation Coke-TheWord MassNoun 0 Cocaine-Powder) (denotation Coke-TheWord MassNoun 2 ColaSoftDrink) (denotation Coke-TheWord SimpleNoun 0 (ServingFn ColaSoftDrink) ) Lexical Entry Example: Coke SLANG

31. Cycorp © 2007 Lexical Entry Example: Eat (verbSemTrans Eat-TheWord 0 TransitiveNPCompFrame (and (isa :ACTION EatingEvent) (performedBy :ACTION :SUBJECT) (inputsDestroyed :ACTION :OBJECT))) Constant: Eat-TheWord isa: EnglishWord Mt: EnglishMt infinitive: “eat” pastTense: “ate” perfect: “eaten” agentive-Sg: “eater” (subcatFrame Eat-TheWord Verb 0 TransitiveNPCompFrame)

32. Knowledge Reduces Work Blah blah al queda blah blah embassy blah blah grenade blah suicide attack [ Zaquawi] was involved in kidnapping [seven israeli children] A polygraph, also known as a lie detector, is an [ electrical device] The heart consists of four chambers, the two upper atria (singular: atrium) and the two lower ventricles. Concept spotting Extraction Templates EBMT: syntax templates Last resort, full parsing Cycorp © 2007

33. Document Tagging …

34. Entire Cyc KB

35. Military Taxonomy

36. Probabilistic Concept Tagging “The plants that produced the cranes that NASA deployed in space in the 1990s are in Canada.” The plants (#$FactoryBuildingComplex 0.8817 #$Plant 0.0967 ) that produced (#$Production-Generic 0.6017) the cranes (#$Crane-MotorizedDevice 0.9387 #$Crane- Bird 0.0408 ) that NASA (#$NASA) deployed (#$DeployingMaterial) in space (#$OuterSpace 0.51 #$SpaceInAHOC 0.1473 #$ReservedSpaceRegion 0.0459 #$Area 0 ) in the 1990s ((#$DecadeFn 199) 1) are in Canada (#$Canada 1).

37. Knowledge for Disambiguation Simple Example: #$isa “… natural resources, of which oil and diamonds are the most relevant.” “oil” #$Oil #$Petroleum-CrudeOil #$ArtistOilPaint #$PetroleumProduct “oil” #$Oil #$Petroleum-CrudeOil #$ArtistOilPaint #$PetroleumProduct “natural resources” #$NaturalResourceType “natural resources” #$NaturalResourceType “diamonds” #$Diamond #$Diamond-Gem #$Diamonds-Suit “diamonds” #$Diamond #$Diamond-Gem #$Diamonds-Suit #$isa licence Looks for collections in the text of which a given object is an instance #$siblingsWRTType licence Looks for collections in the text that share a type

38. Knowledge Driven Disambiguation Example: “common sense” “The heart pumps blood to the lungs.” “heart” #$Heart-Suit #$Heart-LocusOfFeeling #$CenterOfRegion #$Heart “pumps” #$PumpingFluid #$Pumping-MakingSomething Available #$typeBehaviorCapable Are there any pairs such that every C1 is capable of playing a role in an event of type C2? Cyc Knows: The heart is a kind of pump. Cyc Knows: Every pump can pump fluid.

39. Cycorp © 2007 Noun Compounds More Complex Parsing Renaissance Artists Kind of TimeInterval Noun Form: not plural Kind of Agent-Generic Noun form Bronze Age Farmers (SubcollectionOfWithRelationToFn Artist activeDuringPeriod TheRenaissance) (SubcollectionOfWithRelationToFn Farmer activeDuringPeriod TheBronzeAge)

40. +-------------------------------------------Xp-------------------------------------------+ +------------Wd------------+ +--------------------MVp---------------------+ | | +--------A--------+ | +------Jp-----+----Mp----+ | | | | +--G--+--G-+--Ss--+---Os---+--Mp-+ +--Dmcn--+ +N Sa+ +-Js-+ | | | | | | | | | | | | | | | | LEFT Royal.a Dutch Shell Plc halted.v output.n of 455,000 barrels.n a day.p in Nigeria. (#$and (#$isa (#$TheFn #$DecreaseEvent) (#$DecreaseInValueReturnedByFn (#$ExportRateOfByFn #$Petroleum-CrudeOil) #$Nigeria)) (#$doneBy (#$TheFn #$DecreaseEvent) #$RoyalDutchShell) (#$quantityChangeAmount (#$TheFn #$DecreaseEvent) (#$BarrelsPerDay 455000))) +-------------------------------------------Xp-------------------------------------------+ +------------Wd------------+ +--------------------MVp---------------------+ | | + | +------Jp-----+ | | | +-----------+--Ss--+---Os---+--Mp-+ + +-Js-+ | | | | | | | | | | LEFT [Agent] halted.v output.n of [Quantity] in [Locn]. (#$and (#$isa (#$TheFn #$DecreaseEvent) (#$DecreaseInValueReturnedByFn (#$ExportRateOfByFn #$Petroleum-CrudeOil) [Locn])) (#$doneBy (#$TheFn #$DecreaseEvent) [Agent]) (#$quantityChangeAmount (#$TheFn #$DecreaseEvent) [Quantity])) Petróleos de Venezuela S.A. halted output of 760 000 barrels a week in Maracaibo. (#$and (#$isa (#$TheFn #$DecreaseEvent) (#$DecreaseInValueReturnedByFn (#$ExportRateOfByFn #$Petroleum-CrudeOil) #$CityOfMaracaiboVenezuela)) (#$doneBy (#$TheFn #$DecreaseEvent) #$PetroleosdeVenezuelaSA (#$quantityChangeAmount (#$TheFn #$DecreaseEvent) (#$BarrelsPerDay 760000)))

41. Knowledge Acquisition Drill-down Michael Witbrock © Cycorp 2007 Mohamed Atta

42. Wikipedia Page Download Sentence Extractor EBMT Parser Semantic Checker Success No page found Hypothesis not logically consistent Uninformative sentence Unable to parse (#$genls #$Polygraph #$Device- Physical) Automatically Adding to the Model … Klingberg contacted the USSR for the first time in 1957, and soon after that he started his espionage activity. Israel's foreign and domestic intelligence agencies, Mossad and Shin Bet, started suspecting Klingberg of espionage, but shadowing brought no results. At one point, the scientist also successfully passed the polygraph test… Device-Physical Polygraph genls Cycorp © 2007

43. Michael Witbrock © Cycorp 2007 Query “What are symptoms of Whooping Cough?”  ( symptomOfAilment WhoopingCough ?SYMP ) “What are symptoms of Whooping Cough?”  ( symptomOfAilment WhoopingCough ?SYMP ) NL Generation “A symptom of whooping cough is ___” “Whooping cough can cause ___” “A symptom of Pertussis Bordetella is ___” “Symptoms (such as ____) of whooping cough” “A symptom of whooping cough is ___” “Whooping cough can cause ___” “A symptom of Pertussis Bordetella is ___” “Symptoms (such as ____) of whooping cough” Partial English sentences Learning Facts by Search

44. C. Matuszek, R.C. Kahlert, M Witbrock FACTory © Cycorp 2007 Parsing Results “… symptoms of pertussis such as fever and a dry cough …” Looking for something that matches the argument constraints on the predicate… (symptomOfAilment WhoopingCough Fever) (symptomOfAilment WhoopingCough Coughing-AilmentCondition) Parse back into existing CycL concepts Parsing Results

45. C. Matuszek, R.C. Kahlert, M Witbrock FACTory © Cycorp 2007 KB Consistency Check  

46. M Witbrock © Cycorp 2007 Initial Results 61 Sentences Asserted 348 Queries 817 Searches 1016 Sentences Found (symptomOfAilment WhoopingCough Coughing-AilmentCondition) (symptomOfAilment WhoopingCough Blindness) (symptomOfAilment WhoopingCough Fever) 388 Sentences Rejected 3474 Searches 566 Rejected Total Queries: 348 Web Searches: 4290 Initial: 817 verification: 3474 Sentences Found: 1014 Rejected Results: 954 inconsistent with KB: 4 already known to the KB: 384 rejected using Google: 566 Novel formulæ: 61

47. Piracy Event 1 Piracy Event 1 Group of Pirates 1 Group of Pirates 1 Somalia January 20, 2006 January 20, 2006 MV Delta Ranger MV Delta Ranger perpetrator dateOfEvent intendedAttackTargets eventOccursNear intendedAttackTargets Piracy Event 2 Piracy Event 2 Group of Pirates 2 Group of Pirates 2 Philippines January 15, 2006 January 15, 2006 MV Man Chu Yi MV Man Chu Yi perpetratordateOfEvent eventOccursNear Piracy Event 3 Piracy Event 3 Group of Pirates 3 Group of Pirates 3 Nigeria February 18, 2006 February 18, 2006 perpetrator dateOfEvent eventOccursNear Speed Boat 1 Speed Boat 1 deviceUsed Given a set of events that Cyc already knows about… …recognize new instances of that event type in text Malacca Straits: On 17 April 2006, a Malaysian fishing vessel was attacked by armed pirates at approximately nine nautical miles off Parit Haji Baki coast in the Malacca Straits at about 0200 Hrs LT. Six pirates armed with guns in a speedboat closed in rapidly and opened fire at the fishing vessel underway. Several shots hit the side of the vessel but the crew escaped injuries. The fishing vessel crew lodged a police report. Malacca Straits: On 17 April 2006, a Malaysian fishing vessel was attacked by armed pirates at approximately nine nautical miles off Parit Haji Baki coast in the Malacca Straits at about 0200 Hrs LT. Six pirates armed with guns in a speedboat closed in rapidly and opened fire at the fishing vessel underway. Several shots hit the side of the vessel but the crew escaped injuries. The fishing vessel crew lodged a police report. New Piracy Event New Piracy Event

48. P(deviceUsed) = 1/3 = 0.33 p(perpetrator) = 3/3 = 1.0 p(dateOfEvent) = 3/3 = 1.0 p(eventOccursNear) = 3/3 = 1.0 p(intendedAttackTargets) = 2/3 = 0.66 P(deviceUsed) = 1/3 = 0.33 p(perpetrator) = 3/3 = 1.0 p(dateOfEvent) = 3/3 = 1.0 p(eventOccursNear) = 3/3 = 1.0 p(intendedAttackTargets) = 2/3 = 0.66 Piracy Event 1 Piracy Event 1 perpetrator dateOfEvent intendedAttackTargets eventOccursNear intendedAttackTargets Piracy Event 2 Piracy Event 2 perpetratordateOfEvent eventOccursNear Piracy Event 3 Piracy Event 3 perpetrator dateOfEvent eventOccursNear deviceUsed determines appropriate relations for event type that occur in >1/2 of the known events. New Piracy Event New Piracy Event perpetrator intendedAttackTargets dateOfEvent eventOccursNear

49. Malacca Straits: On 17 April 2006, a Malaysian fishing vessel was attacked by armed pirates at approximately nine nautical miles off Parit Haji Baki coast in the Malacca Straits at about 0200 Hrs LT. Six pirates armed with guns in a speedboat closed in rapidly and opened fire at the fishing vessel underway. Several shots hit the side of the vessel but the crew escaped injuries. The fishing vessel crew lodged a police report. Malacca Straits: On 17 April 2006, a Malaysian fishing vessel was attacked by armed pirates at approximately nine nautical miles off Parit Haji Baki coast in the Malacca Straits at about 0200 Hrs LT. Six pirates armed with guns in a speedboat closed in rapidly and opened fire at the fishing vessel underway. Several shots hit the side of the vessel but the crew escaped injuries. The fishing vessel crew lodged a police report. New Piracy Event New Piracy Event Piracy Event 1 Piracy Event 1 Group of Pirates 1 Group of Pirates 1 Somalia January 20, 2006 January 20, 2006 MV Delta Ranger MV Delta Ranger perpetrator dateOfEvent intendedAttackTargets eventOccursNear intendedAttackTargets Piracy Event 2 Piracy Event 2 Group of Pirates 2 Group of Pirates 2 Philippines January 15, 2006 January 15, 2006 MV Man Chu Yi MV Man Chu Yi perpetratordateOfEvent eventOccursNear Piracy Event 3 Piracy Event 3 Group of Pirates 3 Group of Pirates 3 Nigeria February 18, 2006 February 18, 2006 perpetrator dateOfEvent eventOccursNear Speed Boat 1 Speed Boat 1 deviceUsed …look at role fillers for known events… and find similar types of concepts mentioned in the text. perpetrator intendedAttackTargets dateOfEvent eventOccursNear ???

50. Malacca Straits: On 17 April 2006, a Malaysian fishing vessel was attacked by armed pirates at approximately nine nautical miles off Parit Haji Baki coast in the Malacca Straits at about 0200 Hrs LT. Six pirates armed with guns in a speedboat closed in rapidly and opened fire at the fishing vessel underway. Several shots hit the side of the vessel but the crew escaped injuries. The fishing vessel crew lodged a police report. Malacca Straits: On 17 April 2006, a Malaysian fishing vessel was attacked by armed pirates at approximately nine nautical miles off Parit Haji Baki coast in the Malacca Straits at about 0200 Hrs LT. Six pirates armed with guns in a speedboat closed in rapidly and opened fire at the fishing vessel underway. Several shots hit the side of the vessel but the crew escaped injuries. The fishing vessel crew lodged a police report. Malaysia Pirates Some Pirate Some Pirate Parit Haji Baki Parit Haji Baki Malacca Straits Malacca Straits Speed Boats Speed Boats Some Speed Boat Some Speed Boat Police Some Police Officer Some Police Officer Dates Vehicles People Things Places April 17, 2006 April 17, 2006 People & Org.s People & Org.s Concepts in Cyc’s ontology are found in the text

51. Malaysia Pirates Some Pirate Some Pirate Parit Haji Baki Parit Haji Baki Malacca Straits Malacca Straits Speed Boats Speed Boats Some Speed Boat Some Speed Boat Police Some Police Officer Some Police Officer Dates Vehicles People Things Places April 17, 2006 April 17, 2006 Org.s People & Org.s People & Org.s Group of Pirates 1 Group of Pirates 1 Somalia January 20, 2006 January 20, 2006 MV Delta Ranger MV Delta Ranger Group of Pirates 3 Group of Pirates 3 February 18, 2006 February 18, 2006 Group of Pirates 2 Group of Pirates 2 Philippines January 15, 2006 January 15, 2006 MV Man Chu Yi MV Man Chu Yi Speed Boat 1 Speed Boat 1 Groups of Pirates Groups of Pirates The concepts associated with the known events are also mapped to the ontology.

52. P(isa(X,Thing) | (eventOccursNear EVENT X)) = 1 P(isa(X,Place) | (eventOccursNear EVENT X)) = 1 P(isa(X,Date) | (eventOccursNear EVENT X)) = 0 P(isa(X,Vehicle) | (eventOccursNear EVENT X)) = 0 P(isa(X,Person or Org.) | (eventOccursNear EVENT X)) = 0 P(isa(X,Person) | (eventOccursNear EVENT X)) = 0 P(isa(X,Org.) | (eventOccursNear EVENT X)) = 0 P(isa(X,Group of Pirates) | (eventOccursNear EVENT X)) = 0 P(isa(X,Thing) | (eventOccursNear EVENT X)) = 1 P(isa(X,Place) | (eventOccursNear EVENT X)) = 1 P(isa(X,Date) | (eventOccursNear EVENT X)) = 0 P(isa(X,Vehicle) | (eventOccursNear EVENT X)) = 0 P(isa(X,Person or Org.) | (eventOccursNear EVENT X)) = 0 P(isa(X,Person) | (eventOccursNear EVENT X)) = 0 P(isa(X,Org.) | (eventOccursNear EVENT X)) = 0 P(isa(X,Group of Pirates) | (eventOccursNear EVENT X)) = 0 Dates Vehicles People Things Places Org.s People & Org.s People & Org.s Somalia Philippines Collections are associated with each relation… New Piracy Event New Piracy Event eventOccursNear ??? The most relevant Collections are those where the probability of seeing them is high for concepts that have this relation to an event of this type, and have low probability of being seen otherwise.

53. Malaysia Pirates Some Pirate Some Pirate Parit Haji Baki Parit Haji Baki Malacca Straits Malacca Straits Speed Boats Speed Boats Some Speed Boat Some Speed Boat Police Some Police Officer Some Police Officer Dates Vehicles People Things Places April 17, 2006 April 17, 2006 Org.s People & Org.s People & Org.s Groups of Pirates Groups of Pirates Probabilities can be estimated for extracted concepts… to measure how well they fit the relation. New Piracy Event New Piracy Event eventOccursNear p(Malacca Straits) = 1 p(Malaysia) = 1 p(Parit Haji Baki) = 1 p(April 17, 2006) = 0 p(Speed Boats) = 0 P(Some Speed Boat) = 0 … p(Malacca Straits) = 1 p(Malaysia) = 1 p(Parit Haji Baki) = 1 p(April 17, 2006) = 0 p(Speed Boats) = 0 P(Some Speed Boat) = 0 … Malaysia Parit Haji Baki Parit Haji Baki Malacca Straits Malacca Straits eventOccursNear

54. After repeating this process for every relation, choosing relation/concept pairs with >0.5 probability, a potential event has been extracted from the text. New Piracy Event New Piracy Event Some Speed Boat Some Speed Boat April 17, 2006 April 17, 2006 eventOccursNear Malaysia Parit Haji Baki Parit Haji Baki Malacca Straits Malacca Straits intendedAttackTargets dateOfEvent Malacca Straits: On 17 April 2006, a Malaysian fishing vessel was attacked by armed pirates at approximately nine nautical miles off Parit Haji Baki coast in the Malacca Straits at about 0200 Hrs LT. Six pirates armed with guns in a speedboat closed in rapidly and opened fire at the fishing vessel underway. Several shots hit the side of the vessel but the crew escaped injuries. The fishing vessel crew lodged a police report. Malacca Straits: On 17 April 2006, a Malaysian fishing vessel was attacked by armed pirates at approximately nine nautical miles off Parit Haji Baki coast in the Malacca Straits at about 0200 Hrs LT. Six pirates armed with guns in a speedboat closed in rapidly and opened fire at the fishing vessel underway. Several shots hit the side of the vessel but the crew escaped injuries. The fishing vessel crew lodged a police report.

55. Probabilities for each relation/concept pair can then be used to estimate the overall probability of the extracted event being correct. April 17, 2006 (1.0) April 17, 2006 (1.0) Piracy Event (0.67) Piracy Event (0.67) Some Speed Boat (1.0) Some Speed Boat (1.0) eventOccursNear (1.0) Malaysia (1.0) Malaysia (1.0) Parit Haji Baki (1.0) Parit Haji Baki (1.0) Malacca Straits (1.0) Malacca Straits (1.0) intendedAttackTargets (0.67) dateOfEvent (1.0) Malacca Straits: On 17 April 2006, a Malaysian fishing vessel was attacked by armed pirates at approximately nine nautical miles off Parit Haji Baki coast in the Malacca Straits at about 0200 Hrs LT. Six pirates armed with guns in a speedboat closed in rapidly and opened fire at the fishing vessel underway. Several shots hit the side of the vessel but the crew escaped injuries. The fishing vessel crew lodged a police report. Malacca Straits: On 17 April 2006, a Malaysian fishing vessel was attacked by armed pirates at approximately nine nautical miles off Parit Haji Baki coast in the Malacca Straits at about 0200 Hrs LT. Six pirates armed with guns in a speedboat closed in rapidly and opened fire at the fishing vessel underway. Several shots hit the side of the vessel but the crew escaped injuries. The fishing vessel crew lodged a police report.

56. Initial Results C. Matuszek, R.C. Kahlert FACTory © Cycorp 2006 Test corpus of 27 piracy documents. Extractor found 578 relation/concept pairs. 34.78% (201) were correct. Good enough to feed human validation tools for partially automated data entry.

57. Using Human Feedback By giving the extractor feedback about what concepts it got correct and incorrect, the precision of the extractor can be greatly increased. In initial experiments, giving feedback on the 27 piracy paragraphs raised precision from.39 to.61 using 2-fold cross- validation.

58. Wrap-up  Large vocabularies with detailed semantics are useful  More and more of the conceptual structure and knowledge will be automatically learned  The more you know, the less you need to understand  Detailed knowledge really is needed for meaningful reasoning © Cycorp 2007