Ontology-based Information Extraction with a Cognitive Agent Peter Lindes 1, Deryle Lonsdale, David Embley Brigham Young University AAAI Now at University of Michigan © 2015 Peter Lindes 1/22/2015AAAI IE with a Cognitive Agent1

The Problem 1/22/2015AAAI IE with a Cognitive Agent2

Goals and Strategies OntoSoar project goals – Extract genealogy facts from family history books – Project extracted information onto a conceptual model to populate a searchable database Strategies – Use ideas from Embodied Construction Grammar – Use the Soar cognitive architecture – Integrate several levels of knowledge Long term goals – Build computational models of human language processing – Apply these models to real-world applications 1/22/2015AAAI IE with a Cognitive Agent3

Example 1 1/22/2015AAAI IE with a Cognitive Agent4

A Simple Ontology 1/22/2015AAAI IE with a Cognitive Agent5 Charles Christopher Lathrop has born on died on

Example2 1/22/2015AAAI IE with a Cognitive Agent6

A More Complex Ontology 1/22/2015AAAI IE with a Cognitive Agent7 Myra Harwood Jonathan Squires J. Wilbur Squires Feb. 13, 1874

The Solution 1/22/2015AAAI IE with a Cognitive Agent8 Thus, intelligence is the ability to bring to bear all the knowledge that one has in service of one’s goals. Newell (1990), p. 90 Page Layout * Text Analysis Syntax Semantics Pragmatics World Knowledge Conceptual Models

OntoSoar Architecture 1/22/2015AAAI IE with a Cognitive Agent9

Construction Grammar 1/22/2015AAAI IE with a Cognitive Agent10

Applying Constructions 1/22/2015AAAI IE with a Cognitive Agent11 Charles Christopher Lathrop, N. Y. City, b. 1817, d. 1865, son of Mary Ely and Gerard Lathrop ;

… More Constructions 1/22/2015AAAI IE with a Cognitive Agent12 Charles Christopher Lathrop, N. Y. City, b. 1817, d. 1865, son of Mary Ely and Gerard Lathrop ;

Building Knowledge 1/22/2015AAAI IE with a Cognitive Agent13 Charles Christopher Lathrop, N. Y. City, b. 1817, d. 1865, son of Mary Ely and Gerard Lathrop ;

Knowledge Structures Compared 1/22/2015AAAI IE with a Cognitive Agent14 … his widow married JONATHAN SQUIRES, who was born in Ohio, July 25, 1823, by whom she had one son, J. Wilbur, born June 16, 1865, Charles Christopher Lathrop, N. Y. City, b. 1817, d. 1865, son of Mary Ely and Gerard Lathrop ;

Results on Examples 1/22/2015AAAI IE with a Cognitive Agent15

1/22/2015AAAI IE with a Cognitive Agent16

Results on The Ely Ancestry 1/22/2015AAAI IE with a Cognitive Agent17 Item TypeInstance Found Persons16,848 Births8,609 Deaths2,406 Genders1,674 Couples3,343 Children3,049 Total35,929 a book of 830 pages, including our Example 1

Conclusions Contributions Produces usable genealogy data from scanned books Does this using: – Integration of several levels of knowledge – An adaptation of Embodied Construction Grammar – A cognitive architecture (Soar) Future Work Integrate parsing with semantics Develop a means to learn many new constructions Adapt to varying book styles Scale up to perform well on 100’s of thousands of books 1/22/2015AAAI IE with a Cognitive Agent18 It works! … and, it could work a lot better.