Soar 20051 Progress on NL-Soar, and Introducing XNL-Soar Deryle Lonsdale, Jamison Cooper-Leavitt, and Warren Casbeer ( and the rest of the BYU NL-Soar.

Slides:



Advertisements
Similar presentations
Pat Langley Computational Learning Laboratory Center for the Study of Language and Information Stanford University, Stanford, California
Advertisements

ENTERFACE’08 Multimodal high-level data integration Project 2 1.
CPSC Compiler Tutorial 9 Review of Compiler.
NLP and Speech Course Review. Morphological Analyzer Lexicon Part-of-Speech (POS) Tagging Grammar Rules Parser thethe – determiner Det NP → Det.
NLP and Speech 2004 Feature Structures Feature Structures and Unification.
References Kempen, Gerard & Harbusch, Karin (2002). Performance Grammar: A declarative definition. In: Nijholt, Anton, Theune, Mariët & Hondorp, Hendri.
Minimalist Parsing Scott Drellishak CompLing Lab Meeting 2/1/2006.
1 Introducing Collaboration to Single User Applications A Survey and Analysis of Recent Work by Brian Cornell For Collaborative Systems Fall 2006.
Are Linguists Dinosaurs? 1.Statistical language processors seem to be doing away with the need for linguists. –Why do we need linguists when a machine.
The Data Mining Visual Environment Motivation Major problems with existing DM systems They are based on non-extensible frameworks. They provide a non-uniform.
Soar NL-Soar update Deryle Lonsdale BYU Linguistics
Cognitive Linguistics Croft & Cruse 10 An overview of construction grammars (part 1, through )
Annotating Documents for the Semantic Web Using Data-Extraction Ontologies Dissertation Proposal Yihong Ding.
PSY 369: Psycholinguistics Some basic linguistic theory part3.
 2003 CSLI Publications Ling 566 Oct 16, 2007 How the Grammar Works.
Semi-Automatic Learning of Transfer Rules for Machine Translation of Low-Density Languages Katharina Probst April 5, 2002.
1 Deryle Lonsdale, Jeremiah McGhee, Nathan Glenn, and Tory Anderson.
Semantics and Lexicology Generativist semantics. From structuralist semantics Semantic features, components.
Lecture 1 Introduction: Linguistic Theory and Theories
1.3 Executing Programs. How is Computer Code Transformed into an Executable? Interpreters Compilers Hybrid systems.
Lecture 1, 7/21/2005Natural Language Processing1 CS60057 Speech &Natural Language Processing Autumn 2005 Lecture 1 21 July 2005.
Elements of Computing Systems, Nisan & Schocken, MIT Press, 2005, Chapter 10: Compiler I: Syntax Analysis slide 1www.idc.ac.il/tecs.
AQUAINT Kickoff Meeting – December 2001 Integrating Robust Semantics, Event Detection, Information Fusion, and Summarization for Multimedia Question Answering.
Empirical Methods in Information Extraction Claire Cardie Appeared in AI Magazine, 18:4, Summarized by Seong-Bae Park.
Lecture 12: 22/6/1435 Natural language processing Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
Some Thoughts on HPC in Natural Language Engineering Steven Bird University of Melbourne & University of Pennsylvania.
Copyright © 2013 Curt Hill The Zachman Framework What is it all about?
Working group on multimodal meaning representation Dagstuhl workshop, Oct
Parser-Driven Games Tool programming © Allan C. Milne Abertay University v
Experiments on Building Language Resources for Multi-Modal Dialogue Systems Goals identification of a methodology for adapting linguistic resources for.
THE BIG PICTURE Basic Assumptions Linguistics is the empirical science that studies language (or linguistic behavior) Linguistics proposes theories (models)
Soar and Construction Grammar Peter Lindes, Deryle Lonsdale, David Embley Brigham Young University 2014 Soar Workshop © 2014 Peter Lindes 6/19/2014PL 2014.
Understanding Natural Language
Towards multimodal meaning representation Harry Bunt & Laurent Romary LREC Workshop on standards for language resources Las Palmas, May 2002.
1 Syntax In Text: Chapter 3. 2 Chapter 3: Syntax and Semantics Outline Syntax: Recognizer vs. generator BNF EBNF.
Research Topics CSC Parallel Computing & Compilers CSC 3990.
Indirect Supervision Protocols for Learning in Natural Language Processing II. Learning by Inventing Binary Labels This work is supported by DARPA funding.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Fall 2005-Lecture 4.
Compressed Abstract Syntax Trees as Mobile Code Christian H. Stork Vivek Haldar University of California, Irvine.
October 2005CSA3180 NLP1 CSA3180 Natural Language Processing Introduction and Course Overview.
XML Grammar and Parser for WSOL Kruti Patel, Vladimir Tosic, Bernard Pagurek Network Management & Artificial Intelligence Lab Department of Systems & Computer.
CSE573 Autumn /20/98 Planning/Language Administrative –PS3 due 2/23 –Midterms back today –Next topic: Natural Language Processing reading Chapter.
PSY270 Michaela Porubanova. Language  a system of communication using sounds or symbols that enables us to express our feelings, thoughts, ideas, and.
Basic Parsing Algorithms: Earley Parser and Left Corner Parsing
LING 001 Introduction to Linguistics Spring 2010 Syntactic parsing Part-Of-Speech tagging Apr. 5 Computational linguistics.
Syntactic Annotation of Slovene Corpora (SDT, JOS) Nina Ledinek ISJ ZRC SAZU
Chapter 8. Situated Dialogue Processing for Human-Robot Interaction in Cognitive Systems, Christensen et al. Course: Robots Learning from Humans Sabaleuski.
CS 4705 Lecture 17 Semantic Analysis: Robust Semantics.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Fall 2005-Lecture 3.
Object-Oriented Parsing and Transformation Kenneth Baclawski Northeastern University Scott A. DeLoach Air Force Institute of Technology Mieczyslaw Kokar.
 2003 CSLI Publications Ling 566 Oct 17, 2011 How the Grammar Works.
1 Situation Comprehension and Emotion Bob Marinier University of Michigan June 2005.
Slide no 1 Cognitive Systems in FP6 scope and focus Colette Maloney DG Information Society.
Understanding Naturally Conveyed Explanations of Device Behavior Michael Oltmans and Randall Davis MIT Artificial Intelligence Lab.
NATURAL LANGUAGE PROCESSING
Paul Alexander1 DS3 Deliverable Status 4 th SKADS Workshop, Lisbon, 2-3 October 2008 DS3 Deliverables Review.
MENTAL GRAMMAR Language and mind. First half of 20 th cent. – What the main goal of linguistics should be? Behaviorism – Bloomfield: goal of linguistics.
Lec. 10.  In this section we explain which constituents of a sentence are minimally required, and why. We first provide an informal discussion and then.
LingWear Language Technology for the Information Warrior Alex Waibel, Lori Levin Alon Lavie, Robert Frederking Carnegie Mellon University.
10/31/00 1 Introduction to Cognitive Science Linguistics Component Topic: Formal Grammars: Generating and Parsing Lecturer: Dr Bodomo.
Cognitive Language Processing for Rosie
Kenneth Baclawski et. al. PSB /11/7 Sa-Im Shin
Natural Language Processing (NLP)
International Research and Development Institute Uyo
Ling 566 Oct 14, 2008 How the Grammar Works.
Parsing Unrestricted Text
Natural Language Processing (NLP)
Artificial Intelligence 2004 Speech & Natural Language Processing
Owen Rambow 6 Minutes.
Natural Language Processing (NLP)
Presentation transcript:

Soar Progress on NL-Soar, and Introducing XNL-Soar Deryle Lonsdale, Jamison Cooper-Leavitt, and Warren Casbeer ( and the rest of the BYU NL-Soar Research Group) BYU Linguistics

Soar What appears to be happening with NL-Soar support NL-Soar?

Soar What appears to be happening with NL-Soar support > /dev/null NL-Soar?

Soar What’s actually happening with NL-Soar support

Soar What’s actually happening with NL-Soar support

Soar What’s actually happening with NL-Soar support

Soar What’s actually happening with NL-Soar support

Soar NL-Soar developments (1) Discourse/robotic dialogue  Sphinx-4 speech input (working on lattice- based interface)  Festival text-to-speech output  Two agents holding a (short) conversation  Video produced showing round-trip speech- based human/robot interaction  NSF proposal submitted

Soar NL-Soar developments (2) NL generation  Decoupled from comprehension  Can be driven from arbitrary LCS Front-end GUI for creating LCS’s Port to Soar  Some NLG chunking issues remain Modeling of cognition in simultaneous interpretation (English-French)

Soar SI from a cognitive modeling perspective

Soar Parsing and the models

Soar Mapping operators

Soar NL-Soar generation operators

Soar Combining the capabilities

Soar Pipelining the processes

Soar Interleaving operator implemen- tations

Soar Interleaving the processes

Soar Predicted times by operator type

Soar Event timeline (one possibility)

Soar Sample alignment analysis

Soar Observed profile and timing assumptions

Soar First 1/3 of an interleaved scenario timeline

Soar LG-Soar developments Predicate extraction in biomedical texts domain ( Scaling up of Persian syntactic parser

Soar Unveiling XNL-Soar: Minimalism and Incremental Parsing

Soar What are we trying to do? As with NL-Soar, study how humans process language  Lexical access  Syntax/semantics Apply the Soar architecture  Operator-based cognitive modeling system  Symbolic, rule-based, goal-directed agent  Learning Implement syntax in the Minimalist Program

Soar Why XNLS? (1) GB has been (largely) superseded by MP It’s a debatable development (e.g. recent LinguistList discussion/flamefest) No large-scale MP parser implemented yet No MP generator implemented yet Flavor seems right (even operators!) I just re-read Rick's thesis, and I wondered if you've thought at all about applying "newer" grammars (e.g., Chomsky's "minimalist programme") in NL-Soar? (Chris Waterson, June 17, 2002)

Soar Why XNLS? (2) Incrementality of MP not explored Unknown whether MP viable for human sentence processing (but claimed to be) Experience with another formalism  Syntax so far: GB, Link Grammar  Semantics so far: Annotated models, LCS, DRT Pedagogical aims

Soar After hearing “The scientist...”

Soar After hearing “The scientist gave...”

Soar After hearing “The scientist gave the linguist...”

Soar After hearing “The scientist gave the linguist a computer.”

Soar Projecting the structure

Soar Completed tree for “The scientist gave the linguist a computer.”

Soar Operator types (still to be done) (Attention) Lexical access (from NL-Soar, including WordNet) Merge: link 2 pieces of syntactic structure  Constraints: subcategorization, (hierarchy of projections), (theta roles: PropBank?) Move: moves a constituent (e.g. questions)  Constraints: locality, features (Snip)

Soar Operator types Inherit from NL-Soar:  Semantics: build pieces of conceptual representation  Discourse: select and instantiate discourse plans for comprehension and generation  Generation: generate text from semantic representation

Soar Other system components Assigners/receivers set? Parameterized decay-prone I/O buffer New grapher for MP parse trees

Soar Current status Current XNLS system: about 40 rules (c.f. NL-Soar system: 3500 rules) Intransitive sentences  Basic sentences work (e.g. ‘zebras sneezed’) WordNet gives us uninflected forms; this is a problem for generation

Soar Expected payoffs Crosslinguistic development  Easier to parameterize due to features Wider coverage of complex constructions  Ditransitives, resultatives, causatives, unaccusatives, etc. More workable platform for implementing partial analyses from the literature

Soar Conclusion Coals  Performance?  MP not fully explored  More highly lexicalized, so more lexical resources required  XNLS entails the Guilt- Redemption cycle Nuggets  Better coverage (Engl. & crosslinguistically)  New start in Soar8  State-of-the-art syntax  Puts us in the thick of the battle  Relevance to current linguistic pedagogy