Lecture 9: Semantic Parsing

Slides:



Advertisements
Similar presentations
Dr. Leo Obrst MITRE Information Semantics Information Discovery & Understanding Command & Control Center February 6, 2014February 6, 2014February 6, 2014.
Advertisements

Natural Language Processing Lecture 2: Semantics.
Layering Semantics (Putting meaning into trees) Treebank Workshop Martha Palmer April 26, 2007.
Knowledge Representation. Essential to artificial intelligence are methods of representing knowledge. A number of methods have been developed, including:
CSE 425: Semantic Analysis Semantic Analysis Allows rigorous specification of a program’s meaning –Lets (parts of) programming languages be proven correct.
Semantic Role Labeling Abdul-Lateef Yussiff
CS 355 – Programming Languages
CSE 425: Logic Programming I Logic and Programs Most programs use Boolean expressions over data Logic statements can express program semantics –I.e., axiomatic.
NLP and Speech Course Review. Morphological Analyzer Lexicon Part-of-Speech (POS) Tagging Grammar Rules Parser thethe – determiner Det NP → Det.
CS652 Spring 2004 Summary. Course Objectives  Learn how to extract, structure, and integrate Web information  Learn what the Semantic Web is  Learn.
C. Varela; Adapted w/permission from S. Haridi and P. Van Roy1 Declarative Computation Model Defining practical programming languages Carlos Varela RPI.
LING 388: Language and Computers Sandiway Fong Lecture 28: 12/6.
LING 364: Introduction to Formal Semantics Lecture 4 January 24th.
Summary of query compilers (Section16.8) Varun Gupta Department of Computer Science ID-216 CS 257.
March 9, 2011CS 1921 JavaScript Debbie Bartlett March 9, 2011.
© Janice Regan, CMPT 128, Jan CMPT 128 Introduction to Computing Science for Engineering Students Creating a program.
Syntax Directed Translation. Syntax directed translation Yacc can do a simple kind of syntax directed translation from an input sentence to C code We.
Empirical Methods in Information Extraction Claire Cardie Appeared in AI Magazine, 18:4, Summarized by Seong-Bae Park.
Overview of Machine Learning for NLP Tasks: part II Named Entity Tagging: A Phrase-Level NLP Task.
CS212: DATA STRUCTURES Lecture 1: Introduction. What is this course is about ?  Data structures : conceptual and concrete ways to organize data for efficient.
1 Natural Language Processing Lecture Notes 11 Chapter 15 (part 1)
The Internet 8th Edition Tutorial 4 Searching the Web.
Lecture 1 Introduction Figures from Lewis, “C# Software Solutions”, Addison Wesley Richard Gesick.
COP 4620 / 5625 Programming Language Translation / Compiler Writing Fall 2003 Lecture 1, 08/28/03 Prof. Roy Levow.
Management of XML and Semistructured Data Lecture 10: Schemas Monday, April 30, 2001.
3.2 Semantics. 2 Semantics Attribute Grammars The Meanings of Programs: Semantics Sebesta Chapter 3.
For Monday Read chapter 26 Last Homework –Chapter 23, exercise 7.
1 / 48 Formal a Language Theory and Describing Semantics Principles of Programming Languages 4.
Data Mining: Text Mining
CS460/IT632 Natural Language Processing/Language Technology for the Web Lecture 1 (03/01/06) Prof. Pushpak Bhattacharyya IIT Bombay Introduction to Natural.
CS 4705 Lecture 17 Semantic Analysis: Robust Semantics.
COP3502: Introduction to Computer Science Yashas Shankar Program Translation.
A Portrait of the Semantic Web in Action Jeff Heflin and James Hendler IEEE Intelligent Systems December 6, 2010 Hyewon Lim.
For Monday Read chapter 26 Homework: –Chapter 23, exercises 8 and 9.
A Database of Narrative Schemas A 2010 paper by Nathaniel Chambers and Dan Jurafsky Presentation by Julia Kelly.
An Ontology-based Automatic Semantic Annotation Approach for Patent Document Retrieval in Product Innovation Design Feng Wang, Lanfen Lin, Zhou Yang College.
Knowledge Representation Lecture 2 out of 5. Last Week Intelligence needs knowledge We need to represent this knowledge in a way a computer can process.
A Single Intermediate Language That Supports Multiple Implemtntation of Exceptions Delvin Defoe Washington University in Saint Louis Department of Computer.
Brief Intro to Machine Learning CS539
Lecture 7: Constrained Conditional Models
Approaches to Machine Translation
“Under the hood”: Angry Birds Maze
PRESENTED BY: PEAR A BHUIYAN
Lecture 1 Introduction Richard Gesick.
CSC 221: Computer Programming I Spring 2010
CSC 221: Computer Programming I Fall 2005
Lecture 24: Relation Extraction
Lecture 11: Machine Learning
Kai-Wei Chang University of Virginia
Two Discourse Driven Language Models for Semantics
CPE 480 Natural Language Processing
Lecture 19: Question Answering
Machine Learning in Natural Language Processing
Extraction and Detection of Events
Enhanced Dependency Jiajie Yu Wentao Ding.
Man From the South.
Remote Procedure Call (RPC) Neil Tang 11/26/2008
KNOWLEDGE REPRESENTATION
Seminar Topics and Projects
Approaches to Machine Translation
First-order (predicate) Logic
CS246: Information Retrieval
Query Optimization.
Couse webpage: Final Project Kai-Wei Chang UCLA Couse webpage:
Neural Modular Networks
SNoW & FEX Libraries; Document Classification
Poetry Recall What does ‘Tissue’ explore?
Probabilistic Databases with MarkoViews
CS249: Neural Language Model
Owen Rambow 6 Minutes.
Presentation transcript:

Lecture 9: Semantic Parsing Kai-Wei Chang CS @ UCLA kw@kwchang.net Couse webpage: https://uclanlp.github.io/CS269-17/ ML in NLP

Paper summary Individual project, due: Sunday 11/18 1~2 pages: ~1,000 words Submit your summary at CCLE (pdf format, webpage, etc.) (optional) provide the link to your summary: https://goo.gl/m2GQ6S (optional) pull request at https://github.com/uclanlp/CS269- 17/tree/master/summary ML in NLP

Computational Semantics Many high-level applications Question answering Information extraction Internet bots Siri/Cortana/Alexa/Google Now Translation Shallow vs. deep semantics Cheap, fast, low-level techniques v.s. computational expensive, high-level techniques ML in NLP

Semantic Roles Predicates: some words represent events Arguments: specific roles that involves in the event PropBank Several other alternative role lexicons ML in NLP

http://cogcomp.cs.illinois.edu/page/demo_view/srl Semantic Roles His father would come upstairs and stand self-consciously At the foot of the bed and look at his son. ML in NLP

Semantic Role Labelling Give a sentence, identify predicate frames and annotate semantic roles ML in NLP

Role Identification We can model it as multi-class classification ML in NLP

Role labeling Conduct constrained inference ML in NLP

Semantic parsing Motivation: programming language What is the meaning of 3+5*6 Examples from Chris Manning’s NLP course ML in NLP

Semantic parsing More complex meaning 3+5*x: we don’t know x at the compile time “Meaning” at a node is a piece of code Form is “rule-to-rule” translation We provide a way to form the semantics from bottom-up ML in NLP

Semantic Parsing Parse a natural language narrative to a machine readable format Logic form: John smokes.” “Everyone who smokes snores.” ⇒ ∀x.smoke(x)→snore(x) smoke(John) ⇒ snore(John) Equations: Maria is now four times as old as Kate. Four years ago, Maria was six times as old as Kate. Find their ages now. m = 4 × n m − 4 = 6 × (n − 4) ML in NLP

Logic Boolean: semantic values of sentences Entities: e.g., objects, times, etc. Function of various types A function returning a boolean called “predicate” e.g., green (x) Function can return other functions or take functions as arguments ML in NLP

Logic: 𝜆 terms 𝜆 terms: square = 𝜆x x*x, square(3) = 3*3 even = 𝜆x (x mod 2 == 0) a predicate Can take multiple arguments: 𝜆 x.[𝜆 y.times(x,y)] ML in NLP

Parse tree with associated semantics ML in NLP

ML in NLP