Enhanced Dependency Jiajie Yu Wentao Ding.

Slides:



Advertisements
Similar presentations
School of something FACULTY OF OTHER School of Computing FACULTY OF ENGINEERING Chunking: Shallow Parsing Eric Atwell, Language Research Group.
Advertisements

Prolog programming....Dr.Yasser Nada. Chapter 8 Parsing in Prolog Taif University Fall 2010 Dr. Yasser Ahmed nada prolog programming....Dr.Yasser Nada.
Proceedings of the Conference on Intelligent Text Processing and Computational Linguistics (CICLing-2007) Learning for Semantic Parsing Advisor: Hsin-His.
Syntax. Definition: a set of rules that govern how words are combined to form longer strings of meaning meaning like sentences.
Chapter 4 Syntax.
Sequence Classification: Chunking Shallow Processing Techniques for NLP Ling570 November 28, 2011.
Linguistics, Morphology, Syntax, Semantics. Definitions And Terminology.
Statistical NLP: Lecture 3
Steven Schoonover.  What is VerbNet?  Levin Classification  In-depth look at VerbNet  Evolution of VerbNet  What is FrameNet?  Applications.
1 Words and the Lexicon September 10th 2009 Lecture #3.
Learning syntactic patterns for automatic hypernym discovery Rion Snow, Daniel Jurafsky and Andrew Y. Ng Prepared by Ang Sun
1 Prototype Hierarchy Based Clustering for the Categorization and Navigation of Web Collections Zhao-Yan Ming, Kai Wang and Tat-Seng Chua School of Computing,
Artificial Intelligence Research Centre Program Systems Institute Russian Academy of Science Pereslavl-Zalessky Russia.
Richard Socher Cliff Chiung-Yu Lin Andrew Y. Ng Christopher D. Manning
Empirical Methods in Information Extraction Claire Cardie Appeared in AI Magazine, 18:4, Summarized by Seong-Bae Park.
Reyyan Yeniterzi Weakly-Supervised Discovery of Named Entities Using Web Search Queries Marius Pasca Google CIKM 2007.
Paul Lwere Teacher of English Language Kyambogo College School ©2013.
Extracting Semantic Constraint from Description Text for Semantic Web Service Discovery Dengping Wei, Ting Wang, Ji Wang, and Yaodong Chen Reporter: Ting.
10/12/2015CPSC503 Winter CPSC 503 Computational Linguistics Lecture 10 Giuseppe Carenini.
Open Information Extraction using Wikipedia
1 Intelligente Analyse- und Informationssysteme Frank Reichartz, Hannes Korte & Gerhard Paass Fraunhofer IAIS, Sankt Augustin, Germany Dependency Tree.
Programming Languages and Design Lecture 3 Semantic Specifications of Programming Languages Instructor: Li Ma Department of Computer Science Texas Southern.
Authors: Marius Pasca and Benjamin Van Durme Presented by Bonan Min Weakly-Supervised Acquisition of Open- Domain Classes and Class Attributes from Web.
Parts of Speech Major source: Wikipedia. Adjectives An adjective is a word that modifies a noun or a pronoun, usually by describing it or making its meaning.
Natural Language Questions for the Web of Data Mohamed Yahya, Klaus Berberich, Gerhard Weikum Max Planck Institute for Informatics, Germany Shady Elbassuoni.
Fact Extraction Ontology Ontological- Semantic Analysis Text Meaning Representation (TMR) Fact Repository (FR) Text Sources Lexicons Grammars Static Knowledge.
Ranking Definitions with Supervised Learning Methods J.Xu, Y.Cao, H.Li and M.Zhao WWW 2005 Presenter: Baoning Wu.
Unit 8 Syntax. Syntax Syntax deals with rules for combining words into sentences, as well as with relationship between elements in one sentence Basic.
Relational Duality: Unsupervised Extraction of Semantic Relations between Entities on the Web Danushka Bollegala Yutaka Matsuo Mitsuru Ishizuka International.
Mining Dependency Relations for Query Expansion in Passage Retrieval Renxu Sun, Chai-Huat Ong, Tat-Seng Chua National University of Singapore SIGIR2006.
CPSC 422, Lecture 27Slide 1 Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 27 Nov, 16, 2015.
11 Project, Part 3. Outline Basics of supervised learning using Naïve Bayes (using a simpler example) Features for the project 2.
Acquisition of Categorized Named Entities for Web Search Marius Pasca Google Inc. from Conference on Information and Knowledge Management (CIKM) ’04.
◦ Process of describing the structure of phrases and sentences Chapter 8 - Phrases and sentences: grammar1.
Overview of Statistical NLP IR Group Meeting March 7, 2006.
Cross-lingual Dataless Classification for Many Languages
NELL Knowledge Base of Verbs
PHRASE.
A Brief Introduction to Distant Supervision
Statistical NLP: Lecture 3
Cross-lingual Dataless Classification for Many Languages
INAGO Project Automatic Knowledge Base Generation from Text for Interactive Question Answering.
Kenneth Baclawski et. al. PSB /11/7 Sa-Im Shin
Visualizing and Understanding Neural Models in NLP
Natural Language Processing (NLP)
Reading Report: Open QA Systems
Improving a Pipeline Architecture for Shallow Discourse Parsing
Noun Compounds Interpretation简单调研
--Mengxue Zhang, Qingyang Li
HowToKB: Mining HowTo Knowledge from Online Communities
LING/C SC 581: Advanced Computational Linguistics
The Eight Parts of Speech
Enriching Structured Knowledge with Open Information
Table Cell Search for Question Answering Huan Sun
Introduction Task: extracting relational facts from text
Word embeddings based mapping
©2004 Pearson Education, Inc., publishing as Longman Publishers.
Word embeddings based mapping
آسان عربی گرامر حصّہ اول مرکبِ عطفی و توصیفی
PREPOSITIONAL PHRASES
Linguistic Essentials
CS246: Information Retrieval
Some thing about Nouns in WordNet
Natural Language Processing (NLP)
ProBase: common Sense Concept KB and Short Text Understanding
CS565: Intelligent Systems and Interfaces
Artificial Intelligence 2004 Speech & Natural Language Processing
Deep Structured Scene Parsing by Learning with Image Descriptions
A Link Grammar for an Agglutinative Language
Natural Language Processing (NLP)
Presentation transcript:

Enhanced Dependency Jiajie Yu Wentao Ding

Enhancements for shallow natural language understanding tasks Null nodes for elided predicates Propagation of conjuncts Additional subject relations for control and raising constructions Coreference in relative clause constructions Modifier labels that contain the preposition or other case-marking information http://www.lrec-conf.org/proceedings/lrec2016/pdf/779_Paper.pdf

Enhancements for shallow natural language understanding tasks Null nodes for elided predicates Propagation of conjuncts Additional subject relations for control and raising constructions

Enhancements for shallow natural language understanding tasks Coreference in relative clause constructions Modifier labels that contain the preposition or other case-marking information Partitives and light noun constructions Partitive: [DP Det. + of + [DP Det. + NP]] quantificational determiners

Some NLP papers related to Noun Phrase Interpretation published in ACL/EMNLP/NAACL

Some Related Papers Syntactic Parsing of Web Queries (EMNLP 16) Xiangyan Sun; Haixun Wang; Yanghua Xiao; Zhongyuan Wang Equation Parsing : Mapping Sentences to Grounded Equations (EMNLP 16) Subhro Roy; Shyam Upadhyay; Dan Roth Fine-Grained IsA Extraction via Modifier Composition (ACL 17) Ellie Pavlick; Marius Pasca Interpreting Noun Compounds using Paraphrases in a Neural Model. (NAACL 18) Vered Shwartz; Chris Waterson

Syntactic Parsing of Web Queries create a web query treebank by projecting dependency from clicked sentences to queries.

Evaluation

Case Study

EQUATION PARSING : Mapping Sentences to Grounded Equations

Triggers & Equation Tree Syntax

Evaluation

Fine-Grained IsA Extraction via Modifier Composition Populating fine-grained classes with instances Related Work: Noun Phrase Interpretation Compound noun phrases (“jazz musician”) communicate implicit semantic relations between modifiers and the head. Recently, interpretations may take the form of arbitrary natural language predicates They focus exclusively on providing good paraphrases for an input noun compound.

Modifiers as Functions Let 𝑀𝐻 be a class label consisting of a head 𝐻, which assumed to be a common noun, preceded by a modifier 𝑀. The interpretation of a common noun is the set of entities in the universe 𝑈. Two stages Interpreting each modifier relative to the head Using the interpretations to identify instances of the class from text

Learning Modifier Interpretations Input Is-A repository 𝑂 & Fact repository 𝐷 (spo+w) Is-A repository: Hearst pattern Fact repository: facts extracted from ReVerb & OLLIE Building property profiles Expand adjectival by WordNet Compute cosine similarity by VSM

Class-Instance Identification Member of 𝑀𝐻 Member of class 𝐶= 𝑀 1 … 𝑀 𝑘 𝐻 Weakly Supervised Reranking logistic regression Positive: instance in 𝑂; Negative: random extracted pairs

Evaluation Dataset: Wikipedia category pages removing those in which the last word is capitalized or which contain fewer than three words remove any titles that contain links to sub-categories. This is to favor fine-grained classes 17 instances in average 19 instances in average

Evaluation

Interpreting Noun Compounds using Paraphrases in a Neural Model

Model & Evaluation