计算机科学与技术学院 Chinese Semantic Role Labeling with Dependency-driven Constituent Parse Tree Structure Hongling Wang, Bukang Wang Guodong Zhou NLP Lab, School.

Slides:



Advertisements
Similar presentations
CILC2011 A framework for structured knowledge extraction and representation from natural language via deep sentence analysis Stefania Costantini Niva Florio.
Advertisements

SEMANTIC ROLE LABELING BY TAGGING SYNTACTIC CHUNKS
Page 1 SRL via Generalized Inference Vasin Punyakanok, Dan Roth, Wen-tau Yih, Dav Zimak, Yuancheng Tu Department of Computer Science University of Illinois.
Proceedings of the Conference on Intelligent Text Processing and Computational Linguistics (CICLing-2007) Learning for Semantic Parsing Advisor: Hsin-His.
Beyond NomBank: A Study of Implicit Arguments for Nominal Predicates Matthew Gerber and Joyce Y. Chai Department of Computer Science Michigan State University.
Layering Semantics (Putting meaning into trees) Treebank Workshop Martha Palmer April 26, 2007.
Statistical NLP: Lecture 3
Semantic Role Labeling Abdul-Lateef Yussiff
A Joint Model For Semantic Role Labeling Aria Haghighi, Kristina Toutanova, Christopher D. Manning Computer Science Department Stanford University.
Funding Networks Abdullah Sevincer University of Nevada, Reno Department of Computer Science & Engineering.
SRL using complete syntactic analysis Mihai Surdeanu and Jordi Turmo TALP Research Center Universitat Politècnica de Catalunya.
Reporter: Longhua Qian School of Computer Science and Technology
OCFS: Optimal Orthogonal Centroid Feature Selection for Text Categorization Jun Yan, Ning Liu, Benyu Zhang, Shuicheng Yan, Zheng Chen, and Weiguo Fan et.
Learning syntactic patterns for automatic hypernym discovery Rion Snow, Daniel Jurafsky and Andrew Y. Ng Prepared by Ang Sun
Latent Semantic Analysis (LSA). Introduction to LSA Learning Model Uses Singular Value Decomposition (SVD) to simulate human learning of word and passage.
Semantic Role Labeling using Maximum Entropy Model Joon-Ho Lim NLP Lab. Korea Univ.
Longhua Qian School of Computer Science and Technology
Learning Table Extraction from Examples Ashwin Tengli, Yiming Yang and Nian Li Ma School of Computer Science Carnegie Mellon University Coling 04.
Mining and Summarizing Customer Reviews
1 CS546: Machine Learning and Natural Language Preparation to the Term Project: - Dependency Parsing - Dependency Representation for Semantic Role Labeling.
Richard Socher Cliff Chiung-Yu Lin Andrew Y. Ng Christopher D. Manning
Empirical Methods in Information Extraction Claire Cardie Appeared in AI Magazine, 18:4, Summarized by Seong-Bae Park.
RuleML-2007, Orlando, Florida1 Towards Knowledge Extraction from Weblogs and Rule-based Semantic Querying Xi Bai, Jigui Sun, Haiyan Che, Jin.
English for Computer Science Lecture 6. Reading CS Papers (2)  Making Use of Section Titles  Adjusting Your Pace  Bits and Bytes  Reading.
Authors: Ting Wang, Yaoyong Li, Kalina Bontcheva, Hamish Cunningham, Ji Wang Presented by: Khalifeh Al-Jadda Automatic Extraction of Hierarchical Relations.
Dual Coordinate Descent Algorithms for Efficient Large Margin Structured Prediction Ming-Wei Chang and Scott Wen-tau Yih Microsoft Research 1.
Knowledge and Tree-Edits in Learnable Entailment Proofs Asher Stern, Amnon Lotan, Shachar Mirkin, Eyal Shnarch, Lili Kotlerman, Jonathan Berant and Ido.
Extracting Semantic Constraint from Description Text for Semantic Web Service Discovery Dengping Wei, Ting Wang, Ji Wang, and Yaodong Chen Reporter: Ting.
Automatic Detection of Tags for Political Blogs Khairun-nisa Hassanali Vasileios Hatzivassiloglou The University.
Intelligent Database Systems Lab N.Y.U.S.T. I. M. Chinese Word Segmentation and Statistical Machine Translation Presenter : Wu, Jia-Hao Authors : RUIQIANG.
ACBiMA: Advanced Chinese Bi-Character Word Morphological Analyzer 1 Ting-Hao (Kenneth) Huang Yun-Nung (Vivian) Chen Lingpeng Kong
A Weakly-Supervised Approach to Argumentative Zoning of Scientific Documents Yufan Guo Anna Korhonen Thierry Poibeau 1 Review By: Pranjal Singh Paper.
Semantic Role Labeling for Arabic using Kernel Methods Mona Diab Alessandro Moschitti Daniele Pighin.
1 Exploiting Syntactic Patterns as Clues in Zero- Anaphora Resolution Ryu Iida, Kentaro Inui and Yuji Matsumoto Nara Institute of Science and Technology.
1 Boosting-based parse re-ranking with subtree features Taku Kudo Jun Suzuki Hideki Isozaki NTT Communication Science Labs.
INSTITUTE OF COMPUTING TECHNOLOGY Forest-based Semantic Role Labeling Hao Xiong, Haitao Mi, Yang Liu and Qun Liu Institute of Computing Technology Academy.
Frontiers in the Convergence of Bioscience and Information Technologies 2007 Seyed Koosha Golmohammadi, Lukasz Kurgan, Brendan Crowley, and Marek Reformat.
Opinion Holders in Opinion Text from Online Newspapers Youngho Kim, Yuchul Jung and Sung-Hyon Myaeng Reporter: Chia-Ying Lee Advisor: Prof. Hsin-Hsi Chen.
Sentence Compression Based on ILP Decoding Method Hongling Wang, Yonglei Zhang, Guodong Zhou NLP Lab, Soochow University.
Annotation for Hindi PropBank. Outline Introduction to the project Basic linguistic concepts – Verb & Argument – Making information explicit – Null arguments.
A Systematic Exploration of the Feature Space for Relation Extraction Jing Jiang & ChengXiang Zhai Department of Computer Science University of Illinois,
1 Intelligente Analyse- und Informationssysteme Frank Reichartz, Hannes Korte & Gerhard Paass Fraunhofer IAIS, Sankt Augustin, Germany Dependency Tree.
C. Lawrence Zitnick Microsoft Research, Redmond Devi Parikh Virginia Tech Bringing Semantics Into Focus Using Visual.
INSTITUTE OF COMPUTING TECHNOLOGY Forest-to-String Statistical Translation Rules Yang Liu, Qun Liu, and Shouxun Lin Institute of Computing Technology Chinese.
Latent Topic Modeling of Word Vicinity Information for Speech Recognition Kuan-Yu Chen, Hsuan-Sheng Chiu, Berlin Chen ICASSP 2010 Hao-Chin Chang Department.
Mining Dependency Relations for Query Expansion in Passage Retrieval Renxu Sun, Chai-Huat Ong, Tat-Seng Chua National University of Singapore SIGIR2006.
Evaluation issues in anaphora resolution and beyond Ruslan Mitkov University of Wolverhampton Faro, 27 June 2002.
4. Relationship Extraction Part 4 of Information Extraction Sunita Sarawagi 9/7/2012CS 652, Peter Lindes1.
Support Vector Machines and Kernel Methods for Co-Reference Resolution 2007 Summer Workshop on Human Language Technology Center for Language and Speech.
11 Project, Part 3. Outline Basics of supervised learning using Naïve Bayes (using a simpler example) Features for the project 2.
FILTERED RANKING FOR BOOTSTRAPPING IN EVENT EXTRACTION Shasha Liao Ralph York University.
11 A Classification-based Approach to Question Routing in Community Question Answering Tom Chao Zhou 1, Michael R. Lyu 1, Irwin King 1,2 1 The Chinese.
1 Question Answering and Logistics. 2 Class Logistics  Comments on proposals will be returned next week and may be available as early as Monday  Look.
Department of Computer Science The University of Texas at Austin USA Joint Entity and Relation Extraction using Card-Pyramid Parsing Rohit J. Kate Raymond.
Convolution Kernels on Constituent, Dependency and Sequential Structures for Relation Extraction Advisor: Hsin-His Chen Reporter: Chi-Hsin Yu Date:
Relation Extraction: Rule-based Approaches CSCI-GA.2590 Ralph Grishman NYU.
Multi-Class Sentiment Analysis with Clustering and Score Representation Yan Zhu.
Short Text Similarity with Word Embedding Date: 2016/03/28 Author: Tom Kenter, Maarten de Rijke Source: CIKM’15 Advisor: Jia-Ling Koh Speaker: Chih-Hsuan.
Relation Extraction (RE) via Supervised Classification See: Jurafsky & Martin SLP book, Chapter 22 Exploring Various Knowledge in Relation Extraction.
Universiteit Twente Juggling Word Graphs A method for modeling the meaning of sentences using extended knowledge graphs.
Automatically Labeled Data Generation for Large Scale Event Extraction
Learning Textual Entailment from Examples
Longhua Qian School of Computer Science and Technology
Relation Extraction CSCI-GA.2591
Two Discourse Driven Language Models for Semantics
Clustering Algorithms for Noun Phrase Coreference Resolution
Learning to Parse Database Queries Using Inductive Logic Programming
Automatic Extraction of Hierarchical Relations from Text
Using Uneven Margins SVM and Perceptron for IE
Hierarchical, Perceptron-like Learning for OBIE
Presentation transcript:

计算机科学与技术学院 Chinese Semantic Role Labeling with Dependency-driven Constituent Parse Tree Structure Hongling Wang, Bukang Wang Guodong Zhou NLP Lab, School of Computer Science & Technology, Soochow University

Outlines  Motivation  Related work  Tree kernel-based nominal SRL on D-CPT  Experimentation and Results  Conclusion

Motivation(1)  Two kinds of method for SRL  Feature-based VS. Tree Kernel-based  The latter has the potential in better capturing structured knowledge in the parse tree structure.  There are only a few studies employing tree kernel- based methods for SRL and most of them focus on the CPT structure.

Motivation(2)  DPT (Dependency Parse Tree) captures the dependency relationship between individual words, while CPT (Constituent Parse Tree) concerns with the phrase structure in a sentence.  CPT and DPT may behave quite differently in capturing different aspects of syntactic phenomena.  We explore a tree kernel-based methods using a new syntactic parse tree structure, called dependency-driven constituent parse tree (D-CPT) for Chinese nominal SRL.

Related Work  Some studies use tree kernel-based methods for verbal SRL  Moschitti et al., Che et al., Zhang et al.  There are a few related studies in other NLP tasks employing DPT in tree kernel-based methods and achieve comparable performance to the ones on CPT.  semantic relation extraction and co-reference resolution  To our knowledge, there are no reported studies on tree kernel-based methods for SRL from the DPT structure perspective.

D-CPT Structure  The new D-CPT structure benefits from the advantages of both DPT and CPT since D-CPT not only keeps the dependency relationship information in DPT but also retains the basic structure of CPT.  This is done by transforming the DPT structure to a new CPT-style structure, using dependency types instead of phrase labels in the traditional CPT structure.

Example of DPT with nominal predicate and its related arguments annotated

Example of achieving D-CPT structure from DPT structure

Extraction schemes 1) Shortest path tree (SPT)  This extraction scheme only includes the nodes occurring in the shortest path connecting the predicate and the argument candidate, via the nearest commonly-governing node. 2) SV-SPT  This extraction scheme includes the support verb information in nominal SRL. 3) H-SV-SPT  Both of the head argument and the support verb information are included in nominal SRL.

Extraction schemes

Kernels  In order to capture the complementary nature between feature-based methods and tree kernel- based methods, we combine them via a composite kernel.  Our composite kernel is combined by linearly interpolating a convolution tree kernel K T over a parse tree structure and a feature-based linear kernel K L as follow:

Experiment setting  Corpus: Chinese NomBank  Training data: 648 files (chtb_081 to 899.fid)  Test data: 72 files (chtb_001 to 040.fid and chtb_900 to 931.fid)  Development data: 40 files (chtb_041 to 080.fid)  Tools  Classifier: SVM-light toolkit with the convolution tree kernel function SVM light –TK  C (SVM) and λ (tree kernel) are fine-tuned to 4.0 and 0.5 respectively

Results on golden parse trees (1)

Results on golden parse trees (2)

Results on automatic parse trees

Results on Comparison experments(1)

Results on Comparison experments(2)

Results on the CoNLL-2009 Chinese corpus

Conclusion  This paper systematically explores a tree kernel-based method on a novel D-CPT  We propose a simple strategy, which transforms the DPT structure into a CPT-style structure.  Several extraction schemes are designed to extract various kinds of necessary information for nominal SRL and verbal SRL  Evaluation shows the effectiveness of D-CPT both on Chinese NomBank and CoNLL-2009 corpus.

Thanks! Q & C?