Develop a fast semantic decoder Robust to speech recognition noise Trainable on different domains: Tourist information (TownInfo) Air travel information.

Slides:



Advertisements
Similar presentations
Machine Learning Approaches to the Analysis of Large Corpora : A Survey Xunlei Rose Hu and Eric Atwell University of Leeds.
Advertisements

Hidden Information State System A Statistical Spoken Dialogue System M. Gašić, F. Jurčíček, S. Keizer, F. Mairesse, B. Thomson, K. Yu and S. Young Cambridge.
Dialogue Policy Optimisation
Probabilistic Adaptive Real-Time Learning And Natural Conversational Engine Seventh Framework Programme FP7-ICT
Proceedings of the Conference on Intelligent Text Processing and Computational Linguistics (CICLing-2007) Learning for Semantic Parsing Advisor: Hsin-His.
15.0 Utterance Verification and Keyword/Key Phrase Spotting References: 1. “Speech Recognition and Utterance Verification Based on a Generalized Confidence.
1 Unsupervised Semantic Parsing Hoifung Poon and Pedro Domingos EMNLP 2009 Best Paper Award Speaker: Hao Xiong.
Dialogue – Driven Intranet Search Suma Adindla School of Computer Science & Electronic Engineering 8th LANGUAGE & COMPUTATION DAY 2009.
Gaussian Processes for Fast Policy Optimisation of POMDP-based Dialogue Managers M. Gašić, F. Jurčíček, S. Keizer, F. Mairesse, B. Thomson, K. Yu, S. Young.
CS4705 Natural Language Processing.  Regular Expressions  Finite State Automata ◦ Determinism v. non-determinism ◦ (Weighted) Finite State Transducers.
Midterm Review CS4705 Natural Language Processing.
ITCS 6010 Spoken Language Systems: Architecture. Elements of a Spoken Language System Endpointing Feature extraction Recognition Natural language understanding.
1 I256: Applied Natural Language Processing Marti Hearst Sept 27, 2006.
ASR Evaluation Julia Hirschberg CS Outline Intrinsic Methods –Transcription Accuracy Word Error Rate Automatic methods, toolkits Limitations –Concept.
Statistical Natural Language Processing. What is NLP?  Natural Language Processing (NLP), or Computational Linguistics, is concerned with theoretical.
Yun-Nung (Vivian) Chen William Yang Wang Anatole Gershman
OMAP: An Implemented Framework for Automatically Aligning OWL Ontologies SWAP, December, 2005 Raphaël Troncy, Umberto Straccia ISTI-CNR
AQUAINT Kickoff Meeting – December 2001 Integrating Robust Semantics, Event Detection, Information Fusion, and Summarization for Multimedia Question Answering.
An Evaluation Framework for Natural Language Understanding in Spoken Dialogue Systems Joshua B. Gordon and Rebecca J. Passonneau Columbia University.
Spoken Language Understanding for Conversational Dialog Systems
Richard Socher Cliff Chiung-Yu Lin Andrew Y. Ng Christopher D. Manning
Some Advances in Transformation-Based Part of Speech Tagging
1 The Hidden Vector State Language Model Vidura Senevitratne, Steve Young Cambridge University Engineering Department.
Empirical Methods in Information Extraction Claire Cardie Appeared in AI Magazine, 18:4, Summarized by Seong-Bae Park.
Tree Kernels for Parsing: (Collins & Duffy, 2001) Advanced Statistical Methods in NLP Ling 572 February 28, 2012.
Lecture 12: 22/6/1435 Natural language processing Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
For Friday Finish chapter 23 Homework: –Chapter 22, exercise 9.
A Natural Language Interface for Crime-related Spatial Queries Chengyang Zhang, Yan Huang, Rada Mihalcea, Hector Cuellar Department of Computer Science.
Develop a fast semantic decoder for dialogue systems Capability to parse 10 – 100 ASR hypotheses in real time Robust to speech recognition noise Semantic.
Hurieh Khalajzadeh Mohammad Mansouri Mohammad Teshnehlab
The Impact of Grammar Enhancement on Semantic Resources Induction Luca Dini Giampaolo Mazzini
An Extended GHKM Algorithm for Inducing λ-SCFG Peng Li Tsinghua University.
Evaluation of SDS Svetlana Stoyanchev 3/2/2015. Goal of dialogue evaluation Assess system performance Challenges of evaluation of SDS systems – SDS developer.
Discriminative Models for Spoken Language Understanding Ye-Yi Wang, Alex Acero Microsoft Research, Redmond, Washington USA ICSLP 2006.
Interpreter CS 124 Reference: Gamma et al (“Gang-of-4”), Design Patterns Some material taken from:
DIALOG SYSTEMS FOR AUTOMOTIVE ENVIRONMENTS Presenter: Joseph Picone Inst. for Signal and Info. Processing Dept. Electrical and Computer Eng. Mississippi.
Markov Logic and Deep Networks Pedro Domingos Dept. of Computer Science & Eng. University of Washington.
16.0 Spoken Dialogues References: , Chapter 17 of Huang 2. “Conversational Interfaces: Advances and Challenges”, Proceedings of the IEEE,
Still Talking to Machines (Cognitively Speaking) Machine Intelligence Laboratory Information Engineering Division Cambridge University Engineering Department.
DIALOG SYSTEMS FOR AUTOMOTIVE ENVIRONMENTS Presenter: Joseph Picone Inst. for Signal and Info. Processing Dept. Electrical and Computer Eng. Mississippi.
Speech Communication Lab, State University of New York at Binghamton Dimensionality Reduction Methods for HMM Phonetic Recognition Hongbing Hu, Stephen.
For Friday Finish chapter 23 Homework –Chapter 23, exercise 15.
Automatic Grammar Induction and Parsing Free Text - Eric Brill Thur. POSTECH Dept. of Computer Science 심 준 혁.
Chapter 8. Situated Dialogue Processing for Human-Robot Interaction in Cognitive Systems, Christensen et al. Course: Robots Learning from Humans Sabaleuski.
Disambiguating inventor names using deep neural networks Steve Petrie T’Mir Julius.
金聲玉振 Taiwan Univ. & Academia Sinica 1 Spoken Dialogue in Information Retrieval Jia-lin Shen Oct. 22, 1998.
AIFB Ontology Mapping I3CON Workshop PerMIS August 24-26, 2004 Washington D.C., USA Marc Ehrig Institute AIFB, University of Karlsruhe.
Develop a fast semantic decoder for dialogue systems Capability to parse 10 – 100 ASR hypothesis in real time Robust to speech recognition noise Trainable.
Exploiting Named Entity Taggers in a Second Language Thamar Solorio Computer Science Department National Institute of Astrophysics, Optics and Electronics.
Integrating Multiple Knowledge Sources For Improved Speech Understanding Sherif Abdou, Michael Scordilis Department of Electrical and Computer Engineering,
Identifying “Best Bet” Web Search Results by Mining Past User Behavior Author: Eugene Agichtein, Zijian Zheng (Microsoft Research) Source: KDD2006 Reporter:
Department of Computer Science The University of Texas at Austin USA Joint Entity and Relation Extraction using Card-Pyramid Parsing Rohit J. Kate Raymond.
Non-Monotonic Parsing of Fluent Umm I mean Disfluent Sentences Mohammad Sadegh Rasooli[Columbia University] Joel Tetreault[Yahoo Labs] This work conducted.
Predicting and Adapting to Poor Speech Recognition in a Spoken Dialogue System Diane J. Litman AT&T Labs -- Research
Automatic Speech Recognition
CSC 594 Topics in AI – Natural Language Processing
Spectral and Temporal Modulation Features for Phonetic Recognition Stephen A. Zahorian, Hongbing Hu, Zhengqing Chen, Jiang Wu Department of Electrical.
Van-Khanh Tran and Le-Minh Nguyen
Deep learning and applications to Natural language processing
Learning to Transform Natural to Formal Languages
Data Recombination for Neural Semantic Parsing
Neural Networks Advantages Criticism
Learning to Parse Database Queries Using Inductive Logic Programming
CS4705 Natural Language Processing
PROJ2: Building an ASR System
Unsupervised Pretraining for Semantic Parsing
Natural Language to SQL(nl2sql)
Parsing Unrestricted Text
PRESENTATION: GROUP # 5 Roll No: 14,17,25,36,37 TOPIC: STATISTICAL PARSING AND HIDDEN MARKOV MODEL.
Artificial Intelligence 2004 Speech & Natural Language Processing
Presentation transcript:

Develop a fast semantic decoder Robust to speech recognition noise Trainable on different domains: Tourist information (TownInfo) Air travel information system (ATIS) Semantic parsing maps natural language to formal langage – most of the maping incurrent dialogue is fairly simple (cities, times,... ). To develop a fast semantic parser, we have to take advantage of this feature. Inference of compact set of transforation rules which transforms the initial naive semantic hypothesis. Compare semantic tuple classifiers with: A handcrafted Phoenix grammar The Hidden Vector State model (He & Young, 2006) Probabilistic Combinatory Categorial Grammar Induction (Zettlemoyer & Collins, 2007) Markov Logic networks (Meza-Ruiz et al., 2008) Evaluation metrics: Dialogue act type accuracy (e.g. inform or request) Precision, recall and F-measure of dialogue act items (e.g. food=Chinese, toloc.city=New York) Conclusion: semantic tuple classifiers are robust to noise and competitive with the state of the art – they provide a simple yet efficient solution to the spoken language understanding problem! The code is available at Transformation-based Learning for Semantic Parsing F. Jurcicek, M. Gasic, S. Keizer, F. Mairesse, B. Thomson, K. Yu, S. Young Cambridge University Engineering Department | {fj228, mg436, sk561, f.mairesse, brmt2, ky219, Goals Example of parsing Example: find all the flights between Toronto and Sandiego that arrive on Saturday 1.Parser assigns to inital semantics to input sentece. 2.Rules, whose triggers match the sentence a the hypothesised semantics, are sequentially applied. 3.Resulting semantics Acknowledgements This research was partly funded by the UK EPSRC under grant agreement EP/F013930/1 and by the EU FP7 Programme under grant agreement (CLASSiC project: ). Evaluation Motivation Semantic decoderAct accuracy Item precision Item recall Item F TownInfo dataset with transcribed utterances: Semantic Tuple Classifiers Phoenix grammar TownInfo dataset with ASR output: Semantic Tuple Classifiers Phoenix grammar ATIS dataset with transcribed utterances: Semantic Tuple Classifiers Hidden Vector State90.3 PCCG Induction Markov Logic Networks what are the lowest airfare from Washington DC to Boston GOAL= airfare airfare.type= lowest from.city= Wahington from.state= DC to.city= Boston Open source Tranformation parsing TriggersTransformations „tickets“replace the goal by „airfare“ „flights * from“ & GOAL=airfarereplace the goal by flight „Seatle“add the slot „to.city=Seatle“ „connecting“replace the slot „to.city=*“ by „stop.city=*“ GOAL= flight from.city=Toronto to.city=Sandiego departure.day=Saturday #triggertransformation 1„between toronto“add the slot „from.city=Toronto“ 2„and sandiago“add the slot „to.city=Sand Diaego“ 3„Saturday“add the slot „departure.day=Saturday“