Course Overview Lecture 1 Spoken Language Processing Prof. Andrew Rosenberg.

Slides:



Advertisements
Similar presentations
National Technical University of Athens Department of Electrical and Computer Engineering Image, Video and Multimedia Systems Laboratory
Advertisements

A Human-Centered Computing Framework to Enable Personalized News Video Recommendation (Oh Jun-hyuk)
Information Extraction from Spoken Language Dr Pierre Dumouchel Scientific Vice-President, CRIM Full Professor, ÉTS.
Introduction to Computational Linguistics
Introduction to Computational Linguistics
Language Processing Technology Machines and other artefacts that use language.
Introduction to Natural Language Processing and Speech Computer Science Research Practicum Fall 2012 Andrew Rosenberg.
PHONEXIA Can I have it in writing?. Discuss and share your answers to the following questions: 1.When you have English lessons listening to spoken English,
Forschungszentrum Telekommunikation Wien [Telecommunications Research Center Vienna] Interfaces between Speech and Non-Speech Audio Technology Michael.
Natural Language and Speech Processing Creation of computational models of the understanding and the generation of natural language. Different fields coming.
CSE111: Great Ideas in Computer Science Dr. Carl Alphonce 219 Bell Hall Office hours: M-F 11:00-11:
Bootstrapping a Language- Independent Synthesizer Craig Olinsky Media Lab Europe / University College Dublin 15 January 2002.
Spoken Language Technologies: A review of application areas and research issues Analysis and synthesis of F0 contours Agnieszka Wagner Department of Phonetics,
CS 4705 Lecture 1 CS4705 Introduction to Natural Language Processing.
Speech recognition, understanding and conversational interfaces Alexander Rudnicky School of Computer Science
1 Phonetics Study of the sounds of Speech Articulatory Acoustic Experimental.
The Use of Speech in Speech-to-Speech Translation Andrew Rosenberg 8/31/06 Weekly Speech Lab Talk.
1/16 LELA Language and Computers Harold Somers Professor of Language Engineering.
1 Problems and Prospects in Collecting Spoken Language Data Kishore Prahallad Suryakanth V Gangashetty B. Yegnanarayana Raj Reddy IIIT Hyderabad, India.
Track: Speech Technology Kishore Prahallad Assistant Professor, IIIT-Hyderabad 1Winter School, 2010, IIIT-H.
Lecture 1, 7/21/2005Natural Language Processing1 CS60057 Speech &Natural Language Processing Autumn 2005 Lecture 1 21 July 2005.
CHAPTER 1: Language in Our Lives
Welcome Introduction and Overview Computer Science Research Practicum Fall 2012 Andrew Rosenberg.
Schizophrenia and Depression – Evidence in Speech Prosody Student: Yonatan Vaizman Advisor: Prof. Daphna Weinshall Joint work with Roie Kliper and Dr.
1 TrIn 3102: Consecutive Interpreting Week 7 3/1/06.
Chapter 10 Promoting Success for All Students through Technology J. Charlene Welsh.
Midterm Review Spoken Language Processing Prof. Andrew Rosenberg.
Real-Time Speech Recognition Subtitling in Education Respeaking 2009 Dr Mike Wald University of Southampton.
CSD 2230 HUMAN COMMUNICATION DISORDERS Topic 1 Introduction to Communication Disorders and the Professions of Speech Language Pathology and Audiology.
 How to Sound like a Native English Speaker Joey Nevarez CELOP.
Machine Learning in Spoken Language Processing Lecture 21 Spoken Language Processing Prof. Andrew Rosenberg.
A brief overview of Speech Recognition and Spoken Language Processing Advanced NLP Guest Lecture August 31 Andrew Rosenberg.
Natural Language Processing Rogelio Dávila Pérez Profesor – Investigador
Spoken Dialog Systems and Voice XML Lecturer: Prof. Esther Levin.
THE NATURE OF TEXTS English Language Yo. Lets Refresh So we tend to get caught up in the themes on English Language that we need to remember our basic.
Levels of Language 6 Levels of Language. Levels of Language Aspect of language are often referred to as 'language levels'. To look carefully at language.
October 2005CSA3180 NLP1 CSA3180 Natural Language Processing Introduction and Course Overview.
Improving the OER Experience: Enabling Rich Media Notebooks of OER Video and Audio Brandon Muramatsu Andrew McKinney
Introduction to Computational Linguistics
Introduction to Computational Linguistics Jay Munson (special thanks to Misty Azara) May 30, 2003.
ICS 482: Natural language Processing Pre-introduction
1 Branches of Linguistics. 2 Branches of linguistics Linguists are engaged in a multiplicity of studies, some of which bear little direct relationship.
12/5/20151 Spoken Language Processing Julia Hirschberg CS 4706.
DFKI GmbH, , R. Karger Perspectives for the Indo German Scientific and Technological Cooperation in the Field of Language Technology Reinhard.
Rapid Development in new languages Limited training data (6hrs) provided by NECTEC from 34 speakers, + 8 spks for development and test Romanization of.
1 An Introduction to Computational Linguistics Mohammad Bahrani.
Language in Cognitive Science. Research Areas for Language Computational models of speech production and perception Signal processing for speech analysis,
CS 4705 Natural Language Processing Who am I? Julia Hirschberg –Computational Linguist in CS –Focus: Spoken Language Processing –Lab: The Speech Lab,
Behrooz ChitsazLorrie Apple Johnson Microsoft ResearchU.S. Department of Energy.
Chapter 7 Speech Recognition Framework  7.1 The main form and application of speech recognition  7.2 The main factors of speech recognition  7.3 The.
Language Technologies Capability Demonstration Alon Lavie, Lori Levin, Alex Waibel Language Technologies Institute Carnegie Mellon University CATANAL Planning.
Lexical, Prosodic, and Syntactics Cues for Dialog Acts.
Distinctively Visual. Your task Define/describe what each symbol represents. Write down the first few things that pop into your mind.
Preparing for the 2008 Beijing Olympics : The LingTour and KNOWLISTICS projects. MAO Yuhang, DING Xiao-Qing, NI Yang, LIN Shiuan-Sung, Laurence LIKFORMAN,
Basics of Natural Language Processing Introduction to Computational Linguistics.
Communication Process. Defining Communication On a sticky note, write down your own definition of communication. Be as detailed as possible. With a group,
Introduction to English Linguistics, 5hp. What is linguistics? Why should we study it? Social reasons: it tells us about human interaction and relationships.
Welcome to All S. Course Code: EL 120 Course Name English Phonetics and Linguistics Lecture 1 Introducing the Course (p.2-8) Unit 1: Introducing Phonetics.
LearningHouse.com | (502) Understanding and Complying With the Americans With Disabilities Act (ADA)
Related Courses CMPT 411: Knowledge Representation. Mainly Logic. CMPT 413: Computational Linguistics. Dealing with Natural Language. CMPT 419/726: Often.
SPEECH TECHNOLOGY An Overview Gopala Krishna. A
G. Anushiya Rachel Project Officer
Introduction to Linguistics
Introduction to Linguistics
3.0 Map of Subject Areas.
Why Study Spoken Language?
Spoken Language Processing
Why Study Spoken Language?
UDL Checkpoints 1.1, 1.2, 1.3, 2.1, 2.2, 2.3, 2.4, 2.5.
Spoken Language Processing
Presentation transcript:

Course Overview Lecture 1 Spoken Language Processing Prof. Andrew Rosenberg

Spoken Language Processing How do computers interact with speech? Computational approaches help us understand language and spoken communication. Symbolic and Direct Modeling of Prosody 1

Speech Recognition Voice Dialing Voice mail transcription Closed Captioning Interactive Voice Response / Spoken Dialog Systems Keyword Spotting Continuous Speech Recognition Domain Specific vs. Open Domain Symbolic and Direct Modeling of Prosody 2

Speech Synthesis Navigation Systems –Garmin –Google Maps IBM Watson Bank by phone Spoken Dialog Systems Screen Readers Symbolic and Direct Modeling of Prosody 3

How much information is in speech? Words (Lexical Content) –Syntax –Semantics –Pragmatics Speaker Identity –Gender, Personality Speaker State Discourse Acts Symbolic and Direct Modeling of Prosody 4

Other applications Video retrieval “Rich Transcription” Speech Segmentation Emotion Analysis Speech-to-speech translation Intelligence Applications –Deception –Trust –Language & dialect Identification Symbolic and Direct Modeling of Prosody 5

Broader Scientific Questions How do you produce sounds that other perceive as language? How does a hearer decode what you are trying to express? How and why do you use prosodic variation? –Phrasing –Emphasis –Intonational Contours –Emotion, sarcasm, etc. How does smooth turn taking happen? Symbolic and Direct Modeling of Prosody 6

What will be covered in this course. Project driven course. Spoken Dialog System –Recognize Speech CMU Sphinx –Make a decision –Generate Speech Festival Symbolic and Direct Modeling of Prosody 7

How the course is structured Speech Recognition Speech Synthesis Analysis of additional information from speech –Speaker ID –Prosody/Intonation –etc. Symbolic and Direct Modeling of Prosody 8

Project and Exams Build a Spoken Dialog System –4 Deadlines Project Description (and team membership) Speech Recognition Component Speech Synthesis Component Full system with demo. (Start on this early) –Project writeup. In class midterm. Symbolic and Direct Modeling of Prosody 9

The syllabus and course policies course webpage: – s.htmlhttp://eniac.cs.qc.cuny.edu/andrew/slp/syllabu s.html Symbolic and Direct Modeling of Prosody 10

Questions? Policies Course mechanics Expectations Symbolic and Direct Modeling of Prosody 11