Presentation is loading. Please wait.

Presentation is loading. Please wait.

Compensating speaker-to-microphone playback system for robust speech recognition So-Young Jeong and Soo-Young Lee Brain Science Research Center and Department.

Published byEmily Nelson Modified over 9 years ago

Similar presentations

Presentation on theme: "Compensating speaker-to-microphone playback system for robust speech recognition So-Young Jeong and Soo-Young Lee Brain Science Research Center and Department."— Presentation transcript:

1 Compensating speaker-to-microphone playback system for robust speech recognition So-Young Jeong and Soo-Young Lee Brain Science Research Center and Department of Electrical Engineering and Computer Science Korea Advanced Institute of Science and Technology

2  ASR in mismatched environments Environmental information –Background noise, acoustic/transmission channel Assume environment degradation model Motivation Clean speech Channel Additive noise Distorted speech

3 –P.S –F.B. –L.S. –C.S. Channel Impacts on feature Channel Assumption 2 Channel Assumption 1

4  Speaker-to-Microphone playback  Speaker distortion Nonlinearity caused by voice coil  Microphone distortion Frequency response caused by different fabrication Nonlinearity caused by dynamic range Ambient noise by directionality Speaker-to-Microphone compensation

5  Mapper train Where and which type of mapper should be deployed?  Mapper apply Speaker-to-Microphone mapping F.E. + clean F.E.Mapper distorted Error F.E.Trained Mapper distorted To recognizer

6  Diamond, plus, cross denotes PS,FB.LS level Mapping error at L.S.

7 Frequency correlation plots

8  Task Phoneme recognition for 40 TIMIT phone sets Phone accuracy = (N-D-S-I) * 100 /N  Database HTIMIT : re-recording TIMIT sentence thru. 10 various telephone handsets Training : 246 speaker * 8 sent. = 1968sent. Test : 48 speaker * 8 = 384 sent.  Baseline 3-state monophone HMM with 16 gaussian mixture Recognition Experiments

9 Experiment I – CI result typematchedmismatchCMSDIAGLINPERMLP senh54.7 cb153.645.850.352.652.252.451.9 cb254.948.352.455.154.854.653.7 cb348.532.338.737.340.638.241.9 cb449.835.840.837.942.942.243.3 el155.445.652.254.053.553.254.1 el253.736.749.151.852.552.652.4 el351.044.644.547.146.947.147.2 el453.743.147.649.449.649.750.1 pt152.641.143.045.246.045.445.9

10  Speech signal distorted by low-quality speaker-to- microphone playback system can be compensated with feature mapping network  Feature mapping scheme would be useful in cases that environmental condition is tough for collecting database Conclusion

Download ppt "Compensating speaker-to-microphone playback system for robust speech recognition So-Young Jeong and Soo-Young Lee Brain Science Research Center and Department."

Similar presentations

Acoustic model adaptation for telephone-based speech recognition N. Kleynhans and E. Barnard 27 January 2010.

Acoustic model adaptation for telephone-based speech recognition N. Kleynhans and E. Barnard 27 January 2010.
1 A Spectral-Temporal Method for Pitch Tracking Stephen A. Zahorian*, Princy Dikshit, Hongbing Hu* Department of Electrical and Computer Engineering Old.

1 A Spectral-Temporal Method for Pitch Tracking Stephen A. Zahorian*, Princy Dikshit, Hongbing Hu* Department of Electrical and Computer Engineering Old.
Combining Heterogeneous Sensors with Standard Microphones for Noise Robust Recognition Horacio Franco 1, Martin Graciarena 12 Kemal Sonmez 1, Harry Bratt.

Combining Heterogeneous Sensors with Standard Microphones for Noise Robust Recognition Horacio Franco 1, Martin Graciarena 12 Kemal Sonmez 1, Harry Bratt.
Acoustic Model Adaptation Based On Pronunciation Variability Analysis For Non-Native Speech Recognition Yoo Rhee Oh, Jae Sam Yoon, and Hong Kook Kim Dept.

Acoustic Model Adaptation Based On Pronunciation Variability Analysis For Non-Native Speech Recognition Yoo Rhee Oh, Jae Sam Yoon, and Hong Kook Kim Dept.
Frederico Rodrigues and Isabel Trancoso INESC/IST, 2000 Robust Recognition of Digits and Natural Numbers.

Frederico Rodrigues and Isabel Trancoso INESC/IST, 2000 Robust Recognition of Digits and Natural Numbers.
Distribution-Based Feature Normalization for Robust Speech Recognition Leveraging Context and Dynamics Cues Yu-Chen Kao and Berlin Chen Presenter : 張庭豪.

Distribution-Based Feature Normalization for Robust Speech Recognition Leveraging Context and Dynamics Cues Yu-Chen Kao and Berlin Chen Presenter : 張庭豪.
PERFORMANCE ANALYSIS OF AURORA LARGE VOCABULARY BASELINE SYSTEM Naveen Parihar, and Joseph Picone Center for Advanced Vehicular Systems Mississippi State.

PERFORMANCE ANALYSIS OF AURORA LARGE VOCABULARY BASELINE SYSTEM Naveen Parihar, and Joseph Picone Center for Advanced Vehicular Systems Mississippi State.
AN INVESTIGATION OF DEEP NEURAL NETWORKS FOR NOISE ROBUST SPEECH RECOGNITION Michael L. Seltzer, Dong Yu Yongqiang Wang ICASSP 2013 Presenter : 張庭豪.

AN INVESTIGATION OF DEEP NEURAL NETWORKS FOR NOISE ROBUST SPEECH RECOGNITION Michael L. Seltzer, Dong Yu Yongqiang Wang ICASSP 2013 Presenter : 張庭豪.
Advances in WP1 Turin Meeting – 9-10 March 2006 www.loquendo.com.

Advances in WP1 Turin Meeting – 9-10 March
Model-Based Fusion of Bone and Air Sensors for Speech Enhancement and Robust Speech Recognition John Hershey, Trausti Kristjansson, Zhengyou Zhang, Alex.

Model-Based Fusion of Bone and Air Sensors for Speech Enhancement and Robust Speech Recognition John Hershey, Trausti Kristjansson, Zhengyou Zhang, Alex.
HIWIRE MEETING Nancy, July 6-7, 2006 José C. Segura, Ángel de la Torre.

HIWIRE MEETING Nancy, July 6-7, 2006 José C. Segura, Ángel de la Torre.
Communications & Multimedia Signal Processing Analysis of the Effects of Train noise on Recognition Rate using Formants and MFCC Esfandiar Zavarehei Department.

Communications & Multimedia Signal Processing Analysis of the Effects of Train noise on Recognition Rate using Formants and MFCC Esfandiar Zavarehei Department.
HIWIRE Progress Report Trento, January 2007 Presenter: Prof. Alex Potamianos Technical University of Crete Presenter: Prof. Alex Potamianos Technical University.

HIWIRE Progress Report Trento, January 2007 Presenter: Prof. Alex Potamianos Technical University of Crete Presenter: Prof. Alex Potamianos Technical University.
Advances in WP1 and WP2 Paris Meeting – 11 febr. 2005 www.loquendo.com.

Advances in WP1 and WP2 Paris Meeting – 11 febr
1 USING CLASS WEIGHTING IN INTER-CLASS MLLR Sam-Joo Doh and Richard M. Stern Department of Electrical and Computer Engineering and School of Computer Science.

1 USING CLASS WEIGHTING IN INTER-CLASS MLLR Sam-Joo Doh and Richard M. Stern Department of Electrical and Computer Engineering and School of Computer Science.
HIWIRE Progress Report – July 2006 Technical University of Crete Speech Processing and Dialog Systems Group Presenter: Alex Potamianos Technical University.

HIWIRE Progress Report – July 2006 Technical University of Crete Speech Processing and Dialog Systems Group Presenter: Alex Potamianos Technical University.
Visual Speech Recognition Using Hidden Markov Models Kofi A. Boakye CS280 Course Project.

Visual Speech Recognition Using Hidden Markov Models Kofi A. Boakye CS280 Course Project.
1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University.

1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University.
Why is ASR Hard? Natural speech is continuous

Why is ASR Hard? Natural speech is continuous
Authors: Anastasis Kounoudes, Anixi Antonakoudi, Vasilis Kekatos

Authors: Anastasis Kounoudes, Anixi Antonakoudi, Vasilis Kekatos

Similar presentations

Ads by Google