Presentation is loading. Please wait.

Presentation is loading. Please wait.

Speech Conductor Team Six (see below)

Published byJemimah Nash Modified over 6 years ago

Similar presentations

Presentation on theme: "Speech Conductor Team Six (see below)"— Presentation transcript:

1 Speech Conductor Team Six (see below)
Final Report, August 12th, 2005

2 Aims A gesture interface for driving (“conducting”) a text to speech synthesis system Gesture interpretation algorithms and speech signal modification algorithms Real time modification of voice synthesis Formant-based and text-to-speech syntheses Add expression and emotion to the speech flow 11/19/2018

3 Two Tasks Baby Synthesizers Text-to-speech
Real time controlled full voice source models and basic vocal tract model - formant synthesis Pure expression without words Text-to-speech Real time gestural control of intonation English, French 11/19/2018

4 TASK 1: Baby Synthesizer
Elaborated voice source models, including aperiodicities, effort, pressure, pitch and intensity Time domain (LF) vs spectral domain (CALM) models (Glove + keys) vs (keyboard + pedal + sliders) 11/19/2018

5 T1: Time Domain LF Model Filter Formants Jitter Noise αm Jitter AN Oq
Ta F0 Jitter AV AN Jitter Filter 11/19/2018

6 T1: Spectral Domain CALM
Noise Tilt Bg Fg F0 Jitter Formants AN Shimmer AV Filter 11/19/2018

7 DEMOS T1: Mapping Devices Voice Dimensions Model Parameters
Noise Vowel Pressure Effort Intonation Bg Fg F0 Jitter Formants AN Tilt Shimmer AV Oq αm Ta Model Parameters Synthesizers DEMOS 11/19/2018

8 T2: Gestural Control of TTS
Diphone based synthesis of English and French Real-time control: Glove controlled F0 only Keyboard controlled F0, intensity and syllable triggering 11/19/2018

9 T2: Gestural Control of TTS
Intonation Duration Intensity MIDIMbrola Text Voice Phonetic Translation & Syllabification 11/19/2018

10 T1&T2: Conclusions Test Max vs Pure Data
Compare time domain vs spectral domain source models Compare input devices (glove, keyboard, sliders, pedals, joysticks, data spoon) Multi-lingual synthesis (baby, English, French…) 11/19/2018

11 Christophe d'Alessandro Sylvain Le Beux Nicolas D'Alessandro
THE TEAM Christophe d'Alessandro Sylvain Le Beux Nicolas D'Alessandro Feride Çetin Hannes Pirker Juraj Šimko 11/19/2018

12 HERE WE ARE! Questions? 11/19/2018

Download ppt "Speech Conductor Team Six (see below)"

Similar presentations

Acoustic/Prosodic Features

Acoustic/Prosodic Features
PF-STAR: emotional speech synthesis Istituto di Scienze e Tecnologie della Cognizione, Sezione di Padova – “Fonetica e Dialettologia”, CNR.

PF-STAR: emotional speech synthesis Istituto di Scienze e Tecnologie della Cognizione, Sezione di Padova – “Fonetica e Dialettologia”, CNR.
Analysis and Digital Implementation of the Talk Box Effect Yuan Chen Advisor: Professor Paul Cuff.

Analysis and Digital Implementation of the Talk Box Effect Yuan Chen Advisor: Professor Paul Cuff.
Glottal Source Parameterization: A Comparative Study Authors: Ixone Arroabarren, Alfonso Carlosena UNIVERSIDAD PÚBLICA DE NAVARRA Dpt. Electrical Engineering.

Glottal Source Parameterization: A Comparative Study Authors: Ixone Arroabarren, Alfonso Carlosena UNIVERSIDAD PÚBLICA DE NAVARRA Dpt. Electrical Engineering.
“Connecting the dots” How do articulatory processes “map” onto acoustic processes?

“Connecting the dots” How do articulatory processes “map” onto acoustic processes?
Liner Predictive Pitch Synchronization Voiced speech detection, analysis and synthesis Jim Bryan Florida Institute of Technology ECE5525 Final Project.

Liner Predictive Pitch Synchronization Voiced speech detection, analysis and synthesis Jim Bryan Florida Institute of Technology ECE5525 Final Project.
Tools for Speech Analysis Julia Hirschberg CS4995/6998 Thanks to Jean-Philippe Goldman, Fadi Biadsy.

Tools for Speech Analysis Julia Hirschberg CS4995/6998 Thanks to Jean-Philippe Goldman, Fadi Biadsy.
Speech Science XII Speech Perception (acoustic cues) Version 2007-8.

Speech Science XII Speech Perception (acoustic cues) Version
5-Text To Speech (TTS) Speech Synthesis

5-Text To Speech (TTS) Speech Synthesis
CENTER FOR SPOKEN LANGUAGE UNDERSTANDING 1 PREDICTION AND SYNTHESIS OF PROSODIC EFFECTS ON SPECTRAL BALANCE OF VOWELS Jan P.H. van Santen and Xiaochuan.

CENTER FOR SPOKEN LANGUAGE UNDERSTANDING 1 PREDICTION AND SYNTHESIS OF PROSODIC EFFECTS ON SPECTRAL BALANCE OF VOWELS Jan P.H. van Santen and Xiaochuan.
Basic Spectrogram Lab 8. Spectrograms §Spectrograph: Produces visible patterns of acoustic energy called spectrograms §Spectrographic Analysis: l Acoustic.

Basic Spectrogram Lab 8. Spectrograms §Spectrograph: Produces visible patterns of acoustic energy called spectrograms §Spectrographic Analysis: l Acoustic.
Text to Speech for In-car Navigation Systems Luisa Cordano August 8, 2006.

Text to Speech for In-car Navigation Systems Luisa Cordano August 8, 2006.
Automatic Lip- Synchronization Using Linear Prediction of Speech Christopher Kohnert SK Semwal University of Colorado, Colorado Springs.

Automatic Lip- Synchronization Using Linear Prediction of Speech Christopher Kohnert SK Semwal University of Colorado, Colorado Springs.
Complete Discrete Time Model Complete model covers periodic, noise and impulsive inputs. For periodic input 1) R(z): Radiation impedance. It has been shown.

Complete Discrete Time Model Complete model covers periodic, noise and impulsive inputs. For periodic input 1) R(z): Radiation impedance. It has been shown.
1 Frequency Domain Analysis/Synthesis Concerned with the reproduction of the frequency spectrum within the speech waveform Less concern with amplitude.

1 Frequency Domain Analysis/Synthesis Concerned with the reproduction of the frequency spectrum within the speech waveform Less concern with amplitude.
Dr. O. Dakkak & Dr. N. Ghneim: HIAST M. Abu-Zleikha & S. Al-Moubyed: IT fac., Damascus U. Prosodic Feature Introduction and Emotion Incorporation in an.

Dr. O. Dakkak & Dr. N. Ghneim: HIAST M. Abu-Zleikha & S. Al-Moubyed: IT fac., Damascus U. Prosodic Feature Introduction and Emotion Incorporation in an.
Emotions and Voice Quality: Experiments with Sinusoidal Modeling Authors: Carlo Drioli, Graziano Tisato, Piero Cosi, Fabio Tesser Institute of Cognitive.

Emotions and Voice Quality: Experiments with Sinusoidal Modeling Authors: Carlo Drioli, Graziano Tisato, Piero Cosi, Fabio Tesser Institute of Cognitive.
MULTI LINGUAL ISSUES IN SPEECH SYNTHESIS AND RECOGNITION IN INDIAN LANGUAGES NIXON PATEL Bhrigus Inc Multilingual & International Speech.

MULTI LINGUAL ISSUES IN SPEECH SYNTHESIS AND RECOGNITION IN INDIAN LANGUAGES NIXON PATEL Bhrigus Inc Multilingual & International Speech.
6/3/20151 Voice Transformation : Speech Morphing Gidon Porat and Yizhar Lavner SIPL – Technion IIT December 1 2002.

6/3/20151 Voice Transformation : Speech Morphing Gidon Porat and Yizhar Lavner SIPL – Technion IIT December
Advanced Technology Center Stuttgart EMOTIONAL SPACE IMPROVES EMOTION RECOGNITION Raquel Tato, Rocio Santos, Ralf Kompe Man Machine Interface Lab Advance.

Advanced Technology Center Stuttgart EMOTIONAL SPACE IMPROVES EMOTION RECOGNITION Raquel Tato, Rocio Santos, Ralf Kompe Man Machine Interface Lab Advance.

Similar presentations

Ads by Google