THE MODULATION SPECTRUM and Its Application to Speech Science and Technology Les Atlas, Steven Greenberg, Hynek Hermansky Interspeech Tutorial August 27, 2007, Antwerp, Belgium Additional material:
The Tutorials Steven Greenberg (Silicon Speech & Tech. Univ. Denmark) The History and Biology of the Modulation Spectrum Les Atlas (University of Washington) New Theory Insights for Modulation Analysis and Filtering of Speech Hynek Hermansky (IDIAP & Swiss Fed. Inst. Tech. Lausanne) Applications of the Modulation Spectrum to Speech Technology
Agenda Ground rules and organization (5 minutes) Brief overview of the tutorials (12 minutes) Historical and Biological Origins – Steve Greenberg (30 minutes) Break (10 minutes) Theoretical Foundations – Les Atlas (45 minutes) Break (10 minutes) Applications – Les Atlas (15 minutes) Speech Engineering – Hynek Hermansky (30 minutes) Conclusion and Discussion
Ground Rules and Organization Questions permitted (and encouraged) during the tutorials However, please restrict your question or comment to 30 seconds (or less) Additional information available on tutorial web site: The tutorial will resume promptly after each 10-minute break
Overview Steve Greenberg – History and Biology of the Modulation Spectrum Les Atlas – Theoretical Foundations and Applications of the Modulation Spectrum Hynek Hermansky – Speech Engineering Applications of the Modulation Spectrum
Overview Steve Greenberg - History and Biology of the Modulation Spectrum First, I will describe how the modulation spectrum approach originated Speech coding (VODER and VOCODER) Speech intelligibility and room acoustics Next, a survey of the modulation spectrum’s use in speech perception studies Modulations below 16 Hz crucial for understanding speech Why? And what are the implications for the biology of human communication? Finally, the relation of the modulation spectrum to brain mechanisms and language Temporal processing of information optimized for sensory-motor control Temporal properties of spoken language