1. THE MODULATION SPECTRUM and Its Application to Speech Science and Technology Les Atlas, Steven Greenberg, Hynek Hermansky Interspeech Tutorial August 27, 2007, Antwerp, Belgium Additional material: www.silicon-speech.com/modspec

2. The Tutorials Steven Greenberg (Silicon Speech & Tech. Univ. Denmark) The History and Biology of the Modulation Spectrum Les Atlas (University of Washington) New Theory Insights for Modulation Analysis and Filtering of Speech Hynek Hermansky (IDIAP & Swiss Fed. Inst. Tech. Lausanne) Applications of the Modulation Spectrum to Speech Technology

3. Agenda  Ground rules and organization (5 minutes)  Brief overview of the tutorials (12 minutes)  Historical and Biological Origins – Steve Greenberg (30 minutes)  Break (10 minutes)  Theoretical Foundations – Les Atlas (45 minutes)  Break (10 minutes)  Applications – Les Atlas (15 minutes)  Speech Engineering – Hynek Hermansky (30 minutes)  Conclusion and Discussion

4. Ground Rules and Organization  Questions permitted (and encouraged) during the tutorials  However, please restrict your question or comment to 30 seconds (or less)  Additional information available on tutorial web site: www.silicon-speech.com/modspec  The tutorial will resume promptly after each 10-minute break

5. Overview  Steve Greenberg – History and Biology of the Modulation Spectrum  Les Atlas – Theoretical Foundations and Applications of the Modulation Spectrum  Hynek Hermansky – Speech Engineering Applications of the Modulation Spectrum

6. Overview Steve Greenberg - History and Biology of the Modulation Spectrum  First, I will describe how the modulation spectrum approach originated Speech coding (VODER and VOCODER) Speech intelligibility and room acoustics  Next, a survey of the modulation spectrum’s use in speech perception studies Modulations below 16 Hz crucial for understanding speech Why? And what are the implications for the biology of human communication?  Finally, the relation of the modulation spectrum to brain mechanisms and language Temporal processing of information optimized for sensory-motor control Temporal properties of spoken language