2. Articulatory Synthesis of Singing Peter Birkholz Institute for Computer Science, University of Rostock Singing Synthesis Challenge 2007 at the Interspeech‘07, Antwerp

3. 28.08.2007Articulatory Synthesis of Singing2 Introduction Our synthesis of singing is based on a comprehensive articulatory speech synthesizer that was developed at the University of Rostock since about 2001 (Birkholz et al. 2004-2007). The synthesizer comprises a geometrical model of the vocal tract, and modules for articulatory control and the aero-acoustic simulation. The input for the synthesizer is a gestural score. For the synthesis of singing, the synthesizer has been extended by... –a rule-based creation of gestural scores from musical scores –an implementation of pitch-dependent supraglottal articulation –the incorporation of pitch effects like vibrato and overshoot

4. 28.08.2007Articulatory Synthesis of Singing3 The articulatory speech synthesizer (1)

5. 28.08.2007Articulatory Synthesis of Singing4 The articulatory speech synthesizer (2)

6. 28.08.2007Articulatory Synthesis of Singing5 From musical scores to gestural scores An inherent duration is assigned to each speech sound Reduced consonant duration in consonant clusters Pitch transitions and supraglottal transitions towars the first phone in a syllable start at the same time „Phase rules“ determine the coordination of glottal and supraglottal gestures

7. 28.08.2007Articulatory Synthesis of Singing6 Pitch-dependent supraglottal articulation (1) Why? Look at the transfer function and the harmonics of the voice source for the vowel /i:/ at 110 Hz and 440 Hz:

8. 28.08.2007Articulatory Synthesis of Singing7 Pitch-dependent supraglottal articulation (2) As soon as F 0 exceeds F 1, the articulation is adapted in such a way that F 1 follows approximately F 0 (Sundberg, 1975)

9. 28.08.2007Articulatory Synthesis of Singing8 Pitch effects The pitch contour is defined in terms of pitch targets according to Xu et al. (2006, 2007) Approximation of these targets is realized using 3rd order dynamical systems Pitch effects: Vibrato, overshoot, preparation (Saitou et al., 2004)

10. 28.08.2007Articulatory Synthesis of Singing9 And now: The Synthesizer Song ! „Dona nobis pacem“: The Synthesizer Song: