1. 1 Interspeech Synthesis of Singing Challenge, Aug 28, 2007 Formant-based Synthesis of Singing Sten Ternström and Johan Sundberg KTH Music Acoustics, Speech Music and Hearing, Stockholm This is the legacy source-filter technique, with some minor updates The sound is generated from scratch - no prior recordings of voices The synthesizer is driven by the same rule system platform as the text-to-speech systems pioneered by Carlson & Granström Rules for music performance and singing have been added gradually over decades

2. 2 Interspeech Synthesis of Singing Challenge, Aug 28, 2007 Layout Synthesis Engine   interactive control  audio output Flat text transcription of the Score Description of the Singer Rules in RULSYS syntax Rule system parameters

3. 3 Interspeech Synthesis of Singing Challenge, Aug 28, 2007 Input data Score Singer definitions Rules

4. 4 Interspeech Synthesis of Singing Challenge, Aug 28, 2007 Parameter file L E TMI SI NG 28 parameters 100 frames/sec

5. 5 Interspeech Synthesis of Singing Challenge, Aug 28, 2007 Synthesizer highlights source waveform: a train of sinc pulses, filtered to measure here: spectrum slope covaries with source amplitude adjustable L0, cutoff, vibrato and flutter 8 formants in cascade, F6-F8 fixed no source-filter interaction fricative branch with two formant filters no nasal branch sample rate 16 kHz runs on DSP hardware, 32-bit floating point

6. 6 Interspeech Synthesis of Singing Challenge, Aug 28, 2007 Synthesizer Sinc pulse generator HP @ 25 Hz DC blocker Variable slope filter Notch filter LP filter -24 dB/oct T0 spectrum slope delta-L0high cutoff Formant chain F1...F8 Fn, Bn fundamental frequency vibrato extent vibrato frequency flutter extent flutter center frequency flutter bandwidth gain glottal amplitude vocal intensity relative level of the fundamental output Noise + HP2 aspiration + Fricative filters K1, K2 frication Zero 1.8 kHz

7. 7 Interspeech Synthesis of Singing Challenge, Aug 28, 2007 LTAS Bass, entire verse Soprano, entire verse

8. 8 Interspeech Synthesis of Singing Challenge, Aug 28, 2007 Performance

9. 9 Interspeech Synthesis of Singing Challenge, Aug 28, 2007 The End