NONLINEAR SOURCE-FILTER COUPLING IN SPEECH AND SINGING

Slides:



Advertisements
Similar presentations
Advances in Speech Synthesis
Advertisements

Vowel Formants in a Spectogram Nural Akbayir, Kim Brodziak, Sabuha Erdogan.
From Resonance to Vowels March 8, 2013 Friday Frivolity Some project reports to hand back… Mystery spectrogram reading exercise: solved! We need to plan.
Flapping Jaws and Acoustic Laws:
Vowels and Tubes (again) March 22, 2011 Today’s Plan Perception experiment! Discuss vowel theory #2: tubes! Then: some thoughts on music. First: let’s.
MUSIC 150 MUSICAL ACOUSTICS BRASS INSTRUMENTS REFERENCE: CHAPTER 11 IN SCIENCE OF SOUND CHAPTER 14 IN THE PHYSICS OF MUSICAL INSTRUMENTS.
SPPA 403 Speech Science1 Unit 3 outline The Vocal Tract (VT) Source-Filter Theory of Speech Production Capturing Speech Dynamics The Vowels The Diphthongs.
PH 105 Dr. Cecilia Vogel Lecture 17. OUTLINE  Resonances of string instruments  Brass Instruments  Lip reed  Closed tube  Effect of bell  Registers.
6 SOLO SINGING, CHOIR SINGING, HARMONIC SINGING, POP SINGING Science of Sound, Chapter 17 Resonance in Singing, Miller Acoustics for Choir and Orchestra,
ACOUSTICS OF SPEECH AND SINGING MUSICAL ACOUSTICS Science of Sound, Chapters 15, 17 P. Denes & E. Pinson, The Speech Chain (1963, 1993) J. Sundberg, The.
8 VOCE VISTA, ELECTROGLOTTOGRAMS, CLOSED QUOTIENTS
Basic Spectrogram Lab 8. Spectrograms §Spectrograph: Produces visible patterns of acoustic energy called spectrograms §Spectrographic Analysis: l Acoustic.
ACOUSTICS OF SINGING MUSICAL ACOUSTICS Science of Sound, Chapter 17 The Science of the Singing Voice, J. Sundberg, NIU Press, 1987 Resonance in Singing,
The Human Voice. I. Speech production 1. The vocal organs
ACOUSTICAL THEORY OF SPEECH PRODUCTION
The Human Voice Chapters 15 and 17. Main Vocal Organs Lungs Reservoir and energy source Larynx Vocal folds Cavities: pharynx, nasal, oral Air exits through.
Investigating The Voice. The voice follows the rules of physics… The pitch of a vocal sound is affected by the air pressure in the lungs, length and tension.
PH 105 Dr. Cecilia Vogel Lecture 14. OUTLINE  consonants  vowels  vocal folds as sound source  formants  speech spectrograms  singing.
Eva Björkner Helsinki University of Technology Laboratory of Acoustics and Audio Signal Processing HUT, Helsinki, Finland KTH – Royal Institute of Technology.
1 THE HUMAN VOICE LECTURE 2 ELC 523E. 2 WHAT IS HUMAN VOICE sound made by a human being using the vocal folds for talking, singing, laughing, crying,
Complete Discrete Time Model Complete model covers periodic, noise and impulsive inputs. For periodic input 1) R(z): Radiation impedance. It has been shown.
PHYS 103 lecture 29 voice acoustics. Vocal anatomy Air flow through vocal folds produces “buzzing” (like lips) Frequency is determined by thickness (mass)
L 17 The Human Voice. The Vocal Tract epiglottis.
Vowel Acoustics, part 2 November 14, 2012 The Master Plan Acoustics Homeworks are due! Today: Source/Filter Theory On Friday: Transcription of Quantity/More.
Unit 4 Articulation I.The Stops II.The Fricatives III.The Affricates IV.The Nasals.
2. ARTICULATION AND FORMANTS
Topic 3b: Phonation.
ACOUSTICS OF SINGING MUSICAL ACOUSTICS Science of Sound, Chapters 15, 17.
Physics of Sound Wave equation: Part. diff. equation relating pressure and velocity as a function of time and space Nonlinear contributions are not considered.
Acoustics of Instruments Music Theory Class Gettysburg College.
Anatomic Aspects Larynx: Sytem of muscles, cartileges and ligaments.
Abdominal Muscles: down and out Diaphragm: down External Intercostals: ribs up and out Inspiration.
Influence of Acoustic Loading on the Flow-Induced Oscillations of Single Mass Models of the Human Larynx Matías Zañartu Salas School of Electrical and.
WOODWIND INSTRUMENTS MUSICAL ACOUSTICS
Exploring Sound Waves and the Voice
Physics 1251 The Science and Technology of Musical Sound Unit 3 Session 31 MWF The Fundamentals of the Human Voice Unit 3 Session 31 MWF The Fundamentals.
Source/Filter Theory and Vowels February 4, 2010.
Hoarse meeting in Liverpool April 22, 2005 Subglottal pressure and NAQ variation in Classically Trained Baritone Singers Eva Björkner*†, Johan Sundberg†,
Speech Production1 Articulation and Resonance Vocal tract as resonating body and sound source. Acoustic theory of vowel production.
Resonance, Revisited March 4, 2013 Leading Off… Project report #3 is due! Course Project #4 guidelines to hand out. Today: Resonance Before we get into.
Acoustic Phonetics 3/9/00. Acoustic Theory of Speech Production Modeling the vocal tract –Modeling= the construction of some replica of the actual physical.
MUSIC 318 MINI-COURSE ON SPEECH AND SINGING
Musical Instruments Chapter 9 part C. Observations about Musical Instruments They can produce different notes They can produce different notes They.
Speech Science V Akustische Grundlagen WS 2007/8.
Physics 1251 The Science and Technology of Musical Sound Unit 3 Session 30 MWF The Timbre of Wind Instruments Unit 3 Session 30 MWF The Timbre of Wind.
The end of vowels + The beginning of fricatives November 19, 2012.
Structure of Spoken Language
Speech Science VI Resonances WS Resonances Reading: Borden, Harris & Raphael, p Kentp Pompino-Marschallp Reetzp
Vowel Acoustics March 10, 2014 Some Announcements Today and Wednesday: more resonance + the acoustics of vowels On Friday: identifying vowels from spectrograms.
Physics 1251 The Science and Technology of Musical Sound
1 click Hi and WelcomeSlide 1 Please complete each slide as you go. I have marked the number of clicks each slide needs for the complete picture on the.
Fricatives November 20, 2015 The Road Ahead Formant plotting + vowel production exercises are due at 5 pm today! Monday and Wednesday of next week: fricatives,
1. SPEECH PRODUCTION MUSIC 318 MINI-COURSE ON SPEECH AND SINGING
Vowels, part 4 November 16, 2015 Just So You Know Today: Vowel remnants + Source-Filter Theory For Wednesday: vowel transcription! Turkish and British.
A Brief Introduction to Musical Acoustics
P105 Lecture #27 visuals 20 March 2013.
L 17 The Human Voice.
MUSICAL ACOUSTICS ACOUSTICS OF SINGING
B. Harpsichord Strings are plucked
The Human Voice. 1. The vocal organs
P105 Lecture #26 visuals 18 March 2013.
Voice Basics for Singers
MUSIC 150 MUSICAL ACOUSTICS
The Human Voice. 1. The vocal organs
Jaw Position for Singing:
Investigating The Voice
1. SPEECH PRODUCTION MUSIC 318 MINI-COURSE ON SPEECH AND SINGING
Remember me? The number of times this happens in 1 second determines the frequency of the sound wave.
The Production of Speech
Evolution of human vocal production
Presentation transcript:

NONLINEAR SOURCE-FILTER COUPLING IN SPEECH AND SINGING MUSIC 318 MINI-COURSE ON SPEECH AND SINGING NONLINEAR SOURCE-FILTER COUPLING IN SPEECH AND SINGING “Modeling source-filter interaction in belting and high-pitched operatic male singing” (I. Titze and A. Worley, JASA 126, 1530 (2009)) “Source-Filter Interaction in Speaking and Singing is Nonlinear” (I.Titze, ECHOES Summer 2007)_ “The Human Instrument” (I.Titze, Scientific American Jan. 2008)

NONLINEAR vs LINEAR MODELS OF PHONATION THE LINEAR MODEL OF SPEECH AND SINGING ASSUMES THAT THE SOURCE (GLOTTIS), FILTER (VOCAL TRACT) AND RADIATOR (MOUTH, NOSE) ACT INDEPENDENTLY. THE LINEAR MODEL SUCCESSFULLY EXPLAINS MANY ASPECTS OF SPEECH AND SINGING. AS LONG AS THE DOMINANT SOURCE FREQUENCIES ARE WELL BELOW THE FORMANT FREQUENCIES OF THE VOCAL TRACT (GENERALLY TRUE IN MALE SPEECH), THE SOURCE IS INFLUENCED ONLY SLIGHTLY BY THE FILTER. IN FEMALE AND CHILD SPEECH, HOWEVER, THE INTERACTION IS GREATER. RECENT RESEARCH SUGGESTS THAT HUMANS CAN OPERATE THEIR SOURCE-FILTER SYSTEMS WITH EITHER LINEAR OR NONLINEAR COUPLING. FOR LINEAR COUPLING THE SOURCE IMPEDANCE (TRANSGLOTTAL PRESSURE DIVIDED BY GLOTTAL FLOW) IS KEPT MUCH HIGHER THAN THE INPUT IMPEDANCE TO THE VOCAL TRACT. THIS IS ACCOMPLISHED BY ADDUCTING THE VOCAL FOLDS FIRMLY AND WIDENING THE EPILARYNX TUBE SO THAT GLOTTAL FLOW IS DETERMINED BY AERODYNAMICS, AND ACOUSTIC PRESSURES ABOVE AND BELOW THE GLOTIS HAVE LITTLE INFLUENCE.

NONLINEAR SOURCE-FILTER COUPLING IN PHONATION IN NONLINEAR COUPLING THE ACOUSTIC AIRWAY PRESSURES CONTRIBUTE TO THE PRODUCTION OF FREQUENCIES AT THE SOURCE. TRANSGLOTTAL PRESSURE INCLUDES A STRONG ACOUSTIC COMPONENT, MUCH AS IN WIND INSTRUMENTS. FOR NONLINEAR COUPLING, THE GLOTTAL IMPEDANCE IS ADJUSTED TO BE COMPARABLE TO THE VOCAL TRACT INPUT IMPEDNACE, MAKING THE GLOTTAL FLOW HIGHLY DEPENDENT ON ACOUSTIC PRESSURES IN THE VOCAL TRACT. THIS IS ACCOMPLISHED BY SETTING ADDUCTION LEVELS OF THE VOCAL FOLDS THAT MATCH A NARROWER EPILARYNX TUBE. EVIDENCE OF NONLINEAR COUPLING IS THE PRODUCTION OF NEW FREQUENCIES IN THE FORM OF DISTORTION PRODUCTS, LOWERING OF THE OSCILLATION THRESHOLD PRESSURE, PRODUCTION OF SUBHARMONICS, AND SUDDEN JUMPS AS EITHER VOWEL OR F0 ARE CHANGED.

POSITIVE FEEDBACK TO VOCAL FOLDS POSITIVE FEEDBACK FROM THE VOCAL TRACT TO THE VOCAL FOLDS CAN INCREASE SOUND PRODUCTION. (THIS IS SIMILAR TO THE POSITIVE FEEDBACK FROM A BRASS INSTRUMENT TO THE PLAYER’S LIPS). THE IDEAL TIMING OF THE “KICK” COMES WHEN THE MOVEMENT OF THE AIR IS DELAYED WITH RESPECT TO THE MOVEMENT OF THE VOCAL FOLDS. THE AIR COLUMN THEN HAS NEGATIVE INERTANCE. INERTIVE REACTANCE HELPS TO SUSTAIN THE FLOW-INDUCED OSCILLATION OF THE VOCAL FOLDS. (See Titze, 2008). THE SINGER’S TASK IS TO ADJUST THE SHAPE OF THE VOCAL TRACT (BY CAREFULLY SELECTING FAVORABLE “SINGING” VOWELS) SO THAT INERTIVE REACTANCE IS EXPERIENCED OVER MOST OF THE PITCH RANGE—NO EASY TASK.

SOURCE-FILTER INTERACTION IN BELTING AND OPERATIC SINGING BELTERS USE VOCAL TRACT RESONANCES (FORMANTS) DIFFERENTLY FROM CLASSICALLY-TRAINED (OPERA AND ART SONG) SINGERS. THE SECOND HARMONIC, FOR EXAMPLE, RECEIVES STRONG REINFORCEMENT FROM THE FIRST FORMANT IN BELTING. (COMPARE THIS TO PAVAROTTI WHO USES THE SECOND FORMANT TO REINFORCE THE THIRD HARMONIC IN OPERA SINGING). TITZE AND WORLEY (2009) OBSERVE THAT THIS FORMANT TUNING CAN BE AIDED BY UTILIZING SUPRAGLOTTAL INERTIVE REACTANCE TO REINFORCE VOCAL FOLD VIBRATION BY CHOOSING PITCH-VOWEL COMBINATIONS THAT KEEP SEVERAL HARMONICS IN FAVORABLE REACTANCE SIMULTANEOUSLY.

D5 SUNG BY BARBRA STREISAND ON THE WORD “STRONG” SHOWING A STRONG 2ND HARMONIC (Fig. 11.1 in Miller)

SOURCE-FILTER INTERACTION DIAGRAM OF VOCAL FOLDS AND LOWER VOCAL TRACT

SOURCE-FILTER INTERACTION IN BELTING AND OPERATIC SINGING BELTERS USE VOWELS THAT ARE MODIFIED TOWARD A “MEGAPHONE” MOUTH SHAPE. BOTH THE FUNDAMENTAL AND THE SECOND HARMONIC ARE THEN KEPT BELOW THE FIRST FORMANT. OPERA SINGERS, ON THE OTHER HAND, USE VOWELS MODIFIED TOWARD AN INVERTED MEGAPHONE MOUTH SHAPE FOR TRANSITIONING INTO THE HIGH-PITCH RANGE. THIS ALLOWS ALL THE HARMONICS EXCEPT THE FUNDAMENTAL TO BE “LIFTED” OVER THE FIRST FORMANT.

MOUTH AREA OF SINGERS MOUTH AREA AND SOUND SPECTRUM FOR PAVOROTTI SINGING /α/ VOWEL AT A4 MOUTH AREA AND SOUND SPECTRUM FOR CAB CALLOWAY SINGING /α/ VOWEL AT A4 (Titze and Worley 2009)

ACOUSTIC IMPEDANCE ACOUSTIC IMPEDANCE IS SOUND PRESSURE DIVIDED BY FLOW VELOCITY ACOUSTIC ADMITTANCE (1/IMPEDANCE) IS FLOW VELOCITY DIVIDED BY SOUND PRESSURE. CONDUCTANCE IS THE IN-PHASE (REACTIVE) PART OF ADMITTANCE; INERTANCE IS THE OUT-OF-PHASE PART

VOCAL TRACT INPUT IMPEDANCE VOCAL TRACT CARICATURES (left) AND CORRESPONDING INPUT IMPEDANCES (right) AS A FUNCTION OF FREQUENCY (THICK LINES ARE REACTANCES AND THIN LINES ARE RESISTANCES) (Titze and Worley, 2009)

COMPUTER SIMULATION OF GLOTTAL AIRFLOW COMPUTER SIMULATION OF GLOTTAL AIRFLOW WITH A SELF-SUSTAINED OSCILLATION VOCAL-FOLD MODEL THAT INTERACTS WITH: A UNIFORM TUBE OF DIFFERENT AREAS (left) AND A NEUTRAL TUBE WITH DIFFERENT EPILARYNX AREAS (right) (Titze and Worley, 2009)

INERTANCE (INERTANCE IS THE REACTIVE PART OF ADMITTANCE; IT INDICATES ENERGY STORAGE DURING OSCILLATION) INERTOGRAMS (INERTANCE vs FREQUENCY FOR SIX TUBE SHAPES (Titze and Worley, 2009)

INERTOGRAMS OF SINGERS VOCAL TRACT SHAPES DERIVED FROM MRI DATA OF A BARITONE SINGER (left) AND CORRESPONDING INERTOGRAMS (Titze and Worley, 2009)

MOUTH-TO-HEAD AREA RATIOS Table I. Mouth-to-head area ratios. Note Ratio Vowel Male operatic (Luciano Pavarotti) D#4 0.0137 /e/ E4 0.0205 // F#4 0.0288 G4 0.0290 A4 0.0291 Male belt (Cab Calloway) D 0.0170 /u/ 0.0364 /o/ F 0.0614 /a/-/o/ (diphthong) 0.0662 /a/ 0.0840