1 Plenary lecture. 2 On the acoustic and perceptual characterization of reference vowels in a cross-language perspective Jacqueline Vaissière Sorbonne.

Slides:



Advertisements
Similar presentations
A. Hatzis, P.D. Green, S. Howard (1) Optical Logo-Therapy (OLT) : Visual displays in practical auditory phonetics teaching. Introduction What.
Advertisements

Normal Aspects of Articulation. Definitions Phonetics Phonology Articulatory phonetics Acoustic phonetics Speech perception Phonemic transcription Phonetic.
Acoustic and Physiological Phonetics
Sounds that “move” Diphthongs, glides and liquids.
Perturbation Theory, part 2 November 4, 2014 Before I forget Course project report #3 is due! I have course project report #4 guidelines to hand out.
SPPA 403 Speech Science1 Unit 3 outline The Vocal Tract (VT) Source-Filter Theory of Speech Production Capturing Speech Dynamics The Vowels The Diphthongs.
Acoustic Characteristics of Consonants
Glides (/w/, /j/) & Liquids (/l/, /r/) Degree of Constriction Greater than vowels – P oral slightly greater than P atmos Less than fricatives – P oral.
Perturbation Theory March 11, 2013 Just So You Know The Fourier Analysis/Vocal Tract exercise is due on Wednesday. Please note: don’t make too much out.
A two dimensional kinematic mapping between speech acoustics and vocal tract configurations : WISP A.Hatzis, P.D.Green1 History of Vowel.
Phonetics.
Hello, Everyone! Review questions  Give examples to show the following features that make human language different from animal communication system:
SPPA 403 Speech Science1 Unit 3 outline The Vocal Tract (VT) Source-Filter Theory of Speech Production Capturing Speech Dynamics The Vowels The Diphthongs.
Speech Science XII Speech Perception (acoustic cues) Version
Vowel Acoustics, part 2 March 12, 2014 The Master Plan Today: How resonance relates to vowels (= formants) On Friday: In-class transcription exercise.
“Speech and the Hearing-Impaired Child: Theory and Practice” Ch. 13 Vowels and Diphthongs –Vowels are formed when sound produced at the glottal source.
Digital Systems: Hardware Organization and Design
Unit 5 English Front Vowels & Central Vowels Front vowels: / i:, I, e, A / Central vowel: / V:, E, Q /
The Human Voice. I. Speech production 1. The vocal organs
ACOUSTICAL THEORY OF SPEECH PRODUCTION
Speech Perception Overview of Questions Can computers perceive speech as well as humans? Does each word that we hear have a unique pattern associated.
Chapter two speech sounds
PHYSICAL PROPERTIES OF SPEECH SOUNDS
Introduction to Linguistics Chapter 2: Phonetics
Phonetics (Part 1) Dr. Ansa Hameed.
Speech sounds Articulation.
Lecture 2: Phonology (1) Shao Junzong.
1 Sounds: the building blocks of language CA461 Speech Processing 1 Lecture 2.
Linguistics I Chapter 4 The Sounds of Language.
The sounds of language Phonetics Chapter 4.
Phonetics HSSP Week 5.
Phonetics and Phonology
Speech Production1 Articulation and Resonance Vocal tract as resonating body and sound source. Acoustic theory of vowel production.
Acoustic Phonetics 3/9/00. Acoustic Theory of Speech Production Modeling the vocal tract –Modeling= the construction of some replica of the actual physical.
Perturbation Theory + Vowels (again) March 17, 2011.
1 Speech Perception 3/30/00. 2 Speech Perception How do we perceive speech? –Multifaceted process –Not fully understood –Models & theories attempt to.
Speech Science Fall 2009 Oct 26, Consonants Resonant Consonants They are produced in a similar way as vowels i.e., filtering the complex wave produced.
Speech Science VII Acoustic Structure of Speech Sounds WS
Vowel Acoustics November 2, 2012 Some Announcements Mid-terms will be back on Monday… Today: more resonance + the acoustics of vowels Also on Monday:
Say “blink” For each segment (phoneme) write a script using terms of the basic articulators that will say “blink.” Consider breathing, voicing, and controlling.
Phonetics: Dimensions of Articulation October 13, 2010.
Speech Science VI Resonances WS Resonances Reading: Borden, Harris & Raphael, p Kentp Pompino-Marschallp Reetzp
Cardinal Vowels September 27, 2013 Future Plans, Re-revised Transcription homeworks are due! Today we’ll talk about Cardinal Vowels, and maybe Place.
What is phonetics? Phonetics is the scientific study of speech sounds. It consists of three main sub-fields:  Articulatory phonetics  = how speech sounds.
From Resonance to Vowels March 13, 2012 Fun Stuff (= tracheotomy) Peter Ladefoged: “To record the pressure of the air associated with stressed as opposed.
Chapter II phonology II. Classification of English speech sounds Vowels and Consonants The basic difference between these two classes is that in the production.
Chapter Five Language Description language study and linguistic study 1Applied Linguistics Chapter 5 by TIAN Bing.
Introduction to Language Phonetics 1. Explore the relationship between sound and spelling Become familiar with International Phonetic Alphabet (IPA )
LIN 3201 Sounds of Human Language Sayers -- Week 1 – August 29 & 31.
5. Vowels he who.
Sonorant Acoustics + Place Transitions
Stop Acoustics and Glides December 2, 2013 Where Do We Go From Here? The Final Exam has been scheduled! Wednesday, December 18 th 8-10 am (!) Kinesiology.
Stop + Approximant Acoustics
Ch4 – Features Features are partly acoustic partly articulatory aspects of sounds but they are used for phonology so sometimes they are created to distinguish.
Perturbation Theory, part 2
Vowels 2 LIN Some reminders about vowels… 1. Vowels are described in three basic parameters:  Tongue height: [i] vs. [a] (high vs. low /close.
Stop Acoustics + Glides December 2, 2015 Down The Stretch They Come Today: Stop and Glide Acoustics Friday: Sonorant Acoustics + USRI evaluations We’ll.
PHONETICS AND PHONOLOGY
Speech 1 Sept 11, 2017 – DAY 6 Brain & Language
The Human Voice. 1. The vocal organs
Vowels and Consonant Serikova Aigerim.
Sounds of Language: fənɛ́tɪks
Essentials of English Phonetics
Structure of Spoken Language
The Human Voice. 1. The vocal organs
Introduction to Linguistics
English Phonetics and Phonology
Spoken language phonetics: Transcription, articulation, consonants
Speech Perception (acoustic cues)
Motor theory.
Presentation transcript:

1 Plenary lecture

2 On the acoustic and perceptual characterization of reference vowels in a cross-language perspective Jacqueline Vaissière Sorbonne Nouvelle Paris, France

3 Plan 1) introduction 2) IPA chart and cardinal vowels 3) Some remarks on the formants 4) Acoustic characteristics of some DJ’s and PL’s cardinal vowels 5) From vowels to glides to consonants and processes 6) Conclusions

4 Introduction

5 What is the purpose ? Revisit some of the cardinal vowels as proposed by Daniel Jones and their rendition by Peter Ladefoged, available on the web Search for some well-defined acoustic and perceptual criteria, if some as a complement of their articulatory description Using available tool such as articulatory synthesis

6 Applications? 1.To characterize the vowels of a given language relatively to a set of well defined references 2.For comparison or for learning 3.To establish what types of precisely defined vocalic timbers are preferred in the languages 4.To describe fine acoustico-perceptual details for socio-phonetic and prosodic research 5.For clinical phonetics, speech pathologists and therapists 6.To make the students conscious about the non linearity between articulatory gestures, their acoustic consequences, and the resulting percept

7 On the choice of an IPA symbol ? API symbols proved to be very useful for transcribing the phonemic systems. But For phonetic transcription, the choice of a symbol may depend on the transcriber, his/her native, the languages he/her masters, the extend of his/her training in phonetic transcription, etc. And also 1.The phonetic rendition of each symbol depends on the language: references needed 2.Package of articulatory maneuvers often used to achieve a particular percept and inter-articulator compensation possible : There is no one specific invariant vocal tract configuration for creating a specific vowel auditorily quality. 3.So articulatory definition of vowels has its own limit As a consequence, the same symbol may be used to represent different phonetic realities and vice versa, the same reality may be described differently by two different persons.

8 Traditional articulatory description: pb? Some unanswered questions about the two first dimensions generally used to described the vowels: – high and low – front and back (open/close) (Rounding being the third) Traditional articulatory descriptions such as height and backness "are not entirely satisfactory“ (Peter Ladefoged)

9 1) introduction 2) IPA chart and cardinal vowels 3) Some remarks on the formants 4) Acoustic characteristics of some DJ’s and PL’s cardinal vowels 5) From vowels to glides to consonants and processes 6) Conclusions

10 IPA chart and the cardinal vowels

11 1) IPA chart For what? to devise a system for transcribing the sounds of speech, independently of any particular language and applicable to all languages. When? in 1888 By whom ? Association Phonétique Internationale, a group of French language teachers founded by Paul Passy. The three articulatory dimensions in IPA: 1)close-open 2)Front-central-back 3)rounding

12 2) from IPA to cardinal vowels Cardinal 1 and 5 were clearly defined in articulatory terms 1)close-open high-low 2)Front-central-back 3)rounding cardinal 1 tongue as high and as front as possible narrow constriction, but no audible noise. cardinal 5 tongue as low and as back as possible i 

13 8 Primary Cardinal vowels: 4 front Articulatory (and auditory) definition cardinal 1 tongue as high and as front as possible narrow constriction, but no audible noise. cardinal 5 tongue as high and as front as possible narrow constriction, but no audible noise. i  cardinal 2, 3, 4 tongue lowered in equal steps supposed to be auditorily equidistant cardinal 5, 6, 7 Raising the tongue in a retracted position 2,3, 4 derived from 1 and 5

14 8 Primary Cardinal vowels: 4 back Articulatory definition cardinal 1, tongue as high and as front as possible narrow constriction, but no audible noise. cardinal 5 tongue as high and as front as possible narrow constriction, but no audible noise. i  cardinal 2, 3, 4 tongue lowered in equal steps supposed to be auditorily equidistant cardinal 6, 7, 8 Raising the tongue in a retracted position

15 So 8 Primary Cardinal vowels derived from CV 1 and CV5 Articulatory definition cardinal 1, tongue as high and as front as possible narrow constriction, but no audible noise. cardinal 5 tongue as high and as front as possible narrow constriction, but no audible noise. i  cardinal 2, 3, 4 tongue lowered in equal steps supposed to be auditorily equidistant cardinal 5, 6, 7 Raising the tongue in a retracted position

16 8 secondary Cardinal vowels derived from the primary by rounding: the front ones Front Primary + rounding = secondary cardinal 1, tongue as high and as front as possible narrow constriction, but no audible noise. cardinal 5 tongue as high and as front as possible narrow constriction, but no audible noise. i  cardinal 2, 3, 4 tongue lowered in equal steps supposed to be auditorily equisdistant cardinal 5, 6, 7 Raising the tongue in a retracted position Spread > round Round > spread

17 Back primary+ reverse rounding = secondary cardinal 1, tongue as high and as front as possible narrow constriction, but no audible noise. cardinal 5 tongue as high and as front as possible narrow constriction, but no audible noise. i  cardinal 2, 3, 4 tongue lowered in equal steps supposed to be auditorily equisdistant cardinal 5, 6, 7 Raising the tongue in a retracted position spread > round Round > spread 8 secondary Cardinal vowels derived from the primary by rounding: the back ones

18 ?

19 1) introduction 2) IPA chart and cardinal vowels 3) Some remarks on F1, F2, F3 and F4 4) Acoustic characteristics of some DJ’s and PL’s cardinal vowels 5) From vowels to glides to consonants and processes 6) Conclusions

20 3) Some remarks on the formant frequencies Formant frequencies as acoustic correlates of the oral vowels : close to perfection … But their articulatory correlates are not clear cut …

21 F1 F1 = a very good acoustic parameter of the vowel quality ! (but manipulation of F1 a little less straigthforward than generally assumed, Since it is different for palatal and velo- pharyngeal vowels)

22 F1 frequency adequately represents the dimension high-low High or low (close-open) But not a good correspondence between tongue height and high/low Phoneticians are in fact describing an acoustic quality (F1) rather than the actual height of the tongue (Peter Ladefoged).

23 F1 is influenced – by the position of the constriction, – by the size of the constriction – and lip configuration not uniquely by tongue height as it was still believed at Jones’s time. Let us demonstrate the articulatory correlates of F1

24 lip glottis : Neutral VT 2: Area function 4: Simple tube 3,7: Acoustics 4,8: Sounds 5,9: formants modelisation

25 Chiba and Kajiyama: Japanese 5 voyelles Locations of constriction to lower each formant Front constriction : F1 lowers Back constriction: F1 raises

26 lip glottis Front constriction Front constriction : F1 lowers from 495 to 310 Hz

27 Example: manipulation of F1 for palatal vowels Less tight constriction Higher F1 Front constriction Plus manipulation Of the tightness Front constriction : F1 lowersLess tight constriction : F1 raises

28 Less tight constriction > Higher F1 Front constriction

29 Less tight constriction > Higher F1

30

31 Front constriction  Low F1 Less tight constriction > Higher F1 Back constriction  High F1  Fronting of the constriction Plus rounding  lower F1 Front constrictionBack constriction But different gestures to manipulate F1 for back vowels

32 So The size of the constriction (well related to the height of the tongue) in the case if the palatal vowels But fronting of the constriction and rounding in the case of back vowels (as much less known) Important to understand the effect of the context

33 Front constriction  Low F1 Less tight constriction > Higher F1 Back constriction  High F1  Fronting of the constriction Plus rounding  lower F1

34 F2 A good formant not sufficient with F1 to represent the auditorily quality of the non back vowels F1/F2 representation not adequate for our purpose traditionnally associated with the front-back position of the tongue Not as simple

35 Traditional front and back = front (palatal) mid (velar), pharyngeal (back) palatal velar pharyngeal

36 [u] Labio-velar velar Lip rounding allows to lower F2 for velar /u/ F1^F2^F3 (F1F2)^F3

37 [u] Labio-velar velar Lip rounding allows to lower F2 for /u/ F1^F2^F3 (F1F2)^F3 Rounding induces lowering of F2 and F1 To make the students conscious about the non linearity between articulatory gestures, their acoustic consequences, and the resulting percept

38 Lip rounding allows to lower F2 for /u/ round

39 Lip rounding allows to lower F2 for /u/ Not round

40 Lip rounding allows to lower F2 for /u/ round

41 Lip rounding allows to lower F2 for /u/ Non round

42 Lip rounding allows to lower F2 for /u/ round

43 Lip rounding allows to lower F2 for /u/ Non round

F2 is important, yes but there is at least one case where it has no auditory weight Let us see and hear the case … 44

45 originalF2 suppressed Suppression of F2 and even F1 … Bruce Hayes /i/ (F3F4) F1 (F3F4) F1 F2 (F3F4) F2 here not perceptual weight Cardinal /i/ Nb: F4 is strong before It is regrouped with F3

46 F3 Speaker F2’ (effective formant)

47 But F3 alone carries the distinction between /i/ and /y/ (distinctive acoustic feature) ( F2.F3) Cardinal /i/ and cardinal /y/ have a similar (very low) F1 And close F2 (for some speakers, similar). F3 plays the main (distinctive) role between /i/ and /y/

48 articulatory manipulation of F3? Front vowels: lip configuration Next illustration : program Tractsyn, Peter Birkholz, from Germany, available on the web. Tongue fixed and in a fronted position. Remarks 1) the reinforcement of the formant amplitude when the two formants are closed together. 2) Two formants closed: two cavities are resonating at the same frequency.

49

50 F4 Often considered as being due to the laryngeal cavity (sometimes F5)

51 Laryngeal cavity (Fant, Honda, etc.) Suppression of the laryngeal cavity

52 Laryngeal cavity (Fant, Honda, etc.) Suppression of the laryngeal cavity Suppression of the laryngeal cavity: sounds more dull

53 (FnFn+1) Regrouping of two consecutive formants  Reinforcement of their amplitude  >more perceptual weight + perceptual integration  >masking of surrounding formants

54 Grouping of formants? How to do? Only when there is a strong constriction along the VT to separate two cavities or when two cavities are of very different cross sections, they are acoustically decoupled and then when the whole VT and the lips are configured so that one resonance of one cavity is tuned to the resonance of the second cavity. Then the vowel is said « focal »

55 Converging formants create a spectral prominence zones of stability for the formants concerned (Stevens) increase of the two formants amplitude perceptual integration perceived as a single peak very sensitive to lip rounding two cavities that resonance at the same frequencies Very special points

56 Intermediate summary F1 = « height » – place of articulation, degree of constriction and lip configuration F2 – place of articulation, the degree of constriction – for the velar and laryngeal vowels, lip configuration F3 for the velar and palatal vowels, lip configuration F4 – increases the acuteness of the /i/ timber – (F3F4) for the cardinal vowel /i/. focal vowels very special (perceptually)

57 1) introduction 2) IPA chart and cardinal vowels 3) Some remarks on the formants 4) Acoustic characteristics of some DJ’s and PL’s cardinal vowels 5) From vowels to glides to consonants and processes 6) Conclusions

58 Acoustic characteristics of some DJ’s and PL’s cardinal vowels 1)The cardinal vowel 1 and the cardinal vowel 9 are (F3F4) and (F2F3) focal vowels

59 Jones’s and Ladefoged’s rendition and the French vowels Lienard’s book

60 Peter Ladefoged’s cardinal vowel /i/ (F3F4)

61 Peter Ladefoged’s cardinal vowel /i/ (F3F4)

62 Focal vowels from nomograms 62 lip glottis 2 As vague region (quantal theory)

63 Labial dental alveolar prepalatal palatal velar uvular pharyngeal F4 F3 F2 F FRONT MID BACK Round Spread Round Spread Prepalatal (sharp, F3max) and Palatal (dull, F2max) /i/s Prepalatal Palatal As well defined region

64 Labial dental alveolar prepalatal palatal velar uvular pharyngeal F4 F3 F2 F FRONT MID BACK Round Spread Round Spread BH PL

65 originalF2 suppressed The (  F3F4) vowel /i/

66 Comparison 8 languages 66 Gendrot, Cédric et Adda-Decker, Martine Cardinal /i/ (  F3F4) French /i/: the shorter distance between F3 and F4 To create a strong concentration of energy in the high frequencies /i/ At least 1000 occurences

67 Is (  F3F4) vowel more stable? Yes and no No: F3 depends in the length of the front cavity, so it is sensitive to tongue backing and lip rounding, Yes: F1 and F2 are stable (quantal theory) But acoustically sharper, auditory sharpness seems more important that articulatory stability

68 1) F3 sensibility to tongue backing /i/ /e/i/r-r F3, due to the front cavity, is very sensitive to the length of the front cavity, so to the front-back position Extracted /i/ portion in “rire” (laugh) is heard as /e/

69 Is (  F3F4) vowel more stable? Yes and no F3 depends in the length of the front cavity, so it is sensitive to tongue backing and lip rounding. The language exploits the extreme sensitivy to front cavity length… for the creation of cardinal /y/

70 Labial dental alveolar prepalatal palatal velar uvular pharyngeal F4 F3 F2 F FRONT MID BACK Round Spread Round Spread

71 front central back Prepalatal /i/ Very very sensitive To lip configuration From cardinal /i/ to cardinal /y/

72 /y/ PL

73 Some language explore the sensibility of F3 to lip configuration ( F2. F3) Cardinal /i/ and cardinal /y/ have a similar (very low) F1 And close F2 (for some speakers, similar). F3 plays the main (distinctive) role between /i/ and /y/

74 articulatoryacousticperceptual swedish english Willerman and KuhlDelattreWev UCLA Reference vowel Cardinal /i/ (  F3F4) /i/ Links done between

75 Acoustic characteristics of some the cardinal vowels 1)The cardinal vowel 1 and the cardinal vowel 9 1)The cardinal vowel 5

76 Labial dental alveolar prepalatal palatal velar uvular pharyngeal F4 F3 F2 F FRONT MID BACK Round Spread Round Spread (F1F2) as high as possible

77 [  ] from area file model Two close-open tubes same effective length

78 Acoustic characteristics of some the cardinal vowels 1)The cardinal vowel 1 and the cardinal vowel 9 1)The cardinal vowel 5 2)The cardinal vowel 8

79 Labial dental alveolar prepalatal palatal velar uvular pharyngeal F4 F3 F2 F FRONT MID BACK Round Spread Round Spread (F1F2) as low as possible

80 Jones’s and Ladefoged’s rendition and the French vowels

81 Acoustic characteristics of some the cardinal vowels 1)The cardinal vowel 1 and the cardinal vowel 9 2)The cardinal vowel 5 3)The cardinal vowel 8 4)The cardinal vowels 6 and 7

82 Labial dental alveolar prepalatal palatal velar uvular pharyngeal F4 F3 F2 F FRONT MID BACK Round Spread Round Spread (F1F2) auditorily equidistant between (F1F2) as high as possible and as low as possible

83 Jones’s and Ladefoged’s rendition and the French vowels: the 4 back primary vowels More discrepancy For the non focal vowels

84 Acoustic characteristics of some the cardinal vowels 1)The cardinal vowel 1 and the cardinal vowel 9 2)The cardinal vowel 5 3)The cardinal vowel 8 4)The cardinal vowels 6 and 7 5)The lowest F2F3 concentration vowel

85 Another remarquable focal vowel lowest  (F2F3), but not cardinal 2TMY3.WAV Shorter palatal constriction entails higher F3 Lengthening of the front cavity By Lip spreading And/or fronting of the tongue PL

Then it is possible to interpolate other timbers by using articulatory synthesis Neutral vowel with one, two or three constrictions 86

87 Lip height and protrusion neutral + compression + both + protrusion

88 5) From vowels to glides to consonants and processes

89 1) From vowels to glides to consonants using the same notation Place of constriction Spread lipsRounded lips Back  (  F1  F2) 1000Hz C5[ ɑ ] Mid (  F1  F2) 400Hz C8[u] Front Prepalatal (  F3  F4)F3 3200Hz C1[i] (  F2  F3) 1900Hz C9[y] Focal vowels correspond to one or more strong constrictions so they have corresponding glides Same natural acoustic classes

90 vow e l Correspond ing glide Type of clustering Main effect on the surrounding phonemes ijHigh (F3F4)Raises F y ɥ High (F2F3)Lowers F ɚɹ Low (F2F3)Lowers F3 ɑʁ High (F1F2)Raises F1, lowers F uwLow (F1F2)Lowers F1 ad F

91 2) From vowels to coarticulatory processes using the same notation

92 coarticulation 92 /j/, and /g/ and /l/ in /i/ context share (F3F4) features

93 1) introduction 2) IPA chart and cardinal vowels 3) Some remarks on the formants 4) Acoustic characteristics of some DJ’s and PL’s cardinal vowels 5) From vowels to glides to consonants and processes 6) Conclusions

94 1) introduction 2) IPA chart and cardinal vowels 3) Some remarks on the formants 4) Acoustic characteristics of some DJ’s and PL’s cardinal vowels 5) From vowels to glides to consonants and processes 6) Conclusions

95 Three conclusions

96 1)Take advantages of the progress Acoustic theory of speech production Modelisation production> acoustics>percept Fant, Stevens and House 3 parameters: place of the constriction, degree of constriction, lip configuration Articulatory models based on statistics (X-ray): with 4 more parameters (larynx height, nasal opening, …) to hear the sounds Theories Stevens’s quantal theory Lindblom’s dispersion theory Grenoble focalisation-dispersion theory Chistovich’s spectral integration A) theoretical progress

97 Articulatory exploration Exploratory techniques(X-ray, MRI, ultrasounds, etc.) Acoustic analysis (real time) visualisation on spectrograms signal analysis, formant synthesis Data bases and statistical analysis Praat and scripts on Praat Modelling on computer – Spectral changes – Formant synthesis – Articulatory synthesis 1)Take advantage of the progress B) Technical progress

98 1)Take advantage of the progress B) Technical progress To revisit the relationship between articulatory gestures, their acoustic consequences, and the resulting percept To develop a way to represent some reference vowels A) theoretical progress

99 2) How to teach the cardinal vowels concerned here? Easy because they correspond to a well defined acoustic characteristics That can be displayed using real time spectrograms Self training, very precise goal Language-independant teaching

100 acoustic signal percepts vocal tract configuration 3) Articulatory modeling Feel more secure for teaching

101 /i/ (  F3F4) (  F2F3) (  F1F2) (  F2F1)

102 Lienard’s book

103 image Merci !