Statistical Learning in Infants (and bigger folks)

Slides:



Advertisements
Similar presentations
Psych 156A/ Ling 150: Acquisition of Language II Lecture 5 Sounds of Words.
Advertisements

Infant sensitivity to distributional information can affect phonetic discrimination Jessica Maye, Janet F. Werker, LouAnn Gerken A brief article from Cognition.
Foundations of psycholinguistics Week 3 The beginnings of language acquisition Vasiliki (Celia) Antoniou.
Is Recursion Uniquely Human? Hauser, Chomsky and Fitch (2002) Fitch and Hauser (2004)
Ling 240: Language and Mind Acquisition of Phonology.
Speech perception 2 Perceptual organization of speech.
Psych 156A/ Ling 150: Acquisition of Language II Lecture 6 Words in Fluent Speech I.
Development of Speech Perception. Issues in the development of speech perception Are the mechanisms peculiar to speech perception evident in young infants?
Psych 156A/ Ling 150: Acquisition of Language II Lecture 4 Sounds.
Statistical Frequency in Word Segmentation. Words don’t come with nice clean boundaries between them Where are the word boundaries?
Segmenting Nonsense Sanders, Newport & Neville (2002) Ricardo TaboneLIN 7912.
Statistics and Rules in Language Acquisition: Constraints and the Brain Richard N. Aslin Department of Brain and Cognitive Sciences University of Rochester.
Psych 156A/ Ling 150: Psychology of Language Learning Lecture 8 Words in Fluent Speech.
Phonetic Detail in Developing Lexicon Daniel Swingley 2010/11/051Presented by T.Y. Chen in 599.
PaPI 2005 (Barcelona, June) The perception of stress patterns by Spanish and Catalan infants Ferran Pons (University of British Columbia) Laura Bosch.
Psych 156A/ Ling 150: Acquisition of Language II Lecture 6 Words in Fluent Speech II.
Psych 156A/ Ling 150: Psychology of Language Learning Lecture 11 Poverty of the Stimulus II.
Psych 56L/ Ling 51: Acquisition of Language Lecture 8 Phonological Development III.
Psych 156A/ Ling 150: Acquisition of Language II Lecture 12 Poverty of the Stimulus II.
Psych 156A/ Ling 150: Psychology of Language Learning Lecture 4 Words in Fluent Speech.
Distributional Cues to Word Boundaries: Context Is Important Sharon Goldwater Stanford University Tom Griffiths UC Berkeley Mark Johnson Microsoft Research/
Language Acquisition Species-specific, species-universal accomplishment Central issue for cognitive science Important distinction between language comprehension.
Adrienne Moore section COGS1
Experimental evidence for product- oriented generalizations (or not) Vsevolod Kapatsinski Indiana University Dept. of Linguistics Cognitive Science Program.
Psych 156A/ Ling 150: Psychology of Language Learning Lecture 14 Learning Language Structure.
1 Human simulations of vocabulary learning Présentation Interface Syntaxe-Psycholinguistique Y-Lan BOUREAU Gillette, Gleitman, Gleitman, Lederer.
Psych 156A/ Ling 150: Acquisition of Language II Lecture 13 Learning Biases.
Psych 156A/ Ling 150: Acquisition of Language II Lecture 5 Words in Fluent Speech I.
A Lecture about… Phonetic Acquisition Veronica Weiner May, 2006.
Psych 56L/ Ling 51: Acquisition of Language Lecture 2 Introduction Continued.
Psych 56L/ Ling 51: Acquisition of Language Lecture 8 Phonological Development III.
Psych 156A/ Ling 150: Psychology of Language Learning
Sebastián-Gallés, N. & Bosch, L. (2009) Developmental shift in the discrimination of vowel contrasts in bilingual infants: is the distributional account.
Chapter 9: Language and Communication. Chapter 9: Language and Communication Chapter 9 has four modules: Module 9.1 The Road to Speech Module 9.2 Learning.
Psych 56L/ Ling 51: Acquisition of Language Lecture 2 Introduction Continued.
Speech Perception 4/6/00 Acoustic-Perceptual Invariance in Speech Perceptual Constancy or Perceptual Invariance: –Perpetual constancy is necessary, however,
Chapter 4 Opener. Figure 4.1 A testing booth set up for the head-turn preference paradigm.
Infant Speech Perception & Language Processing. Languages of the World Similar and Different on many features Similarities –Arbitrary mapping of sound.
Statistical learning, cross- constraints, and the acquisition of speech categories: a computational approach. Joseph Toscano & Bob McMurray Psychology.
Vygotsky's theory of cognitive development (sociocultural)
Psych156A/Ling150: Psychology of Language Learning Lecture 19 Learning Structure with Parameters.
A chicken-and-egg problem
Building a Lexicon Statistical learning & recognizing words.
Iowa State University Developmental Robotics Laboratory Unsupervised Segmentation of Audio Speech using the Voting Experts Algorithm Matthew Miller, Alexander.
Adaptive Design of Speech Sound Systems Randy Diehl In collaboration with Bjőrn Lindblom, Carl Creeger, Lori Holt, and Andrew Lotto.
Adele E. Goldberg. How argument structure constructions are learned.
Statistical Learning in Infants (and bigger folks)
Growing up Bilingual: One System or Two? Language differentiation and speech perception in infancy.
Epenthetic vowels in Japanese: a perceptual illusion? Emmanual Dupoux, et al (1999) By Carl O’Toole.
LOT 1: jan06 1 Language Acquisition 1. Elena Lieven, MPI-EVA, Leipzig School of Psychological Sciences, University of Manchester.
Psych 156A/ Ling 150: Psychology of Language Learning Lecture 6 Sounds of Words I.
1 LING 696B: Computational Models of Phonological Learning Ying Lin Department of Linguistics University of Arizona.
Acoustic Continua and Phonetic Categories Frequency - Tones.
Statistical Learning in Infants (and bigger folks)
Psych 156A/ Ling 150: Acquisition of Language II
Language Acquisition Computational Intelligence 4/7/05 LouAnn Gerken.
Presented by: Odelya Ohana. Gathercole & Baddeley, 1989 NWR phonological short-term memory. Gathercole, 2006 Phonological storage is the key capacity.
What infants bring to language acquisition Limitations of Motherese & First steps in Word Learning.
Bosch & Sebastián-Gallés Simultaneous Bilingualism and the Perception of a Language-Specific Vowel Contrast in the First Year of Life.
Psych156A/Ling150: Psychology of Language Learning Lecture 15 Poverty of the Stimulus II.
A Bayesian approach to word segmentation: Theoretical and experimental results Sharon Goldwater Department of Linguistics Stanford University.
Speech Perception in Infants Peter D. Eimas, Einar R. Siqueland, Peter Jusczyk, and James Vigorito 1971.
Of Words, Birds, Worms, and Weeds: Infant Word Learning and Lexical Neighborhoods.
Psych 156A/ Ling 150: Psychology of Language Learning Lecture 9 Words in Fluent Speech II.
Presenter: Grace M. Wholley Advisor: Jessica F. Hay Department of Psychology, The University of Tennessee, Knoxville
The significance of learners’ errors S. P. Corder 2007 년 2 학기 담당교수 : 홍우 평 이중언어커뮤니케 이션.
Poverty of stimulus in the context of language Second Semester.
PSYC 206 Lifespan Development Bilge Yagmurlu.
Psych 156A/ Ling 150: Psychology of Language Learning
Psych156A/Ling150: Psychology of Language Learning
Presentation transcript:

Statistical Learning in Infants (and bigger folks)

Statistical Learning Neural network models emphasize the value of statistical information in language –What information can be extracted from this? –Is this sufficient to account for human performance? –Are humans able to perform this kind of analysis? –If so, does it contribute to an understanding of the uniquely human ability to learn language?

Saffran, Aslin, & Newport (1996) 8-month old infants –Passive exposure to continuous speech (2 mins) bidakupadotigolabubidaku… –Test (Experiment #2) bidakubidakubidakubidakubidaku… kupadokupadokupadokupadokupado… –Infants listen longer to unfamiliar sequences –Transitional Probabilities bi da ku pa do ti Jenny Saffran Dick Aslin Elissa Newport

From Bob McMurray, U. of Iowa Head-turn Preference Procedure

What is it good for? Word Learning –Transitional probabilities: local minima = word boundaries –Saffran’s example: ‘pretty baby’ /prItibebi/ p (ti|prI) = 0.8 p (be|ti) = 0.03 How else could children segment words? –Words in isolation (Peters, 1983; Pinker, 1984) –Stress-based segmentation: 90% of English words are stress-initial (Cutler & Carter, 1987) –Phonotactic segmentation, e.g., *dnight (Gambell & Yang, 2005)

Are Local Minima Effective? Gambell & Yang (2005) - –Adult input to children from 3 corpora in CHILDES –226,178 words, 263,660 syllables –Precision: hits/(hits + false alarms)41.6% Recall: hits/(hits + misses)23.3%

More Statistical Learning Additional Stimulus types –Tones –Shapes –etc. Additional species…

Cotton-top Tamarin “Jackendoff” Marc Hauser

Where do constraints come from? Substantive Constraints If the statistical learning mechanism is able to pick up regularities that go beyond those found in natural languages, then there must be additional substantive linguistic constraints that provide the restrictions on natural languages Constraints on Learning & Processing “… some of the constraints on natural language structure might arise from constraints on the computational abilities this mechanism exhibits.” (p. 130)

Test Words bakute gupado pitora kedidu lopaki Partwords bakudo gupara pitodu kediki lopate

Test Words bakute gupado pitora kedidu lopaki Partwords bakudo gupara pitodu kediki lopate

Albert Bregman

k t b | | | C - V - C - V - C | | a a Autosegmental Phonology

Where do constraints come from? “This compatibility between learning and languages in turn suggests that natural language structures may be formed, at least in part, by the constraints and selectivities of what human learners find easy to acquire.” (p. 159)

Where do constraints come from? How well does this generalize?

Where do constraints come from? Substantive Constraints vs. Constraints on Learning or Processing Rather than removing the need for substantive constraints, Newport’s approach seems to shift the burden of explanation onto the theory of representations

Jenny Saffran Curr. Dir. Psych. Sci., 12: (2003)

Experiment 1 - Syllable Size Step 1: Pattern Induction –Regime A: CVCV words, e.g., boga, diku –Regime B: CVCCVC words, e.g., bikrub, gadkug Step 2: Segmentation –4 words: [baku, dola], [tupgod, girbup] –Continuous stream: tupgodbakugirbupdolabaku… Step 3: Testing –Same words used in segmentation: [baku, dola], [tupgod, girbup] –Infants listened longer to words consistent w/ induced pattern

Experiment 2 - Phonotactics Step 1: Pattern Induction –Regime A: -V+V syllables, e.g., todkad, pibtug –Regime B: +V-V syllables, e.g., dakdot, gutbip Step 2: Segmentation –4 words: [kibpug, pagkob], [bupgok, gikbap] –Continuous stream: pagkobbupgokgikbapkibpug… Step 3: Testing –Same words used in segmentation: [kibpug, pagkob], [bupgok, gikbap] –Infants listened longer to words inconsistent w/ induced pattern

Experiment 3 - Unnatural Phonotactics Experiment 2 –-V+V pattern is stated over a feature-based class: /p,t,k/ vs. /b,d,g/ Experiment 3 –Modify segment ‘groupings’: /p,d,k/ vs. /b,t,g/ –Other details just like Experiment 2 –No listening preference at test phase

Conclusion “To the extent that patterns that do not occur in natural languages are more difficult to acquire, we may consider the possibility that constraints on how infants learn may have served to shape the phonology of natural languages. Patterns that are difficult to acquire are less likely to persist cross-linguistically than those that are easily learned. Thus, languages may exploit devices such as voicing regularities in part because they are readily acquired by young learners.” [Saffran & Thiessen 2003, p. 491]

discussion …

(Peña et al. 2002)

Gomez 2002

pel __ rud vot __ jic dak __ tood 2: wadim, kicey 6: puser, fengle, coomo, loga 12: gople, taspu, hiftam, deecha, vamey, skiger 24: benez, gensim, feenam, laeljeen, chila, roosa, plizet, balip, malsig, suleb, nilbo, wiffle Experiment 1: adults 18-minute training

Experiment 2 18-month old infants 3-minute training

Marcus et al. (1999) Training –ABA:ga na gali ti li –ABB:ga na nali ti ti Testing –ABA:wo fe wo –ABB:wo fe fe Gary Marcus

#1: ABB vs. ABA #2: ABB vs. ABA #3: ABB vs. AAB

Marcus, Fernandes & Johnson, 2007 (Psychological Science)