Age of acquisition and frequency of occurrence: Implications for experience based models of word processing and sentence parsing Marc Brysbaert.

Slides:



Advertisements
Similar presentations
Accessing spoken words: the importance of word onsets
Advertisements

Brian MacWhinney, CMU Heidi Feldman, Pitt Kelley Sacco, CMU
Method Participants 36 healthy participants (19 females) aged from 17 to 24 years (mean = 20; SD = 1,67) Material Participants were randomly allocated.
Marslen-Wilson Big Question: “What processes take place during the period that the sensory information is accumulating for the listener” during spoken.
Psycholinguistic what is psycholinguistic? 1-pyscholinguistic is the study of the cognitive process of language acquisition and use. 2-The scope of psycholinguistic.
Facilitation in Recognizing Pairs of Words: Evidence of a Dependence between Retrieval Operations By David E. Meyer & Roger W. Schvaneveldt Presented by.
Language Comprehension Speech Perception Semantic Processing & Naming Deficits.
Chapter 7 Knowledge Terms: concept, categorization, prototype, typicality effect, object concepts, rule-governed, exemplars, hierarchical organization,
Learning linguistic structure with simple recurrent networks February 20, 2013.
Probabilistic inference in human semantic memory Mark Steyvers, Tomas L. Griffiths, and Simon Dennis 소프트컴퓨팅연구실오근현 TRENDS in Cognitive Sciences vol. 10,
The Timecourse of Morphological Processing: Base and surface frequency effects in speed-accuracy tradeoff designs Jennifer Vannest University of Michigan.
An introduction to: Deep Learning aka or related to Deep Neural Networks Deep Structural Learning Deep Belief Networks etc,
Knowing Semantic memory.
Large-Scale Organization of Semantic Networks Mark Steyvers Josh Tenenbaum Stanford University.
Reading. Reading Research Processes involved in reading –Orthography (the spelling of words) –Phonology (the sound of words) –Word meaning –Syntax –Higher-level.
Language Comprehension Speech Perception Naming Deficits.
1 Human simulations of vocabulary learning Présentation Interface Syntaxe-Psycholinguistique Y-Lan BOUREAU Gillette, Gleitman, Gleitman, Lederer.
Computer vision: models, learning and inference Chapter 10 Graphical Models.
Memory development Psych. 414 Prof. Jessica Sommerville.
Second language acquisition
Learning the passive in natural(istic) settings Katie Alcock, Ken Rimba, Manizha Tellaie, and Charles Newton Thanks to Kamil ud Deen.
Electrophysiological Correlates of Repetition and Translation Priming in Different Script Bilinguals Noriko Hoshino 1, Katherine J. Midgley 1,2, Phillip.
Speech and Language Issues For Babies and Pre-school age children who have Down Syndrome Ups and Downs Southwest Conference 2007.
The changing face of face research Vicki Bruce School of Psychology Newcastle University.
The impact of typical and atypical language dominance on visual word recognition Marc Brysbaert.
Connectionist Models of Language Development: Grammar and the Lexicon Steve R. Howell McMaster University, 1999.
Adele E. Goldberg. How argument structure constructions are learned.
Shane T. Mueller, Ph.D. Indiana University Klein Associates/ARA Rich Shiffrin Indiana University and Memory, Attention & Perception Lab REM-II: A model.
Modelling Language Evolution Lecture 1: Introduction to Learning Simon Kirby University of Edinburgh Language Evolution & Computation Research Unit.
Systems Development Lifecycle Analysis. Learning Objectives List the nine stages of the system life cycle Explain the system life cycle as an iterative.
Comp. Genomics Recitation 3 The statistics of database searching.
Methodology of Simulations n CS/PY 399 Lecture Presentation # 19 n February 21, 2001 n Mount Union College.
Training Phase Results The RT difference between gain and loss was numerically larger for the second half of the trials than the first half, as predicted,
Modelling Language Acquisition with Neural Networks Steve R. Howell A preliminary research plan.
As expected, a large N400 effect was observed for all 3 word types in both experiments, |ts|≥7.69, ps
1 Statistical NLP: Lecture 7 Collocations. 2 Introduction 4 Collocations are characterized by limited compositionality. 4 Large overlap between the concepts.
Explanations of Gender Development: Evaluating Kohlberg
E BERHARD- K ARLS- U NIVERSITÄT T ÜBINGEN SFB 441 Coordinate Structures: On the Relationship between Parsing Preferences and Corpus Frequencies Ilona Steiner.
LING 322. DEVELOPMENT OF VOCABULARY AS LANGUAGE RESOURCE VOCABULARY AND CONCEPTUAL DEVELOPMENT DIFFERENT ASPECTS OF VOCABULARY KNOWLEDGE PRINCIPLES FOR.
Introduction Chapter 1 Foundations of statistical natural language processing.
Comparing the effectiveness of orthographic and phonological cues in the treatment of anomia. Lyndsey Nickels 1, Antje Lorenz 1,2, 1 Macquarie Centre for.
COGNITIVE MORPHOLOGY Laura Westmaas November 24, 2009.
How to structure good history writing Always put an introduction which explains what you are going to talk about. Always put a conclusion which summarises.
Motion Perception Deficits and Reading Impairment It’s the noise, not the motion A. Sperling, Z-L. Lu, F. Manis & M. Seidenberg.
PET Count  Word Frequency effects (coefficients) were reliably related to activation in both the striate and ITG for older adults only.  For older adults,
Eye Movements and Working Memory Marc Pomplun Department of Computer Science University of Massachusetts at Boston Homepage:
Syntactic Priming in Sentence Comprehension (Tooley, Traxler & Swaab, 2009) Zhenghan Qi.
Processing Faces with Emotional Expressions: Negative Faces Cause Greater Stroop Interference for Young and Older Adults Gabrielle Osborne 1, Deborah Burke.
Chapter 11 Language. Some Questions to Consider How do we understand individual words, and how are words combined to create sentences? How can we understand.
Models of Production and Comprehension [1] Ling4-437.
Psychological explanations of gender development Cognitive theories.
Contact Info: Improving Decision Making: The use of simple heuristics Dr. Guillermo Campitelli Cognition Research Group Edith.
Lab 4: Pseudo-homophones They sound like words, but they aren’t.
Cognitive Processes in Second Language Learners and Bilinguals: The Development of Lexical and Conceptual Representations JUDITH F. KROLL AND GRETCHEN.
Chapter 9 Knowledge. Some Questions to Consider Why is it difficult to decide if a particular object belongs to a particular category, such as “chair,”
Lack of adjustment in L2 English?
Does the face fit the facts
Ups and Downs Southwest Conference 2007
Cognitive Processes in SLL and Bilinguals:
Phonological Priming and Lexical Access in Spoken Word Recognition
Viv Moore University of Kent. Jamie Smith-Spark Tim Valentine
The Components of the Phenomenon of Repetition Suppression
The what, where, when, and how of visual word recognition
Evidence of Inhibitory Processing During Visual Search
Catherine Barsics & Serge Brédart
Phonological Priming and Lexical Access in Spoken Word Recognition
A connectionist model in action
An introduction to: Deep Learning aka or related to Deep Neural Networks Deep Structural Learning Deep Belief Networks etc,
CS249: Neural Language Model
Presentation transcript:

Age of acquisition and frequency of occurrence: Implications for experience based models of word processing and sentence parsing Marc Brysbaert

A rare phenomenon in psychological research All researchers agree … … that word recognition depends on word frequency. High-frequency words are recognised faster than low-frequency words.

Frequency effect in sentence parsing? More controversial Is sentence parsing based on principles or on experience? Examples of experience-based accounts: tuning hypothesis, probabilistic models, neural networks This talk is on lexical processing, but the principles also apply to experience-based models of sentence processing.

How do we measure word frequemcy? Word frequency is the frequency (per million) with which words are encountered in a representative corpus of text or (more recently) speech. As it happens, virtually all corpora are based on texts written and read or spoken by adults.

Assumptions Either frequency of words in adulthood = frequency of words in childhood or only words encountered in the last years matter

Testing the assumptions Frequency childhood = adulthood? –ambulance : adults = 15 / million children = 86 / million –ancestor :adults = 15 / million children = < 1 / million It does not matter? –Morrison & Ellis (1995) : words like ambulance are named 30 ms faster than words like ancestor (effect of 80 ms in LDT)

Gerhand & Barry (1999)

The AoA effect: definition Stimuli (words) that have been acquired early are processed faster than stimuli that have been acquired later, even when they are matched on frequency. AoA measured with rating scales or by directly looking at the performance of children (r =.75).

The AoA effect: explanations Three classes of explanations: 1. Frequency and AoA have a different origin frequency effect strong at input stages; AoA effect strong at verbal output stages effect of AoA in the organisation of the semantic system 2. Frequency and AoA have the same origin cumulative frequency instead of frequency learning in a connectionist model with distributed representations (loss of plasticity)

The AoA effect: explanations Three classes of explanations: 1. Frequency and AoA have a different origin 2. Frequency and AoA have the same origin 3. Effects of AoA are due to bad frequency measures Higher correlation with frequency when measures take into account childhood frequencies (Zeno et al.) Higher correlation with frequency when measures are based on film subtitles than on books (New et al., 2007)

The AoA effect: explanations Brysbaert & Ghyselinck (Visual Cognition, 2006) –to decide between the first two classes, we have to look at the correlation between the frequency effects and the AoA effects across tasks –if both effects have the same origin, there should be strong positive correlation between the magnitudes of the effects –if the effect of AoA is due to cumulative frequency, then AoA < freq

Why the effect of AoA < the effect of frequency according to the cum hyp High frequency word > 50 / million Low frequency word < 5 / million This gives a ratio > 10:1 Early acquired words < 5 yr (15 yrs ago) Late acquired words > 15 yr (5 yrs ago) This gives a ratio of 3:1 So, effect AoA = 1/3 effect frequency

Gerhand & Barry (1998,1999a,b)

Ghyselinck et al. (2004)

Interim summary For many tasks, there is perfect correlation between the frequency effect and the AoA effect. This suggests that both effects are the result of the same learning process (futile to look for tasks that would show a frequency effect but no AoA effect). The AoA effect is too big for the cumulative frequency hypothesis.

The connectionist account of AoA Ellis & Lambon-Ralph (2000) Simple network: 100 input nodes, fully connected to 50 hidden nodes, fully connected to 100 output nodes « Words » defined by arbitrary patterns of 0 (80%) and 1 (20%) Groups of « words » entered at different times.

Discussion with Zevin & Seidenberg (2002) Z&S : an AoA effect that is larger than predicted on the basis of the cumulative frequency hypothesis will be found only when there is an arbitray mapping between input and output. Otherwise, the late-acquired patterns profit from the connections made by the early acquired patterns (is the case for word naming).

Recapitulation claim Brysbaert & Ghyselinck, 2006 if the AoA and the frequency effect have the same origin, there should be strong positive correlation between the magnitudes of the effects

In search of the frequency-independent AoA effect in picture naming 1. Semantic origin of AoA –Brysbaert et al. (2000): picture naming requires semantic mediation; hence semantic origin of the frequency- independent AoA effect. –Steyvers & Tenenbaum (2005): growing network

In search of the frequency-independent AoA effect problem: no evidence for a frequency- independent AoA effect in semantic decision tasks (there is an AoA effect in these tasks, but it looks like it is the frequency-related AoA effect)

In search of the frequency-independent AoA effect 2. The lexical-semantic competition hypothesis –the frequency-independent effect is due to the transition from semantics to verbal output –when we name a picture, initially many semantically related names (lemmas) become activated, and selecting the correct name requires a competition between the different candidates –hypothesis: early acquired lemmas are stronger competitors than late acquired lemmas (e.g., CAT is a stronger competitor for the naming of LION than vice versa)

Belke et al. (2005) Made use of the semantic blocking effect. It is more difficult to name pictures repeatedly if they are part of a semantically homogeneous set than if they are part of a semantically heterogeneous set.

Homogeneous condition

Heterogeneous condition

Belke et al. (2005) On the basis of the previous finding, we predicted that the blocking effect would be larger for late acquired words than for early acquired words

experiment 36 participants 16 pictures with early-acquired names and 16 pictures with late-acquired names matched on visual similarity, frequency, name length,… stimuli presented 6 times per block homogeneous and heterogeneous lists in different blocks (counterbalanced)

orangebanana pearcarrot lionfrog spiderrabbit scissorspaintbrush ladderhammer jumpertrousers dressshoe Early acquired stimuli

peppercherryonionlettuce ostricheaglebeetlecamel chiselpliersspannerbroom tightsshawlmittenwaistcoat Late acquired stimuli

In search of the frequency-independent AoA effect 3. Picture naming is not always semantically mediated –Funnell et al. (2006) –There is a difference in learning experience between young and old children. –Young children learn about things by seeing them (either in real or in pictures). –Older children learn about things by having them described

In search of the frequency-independent AoA effect Funnell et al. –Pictures of early acquired objects are named faster, because there is a direct link between the input stimulus and the name. –Pictures of late acquired objects are named slower, because the naming requires semantic mediation

Conclusions AoA as part of the cumulative frequency seems to be a given. Question whether AoA has an effect over and above cumulative frequency: looks probable (plasticity in model) Still uncertainty about what causes the frequency- independent AoA effect in picture naming

Reading list Brysbaert, M. & Ghyselinck, M. (2006). The effect of age of acquisition: Partly frequency related, partly frequency independent. Visual Cognition, 13, Johnston, R.A. & Barry, C. (2006). Age of acquisition and lexical processing. Visual Cognition, 13, Juhasz, B.J. (2005). Age-of-acquisition effects in word and picture identification. Psychological Bulletin, 131,