Origins of Modularity. Preliminary Binding Study Results –13 participants tested using Linger –Data can be analyzed using Lingalyzer Lite –Region encoding.

Slides:



Advertisements
Similar presentations
Chapter 10: Designing Databases
Advertisements

Component Oriented Programming 1 Chapter 2 Theory of Components.
All slides © S. J. Luck, except as indicated in the notes sections of individual slides Slides may be used for nonprofit educational purposes if this copyright.
Eye Movements and Spoken Language Comprehension: effects of visual context on syntactic ambiguity resolution Spivey et al. (2002) Psych 526 Eun-Kyung Lee.
Sentence Processing III Language Use and Understanding Class 12.
18 and 24-month-olds use syntactic knowledge of functional categories for determining meaning and reference Yarden Kedar Marianella Casasola Barbara Lust.
Sentence Processing 1: Encapsulation 4/7/04 BCS 261.
Eye-witness testimony
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
NYU ANLP-00 1 Automatic Discovery of Scenario-Level Patterns for Information Extraction Roman Yangarber Ralph Grishman Pasi Tapanainen Silja Huttunen.
Chapter Learning Objectives
The Art and Science of Teaching (2007)
Language Use and Understanding BCS 261 LIN 241 PSY 261 CLASS 12: SNEDEKER ET AL.: PROSODY.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Spring 2006-Lecture 4.
Psy1302 Psychology of Language Lecture 12 Sentence Comprehension II.
PSY 369: Psycholinguistics Language Comprehension: The role of memory.
Working Memory and Relative Clause Attachment under Increased Sentence Complexity Akira Omaki Department of Second Language Studies, University of Hawai‘i.
La Technologie des Mouvements Oculaires en Linguistique Expérimentale Rachel Shen.
Lecture Nine Database Planning, Design, and Administration
Formulating the research design
Major Tasks in Data Preprocessing(Ref Chap 3) By Prof. Muhammad Amir Alam.
Science Inquiry Minds-on Hands-on.
The time-course of prediction in incremental sentence processing: Evidence from anticipatory eye movements Yuki Kamide, Gerry T.M. Altman, and Sarah L.
Introduction to Research Methodology
Amira Al Harbi.  Psycholinguistics is concerned with language and the brain.  To be a perfect psycholinguistist, you would need to have a comprehensive.
Language and Literacy Unit 4 - Getting Ready for the Unit
Results Following Signal Detection Theory, Accuracy is calculated as the difference between Real and Foil claim rates, and Bias is the mean of the two.
Jelena Mirković and Maryellen C. MacDonald Language and Cognitive Neuroscience Lab, University of Wisconsin-Madison Introduction How to Study Subject-Verb.
Syntax Lecture 8: Verb Types 1. Introduction We have seen: – The subject starts off close to the verb, but moves to specifier of IP – The verb starts.
Lecture 12: 22/6/1435 Natural language processing Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
Assessment of Semantics
CriteriaExemplary (4 - 5) Good (2 – 3) Needs Improvement (0 – 1) Identifying Problem and Main Objective Initial QuestionsQuestions are probing and help.
Ferreira and Henderson (1990)
The Independence of Syntactic Processing Advanced Psycholinguistics Presenter: Dong-Bo Hsu 02/09/06.
MEMORY. Sensory Memory Sensory Memory: The sensory memory retains an exact copy of what is seen or heard (visual and auditory). It only lasts for a few.
Modularity What’s the Big Deal? (1983) (not 1983)
Avoiding the Garden Path: Eye Movements in Context
The Impact of Exposure to MSA on the Acquisition of Basic Language and Literacy Skills in Arabic Elinor Saiegh-Haddad Bar-Ilan University
CHAPTER 12 Descriptive, Program Evaluation, and Advanced Methods.
University of Windsor School of Computer Science Topics in Artificial Intelligence Fall 2008 Sept 11, 2008.
Background: Speakers use prosody to distinguish between the meanings of ambiguous syntactic structures (Snedeker & Trueswell, 2004). Discourse also has.
AL-MAAREFA COLLEGE FOR SCIENCE AND TECHNOLOGY INFO 232: DATABASE SYSTEMS CHAPTER 1 DATABASE SYSTEMS Instructor Ms. Arwa Binsaleh.
PSY270 Michaela Porubanova. Language  a system of communication using sounds or symbols that enables us to express our feelings, thoughts, ideas, and.
Effective Teaching Strategies Day 2
9-Dec Dec-15  INTRODUCTION.  FEATURES OF OOP.  ORGANIZATION OF DATA & FUNCTION IN OOP.  OOP’S DESIGN.
Testing OO software. State Based Testing State machine: implementation-independent specification (model) of the dynamic behaviour of the system State:
Chapter 8. Situated Dialogue Processing for Human-Robot Interaction in Cognitive Systems, Christensen et al. Course: Robots Learning from Humans Sabaleuski.
Basic components of memory
Finite State Machines (FSM) OR Finite State Automation (FSA) - are models of the behaviors of a system or a complex object, with a limited number of defined.
48 Item Sets (Only the results for the relative clause versions are reported here.) The professor (who was) confronted by the student was not ready for.
Unit 11: Use observation, assessment and planning
Understanding Naturally Conveyed Explanations of Device Behavior Michael Oltmans and Randall Davis MIT Artificial Intelligence Lab.
 Problem solving involves a number of well- defined steps, which are as follows:  Define the problem.  Analyze the problem.  Identify and evaluate.
Method. Input to Learning Two groups of learners each learn one of two new Semi-Artificial Languages. Both Languages: Example sentences: glim lion bee.
Chapter 5 Motor Programs 5 Motor Programs C H A P T E R.
#1 Make sense of problems and persevere in solving them How would you describe the problem in your own words? How would you describe what you are trying.
Special Ed. New Direction - Kathy Airhart and Joey Hassel  focus on embedded PD model combining sped and general PD  shifting towards performance based.
48 Item Sets (Only the results for the relative clause versions are reported here.) The professor (who was) confronted by the student was not ready for.
The PLA Model: On the Combination of Product-Line Analyses 강태준.
VISUAL WORD RECOGNITION. What is Word Recognition? Features, letters & word interactions Interactive Activation Model Lexical and Sublexical Approach.
Instructional Strategies
Object-Oriented Software Engineering Using UML, Patterns, and Java,
Syntax Lecture 9: Verb Types 1.
Graph Coverage for Specifications CS 4501 / 6501 Software Testing
The interactive alignment model
CAPE INFORMATION TECHNOLOGY
Human Complexity of Software
SECOND LANGUAGE LISTENING Comprehension: Process and Pedagogy
CAPE INFORMATION TECHNOLOGY
Lecture 6 Architecture Algorithm Defin ition. Algorithm 1stDefinition: Sequence of steps that can be taken to solve a problem 2ndDefinition: The step.
Presentation transcript:

Origins of Modularity

Preliminary Binding Study Results –13 participants tested using Linger –Data can be analyzed using Lingalyzer Lite –Region encoding needs to be added (perl script, Excel?) –Short-term objective: means & standard errors, accuracy Longer-term objective –Fine-tune experimental items –Test with naïve participants –ANOVA analyses

Regions

Statistical Analyses Raw vs. residual reading times ANOVA –MS = s 2 = SS/df –F-ratio = MS between /MS within –Interaction in 2-way ANOVA: between group variance that is not accounted for by main effects Repeated Measures ANOVA –Intuitively: are all subjects/items affected similarly by the experimental factor? –Statistically: F = MS repeated-measure /MS interaction –Power of subjects analysis depends on number of items, and vice versa

Effects of informational encapsulation due to –Architectural constraints –Computational constraints

(Trueswell et al. 1999)

Summary from Last Week ‘Autonomy’ in Generation vs. Selection –Most evidence does not specifically identify effect of semantics/pragmatics on structure generation –What would needed for semantics to impact generation In order to block generation of one analysis, semantic information must have its effect prior to the ambiguous input E.g., anomaly of ‘the frog’ in multiple frog context triggers search for restrictive modifier Requires a link from failure to resolve definite description to generation of specific structure Predicts limited effects on generation, at best –Multiple referent contexts –NOT plausible combinations, e.g. evidence examined, warehouse fires

(Tanenhaus et al., 1995)

Implication –“Our results demonstrate that in natural contexts, people seek to establish reference with respect to their behavioral goals during the earliest moments of linguistic processing. Moreover, referentially relevant non- linguistic information immediately affects the manner in which the linguistic input is initially structured. Given these results, approaches to language comprehension that assign a central role to encapsulated linguistic subsystems are unlikely to prove fruitful.” (p. 1634) –Do these results imply strong interactivity? (Tanenhaus et al., 1995)

How Representative are VW Studies? Strong context effects occur in narrowly constrained situations, where –Prior material generates expectation for one variant of an ambiguity, with sufficient specificity to predict individual words –Context is constrained enough such that Specific expectation can be elicited (i.e. notice ‘Oops, there are two apples in this scene, which one can he be referring to?’) There is a good understanding of what are the relevant objects in the visual context –“… visual stimuli can combine with linguistic stimuli in a manner that effectively constrains the referential domain in ways that may be unrepresentative of the challenges that readers and listeners face when dealing language about displaced objects and events” (Pickering, McElree, & Garrod, 2004)

“Second, the effects of the objects on processing an utterance may be exacerbated by the small number of objects presented (typically about four). Presumably, small sets are necessary because larger sets would increase memory demands (both for the retention of the objects and their locations) and would dilute effects. However, small sets enable particular strategies that may be optimal for the experimental task but not necessarily representative of general operations involved in processing language. For instance, participants may circumvent standard processing operations by developing strategies based on a limited number of representations held in working memory. Immediate effects that depend on properties of the paradigm cannot be used to provide strong support for interactive theories of comprehension.” (Pickering, McElree, & Garrod, 2004)

(Trueswell et al. 1999)

“Put the hippo on the towel in the basket” “Put the bear on the plate in the box” Adult (Trueswell et al. 1999)

“Put the frog on the napkin in the pot” “Put the hippo on the towel in the basket” 5-year Old (Trueswell et al. 1999)

Kindergarten Path Effect Why are the children failing to act as adults do on the 2- referent context? –Overall VP-attachment bias, stronger than adults (due to minimal attachment, or to statistical bias of put for a location argument) –Unable to take advantage of referential context –Insensitive to definiteness –Unable to revise initial commitments/plans of action

One Answer Compare put and wiggle (2-referent contexts only, n=16) –Put the frog (that’s) on the napkin in the box. ActionsAmbig55%Unambig16% Looks (n=8)Ambig71%Unambig44% –Wiggle the frog (that’s) on the napkin in the box. ActionsAmbig23%Unambig8% Looks (n=8)Ambig52%Unambig38% (Trueswell et al. 1999)

Another Answer Modifier-bias Choose the cow with the stick. Equi-bias Feel the frog with the feather. Instrument-bias Tickle the pig with the fan. (Snedeker & Trueswell, in press)

Another Answer Modifier-bias Choose the cow with the stick. Equi-bias Feel the frog with the feather. Instrument-bias Tickle the pig with the fan. (Snedeker & Trueswell, in press)

Memory

The defendant examined by the lawyer… The evidence examined by the lawyer… (Just & Carpenter 1992)

The defendant examined by the lawyer… The evidence examined by the lawyer… (Just & Carpenter 1992)

The defendant examined by the lawyer… The evidence examined by the lawyer… (Just & Carpenter 1992)

The soup cooked in the pot but was not ready to eat. The soup bubbled in the pot but was not ready to eat. (Pearlmutter & MacDonald, 1995)

The soup cooked in the pot but was not ready to eat. The soup bubbled in the pot but was not ready to eat. (Pearlmutter & MacDonald, 1995)

The soup cooked in the pot but was not ready to eat. The soup bubbled in the pot but was not ready to eat. (Pearlmutter & MacDonald, 1995)

Processing Overload RC/RC center embedding –The school board which the teachers who were neglecting the students had angered troubled the superintendent.

A Contrast (Gibson 1998) Relative Clause within a Sentential Complement (RC  SC): The fact [ CP that the employee [ RC who the manager hired] stole office supplies] worried the executive. Sentential Complement within a Relative Clause (SC  RC): #The executive [ RC who the fact [ CP that the employee stole office supplies] worried] hired the manager. RC  SC is easier to process than SC  RC

A Contrast (Gibson 1998) Relative Clause within a Sentential Complement (RC  SC): [ SC that the employee [ RC who the manager hired] stole Sentential Complement within a Relative Clause (SC  RC): [ RC who the fact [ SC that the employee stole office supplies] worried] RC  SC is easier to process than SC  RC

A Contrast (Gibson 1998) Relative Clause within a Sentential Complement (RC  SC): [ SC that the employee [ RC who the manager hired] stole Sentential Complement within a Relative Clause (SC  RC): [ RC who the fact [ SC that the employee stole office supplies] worried] RC  SC is easier to process than SC  RC

Complexity Measures Memory cost associated with –Incomplete syntactic dependencies (prediction, memory cost) Number Length –Completion of syntactic dependencies (integration cost) Number Length (Gibson 1998)

Role in ambiguity resolution –Minimization of memory costs contribute to choice among alternative resolutions of an ambiguous structure –Prediction: when difference in memory costs is large, this factor overrides other factors

Plausibility Grodner et al The evidence examined by the lawyer turned out to be unreliable. The witness who the evidence examined by the lawyer implicated seemed to be very nervous. The witness thought that the evidence examined by the lawyer implicated his next-door neighbor.

Plausibility Grodner et al The evidence examined by the lawyer turned out to be unreliable. The witness who the evidence examined by the lawyer implicated seemed to be very nervous. The witness thought that the evidence examined by the lawyer implicated his next-door neighbor. Large syntactic difference overrides plausibility bias

(Grodner, Gibson & Tunstall, 2002)

Experiment 2: N-N compound vs. RC –Plausible The alley (which) mice run rampant in is damp and dimly lit but relatively clean. –Implausible The tool (which) plumbers need to have is a good monkey wrench for loosening rusty pipes. (Grodner, Gibson & Tunstall, 2002)

Plausibility Eastwick & Phillips, 2000 The judge remembered that the document… stating that the [ defendant/evidence (that was) examined by the lawyer was unreliable ] …had been stolen from the filing cabinet.

Plausibility Eastwick & Phillips, 2000 The judge remembered that the document… had stated that the [ defendant/evidence (that was) examined by the lawyer was unreliable] …and should be withdrawn from the testimony

Architecture Again

Three Architectural Issues Abstraction (fall) –Relation between language and conceptual/perceptual systems –Abstraction (in phonology, lexicon, syntax, etc.) allows for powerful & efficient combinatorial systems –…but exacts a cost for recognition and learning Incrementality (winter) –Relation between systems for understanding, speaking, and acceptability judgments –Computation is fast, but how is this achieved? Modularity (spring) –Relation between computations at different levels of representation –Various possible sources for constraints on interaction