Eye Movements in Reading Syntactically Ambiguous Sentences in Russian Language Victor N. Anisimov, Anna S. Jondot, Olga V. Fedorova, Alexander V. Latanov.

Slides:



Advertisements
Similar presentations
KeTra.
Advertisements

THE LANGUAGE OF FILM. EXTREME LONG SHOT (XLS) A shot that reveals great exposure. This creates series of isolation.
Introduction to Eye Tracking
Another word on parsing relative clauses Eyetracking evidence from Spanish and English Manuel Carreiras & Charles Clifton, Jr.
Eye Movements and Spoken Language Comprehension: effects of visual context on syntactic ambiguity resolution Spivey et al. (2002) Psych 526 Eun-Kyung Lee.
Intro to NLP - J. Eisner1 Human Sentence Processing.
The Interaction of Lexical and Syntactic Ambiguity by Maryellen C. MacDonald presented by Joshua Johanson.
Effect of Opacity of Stimulus in Deployment of Interest in an Interface Sujoy Kumar Chowdhury & Jeremiah D. Still Missouri Western State University Introduction.
Cognitive Psychology, 2 nd Ed. Chapter 12 Language Comprehension.
ERPs to Semantic and Physical Anomalies in Cartoon Videos Jennifer Michelson 1, Courtney Brown 1, Laura Davis 1, Tatiana Sitnikova 2 & Phillip J. Holcomb.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Eye Movements of Younger and Older Drivers Professor: Liu Student: Ruby.
Background POP displays are critical because 68% of all buying decisions are made with no prior planning (Stahlberg & Maila, 2010). Effective POP displays.
Transient Cortical Excitation at the onset of visual fixation Visual recognition is brain state dependent.
Evaluating the Effects of Text Chunking on Subtitling: A Quantitative and Qualitative Examination Andrew T. Duchowski COMPUTER SCIENCE CLEMSON UNIVERSITY.
Detecting Prosody Improvement in Oral Rereading Minh Duong and Jack Mostow Project LISTEN Carnegie Mellon University The research.
Copyright © 2007, Pearson Education, Inc., Publishing as Pearson Addison-Wesley. The thin-lens equation The camera The human eye The magnifier The microscope.
PSY 369: Psycholinguistics Language Comprehension: Sentence comprehension.
PSY 369: Psycholinguistics Language Comprehension: Sentence comprehension.
Nonparametric statistics. Nonparametric? What are they? Tests that don’t assume data is normal, or t-distributed, or χ 2, or... –so they don’t involve.
La Technologie des Mouvements Oculaires en Linguistique Expérimentale Rachel Shen.
Importance of region-of-interest on image difference metrics Marius Pedersen The Norwegian Color Research Laboratory Faculty of Computer Science and Media.
Eye Movements and Visual Attention
Introduction To know how perceptual and attentional processes and properties of words guide the eyes through a sentence, the following issues are particularly.
The Text Structure Strategy for reading comprehension Insights through eye-movement monitoring Li-Hao Yeh, Aaron Baule & Ana I. Schwartz The University.
English versus French: Determinants of eye movement control in reading Sébastien Miellet, Cyril Pernet, Patrick J. O’Donnell, and Sara C. Sereno Department.
SYNTAX 8 ON-LINE PROCESSING DAY 37 – NOV 22, 2013 Brain & Language LING NSCI Harry Howard Tulane University.
Maria Grazia Albanesi, Riccardo Amadeo University of Pavia, Faculty of Engineering, Computer Department Impact of Fixation Time on Subjective Video Quality.
Change blindness and time to consciousness Professor: Liu Student: Ruby.
Ruthellen Josselson, Ph.D.. “There is no method capable of being learned and systematically applied so that it leads to the goal. The scientist has to.
Ferreira and Henderson (1990)
Speech Comprehension: Decoding meaning from speech.
Silke Gutermuth & Silvia Hansen-Schirra University of Mainz Germany Post-editing machine translation – a usability test for professional translation settings.
Hand trajectories reveal hidden cognitive states Ken Nakayama a Joo-Hyun Song b Matthew Finkbeiner c Alfonso Caramazza a a Harvard University b Smith-Kettlewell.
Intra-individual variability in early child language Representing and testing variability and variability change Paul van Geert University of Groningen.
BLOCK Y January 14, NAKAMURA, H. Y.; LIMA, M. C. M. P; GONÇALVES, V. M. G. Sonar System- digital sounds of instruments for behavior hearing tests.
PSY 369: Psycholinguistics Language Comprehension: Methods for sentence comprehension.
HighlY Constrained Back PRojection (HYPR) Thank you to Oliver Wieben!!
Avoiding the Garden Path: Eye Movements in Context
Analysis of Eye Movement Data Frank M. Marchak, Ph.D. Veridical Research and Design Corporation
Background: Speakers use prosody to distinguish between the meanings of ambiguous syntactic structures (Snedeker & Trueswell, 2004). Discourse also has.
Bornkessel, Fiebach, Friederici, & Schlesewsky (2004) What individual difference measures best predict differences in language comprehension? –Working.
The Duration of Eyelid Movements During Blinks: Changes with Drowsiness Tucker, AJ, Johns, MW Sleep Diagnostics Pty Ltd Melbourne, Australia Introduction.
E BERHARD- K ARLS- U NIVERSITÄT T ÜBINGEN SFB 441 Coordinate Structures: On the Relationship between Parsing Preferences and Corpus Frequencies Ilona Steiner.
The geometry of the system consisting of the hyperbolic mirror and the CCD camera is shown to the right. The points on the mirror surface can be expressed.
Age Differences in Visual Search for Traffic Signs During a Simulated Conversation 學生:董瑩蟬.
Visual Search Deficits in Williams Buren Syndrome Montfoort, I., Frens, M.A., Lagers- Van Haselen, G.C., & van der Geest, J.N.
Counting How Many Words You Read
Spatio-temporal saliency model to predict eye movements in video free viewing Gipsa-lab, Grenoble Département Images et Signal CNRS, UMR 5216 S. Marat,
An Eyetracking Analysis of the Effect of Prior Comparison on Analogical Mapping Catherine A. Clement, Eastern Kentucky University Carrie Harris, Tara Weatherholt,
© 2010 Pearson Education, Inc. PowerPoint ® Lectures for College Physics: A Strategic Approach, Second Edition Chapter 19 Optical Instruments.
Neural correlates of morphological decomposition in a morphologically rich language : An fMRI study Lehtonen, M., Vorobyev, V.A., Hugdahl, K., Tuokkola.
Word recognition in normal reading Sara C. Sereno Collaborators: RAs/PGs: Paddy O’DonnellSébastien Miellet Hartmut LeutholdGraham Scott Christopher Hand.
More information flow… English Language, Unit 4. Some astonishing questions about the nature of the universe have been raised by scientists exploring.
Measures of Academic Progress (MAP) Presenter: Rachel Iaconelli-Scheyer Director of Curriculum Director of Curriculum Ocean City School District Ocean.
Towards an express-diagnostics for level of processing and hazard perception Boris M. Velichkovsky et al. Transportation Research Part F 5 (2002)
SWBAT: Perform a one sample t-test for a population mean. Do Now:
How much more could you get done if you completed all of your required reading in 1/3 or 1/5 the time? Increasing reading speed is a process of controlling.
Blink Is Not A Random Event In Reading Yu-Chi Tai, James Sheedy, & John Hayes Pacific University, College of Optometry.
A sentence in English What we need to write a sentence.
Reading, Processing and Interacting with Hypertext on the Web
What can we learn from eye movements?
ISO & Shutter Speed.
Timing and Specificity of Feed-Forward Inhibition within the LGN
An Interference Effect of Observed Biological Movement on Action
An Interference Effect of Observed Biological Movement on Action
Volume 27, Issue 2, Pages (January 2017)
Measures of Academic Progress (MAP)
Behavioral task and performance.
Differences in verb and noun comprehension in aphasia
Presentation transcript:

Eye Movements in Reading Syntactically Ambiguous Sentences in Russian Language Victor N. Anisimov, Anna S. Jondot, Olga V. Fedorova, Alexander V. Latanov M.V. Lomonosov State University, Moscow Moscow, 2015

30 min recording, sampling rate of 8 fps First study of eye movements in reading syntactically ambiguous sentences fixation

Syntactic ambiguity in English (a) They gave her dog candies (b) They gave her dog candies They told her cat stories They told her cat stories Two interpretations of the sentence: Number of fixations normalized for 10 participants and reading every sentence with definite interpretation - (a) or (b).

Syntactic ambiguity in English dog candies (b) Number of fixation Number of fixations normalized for 10 participants in reading every sentence with definite interpretation - (a) or (b). Number of fixation her dog (a)

The criminal shot the servant of the actress who was on the balcony the servantthe actress early closure late closure Who was on the balcony? Syntactic ambiguity (early/late closure) ? dominates in Englishdominates in Russian

A priory interpretation complexity during reading structurally (syntactically) ambi- guous sentences slows reading in comparison with reading sentences without any syntactic ambiguity.

Method Monitor for stimuli presentation IR - mirror IR - light Hight-speed digital camera

Top view 45 deg. Eye image, reflected from IR mirror, is projected to camera matrix Eye Monitor IR mirrors

29 subjects, years old; 20 sentences Global (G) and Control (C); originally developed eye tracker based on fast digital camera FV300; sampling rate of 250 fps; matrix resolution 640х480 pixels; angular size of the monitor for text presentation 47 deg.; average angular size of the character 0,6 deg. Method (1 st part)

Example of reading sentence with ambiguity regression 1 s 2 nd str 3 id str 1 st str

Example of stimuli (overall 40)

Eye movements parameters in reading 2 nd string (test and control). Data averaged over all sentences and 30 subjects. Spread presented by standard error of mean, sample size in parenthesis). ParameterGlobal (G)Control (C) Significant level, р Reading time (ms) 1393±20 (1169) 1195±14 (1169) <0,00001 Number of fixations (in one string) 5,29±0,05 (1169) 4,72±0,04 (1169) <0,00001 Regression frequency (in one string) 0,662±0,029 (1169) 0,336±0,019 (1169) <0,00001 Fixation duration (ms) 207±1 (5964) 200±1 (5326) <0,00001 Results. 1 st experiment. Anisimov et. al., 2014

Parameters of eye movements in reading 2 nd string in G and C

Regressive saccades Comparison of regressive saccades in 1 st and 2 nd strings in reading sentence with global ambiguity and control F2(G1/G2)=47,61; p<0,01, n=16 F2(G1/C1)=0,80; p<0,37, n=16 F2(G2/C2)=62,9; p<0,01, n=16 p<0,01 Number of regressive saccades 1 st string2 nd string G1 C1 G2 C2

Types of ambiguity G – global LE – local, early closure LL – local, late closure C – control

Gardener met daughter of the cook who went to school. Садовник встретил дочку кухарки, которая пошла в школу. Girl caught snowflake that melt on the palm. Девочка поймала снежинку, которая растаяла на руке. Sentences with and without ambiguity

Types of syntactic ambiguity

· 31 subjects, years old; · 12 sentences LE, LL, G and C; · originally developed eye tracker based on fast digital camera FV300; · sampling rate of 250 Hz; · matrix resolution 640х480 pixels; · angular size of the monitor for text presentation 47 deg.; · average angular size of the character 0,6 deg. Method (2 nd part)

Example of reading sentence with ambiguity

Results. 2 nd experiment. Eye movement parameters (M±SEM, sample size in parentheses) averaged over all subjects in reading LE, LL, G and С.

In reading LL subjects demonstrate more fixations than in reading LE. Significant differences revealed by Student t-test criterion. Number of fixations in reading sentences with local ambiguity.

In reading LL regression frequency significantly higher than in reading G. Number of fixations is quasi significantly higher than in reading G. Significant differences revealed by Student t-test criterion. Regression frequency in reading sentences with ambiguity.

1.Syntactic ambiguity leads to slowing reading because of language processing complication. 2.LL is more complicated in terms of syntactic interpretation than LE. 3.Higher regression frequency and greater number of fixations in reading LL in comparison with reading G indicate that interpretation of LL is more complicated than interpretation of G. 4.Disambiguation of G in Russian (as well as in English) apparently doesn't provoke additional complexity of syntactic analysis and its interpretation is predetermined by domination of early closure (high attachment) principle in Russian to a considerable extent. The absence of any significant differences between eye movement parameters in reading G and LE proves this point.

Thanks for you attention!