Matching pictures with the appropriate sound: results from an eye-tracking study of dogs and 14-month-old infants 2012.10.09 Anna Gergely 1* A. Hernádi.

Slides:



Advertisements
Similar presentations
Role of communication experience in facial expression coding in preschool children Vera Labunskaya a a Academy of psychology and pedagogy of Southern Federal.
Advertisements

Modality-specific interaction between phonology and semantics Gail Moroschan & Chris Westbury Department of Psychology, University of Alberta, Edmonton,
Language and Cognition Colombo, June 2011 Day 8 Aphasia: disorders of comprehension.
Atypical Visual Processing in Infant Siblings of Children with Autism Spectrum Disorders (ASD) Karen Dobkins Leslie Carver Joseph McCleery Funded by NAAR.
INFANTS’ PERCEPTION OF FACE-AFFECT RELATIONS IN MULTIMODAL EVENTS Melissa A. Shuman & Lorraine E. Bahrick Florida International University Introduction.
Ling 240: Language and Mind Acquisition of Phonology.
Chapter 4: Physical Development: Body, Brain, and Perception Perceptual Development By Kati Tumaneng (for Drs. Cook & Cook)
Karen Dobkins Development of Motion Processing in Human Infants Karen Dobkins Psychology Department UC San Diego.
Effects of Sound and Visual Congruency on Product Selection and Preference Brock Bass Felipe Fernandez Drew Link Andrew Schmitz.
Chapter 6 Perception.
5-Month-Old Infants Match Facial and Vocal Expressions of Other Infants Mariana Vaillant and Lorraine E. Bahrick Florida International University Abstract.
Development of sound localization
Research with Infants PSY 415. General Issues Sampling –Time-consuming –Expensive –Not representative? Attrition –Fussiness –Drowsiness/sleep.
P ARTS, CAVITIES, AND OBJECT REPRESENTATION IN INFANTS BY : ANGELA HAYDEN, RAMESH S. BHATT, ASHLEY KANGAS AND NICOLE ZIEBER Presented: VICTORIA KHA.
28/06/2015 Electronic Imaging Conference - San Jose 1 The impact of interactive exploration on the recognition of objects Frank Meijer a, Egon L. van den.
The role of auditory-visual integration in object recognition Clara Suied 1, Nicolas Bonneel 2 and Isabelle Viaud-Delmon 1 1 CNRS – UPMC UMR 7593 Hôpital.
Answers to Group Questions Brownell, Svetlova, & Nichols (2009)
Synchronization and Continuation Tapping to Complex Meters Joel S. Snyder 1, Erin E. Hannon 2, Edward W. Large 3, & Morten H. Christiansen 2 1 The Rotman.
Chapter 6 Perception.
4:39 PM Two topics 1. What is Cognitive Psychology about? Interaction with the world The cognitive psychology of the Couch Potato 2. What methods does.
Infant Discrimination of Voices: Predictions from the Intersensory Redundancy Hypothesis Lorraine E. Bahrick, Robert Lickliter, Melissa A. Shuman, Laura.
Mapping words to actions and events: How do 18-month-olds learn a verb? Mandy J. Maguire, Elizabeth A. Hennon, Kathy Hirsh-Pasek, Roberta M. Golinkoff,
Cattell-Horn-Carroll model of psychometric abilities.
Psych 156A/ Ling 150: Psychology of Language Learning Lecture 7 Sounds of Words II.
Suppression Task. We used a task modeled on Gernsbacher et. al. (1991) Lewis and colleagues 3,4 measured the monocular visual field extent of 3-, 4-, and.
Human and chimpanzee face processing in chimpanzees Julie Martin-Malivel 1 and Kazunori Okada 2 1 Yerkes National Primate Research Center, Emory University.
Comparative Cognition Bob Batsell Kalamazoo College Kalamazoo, MI USA October 21-25, 2013.
The Relative Significance of Gender in Comparison to a Range of Personality Dimensions for Nonverbal Expressiveness and Nonverbal Sensitivity 10 Correlational.
N400-like semantic incongruity effect in 19-month-olds: Processing known words in picture contexts Manuela Friedrich and Angela D. Friederici J. of cognitive.
1 Cross-language evidence for three factors in speech perception Sandra Anacleto uOttawa.
Chapter five.  Language is a communication tools whose development depends on the prior development of communication.  Language is a social tool.* 
Infant Perception. William James, 1890 “The baby, assailed by eyes, ears, nose, skin and entrails all at once, feels it all as one great blooming, buzzing.
Beyond generalization: Continuous repertoires ABA #317 5/26/03 9:00 -10:20.
Multisensory processing: an introduction
1 Psychology 307: Cultural Psychology January 23 Lecture 6.
Fig61. Fig62 Fig5_14 InRev5a InRev4bInRev2a PRINCIPLES OF PERCEPTUAL ORGANIZATION AND CONSTANCY Certain objects or sounds are automatically identified.
Chapter 16. Multiple Motivations for Imitation in Infancy in Imitation and Social Learning in Robots by Mark Nielsen and Virginia Slaughter JIHYUN LEE.
Basic cognitive processes - 1 Psych 414 Prof. Jessica Sommerville.
Basic Cognitive Processes - 2
Alterations in ZENK Expression in Zebra Finches Reared by a Single Parent Tareq Yousef, Jordan Fisk, Tara S. Perrot, and Leslie S. Phillmore Department.
Infant Perception of Object-Affect Relations Mariana Vaillant-Molina and Lorraine E. Bahrick Florida International University Presented at the Society.
© 2007 Peter B.L. Meijer The vOICe in Neuroscience 2007: Cross-modal plasticity & visual sounds Amedi et al., Nature Neuroscience, June 2007: Shape conveyed.
D EFINITION OF AUDITORY PROCESSING DISORDER  APD is defect in the neural processing of auditory stimuli that caused by higher level of language, cognitive.
Investigating the basis for conversation between human and robot Experiments using natural, spontaneous speech, speaking to the robot as if it were a small.
Introduction Ruth Adam & Uta Noppeney Max Planck Institute for Biological Cybernetics, Tübingen Scientific Aim Experimental.
Describe how reaching and grasping abilities develop in the first year of life.
Intersensory Redundancy Facilitates Infants’ Perception of Meaning in Speech Passages Irina Castellanos, Melissa Shuman, and Lorraine E. Bahrick Florida.
Reinforcement Look at matched picture after sound ends & it moves 10 trials (5 of each pairing) 2 or 4 blocks (2 pairs of words, 2 pairs of swoops) Participants.
Infant Physical Development: Perceptions – Learning Infant Health
Two systems for reasoning, two systems for learning Harriet Over and Merideth Gattis School of Psychology, Cardiff University.
Research Paper: The role of sensory processing in word learning in children at risk of autism By Tatjana Zeljic, MSc Ed. Neuroscience.
Methods Identifying the Costs of Auditory Dominance on Visual Processing: An Eye Tracking Study Wesley R. Barnhart, Samuel Rivera, & Christopher W. Robinson.
Connecting Sound with the Mind’s Eye: Multisensory Interactions in Music Conductors W. David Hairston, Ph.D Advanced Neuroscience Imaging Research Lab.
The Oxford Vocal (OxVoc) Sounds Database:
Development of Audiovisual Integration in Central and Peripheral Vision Yi-Chuan Chen, Terri L. Lewis, David I. Shore, and Daphne Maurer Department.
Effects of Working Memory on Spontaneous Recognition
Oxytocin receptor gene polymorphisms are associated with human directed social behavior in dogs Dóra Koller1,2, Melinda Bence1,2, Enikő Kubinyi1 Anna Kis3,4,
Adults’ Gestures During Object Naming and Preverbal Infants’ Word Mapping: Does Type of Motion Matter? Lakshmi J. Gogate & Dalit J. Matatyaho State University.
Promoting positive welfare in chimpanzees through videos of chimps
Associations Between Regional Brain Volumes and the NIH-Toolbox Cognition Battery Fluid and Crystallized Composite Scores in Cognitively Healthy Older.
Paridon KN, Turner K, Nevison CM, Bristow M, Timmis MA
The Development of Emotional Interactions Across the Senses:
Experimental Design in Functional Neuroimaging
Detection of Human Simultaneity Thresholds Using Cross-Modal Stimuli
Multisensory Perception and Biological Motion
Kinetic Depth Cues (Optical Expansion)
Multisensory integration: perceptual grouping by eye and ear
Multisensory Integration and Attention in Developmental Dyslexia
Reminders: Exam 2 DUE THURSDAY 11:59 P.M.!
Dogs' Gaze Following Is Tuned to Human Communicative Signals
Presentation transcript:

Matching pictures with the appropriate sound: results from an eye-tracking study of dogs and 14-month-old infants Anna Gergely 1* A. Hernádi 2, E. Petró 1, B. Miklósi 1, Á. Miklósi 1, J. Topál 2 1 Department of Ethology, Eötvös Loránd University, Budapest 2 Institute of Cognitive Neuroscience and Psychology, Hung. Acad. Sci., Budapest

Domestic dogs (Canis familiaris) Promising candidate for modelling human social behaviour (Topál 2009) Communicative signs: pointing (eg. Miklósi et al 2000), gaze following (Téglás et al 2012) Domestication  selection

Eye-tracking with dogs 1999 (Dell’Osso et al): restrict dogs’ head movements 2010 (Mills et al): complex pre-training 2012 (Téglás et al): without any restriction, training

Cross-modal matching  Integration of information coming from several sensory modalities is crucial for communication and individual recognition in many species (Bovet & Deputte 2009)  Auditory-visual intermodal matching -Humans: communication, categorical discrimination

Aim & Questions 2. Do dogs and human infants show more attention and preference towards pictures of conspecifics? Simple picture-sound matching abilities: human & dog portraits bark & human voice 1. Do (a) dogs and (b) 14-months old infants show sound-image matching (gazing more at dog pic. the ‘barking’ condition and more at human portrait in the ‘human voice’ condition)?

Methods 1. Calibration Subjects 27 adult pet dogs, months old infants 2. Test trial

Data analysis Variables 1, Cumulative Accurancy: total looking time (milisecundum) in each AOI 2, First look: first registrated looking data in AOI, difference score: number of first look at one of the AOIs/ 2 Areas of interests (AOI) Congruent area Incongruent area Dog Human

Results – Dogs Cummulative accurancy Wilcoxon Matched pairs test Ns p>0.05 * p<0.05 N=27 Df=25 Looking time median ± SD (msec) ns * PreferenceMatching

Results – Dogs First look Wilcoxon Matched pairs test Ns p>0.05 * p<0.05 N=27 Df=25 Difference score * ns PreferenceMatching

Results – Infants Cummulative accurancy Paired t- test ** p<0.01 * p<0.05 N=17 Df=16 *** Looking time mean ± SE (msec) PreferenceMatching

Results – Infants First look * ns Difference score Wilcoxon Matched pairs test Ns p>0.05 * p<0.05 N=17 Df=15 PreferenceMatching

 Dogs show sophisticated ability to match auditory and visual stimuli ‘Matching ability’ Conclusions  Infants also showed some evidence of matching

Conclusions  Unlike dogs, infants showed a striking preference for dog image ‘Spontaneous preference’  novelty/attractivity effect; the ‘novelty value’ and/or the attractivity of an unfamiliar dog image may be higher than that of the unfamiliar human.

Thank you for your attention! This research is supported by SNFS Sinergia project “Swarmix” (CRSI )