Effects of Sound and Visual Congruency on Product Selection and Preference Brock Bass Felipe Fernandez Drew Link Andrew Schmitz.

Slides:



Advertisements
Similar presentations
Introduction to Eye Tracking
Advertisements

Visual speech speeds up the neural processing of auditory speech van Wassenhove, V., Grant, K. W., & Poeppel, D. (2005) Proceedings of the National Academy.
Eye Movements of Younger and Older Drivers Professor: Liu Student: Ruby.
Background POP displays are critical because 68% of all buying decisions are made with no prior planning (Stahlberg & Maila, 2010). Effective POP displays.
Experimental Psychology PSY 433 Chapter 7 Perception (Cont.)
Bilateral Attentional Advantage in Gabor Detection Nestor Matthews & Jenna Kelly Department of Psychology, Denison University, Granville OH USA In.
LOGO Effects of scene inversion on change detection of targets matched for visual salience Professor: Liu Student: Ruby.
Influence of Detailed Photographs of Product on Customer’s Purchase Decision Sanjay Kumar Ranganayakulu Nikhil Bendre Shaunak Natu.
A.Diederich – International University Bremen – USC – MMM – Spring 2005 Rhythm and timing  Clarke, E.F. Rhythm and timing in music. In Deutsch, D. Chapter.
The Use of Eye Tracking Technology in the Evaluation of e-Learning: A Feasibility Study Dr Peter Eachus University of Salford.
Memory Span A Comparison Between Major Types Amy Bender, Jeremy Owens, and Jared Smith Hanover College 2007.
Visually-induced auditory spatial adaptation in monkeys and humans Norbert Kopčo, I-Fan Lin, Barbara Shinn-Cunningham, Jennifer Groh Center for Cognitive.
Interactions between Stimulus- Specific Adaptation and Visual Auditory Integration in the Forebrain of the Barn Owl Amit Reches, Shai Netser, and Yoram.
Business Minor grade adjustments on Midterm 2 Opportunity to participate in Cognitive Neuroscience and Perception experiment - sign up for Tuesday, Wednesday.
Enhanced Rendering of Fluid Field Data Using Sonification and Visualization Maryia Kazakevich May 10, 2007.
Vision Computing An Introduction. Visual Perception Sight is our most impressive sense. It gives us, without conscious effort, detailed information about.
The Effects of Increased Cognitive Demands on the Written Discourse Ability of Young Adolescents Ashleigh Elaine Zumwalt Eastern Illinois University.
Visually-induced auditory spatial adaptation in monkeys and humans Norbert Kopčo, I-Fan Lin, Barbara Shinn-Cunningham, Jennifer Groh Center for Cognitive.
Audiovisual Multisensory Facilitation: A Fresh Look at Neural Coactivation and Inverse Effectiveness. Lynnette Leone North Dakota State University.
Modules 11, 15 & 16 A.P. Psychology: Sensation & Perception.
Evaluating Eye Movement Differences when Processing Subtitles Andrew T. Duchowski COMPUTER SCIENCE CLEMSON UNIVERSITY Abstract Our experimental.
Change blindness and time to consciousness Professor: Liu Student: Ruby.
Cognitive demands of hands-free- phone conversation while driving Professor : Liu Student: Ruby.
Final Study Guide Research Design. Experimental Research.
Negative Priming Vision vs. Audition Although there have been many studies examining the negative priming phenomenon, virtually all of the existing studies.
Hao Wu Nov Outline Introduction Related Work Experiment Methods Results Conclusions & Next Steps.
Instrument One instructional (INS) slide and three masking (MSK) slides provided directions for 4 test slides that each contained 3 lists of 3 color words.
SIGNAL DETECTION IN FIXED PATTERN CHROMATIC NOISE 1 A. J. Ahumada, Jr., 2 W. K. Krebs 1 NASA Ames Research Center; 2 Naval Postgraduate School, Monterey,
CIALDINI, R., et al Culture and Compliance. Personality and Social Psychology Bulletin 125, 1242–1253. KAHNEMAN, D. AND TVERSKY, A Prospect.
Chapter 5 – Sensation & Perception Sensation = reception of stimuli Perception = interpretation of those stimuli.
Consumer Purchasing Based on Packaging Structural Design/Product Visual Display in a Retail Environnent Pham, Thackston, Galvarino, Ouzts.
Presenter: Lung-Hao Lee Nov. 3, Room 310.  Introduction  Related Work  Methods  Results ◦ General Gaze Distribution on SERPs ◦ Effects of Task.
Eye Tracking In Evaluating The Effectiveness OF Ads Guide : Dr. Andrew T. Duchowski.
Neural Basis of the Ventriloquist Illusion Bonath, Noesselt, Martinez, Mishra, Schwiecker, Heinze, and Hillyard.
Multisensory processing: an introduction
Acknowledgments We thank Dr. Yu, Dr. Bateman, and Professor Szabo for allowing us to conduct this study during their class time. We especially thank the.
An Analysis of Advertisement Perception through Eye Tracking William A. Hill Physics Youngstown State University Zach C. Joyce Computer.
The Role of Multisensory Information in Infant Attention to Faces of Speakers Versus the Rhythm of Speech Lorraine E. Bahrick, Mariana Vaillant-Molina,
Tonal Violations Interact with Lexical Processing: Evidence from Cross-modal Priming Meagan E. Curtis 1 and Jamshed J. Bharucha 2 1 Dept. of Psych. & Brain.
Introduction Ruth Adam & Uta Noppeney Max Planck Institute for Biological Cybernetics, Tübingen Scientific Aim Experimental.
Intersensory Redundancy Facilitates Infants’ Perception of Meaning in Speech Passages Irina Castellanos, Melissa Shuman, and Lorraine E. Bahrick Florida.
ANT Z=52 R ACUE - PASSIVE VCUE - PASSIVE 1300 msVoltageCSD.31uV.03uV/cm 2 AIM We investigate the mechanisms of this hypothesized switch-ERP.
FMRI and Behavioral Studies of Human Face Perception Ronnie Bryan Vision Lab
A Comparison of Methods for Estimating the Capacity of Visual Working Memory: Examination of Encoding Limitations Domagoj Švegar & Dražen Domijan
What you see is what you get? Heather Johnston March 24, 2005.
Research Paper: The role of sensory processing in word learning in children at risk of autism By Tatjana Zeljic, MSc Ed. Neuroscience.
Compassion Meditation vs. Mindfulness Meditation: Effect on Attitude and Disposition By Graham Maione Advisor: Dr. Paul Bueno de Mesquita.
Poster presented at APS 2014 Abstract This study was conducted to determine if explaining criminal behavior influences later identification. Schooler and.
Examining the Conspicuity of Infra-Red Markers For Use With 2-D Eye Tracking Abstract Physical infra-red (IR) markers are sometimes used to help aggregate.
Methods Identifying the Costs of Auditory Dominance on Visual Processing: An Eye Tracking Study Wesley R. Barnhart, Samuel Rivera, & Christopher W. Robinson.
Melanie Boysen & Gwendolyn Walton
Development of Audiovisual Integration in Central and Peripheral Vision Yi-Chuan Chen, Terri L. Lewis, David I. Shore, and Daphne Maurer Department.
Christian Christopherson and Michael J. Crowley
CS-411 : Digital Education & Learning Analytics
From: Cross-modal attention influences auditory contrast sensitivity: Decreasing visual load improves auditory thresholds for amplitude- and frequency-modulated.
Which of these is “a boy”?
The Effects of Musical Mood and Musical Arousal on Visual Attention
Impacts of workload on trust in imperfect automated systems
The involvement of visual and verbal representations in a quantitative and a qualitative visual change detection task. Laura Jenkins, and Dr Colin Hamilton.
Psychology 3450W: Experimental Psychology
The Development of Emotional Interactions Across the Senses:
Experimental Psychology PSY 433
Sarah K. Arboleda and Jaclyn E. Reagan
Michael S Beauchamp, Kathryn E Lee, Brenna D Argall, Alex Martin 
Multisensory Perception and Biological Motion
Michael S Beauchamp, Kathryn E Lee, Brenna D Argall, Alex Martin 
Learning Letters in Adulthood
Jennifer K. Bizley, Ross K. Maddox, Adrian K.C. Lee 
Volume 22, Issue 5, Pages (March 2012)
Presentation transcript:

Effects of Sound and Visual Congruency on Product Selection and Preference Brock Bass Felipe Fernandez Drew Link Andrew Schmitz

Introduction Watched a hypnotist named Michael C. Anthony. The hypnotized participants would do some funny and crazy things once they heard a snap of a finger.

Questions Can ‘sound’ really have an influence on people? Can sounds associated with an image have an effect on products selection? Will eye tracking help us find a connection?

Background Cross-modality examined from general to specific: –Visual and auditory stimuli General categories –Spatial and temporal proximity Physical manipulations –Natural sounds and contextual congruent imagery Conceptual manipulations

Visual and auditory stimuli –Congruence between auditory pitch and visual position Higher pitch = detection/location of higher items Lower pitch = detection/location of lower items Higher pitch = selection of lighter contrast item Lower pitch = selection of darker contrast item Background

Visual and auditory stimuli –Visual stimuli size, position, and spatial frequency interact with auditory pitch (Evans & Triesman, 2010) –Complex relationship between auditory stimuli and visual stimuli Processing and selection of visual stimuli Background

Spatial and temporal proximity –Close spatial proximity between auditory/visual stimuli resulted in better detection (Frassinetti, Bolognini, & Ladavas, 2002) –Close temporal proximity (simultaneous noise bursts) resulted in better detection –Neural patterns differed in spatially congruent versus spatially incongruent conditions Background

Natural sounds and contextually congruent imagery –Differs in respect to pure tones used in other studies –Potential effect of natural sounds Complex/dynamic sounds create neurological activity Novel research area with many questions to answer Background

Hypotheses H 1 –When a natural auditory stimulus is presented along with a series of visual stimuli, fixations will increase on the target object of highest congruence H 2 –When a natural auditory stimulus is presented along with a series of visual stimuli, more selections of the object of highest congruence will be made

Methods

Apparatus CUshop Tobii Glasses Recording Assistant Infrared (IR) Markers Tobii Studio Software Audio playback

Metrics AOIs are absolutely crucial –No AOIs = No data Data extraction process –Fill in demographics, trial, & selections –Mark AOIs –Tell Tobii the metrics to measure –Hit Go! Metrics we used –Fixation Duration (per fixation & per participant) –Visit Duration (per fixation & per participant) –Selection congruency

Participants 31 participants (18 female, 13 male) –Age –Recruited via verbal recruiting and SONA –Two participants dropped due to calibration issues –Random assignment to three conditions

Design One-way ANOVA –IV = Sound (No sound, Incongruent Sound, Congruent Sound) –DVs = eye tracking data, product selection Chi-square analysis for discrete target selection DV

Experimental setup CUShop –Shelf stocked with products LG Soundbar for ambient sound stimuli –Hidden from view

48 in 3.5 x 2.5 in Sound bar 70 dB Soap boxes (center box is target)

48 in

Procedure 1.Introduction 2.Calibration 3.Shopping 1.Shopping list randomized 4.Survey 1.Demographic info

Results

No effect of sound on total fixation duration on target F(1,30) = 0.49, p =.67)

No effect of sound on total AOI visit duration on target (F(1,30) =.46, p =.63).

No effect of sound on target selection χ2(1, N = 30) = 3.76, p =.15

Discussion

Results were not significant, why? –Auditory stimuli (ocean and city) may have been too similar –Spatial proximity of auditory stimulus Less directional than other studies –Temporal proximity of auditory stimulus Continuous rather than short noise burst

Discussion

There may be a significant behavioral result (selection) Larger sample size needed Perhaps a person can fixate equally on stimuli, but be more likely to choose the congruent visual/auditory combo Discussion

Conclusion Lack of findings –Possibly due to sample size –Location of sound –Lack of manipulation check (did the participants notice the sound?) Future studies –Potential for meaningful findings, especially behaviorally

References Evans, K. K., and Treisman, A. Natural cross-modal mappings between visual and auditory features. Journal of Vision, 10, 1, 6 (2010), Frassinetti, F., Bolognini, N., & Ladavas, E. Enhancement of visual perception by crossmodal visuo-auditory interaction. Experimental Brain Research, 147, 3 (2002), Teder-Salejarvi, W. A., Di Russo, F., McDonald, J. J., and Hillyard, S. A. Effects of spatial congruity on audio-visual multimodal integration. Journal of Cognitive Neuroscience, 17, 9 (2006), Tiippana, K., Andersen, T. S., and Sams, M. Visual attention modulates audiovisual speech perception. European Journal of Cognitive Psychology, 16, 3 (2004),