Charles Spence Department of Experimental Psychology, Oxford University New Perspectives from the Human Sciences Consumer Focus Workshop (November, 2001)

Slides:



Advertisements
Similar presentations
Wednesday, 25 th May, pm University of Lancaster Fylde College Lecture Theatre 1 Crossmodal correspondences: Looking for links between sound.
Advertisements

The Perception of Speech. Speech is for rapid communication Speech is composed of units of sound called phonemes –examples of phonemes: /ba/ in bat, /pa/
Perceptual Processes: Attention & Consciousness Dr. Claudia J. Stanny EXP 4507 Memory & Cognition Spring 2009.
Chapter 3 Attention and Performance
Neurological Disorders Lesson 1.4
PERCEPTION The organization and interpretation of our senses.
The Perception of Speech. Speech is for rapid communication Speech is composed of units of sound called phonemes –examples of phonemes: /ba/ in bat, /pa/
Read this article for next week: A Neural Basis for Visual Search in Inferior Temporal Cortex Leonardo Chelazzi et al. (1993) Nature.
Attention I Attention Wolfe et al Ch 7. Dana said that most vision is agenda-driven. He introduced the slide where the people attended to the many weird.
Read this article for Wednesday: A Neural Basis for Visual Search in Inferior Temporal Cortex Leonardo Chelazzi et al. (1993) Nature.
Chapter 2 Perception.
Organizational Notes no study guide no review session not sufficient to just read book and glance at lecture material midterm/final is considered hard.
Theoretical Models of Attention. Broadbent (1958) conceptualized attention as information processing Used a cuing paradigm to show that attentional selection.
What is Cognitive Science? … is the interdisciplinary study of mind and intelligence, embracing philosophy, psychology, artificial intelligence, neuroscience,
Theoretical Models of Attention. Broadbent (1958) conceptualized attention as information processing Used a cuing paradigm to show that attentional selection.
Mind, Brain & Behavior Wednesday February 5, 2003.
Mind, Brain & Behavior Friday February 7, From Nerve Cells to Cognition (Cont.) Chapter 18.
Multimodality Alistair D N Edwards Department of Computer Science
Audiovisual Multisensory Facilitation: A Fresh Look at Neural Coactivation and Inverse Effectiveness. Lynnette Leone North Dakota State University.
T HE VISUAL INTERFACE Human Visual Perception Includes material from Dix et al, 2006, Human Computer Interaction, Chapter 1 1.
SENSATION AND PERCEPTION. DEFINITIONS  Sensation: the process in which our sensory receptors and nervous system receive and represent stimulus energies.
Modules 11, 15 & 16 A.P. Psychology: Sensation & Perception.
Human Perception, Cognition and Action
The role of auditory-visual integration in object recognition Clara Suied 1, Nicolas Bonneel 2 and Isabelle Viaud-Delmon 1 1 CNRS – UPMC UMR 7593 Hôpital.
Copyright 2006 John Wiley & Sons, Inc Chapter 4 – Physical Engineering HCI: Developing Effective Organizational Systems Dov Te’eni Jane Carey Ping Zhang.
Course Overview Syllabus Schedule of Topics Topic Pages –Reading Assignments –Discussion Questions –Additional Sources Exams – 100 points each Quizzes.
Touch: 1. State the purpose of pain, and describe the biopsychosocial approach to pain. 2. Describe the sense of taste, and explain the principle of sensory.
UNIT 4: SENSATION & PERCEPTION Module 12. Sensation & Perception Sensation: the process by which you detect physical energy from your environment and.
Vision Hearing Other Senses Perception 1 Perception 2.
Chapter 20: Perceptual Motor Development PED 383: Adapted Physical Education Dr. Johnson.
Perception Review Kimberley Clow
Localization of Auditory Stimulus in the Presence of an Auditory Cue By Albert Ler.
Fundamentals of Sensation and Perception ERIK CHEVRIER SEPTEMBER 9 TH, 2015.
Lecture 4 – Attention 1 Three questions: What is attention? Are there different types of attention? What can we do with attention that we cannot do without.
Introduction to Sensation and Perception
Sensory Integration Dysfunction Mazyad Alotaibi. Sensory Integration: The Theory Ayres (1972) hypothesized that… – “learning is a function of the brain.
Users’ Quality Ratings of Handheld devices: Supervisor: Dr. Gary Burnett Student: Hsin-Wei Chen Investigating the Most Important Sense among Vision, Hearing.
Multisensory processing: an introduction
Evaluating Perceptual Cue Reliabilities Robert Jacobs Department of Brain and Cognitive Sciences University of Rochester.
1 ISE 412 ATTENTION!!! From page 147 of Wickens et al. ATTENTION RESOURCES.
Myers PSYCHOLOGY Seventh Edition in Modules
Multimodal Virtual Environments: Response Times, Attention, and Presence B 陳柏叡.
Orienting Attention to Semantic Categories T Cristescu, JT Devlin, AC Nobre Dept. Experimental Psychology and FMRIB Centre, University of Oxford, Oxford,
Multimodal Perception
Seeinghearing speakingthinking PET Scans. Frontal Temporal Parietal Occipital Cerebellum The Boundaries of the Lobes.
Perceptual organization How do we form meaningful perceptions from sensory information?
Sensation & Perception Chapter 5. Sensation & Perception The “five” senses: – sight, hearing taste, smell, touch, vestibular & kinesthetic Sensory organs.
Methods Identifying the Costs of Auditory Dominance on Visual Processing: An Eye Tracking Study Wesley R. Barnhart, Samuel Rivera, & Christopher W. Robinson.
Perception and Attention Advanced Cognitive Psychology PSY 421, Fall 2004.
Sensation –Thresholds –Vision –Hearing –Other senses Perception –Selective attention –Illusions –Organization –Interpretation –ESP.
Connecting Sound with the Mind’s Eye: Multisensory Interactions in Music Conductors W. David Hairston, Ph.D Advanced Neuroscience Imaging Research Lab.
Multimodal and Natural computer interaction Evelina Stanevičienė.
SENSATION The basics, vision, and hearing, and the other senses.
Review: Introduction.
Senses Chapter 29.
SENSATION AND PERCEPTION
How do we realize design? What should we consider? Technical Visual Interaction Search Context of use Information Interacting/ transacting.
How do organisms receive and respond to information from their environment? Yesterday and today you worked with your partners on stations that tested your.
Multisensory perception: Beyond modularity and convergence
Cognitive Brain Dynamics Lab
Multimodal Human-Computer Interaction New Interaction Techniques 22. 1
SENSATION AND PERCEPTION
SENSATION AND PERCEPTION
Introduction to Sensation and Perception
SENSATION AND PERCEPTION
How consumers see the world and themselves
Psychology “the science of mind and behaviour”
Multisensory Integration: Maintaining the Perception of Synchrony
SENSATION AND PERCEPTION Sunday, June 02,
Sensation.
Presentation transcript:

Charles Spence Department of Experimental Psychology, Oxford University New Perspectives from the Human Sciences Consumer Focus Workshop (November, 2001)

The Execution of Lady Jane Grey

We are aware of only a small amount of the sensory information available at any one time For example…...

Do people detect changes in ‘real- world’ interactions? Implications for: - eye-witness testimony - head-up displays in cars & planes

Wickens (1980, 1984, 1988, ) Structure of human processing resources

Same-Side Condition Different-Sides Condition Relevant Visual Irrelevant AuditoryRelevant Auditory Irrelevant Visual Relevant Visual Relevant AuditoryIrrelevant Auditory Irrelevant Visual

Shadowing Performance 1) Lip-reading facilitates shadowing 2) Better performance when auditory & visual information from same location Same Side Different Sides 1) 2) % Correct

Don’t Dial & Drive?

Spence & Reid (2000)

Ergonomics: Design based on Human Capabilities- Multisensory Warning Signals

In the Realm of the Senses

Interactions between smell & vision Speeded left/right response. Menthol to either nostril. Olfactory & visual stimuli from same locations. Cuing (80% valid, 20% invalid).

Spence, Kettenmann, Kobal, & McGlone (2000, 2001a, b) Attending to smell affects vision Implications for: advertising, alerting, & pain management Target Modality

Multisensory Perception Most products are multimodal: Skincare products have smell, colour, tactile qualities Foodstuffs: taste, colour, & smell It’s important to know what aspects of a product people attend to, to determine what they will perceive

Multisensory Perception The McGurk effect

Crossmodal Illusions - McGurk effect McGurk effect shows that what we see alters what we hear Manipulating information in one modality allows us to change perception in other modalities predictably

Vision can also dominate taste DuBose et al. (1980) Cherry-flavoured carbonated drinks perceived as ‘orange-flavoured’ when coloured orange

Sound dominates touch ‘Parchment Skin’ Illusion Jousmaki & Hari (1998) People estimated skin roughness & wetness, while rubbing hands together Sound presented over headphones, & frequency content manipulated Changing sound dramatically altered perception of skin roughness

Changing perception of skin through sound? Dry Hydrated ?

1) Selective use of subjects 2) Results rely on subjective report, & hence open to task demands Solution: Develop experimental paradigms that rely on more objective measures (eg psychophysics, neuroimaging) But, there are problems...

Changing perception of products through sound?

Superadditivity: Neurophysiology Stein & Meredith (1993)

Multisensory Integration “The integration of inputs from different sensory modalities not only transforms some of their individual characteristics, but does so in ways that can enhance the quality of life” “Integrated sensory inputs produce far richer experiences than would be predicted from their simple coexistence or the linear sum of their individual products” Stein & Meredith (1993)

Superadditivity: Taste & Smell (Dalton et al., 2000)

Cognitive Neuroscience Orbitofrontal Cortex (Reward) Neutral TouchPleasant Touch

Improving the quality of life for the physically challenged / brain damaged

Conclusions Attention & cognition critically determine perception & behavior A better understanding of multisensory interactions will enhance quality-of-life Converging methodologies approach provides powerful & increasingly subtle tools to understand both brain function & behavior (consumer science)