Feel of Seeing. Feel of Hearing What is the quality of sensory experience? J Kevin ORegan Laboratoire Psychologie de la Perception Centre National de.

Slides:



Advertisements
Similar presentations
Human-Computer Interaction
Advertisements

Presenter Name(s) Issue date National Student.
Cognitive Computing 2012 Embodiment and Enactivism A SENSORIMOTOR ACCOUNT OF VISUAL CONSCIOUSNESS (OREGAN & NOE) Professor Mark Bishop - Images from J.
Operationalising what? Liz Irvine, University of Edinburgh, 1. The Problem What are reports and behaviours operationalisations of?
When Media Aren’t Media: The Concept of (Tele)presence Matthew Lombard Temple University BTMM 3446/8446 March 2, 2010.
PowerPoint® Presentation by Jim Foley © 2013 Worth Publishers The Biology of Mind.
Introduction to Psychology Suzy Scherf Lecture 8: How Do We Know? Sensation and Perception Early Memory.
Sensation Overview How is perception different from sensation? What is psychophysics? What do sense organs do? How does vision work? How does this compare.
Sensation and Perception
Sensation & Perception. Sensation vs Perception  Sensation – detecting physical energy from the environment and encoding it as neural signals.  Perception.
Sebastian Bitzer Seminar Neurophysiological Foundations of Consciousness University of Osnabrueck A sensorimotor.
Changing qualia, acquiring new qualia Class 4 Changing qaulia between sight and sound Re-wired ferret Soundscape New qualia – magnetic north.
Learning Sensorimotor Contingencies James J. Clark Centre for Intelligent Machines McGill University.
Mind, Brain & Behavior Wednesday February 5, 2003.
Embodied Cognition and Consciousness: A Bestiary Dr. Andrew Bailey Philosophy Department University of Guelph Guelph, Ontario N1G 2W1, Canada
Sensation & Perception
The Proximal Sense By Max Drodofsky. What is Proximity?  In order to know and understand the proximal sense, you should know what Proximity is.  Proximity.
Sensation and Perception Chapter 4
Five Senses? There are other senses of which we are unaware or are physiologically separate from the classic senses: Kinesthetic senses (motor sense) Proprioception.
Sensation and Perception Sensation: your window to the world Perception: interpreting what comes in your window.
Area of Study #2 Visual Perception
Myers EXPLORING PSYCHOLOGY Module 14 Introduction to Sensation and Perception: Vision James A. McCubbin, PhD Clemson University Worth Publishers.
Chapter 5 Sensation — the window on the world How does the world out there get in?
BRS 214 Introduction to Psychology Sensation & Perception Ms. Dawn Stewart BSC, MPA, PHD.
.  Sensation: process by which our sensory receptors and nervous system receive and represent stimulus energy  Perception: process of organizing and.
Sensory modalities Different approaches. O’Regan, J. K., Noe, A., A sensorimotor account of vision and visual consciousness Behavioral and Brain sciences.
If I were to touch the part of your brain that usually processes sound –would you 'hear' my hand? or –would you ‘feel’ my hand? In other words, Is the.
Jayme Shadowens.  Senses = filters  Process incoming information  Physical stimulation into neural impulses that give us sensations  Sensation: the.
Sensation and Perception Sensation: your window to the world Perception: interpreting what comes in your window.
Light enters through the pupil, and reaches the lens, which focuses light on the retina. The retina contains light sensitive cells called cones and rods.
CB during flicker (Rensink, O’Regan & Clark, 1997; 2000)
Sensation and Perception: Hearing. Sound Sound comes in waves. The waves are produced by vibration. Sound is vibration Ex. Clap your hands causes the.
Cognitive ability: Challenge: How to recognize objects in a scene; where are the object’s boundaries? This problem is known as ‘image segmentation’ in.
Virtual University - Human Computer Interaction 1 © Imran Hussain | UMT Imran Hussain University of Management and Technology (UMT) Lecture 7 Human Input-Output.
SENSATION AND PERCEPTION KEY POINTS Distinguish between sensation and perception Psychophysics: absolute threshold and difference threshold Identify.
Sensory Systems Lesson 14. Sensory Information n Detection of changes in environment l external or internal n 4 main functions l perception l control.
Psych 101 Chapter 41 What’s that smell? Do you hear that noise? Taste this! Look at me! Feel this, isn’t it soft? We use these phrases because of our.
Step Up To: Psychology by John J. Schulte, Psy.D. From Myers, Psychology 8e Worth Publishers.
Unit 4: Sensation, Perception and States of Consciousness
Chapter 13 Senses.
Seeing is a SKILL Exercising the sensorimotor contingencies.
Sensation & Perception What is the difference?. Sensation Detection of physical energy emitted or reflected by physical objects Sense organs –eyes, ears,
Why do we think we see “everything”? Immediate availability at flick of eye/attention The “world as an outside memory”(O’Regan, 1992) refrigerator light.
Psy 4200: Physiological Psychology Read the syllabus! (this is just a summary) Pre-requisites Psych 4000 (Statistics) and Psych 4050 (Research Methods)
Introduction to Sensation: EQ: How do our sensory systems function and how do they allow us to interact with the world around us?
The Process of Forming Perceptions SHMD219. Perception The ability to see, hear, or become aware of something through the senses. Perception is a series.
Sensation and Perception. Transformation of stimulus energy into a meaningful understanding –Each sense converts energy into awareness.
Sensation & Perception Chapter 5. Sensation & Perception The “five” senses: – sight, hearing taste, smell, touch, vestibular & kinesthetic Sensory organs.
1 Computational Vision CSCI 363, Fall 2012 Lecture 32 Biological Heading, Color.
Unit 4: Sensation & Perception
Start with the Holy name of Almighty ALLAH. Human Input Output Channels
Basic Principles of Sensation and Perception
SENSATION The basics, vision, and hearing, and the other senses.
Sensation and Perception
Sensation and Perception Unit 7
Unit 4: Sensation and Perception
Transduction Transformation of stimulus energies to electrochemical energy of neural impulses Sensory receptors are responsible for transduction Rods and.
INPUT-OUTPUT CHANNELS
Chapter 6 Sensation and Perception
Review Session 3: Sensation and Perception
October 27, 2013 Eq- How is information from our sensory organs processed by the brain? Standard- BF 2 Table of Contents: 42. The 7 senses 43. Chapter.
Sensorimotor Learning and the Development of Position Invariance
The Senses Psychology.
Sensory Systems Lecture 12.
Olaf Blanke, Mel Slater, Andrea Serino  Neuron 
AP Psychology Sept. 28th Objective Opener
Chapter Four Sensation
Sensation and Perception
Learning Sensorimotor Contingencies
Sensation and Perception
Presentation transcript:

Feel of Seeing

Feel of Hearing

What is the quality of sensory experience? J Kevin ORegan Laboratoire Psychologie de la Perception Centre National de la Recherche Scientifique & Université René Descartes - Paris 5

No Feel

Quality of sensory modalities Old view: –Müllers specific nerve energy New view: –Cortical maps, neural pathways

Brain creates experience standard view Explanatory gap!

Sensorimotor approach to sensory experience (ORegan & Noë, Behavioral and Brain Sciences, 2001)

No more explanatory gap! Sensation = exercising a skill

Sensation Accessing knowledge that you are currently exercising a certain sensorimotor skill. Quality of sensation: laws of sensorimotor contingency

The laws governing how what you do affects sensory input Sensorimotor Contingencies (D. M. MacKay, 1956)

Seeing

Red is the way red things change the light (Broackes, 1992)

Seeing Red knowing that sensorimotor contingencies typical of red are currently being obeyed.

Biological reflection properties for a biological organism reflection properties are constraints over sensory inputs set of reflection properties is finite dimensional finite number of singular reflection properties R LMS i LMS r

Universal color categories World color survey: Berlin & Kay (1969)

D. Philipona & J K ORegan, 2006

Unique hues D. Philipona & J K ORegan, 2006

Hue Cancellation 3D Wandell D. Philipona & J K ORegan, 2006

Red is the way red things change the light (Broackes, 1992)

Aline Bompas with split-field glasses

Forced choice more yellow-ish more blue-ish Bompas & ORegan, 2005, 2006

Seeing

Seeing is making an internal representation Seeing is visually manipulating standard viewnew view

The impression of seeing everything richness not in the head have algorithms to access information you see what you visually manipulate world as outside memory (ORegan, 1992; cf. also Minsky, 1988; R. Brooks, 1991)

Refrigerator light analogy (N. Thomas)

CB during Mudsplashes (ORegan, Rensink & Clark, 1999)

Reimer & Simons, 2001; Auvray & ORegan, 2004

Flicker –Rensink, ORegan & Clark,1997; 1999 Eye saccades –Currie, McConkie, Carlson-Radvansky & Irwin, 1995; McConkie & Currie, 1996 Blinks –ORegan, Deubel, Clark, Rensink, 1999 Film cuts, real life –Levin & Simons, 1997 Mudsplashes –ORegan, Rensink & Clark (Nature, 1999) Change Blindness

Inattentional blindness –Neisser –Mack & Rock –D. Simons

Sensation = exercising a skill

Sensation Accessing knowledge that you are currently exercising a certain sensorimotor skill. Quality of sensation: laws of sensorimotor contingency

big change expanding flow shifting flow nothing big change no change increasing amplitude asynchrony big change nothing blink: move forward: turn sideways: cover ears: cover eyes: SEEING HEARING Examples of sensorimotor contingencies

Tactile Visual Sensory Substitution Bach y Rita (1972; 1984)

Tongue Display Unit Sampaio, E., S. Maris., and P. Bach-y-Rita Brain plasticity: 'Visual' acuity of blind persons via the tongue. Brain Research 908(July 13):204.

Sensory Substitution rewired ferrets (Sharma, Angelucci & Sur, 2000; Melchner, Pallas & Sur, 2000) Phantom limbs TVSS (Bach y Rita, 1972, 1984) substitution of vision through sound embodiment in virtual reality –Murray & Sixsmith (1999); Heim (1995)

testing P. Meijers The vOICe Auvray & ORegan, in press

Sensation = exercising a skill

Rubber arm experiment of Botvinick & Cohen, 1998

Hand-image matching

Experiment 2 Responses: picture-matching (shoes) and foot-localisation

Stimuli: the little feet

Sensation = exercising a skill

Each eye is constitued of a retina made of randomly distributed omnidirectional photosensitive cells, and a diaphragm Each joint can freely rotate (rotule) Each segment can stretch (piston) Each light can freely move in 3D space Space from sensorimotor contingencies Philipona, O'Regan & Nadal, Neural Computation, Philipona, O'Regan, Nadal & Coenen, NIPS, 2003.

Philipona, O Regan & Nadal, Neural Computation 2003

Aerial Snapshot Agent Uncalibrated camera, effectors

Aerial Snapshot Agent –Make linear predictors –Study commutativity –Determine basis of translations and rotations

Aerial Snapshot Agent Sensorimotor embedding Self insertion Similarity (proximity) judgments

Aerial Snapshot Agent Isomap with K=4,5,6,7Sensorimotor embedding Philipona, Glanois & ORegan, under review

Summary New view on what sensory experience is Predictions about –Color –Sensory substitution –Body sense Robotic applications –Color –Space –Dimension reduction Other work –Sensory feels vs mental feels –Pain –Consciousness

Philosophy –Erik Myin, Antwerp Psychology –Malika Auvray, Aline Bompas, Ed Cooke Robotics –David Philipona, Fred Glanois EU funding: CoSy Integrated project ENACTIVE Network of excellence