1. Feel of Seeing

2. Feel of Hearing

3. What is the quality of sensory experience? J Kevin ORegan Laboratoire Psychologie de la Perception Centre National de la Recherche Scientifique & Université René Descartes - Paris 5

4. No Feel

5. Quality of sensory modalities Old view: –Müllers specific nerve energy New view: –Cortical maps, neural pathways

6. Brain creates experience standard view Explanatory gap!

7. Sensorimotor approach to sensory experience (ORegan & Noë, Behavioral and Brain Sciences, 2001)

8. No more explanatory gap! Sensation = exercising a skill

9. Sensation Accessing knowledge that you are currently exercising a certain sensorimotor skill. Quality of sensation: laws of sensorimotor contingency

10. The laws governing how what you do affects sensory input Sensorimotor Contingencies (D. M. MacKay, 1956)

11. Seeing

12. Red is the way red things change the light (Broackes, 1992)

13. Seeing Red knowing that sensorimotor contingencies typical of red are currently being obeyed.

14. Biological reflection properties for a biological organism reflection properties are constraints over sensory inputs set of reflection properties is finite dimensional finite number of singular reflection properties R LMS i LMS r

15. Universal color categories World color survey: Berlin & Kay (1969)

16. D. Philipona & J K ORegan, 2006

17. Unique hues D. Philipona & J K ORegan, 2006

18. Hue Cancellation 3D Wandell D. Philipona & J K ORegan, 2006

19. Red is the way red things change the light (Broackes, 1992)

20. Aline Bompas with split-field glasses

21. Forced choice more yellow-ish more blue-ish Bompas & ORegan, 2005, 2006

22. Seeing

23. Seeing is making an internal representation Seeing is visually manipulating standard viewnew view

24. The impression of seeing everything richness not in the head have algorithms to access information you see what you visually manipulate world as outside memory (ORegan, 1992; cf. also Minsky, 1988; R. Brooks, 1991)

25. Refrigerator light analogy (N. Thomas)

31. CB during Mudsplashes (ORegan, Rensink & Clark, 1999)

38. Reimer & Simons, 2001; Auvray & ORegan, 2004

39. Flicker –Rensink, ORegan & Clark,1997; 1999 Eye saccades –Currie, McConkie, Carlson-Radvansky & Irwin, 1995; McConkie & Currie, 1996 Blinks –ORegan, Deubel, Clark, Rensink, 1999 Film cuts, real life –Levin & Simons, 1997 Mudsplashes –ORegan, Rensink & Clark (Nature, 1999) Change Blindness

41. Inattentional blindness –Neisser –Mack & Rock –D. Simons

42. Sensation = exercising a skill

43. Sensation Accessing knowledge that you are currently exercising a certain sensorimotor skill. Quality of sensation: laws of sensorimotor contingency

44. big change expanding flow shifting flow nothing big change no change increasing amplitude asynchrony big change nothing blink: move forward: turn sideways: cover ears: cover eyes: SEEING HEARING Examples of sensorimotor contingencies

45. Tactile Visual Sensory Substitution Bach y Rita (1972; 1984)

46. Tongue Display Unit Sampaio, E., S. Maris., and P. Bach-y-Rita. 2001 Brain plasticity: 'Visual' acuity of blind persons via the tongue. Brain Research 908(July 13):204.

47. Sensory Substitution rewired ferrets (Sharma, Angelucci & Sur, 2000; Melchner, Pallas & Sur, 2000) Phantom limbs TVSS (Bach y Rita, 1972, 1984) substitution of vision through sound embodiment in virtual reality –Murray & Sixsmith (1999); Heim (1995)

48. testing P. Meijers The vOICe Auvray & ORegan, in press

49. Sensation = exercising a skill

50. Rubber arm experiment of Botvinick & Cohen, 1998

52. Hand-image matching

53. Experiment 2 Responses: picture-matching (shoes) and foot-localisation

54. Stimuli: the little feet

55. Sensation = exercising a skill

59. Each eye is constitued of a retina made of randomly distributed omnidirectional photosensitive cells, and a diaphragm Each joint can freely rotate (rotule) Each segment can stretch (piston) Each light can freely move in 3D space Space from sensorimotor contingencies Philipona, O'Regan & Nadal, Neural Computation, 2003. Philipona, O'Regan, Nadal & Coenen, NIPS, 2003.

60. Philipona, O Regan & Nadal, Neural Computation 2003

61. Aerial Snapshot Agent Uncalibrated camera, effectors

62. Aerial Snapshot Agent –Make linear predictors –Study commutativity –Determine basis of translations and rotations

63. Aerial Snapshot Agent Sensorimotor embedding Self insertion Similarity (proximity) judgments

64. Aerial Snapshot Agent Isomap with K=4,5,6,7Sensorimotor embedding Philipona, Glanois & ORegan, under review

65. Summary New view on what sensory experience is Predictions about –Color –Sensory substitution –Body sense Robotic applications –Color –Space –Dimension reduction Other work –Sensory feels vs mental feels –Pain –Consciousness

66. http://nivea.psycho.univ-paris5.fr Philosophy –Erik Myin, Antwerp Psychology –Malika Auvray, Aline Bompas, Ed Cooke Robotics –David Philipona, Fred Glanois EU funding: CoSy Integrated project ENACTIVE Network of excellence