How many senses do we have? An introduction to multimodality Alistair D N Edwards Department of Computer Science http://www-users.cs.york.ac.uk/~alistair/
How many senses do we have?
Five
‘Extra’ senses 1 Pain 2 Balance 3 Time 4 Temperature 5 Digestion http://www.bbc.co.uk/radio4/science/extrasenses.shtml 1 Pain 2 Balance 3 Time 4 Temperature 5 Digestion
Previous answers 18 Pressure 19 Empathy 20 Fear 21 Tiredness 22 Thirst 1 Sight 2 Smell 3 Taste 4 Hearing 5 Touch 6 Balance 7 Direction 8 Humour 9 Body position 10 Heat 11 Danger 12 Circadian Rhythms 13 Hunger 14 Bodily needs 15 Time 16 Pain 17 Fatigue 18 Pressure 19 Empathy 20 Fear 21 Tiredness 22 Thirst 23 Satiation
What is a sense?
What modes do we use in interaction? Which others could we use? Objectives What modes do we use in interaction? Which others could we use? Why? How?
Some practical(?) possibilities Sounds Haptics Smell
Sounds Speech Non-speech synthesized earcons auditory icons sonification data mapping audification programs
Sounds Why do we not make more use of sounds in interfaces?
Haptics - definitions http://www.dcs.gla.ac.uk/~stephen/papers/CHI2000.pdf Term Definition Proprioceptive Relating to sensory information about the state of the body (including cutaneous, kinesthetic, and vestibular sensations). Haptic Relating to the sense of touch. Vestibular Pertaining to the perception of head position, acceleration, and deceleration Kinesthetic Meaning the feeling of motion. Relating to sensations originating in muscles, tendons and joints Cutaneous Pertaining to the skin itself or the skin as a sense organ. Includes sensation of pressure, temperature, and pain. Tactile Pertaining to the cutaneous sense but more specifically the sensation of pressure rather than temperature or pain. Force Feedback Relating to the mechanical production of information sensed by the human kinesthetic system.
Sensable Phantom Omni http://www.sensable.com/
Tactile images
Tactile images
Features of tactile images Easy to produce Hard to design Inexpensive Static Mixed tactile/visual suitable for partially sighted people Relatively
Combining senses? Tactile Auditory speech non-speech Rotation Haptic?
Trisenx Scent Dome http://www.trisenx.com/
DigiScents iSmell http://www.complex.com/tech/2011/04/the-50-worst-fails-in-tech-history/digiscents-ismell
Digiscents …folded in April 2001
smells Why do we not make more use of smells in interfaces?
Conclusions Why do we not make more use of other senses/channels/modes in interaction? Which ones could we practically use more? What would be the benefits?