Haptics, Smell and Brain Interaction The Frontiers of HCI

Learning Outcomes Describe how haptics are used on Mobile devices Medical devices Research tools Describe the exploration of Olfactory detection and production Brain wave detection

The Human Perceptual System Physical Aspects of Perception Touch (tactile/cutaneous) Located in the skin, enables us to feel Texture Heat Pain Movement (kinesthetic/proprioceptive) The location of your body and its appendages The direction and speed of your movements

Physical Aspects of Perception Movement (kinesthetic/proprioceptive) We use the angles of our joints to determine the position of our limbs We determine movement by the rate of change in the position of those joints

Mobile devices Phone output Vibrate – silent alert. These can be used like earcons – different signals for different events Does your phone have different alerts? Can you tell the difference?

Mobile devices Phone input Touch screens See previous lecture Accelerometer - shaking actions Inconsistent interactions, high error rates Passive input Gps Altimeter Temperature Humidity

Using Haptics in Interaction Design ImmersiveTouch™

Using Haptics in Interaction Design Medical Uses surgeon controls ‘robot’ Surgeon’s view zoomed Small device reduces invasiveness ~~$2mill

Using Haptics in Interaction Design The GuideCane (Ulrich and Borenstein, 2001)

Using Haptics in Interaction Design The ActiveBelt (Tsukada and Yasumrua, 2004) Device architecture of ActiveBelt GPS, global positioning system; LED, light-emitting diode.

Using Haptics in Interaction Design Motor Disabilities HAL-5 (Hybrid Assistive Limb), CYBERDYNE Inc. www.cyberdyne.jp

Force Feedback Displays Manipulator Gloves CyberGlove II CyberGrasp CyberForce

Technical Issues Concerning Haptics Desktop Devices SensAble PHANTOM haptic devices PHANTOM Premium McSig – our work with visually impaired http://dl.acm.org.ezproxy.auckland.ac.nz/citation.cfm?id=1993060.1993067&coll=DL&dl=ACM&CFID=333467105&CFTOKEN=52399920

Technical Issues Concerning Haptics Desktop Devices Space Interface Device for Artificial Reality (SPIDAR) (Sato, 2002) SPIDAR-8. Rubik’s Cube SPIDAR-8. Finger attachments. PHANTOM Premium 1.5 & 1.5 high-force haptic device

Olfactory - Odour/ Smell Smell is essentially our ability to detect specific chemical particles in the air We can detect about 4000 different smells And the can be combined in millions different ways Smell is very deep in our animal brain

Technology of Odour Input Output Detecting particular chemicals is possible Drug/ explosive sniffers Detecting the range of smells in anything like human terms and extremely difficult task Output Manufacturing particular smells possible ‘fresh cookies’ Active generation of range of smells very difficult – too many chemicals and too supple differences

Smell – current research Not sure how many different smells can be generated. Check out the video Yongsoon Choi, Rahul Parsani, Xavier Roman, Anshul Vikram Pandey, and Adrian David Cheok. 2012. Sound perfume: building positive impression during face-to-face communication. In SIGGRAPH Asia 2012 Emerging Technologies (SA '12). ACM, New York, NY, USA, , Article 22 , 3 pages. DOI=10.1145/2407707.2407729 http://doi.acm.org.ezproxy.auckland.ac.nz/10.1145/2407707.2407729

Brain Computer Interact Detecting the brain waves and interpreting Inside the skull – accurate but invasive http://www.youtube.com/watch?v=ogBX18maUiM From outside the skull – not very accurate

Summary Describe how haptics are used on Describe the exploration of Mobile devices Output – vibrate Input accelerometers & gps Medical devices Keyhole surgery with remote tool guidance Research tools Haptic pen input and output devices – move in full 3D space Describe the exploration of Olfactory detection and production Detection of specific chemicals possible Production of a limited range of scents Brain wave detection Many new devices to gather brain activity from cap sensors, still fairly limited interaction