1 © NOKIA MIT Media Lab Europe PPT / / RTT S ensing M y D evice and C ontextual A wareness: M y N ew D imensions of C ommunication Roope Takala Nokia Research Center

2 © NOKIA MIT Media Lab Europe PPT / / RTT Sensing the context and the user Communicating Input Sensing the user and enabling his interaction. Output Multimodality in output relies on coherent Visual, Audible and Tactile feedback Contextual Awareness and Tangibility in Personal Communications

3 © NOKIA MIT Media Lab Europe PPT / / RTT

4 © NOKIA MIT Media Lab Europe PPT / / RTT Environmental sensors Temperature Pressure Sound acceleration Touch sensing Touch screens/pads Movement Sensing other devices Bluetooth RFID Inductive Merging non sensor data Date / Time Network type / cell Sensors and Signals

5 © NOKIA MIT Media Lab Europe PPT / / RTT

6 © NOKIA MIT Media Lab Europe PPT / / RTT

7 © NOKIA MIT Media Lab Europe PPT / / RTT My Personal IDENTITY for the situation Situation based Applications Suggesting My AUTOMATION for the situation Non-intrusive USER INTERFACE for the situation Access to WHAT I NEED in the situation Adjusting My COMMUNICATION to the situation My Personal SECURITY for the situation Versatile INTERACTION for the situation Casual INTERACTION for the situation

8 © NOKIA MIT Media Lab Europe PPT / / RTT Keys Touch sensitive surfaces Stylus sensitive surfaces Tilting and turning Analog pointing devices Digital pointing devices Rotating dials Tangible Input Methods

9 © NOKIA MIT Media Lab Europe PPT / / RTT Visual Larger more colorfull displays Audible Beeps, clicks Polyphonic sound MIDI output HAPTICS and TANGIBLE UI’s Breaking down the problem Practical research tools Some tools for developing and testing user experience and the technologies. Research towards Tactility

10 © NOKIA MIT Media Lab Europe PPT / / RTT Haptics a key element of Tangibility

11 © NOKIA MIT Media Lab Europe PPT / / RTT DIP3 System is a basic setup designed to run UI simulations on PDP Basic PDP setup with: Color display (Calypso display update speed ~1.2fps) (faster display units with Pica monocrome displays are also available ) Joystick, resistive keypad Vibra motor, audio, camera Serial cable (or BT) link to PC where the simulation is run Maestro UI simulator compatible Stable generic phone simulation.

12 © NOKIA MIT Media Lab Europe PPT / / RTT OLIVE : Secure Wireless IPv6 Terminal OLIVE implements a wireless Internet handheld terminal optimized for web applications. The terminal utilizes WLAN for the wireless access, MobileIPv6 for mobility management, IPSEC for encryption and RFID for user identification. Key Features: Jappla2 engine with OMAP 120MHz, SDRAM 64MB / Flash 16MB, Bluetooth. Nokia D211 WLAN/GPRS 13.56MHz RFID reader 4 inch color VGA touch screen display MobileIPv6 and IPSec on Montavista LINUX IPv6 WLAN RFID VoIP MobileIPv6 IPsec Home agent Application server

13 © NOKIA MIT Media Lab Europe PPT / / RTT Rocinante Rocinante is a demonstration of a generic media phone. Focus is on testing media phone related HW components and developing SW. User Interface: PDP based user inteface board incl.: Control keys, Camera, HF- speaker, and microphone. 3.5’’ Transflective TFT-LCD, 53.6mm x 71.5mm, 240 x 320 pixels; 260K colors Engine (Jappla2(TI OMAP)) : Operating system: Linux MCU: ARM925 / 120 MHz / 120MIPS DSP: TI C55x / 120MHz / 220MIPS PCM Audio codec Memory: SDRAM 64MB / Flash Expandability: Compact Flash Connector, Multi Media Card Connector, Bluetooth, WLAN, Pop-Port™ Size 160 x 70 x 28 mm

14 © NOKIA MIT Media Lab Europe PPT / / RTT User & technology views on devices Application needs Form-Factor needs Feasible Mobile Devices User Sensor Technology Mechanical structures SW systems Technology

15 © NOKIA MIT Media Lab Europe PPT / / RTT True multimodal input and feedback is on its’ way Summary Adaptability of technology to new applications Tactile feel and feedback All user interfaces have some historical carry over Usable for multiple applications

16 © NOKIA MIT Media Lab Europe PPT / / RTT T hank Y ou Questions?