Collaborative Tangible User Interfaces for Wireless Environments aka “The Motorola Toy Project” Me: Trent Apted Supervisor: Associate Professor Bob Kummerfeld

Eh? “The” user interface will consist of a number of devices The devices will share information via a wireless medium This will allow them to collaborate A model is maintained of the real environment in which interaction occurs What about tangible?

Motivation Facilitate an intimate interaction between the user and the user interface device Use collaboration to promote interaction between users and other user’s devices Develop interacting models of knowledge –The device’s behavioural model –A pervasive model of the user –An environment model

Method Target younger users with a plush toy to provide a fun, personalised companion Surgically implant a low-power computer –Possibly talking to a more powerful one Keep the device entirely untethered Spawn siblings (or simulate them) Simulate a real environment for interaction to occur

Method (cont) Make it intelligent –Perceptive Give it sensors (voice recognition?) –Reactive Make it ‘talk’ (speech generation) –Anticipatory Initiate logical actions with or without direct stimuli –Teachable Reinforcement learning – reward and punish

Applications Collaborative games –‘Secret’ sharing –Initiate meetings –Interactive device - device education –Guessing games –Computer mediated (avatars) –Role playing –Suggestions? Companionship –Learning assistant –Co-operative game play –“You’re working too hard. Take a break.” –Background mood –Alarm clock / schedular –Pillow