1. Sentient Computing Ubiquitous Computing vision Computing devices everywhere Access to applications anywhere Whatever is on hand is available Sentient Computing vision Ubiquitous Computing made context-aware Physical context used for automatic control Sensors and space are part of computing systems

2. Programming With Space The components Notions and representations of physical space Data and computational models Sensor information User interface the real world

3. Components for Programming With Space Devices Platforms Sensors Networks +Architecture Conduits

4. Components for Programming With Space Devices Platforms Sensors +Architecture

5. Sensors: Location Information u Containment –GSM, UMTS, broadband radio –Active badge u Proximity –Bluetooth, IrDA –PICOnet u Co-ordinate –GPS –Active bat

6. Sensors: Location Information u Containment –GSM, UMTS, Broadband Radio –Active Badge u Proximity –Bluetooth, IrDA –PICOnet u Co-ordinate –GPS –Active bat

7. Containment: Active Badge Infra-Red Network 10 meter range diffuse room-scale location

8. Sensors: Location Information u Containment –GSM, UMTS, Broadband Radio –Active Badge u Proximity –Bluetooth, IrDA –PICOnet u Co-ordinate –GPS –Active Bat

9. Sensors: Location Information u Containment –GSM, UMTS, broadband radio –Active badge u Proximity –Bluetooth, IrDA –PICOnet u Co-ordinate –GPS –Active bat

10. Ultrasonic Location System Mobile transmitter (Bat) Fixed receivers Ceiling Active Bats Ultrasonic transponder Measure pulse time-of-flight Radio synchronised

11. DSP Ceiling Array 25,000 MIPS to cover AT&T Laboratories Cambridge!

12. Components for Programming With Space Devices Platforms Sensors Networks +Architecture Conduits

13. Telephone 318 Computer “Pumpkin” Computer “Papaya” Person “Mike” Person “Pete” Representing the Real World u Model real world as collection of objects Computer “Plantain” Person “Andy” Follow-me Phonebook Mobile Desktop Telephone 241 Telephone 217 CTI switch Resource monitor Keyboard monitor Location service Applications Software objects Sensors –Objects maintain state using sensor data –Applications query relevant sets of objects

14. Data Model Visualisation

15. Spatial Monitoring Vague spatial facts formalised as geometric containment and overlapping relationships between spaces X M ‘X is holding the microphone M’ ‘X can be seen by camera B but not by camera A’ A B X

16. Spatial Indexing Generates all positive/negative overlapping or containment events throughput (‘000 updates s -1 ) 1 3 2 4 population (‘000) 102030 non-overlapping spaces overlapping spaces

17. Putting It All Together Move user’s desktop to screen in front of them Visible A Visible B Visible C Callbacks Registration +ve Containment (Andy) -ve Overlapping (Andy) -ve Overlapping(Andy,”Visible B”) CLEAR DESKTOP FROM B -ve Overlapping(Andy,”Visible A”) CLEAR DESKTOP FROM A +ve Containment(Andy,”Visible B”) MACHINE B: NOT IN USE MOVE DESKTOP TO B +ve Containment(Andy,”Visible C”) MACHINE C: IN USE NO ACTION

18. Example Applications Corporate memory Record me / what’s around me Annotate multimedia stream Camera field-of-view Flat display Composite display “Plonk-and-play” systems Spatial configuration determines logical configuration No need to know device IDs Automatic personalisation

19. Sentient Computing: New User Interfaces  Non-user interfaces!  Objects and people are cursors in the real-world of icons   Aural and visual feedback