1. Ubitrack - Ubiquitous Tracking for Augmented Reality Joe Newman For more information email: jfn@ims.tuwien.ac.at

2. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Introduction Ubiquitous Computing Ubiquitous Computing Augmented Reality Augmented Reality Sensors Sensors Applications Applications Ubiquitous Tracking Ubiquitous Tracking Simulation Simulation

3. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Ubiquitous Computing Phase in use & development of computer systems Phase in use & development of computer systems Permeate environment Permeate environment Embedded in most artifacts Embedded in most artifacts “calm” technology “calm” technology Appropriate feedback at periphery of consciousness Appropriate feedback at periphery of consciousness Until need for user’s focus to be drawn Until need for user’s focus to be drawn Augmented Reality (AR) is the natural interface to Ubicomp environment Augmented Reality (AR) is the natural interface to Ubicomp environment

4. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Augmented Reality (AR) Augmentation of human perception Augmentation of human perception Visual, auditory, tactual, olfactory, gustatory Visual, auditory, tactual, olfactory, gustatory Rich and meaningful AR experience Rich and meaningful AR experience Wearable computing Wearable computing Display technologies Display technologies Tracking & graphics Tracking & graphics

5. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 AR Sensors High update rate High update rate High accuracy High accuracy Small working volume Small working volume Mostly stationary Mostly stationary Expensive & scarce Expensive & scarce

6. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Ubicomp sensors Low update rate Low update rate Low accuracy Low accuracy Large working volume Large working volume Mobile Mobile Cheap & numerous Cheap & numerous

7. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 AR Applications

8. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Ubiquitous Tracking What could we do with perfect tracking? What could we do with perfect tracking? Integrating different trackers Integrating different trackers Model spatial relationship graphs that map to networks of heterogeneous sensors Model spatial relationship graphs that map to networks of heterogeneous sensors Extensible framework accommodates arbitrary Extensible framework accommodates arbitrary sensors, filtering schemes, optimisation criteria sensors, filtering schemes, optimisation criteria Query mechanism Query mechanism Satisfies client needs but Satisfies client needs but Negotiates resources Negotiates resources

9. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Asdf A sdf World Model

10. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Asdf A S df Measured Relationships

11. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Inferred Relationships

12. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Optical Shared Tracking Marker C need only be visible to a single camera

13. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Simulation Environment Resource constraints Resource constraints People, trackers People, trackers Experiment with scarce, expensive and even non-existent equipment Experiment with scarce, expensive and even non-existent equipment Design, develop, deploy and extend Ubitrack environments Design, develop, deploy and extend Ubitrack environments Requirements analysis Requirements analysis Prototyping, tools Prototyping, tools

14. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 GUI

15. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Simulation

16. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Other tools MATLABSimulinkRTWMaple

17. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Future Work Expand scope of simulator Expand scope of simulator Distribution Distribution Platforms Platforms Tools (simulink, maple, etc…) Tools (simulink, maple, etc…) Develop maths to handle new Develop maths to handle new sensors sensors Accelerometers, RFID tags… Accelerometers, RFID tags… filters filters Generalised kalman filters, Bayesian nets, Condensation Filters Generalised kalman filters, Bayesian nets, Condensation Filters

18. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Conclusion Ubicomp and AR need Ubitrack Ubicomp and AR need Ubitrack Theoretical framework Theoretical framework (Spatial) Relations modelled as graphs (Spatial) Relations modelled as graphs Simulation important component Simulation important component Extension to arbitrary sensors Extension to arbitrary sensors Collaboration Collaboration Develop the mathematics Develop the mathematics Improve and introduce Computer Vision trackers Improve and introduce Computer Vision trackers Security/Privacy Security/Privacy Unresolved middleware issues Unresolved middleware issues

19. Joseph Newman June 9th -Studierstube Day 4, Graz 2004 Questions?