1. Engaging Technolog(ies) for Effective Interaction Jeremy R. Cooperstock Centre for Intelligent Machines McGill University Centre for Interdisciplinary Research in Music Media and Technology McGill University

2. A Brief Roadmap  Shared Reality  Intelligent Classrooms  Ultra-Videoconferencing

3. Inspiration Mark Weiser “The most profound technologies are those that disappear.” Jef Raskin “Graphical User Interfaces are not human-compatible.”

4. Classroom Technology

5. “High-tech” touch-screen control…

6. Simplified button control light controls motor controls context- sensitive volume control

7. I don’t want to control all of that!

8. Solution: Intelligent Classroom “Reactive” Technology  room senses events….  and responds automatically

9. Full-featured button panel left right

10. Simplifying Lecture Capture

11. What about the cameraman?

12. Student Questionnaires  technology viewed favourably by most users  2000-01:  90 survey responses, 83% positive  2002-03:  115 survey responses, 77% positive  (most negative comments related to technical problems)  2003-04:  110 survey responses, 85% positive

13. Videoconferencing: the past (AT&T PicturePhone – 1956)

14. Videoconferencing: the future? Zack Snyder’s “Online Jam”, October 2001

15. For those with DSL at home... yeah, right!

16. You don’t say! "As depicted in the spot, it's a bit of a stretch for the home consumer to run that instantaneously and smoothly; that's more the realm of the professional musician…. there's a little more to it than just going on the net."

17. "Playing Together" experiment New York-Ottawa, Remote Masters class, Dec. 8, 2000 Pinchas Zuckerman, Columbia U, NYC Wu Ji, Canarie ARDNOC, Ottawa

18. Latency: The Interaction-Killer or put another way...

19. Tolerated Synchronicity compress transmit 10 0 20 40 30 50 70 60 80ms speed of light: Mtl-LA net latency Mtl-LA networks small ensemble large ensemble lip synch musical activity * This is a theoretical “best-case” scenario. Actual performance may vary. The manufacturer makes no warranties, either express or implied, and will not be held liable for damage resulting from use of the product. Certain restrictions may apply. Offer void where prohibited by law. Batteries not included. MPEG* acquire

20. Distributed Violin Duet McGill-Université de Montréal for RISQnet Conference, Nov. 21, 2001

21. "The medium is the message" - Marshall McLuhan Cooperstock's Corollary: "The medium must be faster than the message.” * * but between protocol deficiencies (TCP, UDP), competing data flows, process scheduling on a budget, ARQ (retransmission management) without QoS, interface HW/SW “uncooperativeness”, aggressive router policies, multi-format support, echo suppression, and interface complexity… it’s much more than just the medium

22. Note:look of anguish

23. The Brass Montreal-Ottawa (NRC) Trial with Pace Sturdevant, February 2, 2002

24. Violin Masters Class Montreal-Ottawa (NRC) Trial with Pinchas Zuckerman, Feb. 20, 2002

25. Size does matter

26. Distributed Jazz Jam Montreal-Stanford (CCRMA), Research Demonstration, Oct. 24, 2002

27. Remote Video Interpretation (Sign Language) Montreal-Fredericton (UNB), research trials, 2003 physician's setup patient's setup

28. Shared Reality and Shared Spaces: Toward Immersive Telepresence

30. Vibrosensory Transmission VRQ demo, March 8, 2004

31. … and another application

32. Next Steps: Multi-screen High-Def Funded by Canarie’s Advanced Applications Program

33. Conference Room Configuration

34. New challenge: Real-time mosaicing

35. Sample Result: Can your camera do this?

36. And going deep under… Funded by Canarie’s Intelligent Infrastructure Program and NEPTUNE

37. Thank you... software download: http://www.ultravideo.mcgill.edu Shared Reality Lab: http://www.cim.mcgill.ca/sre