1. Learnware Network description Project concerns and components Remote Sign Language Interpretation Questions Technical Details (Jeremy) Music teaching and recording Intelligent Classroom Questions Project Overview (John)

2. Learnware Network Description Educational network on CA*net 3 Production and distribution of educational materials and tools Materials and tools use high-quality digital audio and video

3. Project Main Concerns Engineering, networking and streaming technology issues Optimization of hardware and software for high quality audio and video Broadcast studio SMPTE 259M uncompressed SDI video (200+ Mbps) Recording studio quality uncompressed multichannel 96kHz, 24 bit audio

4. Learnware Components Music and Audio Negotiation Simulation Classroom Teaching in Engineering Related project: Remote Sign Language Interpretation

5. Music and Audio multi-channel surround sound studio sharing composition collaboration master classes shared performances shared recording sessions

6. Montreal Los Angeles 12 channels, 96kHz, 24 bits/channel Music and Audio Sept. 2000: McGill – USC Shared Recording

7. Music and Audio Nov. 2001: McGill – HEC Violin Duet

8. Music and Audio Mar. 2002: Pinchas Zukerman Master Class

9. Negotiation Simulation teach negotiation skills existing CD-ROM application conversion to Java for web delivery video delivery creates heavy system load

10. Negotiation Simulation

11. Classroom Teaching augmented videoconference teaching automatic recording and indexing of lecture for later retrieval instructor tracking automatic far-end camera control

12. Remote Sign Language Interpretation Related project Physician and deaf patient in hospital Interpreter in another city DV video and audio 3 compressed video streams Software decompression

13. Sign Language

14. Technical issues Social factors Intelligent Classroom Overview Questions Part II

15. Music Video Recorded via Internet2 Palo Alto, CA (Nov. 6)--To demonstrate the broadband capabilities of Internet2, a network technologies development program being led by over 180 universities, musicians and engineers at college campuses throughout the United States recently collaborated on a music video recording session via the network. But…

16. Where were going same idea, but no cheating -- real interaction –remote instruction, master classes –distributed rehearsal and performance –studio sharing, recording sessions –remote sign-language interpretation –collaborative engineering design all at high-resolution, low-latency

17. 27.6 Mbps Recording Studio that Spans a Continent AES 109th demo, Sept. 23, 2000

18. The Frères Jacques experiment RISQ 2000: low-latency MPEG-2 videoconferencing

19. Playing Together experiment MPEG-2 Remote Master Class, Dec. 8, 2000 Pinchas Zukerman, Columbia U, NYC Wu Ji, Canarie ARDNOC, Ottawa

20. Tolerated Synchronicity compress transmit 10 0 20 40 30 50 70 60 80ms speed of light: Mtl-LA net latency Mtl-LA networks small ensemble large ensemble lip synch musical activity * This figure is a theoretical best-case scenario. Actual performance may vary based on local hardware. The manufacturer makes no warranties, either express or implied, and cannot be held liable for any damages resulting from use of the product. Certain restrictions may apply. Offer void where prohibited by law. Batteries not included. MPEG* acquire

21. Size *does* matter: The Big Picture high-res* video high-fidelity audio multi-channel surround large (life-size?) picture

22. Starting to feel more like being there?

23. Intelligent Classroom Want to benefit from educational technology But dont want the distraction

24. Objectives Leave behind confusing user interfaces Automatically generate web-capture of lecture Automatically send appropriate view to remote end

25. What is she doing and how can we help? obtain input from background sensors select most appropriate configuration of equipment in response Computer as assistant

26. Remote Classroom Teaching

27. Robust Person Tracking

28. Detecting Raised Arms

30. Questions? McGill Advanced Learnware: –http://www.mcgill.ca/icc/canarie/learnWare/ Remote Sign Language Interpretation –http://www.mcgill.ca/icc/canarie/signLanguage/ Network Audio Streaming: –http://www.cim.mcgill.ca/~jer/research/aes Intelligent Classroom: –http://www.cim.mcgill.ca/~jer/research/iroom