1. ResearchChannel Michael Wellings, Director, Engineering Immersive Medical Telepresence Workshop Phoenix 2006 Innovations in Interactive HD Video Over High-Bandwidth Networks September 6-7, 2006

2. Think Forward. Think ResearchChannel. What Is ResearchChannel? As a consortium of universities and research institutions, we are an intellectual community that makes knowledge available to all by sharing our developments, insights and discoveries with a global audience. We bring together ideas from the world’s premier institutions and disseminate those ideas to the public directly. We engage our audience in the research process by communicating developments as they unfold. We experiment with technology to enable alternative, leading-edge exchanges of our resources. We are committed to looking forward, both in terms of our technological innovation and our continual diversification and expansion of resources for our audience.

3. Think Forward. Think ResearchChannel. Pioneering Technology Innovations To advance global networking technologies To explore new methods of media distribution and sharing for teaching learning and research To further multidisciplinary multinational scientific collaboration Because the consortium is uniquely qualified to do so

4. Think Forward. Think ResearchChannel. Arizona State University California State College, Monterey Bay Duke University George Mason University Indiana University, School of Informatics Johns Hopkins University Massachusetts Institute of Technology National University of Singapore New York University Pennsylvania State University Rice University Rutgers, The State University of New Jersey Stanford University Medical Center Texas A&M University Tulane University, Freeman School of Business Our Consortium of University Participants Universidad de Puerto Rico Universidade de São Paulo University of Alaska - Fairbanks University of Chicago University of Hawaii University of Kentucky University of Maryland University of Michigan University of Pennsylvania University of Southern California University of Virginia University of Washington University of Wisconsin-Madison Virginia Tech Yale University

5. Think Forward. Think ResearchChannel. AARNet Advanced Network Forum AJA Video Systems Inc. Fujinon Howard Hughes Medical Institute IBM Corporation Intel Corporation Internet2 Johnson & Johnson Library of Congress Microsoft Research National Academies National Academy of Engineering and Research Centers/Affiliates National Academy of Sciences National Institute of Nursing National Institute of Standards and Technology National Institutes of Health National Library of Medicine National Science Foundation National Sea Grant College Program NTT Labs Pacific Northwest Gigapop Poznañ Supercomputing and Networking Center R1edu.org SURFnet Vulcan Northwest Inc. Wisconsin Public Television

6. Think Forward. Think ResearchChannel. Our Newest Participants

7. Think Forward. Think ResearchChannel. Cable and Satellite Television DishNetwork satellite system 11.4 million homes Cable systems 10.3 million homes Our Multi-platform Distribution Streaming Worldwide Video on demand Broadband and multiple bit rate

8. ResearchChannel Distribution

9. Think Forward. Think ResearchChannel. 21.7 million households DishNetwork satellite system 11.5 million homes Cable systems 10.2 million homes 35 states U.S. Television Distribution

10. Think Forward. Think ResearchChannel. Ideally suited to VOD platform Charter Communications agreement adds 2 million VOD subscribers Launch first quarter 2006 with 15 titles per month Google Video, Open Media Network New Distribution Initiatives: Cable VOD

11. Think Forward. Think ResearchChannel. DigitalWell: Grid Enabled Digital Asset Management Project Focus Easy way to acquire, collect, classify, store,deliver large collections of digital media over IP networks. Proxy for any type of large data sets but initially focused on video and audio assets – content agnostic Includes broadcast/Internet Integration Exploits next generation networking to ensure high quality – Deliver Realism Easy-to-use Web services-based interface compatible with current Web browsers and computing platforms. Uses pluggable authentication to ensure security and control access to collections. Scalable architecture ensures that collections can be built, accessed, searched and shared between disparate networked communities. D-Lib/Data Grid Interoperation via SRB and OAI for content and metadata sharing.. Middleware – modular integration model Metadata, DRM/IP, AAI, WSAPI, Grid Automation – End to End Capture, Describe, Preserve, Deliver

12. Think Forward. Think ResearchChannel. Grid Enabled Digital Broadcast DigitalWell SRB TSM Metadata Acquisitio n Tape Ingest Dub Final Cut Edit Suites Television Scheduling Broadcast Services Storage Tape/Disk Services Encoding Captioning Services Streaming VoD Services Content Distributio n Services Manage Digital Essence Edit, Transcode, … Automate Metadata Device Acquisition MXF, AAF, SMPTE, MPEG7,… Archive/Preservation Re-purpose, Footage, … Service Flows

13. Think Forward. Think ResearchChannel. SRB 1 st Tier Disk Cache Stage Disk Cache Stage Disk Cache 1 st Tier Disk Cache Near-line Archive Near-line Archive Storage Abstraction Data Grid

14. Think Forward. Think ResearchChannel.

15. Data Grid - Digital Library Integration SRB and Digital Libraries Conduit for sharing metadata and/or content in a federation Platform for building a preservation environment D-Libs using or considering SRB MIT D-Space - +120 sites Cornell Fedora – +30 sites ResearchChannel DigitalWell UCSD TV CDL Data Grids WUNGrid PRAGMA Grid

16. Think Forward. Think ResearchChannel.

17. SC’05 DigitalWell SRB Data Grid Diagram – HD Collaborative Video Demonstration

18. Think Forward. Think ResearchChannel. DigitalWell Collections Existing, Ongoing, New … +2100 hrs ResearchChannel, UWTV +180 Ocean Science uncompressed HD Microsoft Research Lecture Series Multi-University Research Library Forestry Old Growth Satellite Imagery Deep Space Astronomy – WUNGrid Project KEXP Radio Live Broadcasts, In Studio Sessions +15,000 hrs Ethnomusicology Research Instructional Medical Datasets UW Library Collections

19. Innovations in Technology

20. Think Forward. Think ResearchChannel. Why? To advance global networking technologies To explore new methods of media distribution and sharing for teaching learning and research To further multidisciplinary multinational scientific collaboration Because the consortium is uniquely qualified to do so

21. Think Forward. Think ResearchChannel. ResearchChannel is a collaboration among experts in Internet networking, storage/search infrastructure development, emerging streaming media and interactive technologies, digital television engineering, and video production. On the Leading Edge

22. Think Forward. Think ResearchChannel. Projects First Internet HDTV transmission - iHDTV Digital Asset Management System Development - DigitalWell Automation of multiple format encoding Webcasting (SD and HD over IP in multiple formats) Streaming to handheld devices ResearchChannel Internet2 Working Group

23. Think Forward. Think ResearchChannel. Advanced Media Delivery Methods “Big Video” HD Multiple Unicast HD Multicast SD Multicast SD Multiple Unicast WMV VOD HD VOD “small video” Enhanced Phone unicast delivery “Podcasting” AUP of R&E networks (NLR, for example) can make 10gige Lambdas available The Commodity Internet will catch up

24. Think Forward. Think ResearchChannel. Advanced on-line Services 2500 hours of content on the web in multiple formats: MPEG2 @ 5.6mbps WMV 1300mbps WMV multi-resolution feed Pocket-video files being created Programming is encoded automatically and pushed to the web When the show first airs on the channel, the encoded VOD version is available on the web Google downloads of ResearchChannel programming available soon

25. Think Forward. Think ResearchChannel. iHDTV Software Suite iHDTV Explained iHD1500 iHD270 HD to the Desktop WindowsXP-based application suite Released as Open Source as of April 24 th, 2006 Announcement at Internet2 Spring Member Meeting

26. Think Forward. Think ResearchChannel. iHDTV Explained iHD1500 Uncompressed SMPTE 292M 4:2:2 Data rate total approx 1.5 gbps Requires: high-end HD capture cards PCI Express platforms Windows XP 2 x gige network connection Jumbo frame transport and routing

27. Think Forward. Think ResearchChannel. iHDTV Explained iHD270 (first introduced aug 99) Sony HDCam tm compression SDTI data format 270mbps AJA Xena I/O Requires: AJA Xena-HD capture cards Dual Processor P4 Windows XP Sony HDCam Hardware encoder/decoder Gige network connection

28. Think Forward. Think ResearchChannel. Sept 2005 - iGrid San Diego Enhanced HD interactive - USA118: Global N-Way Uncompressed Interactive Conferencing Underwater research using HD from SS Thompson – USA119: 20,000 Terabits Under the Sea Nov 2005 - SC05 Seattle Enhanced HD Interactive Conferencing/HD Storage, capture and editing using SRB (Storage Resource Broker) Recent Demonstrations

29. Think Forward. Think ResearchChannel. iGRID 2005 San Diego USA118: Global N-Way Interactive HD USA119: 20,000 Terabits under the sea

30. Think Forward. Think ResearchChannel. iGrid Demonstration USA118: Global N-Way Interactive HD

31. Think Forward. Think ResearchChannel. Technology Support

32. Think Forward. Think ResearchChannel. iGRID 05 – USA118 Sept 2005 - iGrid San Diego Enhanced HD interactive - USA118: Global N-Way Uncompressed Interactive Conferencing Remote sites: 1.Pacific Northwest Gigapop - University of Washington - Seattle 2.The WIDE (Widely Integrated Distributed Environment) Project - Tokyo 3.University of Wisconsin - Madison 4.University of Michigan – Ann Arbor 5.SURFnet - Amsterdam

33. Think Forward. Think ResearchChannel. iGRID 05 – USA118 Sept 2005 - iGrid San Diego Remote site equipment: 2 RX iHD1500 Hosts (multicast from iGRID) 1 TX iHD1500 Client (unicast to iGRID) Central site equipment: 6 RX iHD1500 Clients 2 TX iHD1500 Hosts (Multicast) Evertz VIP-12 HD Video Tile Generator Multichannel mix-minus audio system

34. Think Forward. Think ResearchChannel. iGRID 05 – USA118 iHD500 – first demonstrated at SuperComputing 2004 Real-time HD communication: Australia and Seattle > Pittsburgh @ 1.5gbps each direction At that time relatively high latency (1500ms RT) 500ms hardware/software one-way 250ms network delay one-way

35. Think Forward. Think ResearchChannel.

36. iGRID USA 118 Network Diagram

37. Think Forward. Think ResearchChannel. iGRID USA 118

38. Think Forward. Think ResearchChannel. iGRID USA 118

39. Think Forward. Think ResearchChannel.

40. iGRID 05 – USA119 Sept 2005 - iGrid San Diego First ever live HD/ip from a ship at sea to viewers on shore Ku-Band equipment upgrade to SeaTel antenna Careful RF engineering to design satellite Link-Budget Real-time MPEG-2 MP@HL encoding Ip gateway Satellite modem 20mbps

41. Think Forward. Think ResearchChannel. Internet HDTV: VISIONS’05

42. Think Forward. Think ResearchChannel. iGRID USA 119

43. Think Forward. Think ResearchChannel. iGRID USA 119 Network

44. Think Forward. Think ResearchChannel. iHD1500 application SMPTE 292M/ip ~1.5gbps 1080-60i HD video with multiplexed audio ResearchChannel partner Intel PCE-Express 3.4GHz Dual Xeon platforms ResearchChannel partner AJA Video Systems supplied initial round of Xena-HD capture boards

45. Think Forward. Think ResearchChannel. iHD1500 application Latency about 4 frames end to end plus network delay 4 frames=133ms or ~ 1/7 sec Network delay Australia>Philadelphia ~ 250ms Satellite latency about 250ms per hop H.323 devices about 220ms plus network delay No significant delay in video equipment

46. Think Forward. Think ResearchChannel. Software Enhancements iHD1500 Enhancements: tile display generated in software Audio mixing in software Audio mix-minus in software Video switching in software

47. Think Forward. Think ResearchChannel. iHDTV Open Source Group Launched Spring quarter 2006 iHDTV Trusted Partners Group formed Advisory groups: Executive Team Technical Team Enhancement planed as first step Wide deployment desired Multicast tunnel nodes Interoperability with other HD systems is an important goal iHD-X: Open Source Initiative

48. Think Forward. Think ResearchChannel. High Definition Video to the Desktop FORMATS MPEG2 MP@HL VC-1 (WMV-HD) H.264/AVC/MPEG4 Part 10 HDV (MPEG2 MP@H14) PLAYERS VLC WM9/10 QuickTime/MPEG4 VLC

49. Think Forward. Think ResearchChannel. Advanced Delivery Methods The content is important, not the delivery method We will use what works best for the application Quality will scale to match the receiving device Multiple delivery methods will be used Wired delivery for stationary receivers Non-wired delivery for mobile devices As high speed connectivity proliferates, over-the-air transmission becomes less important for stationary receivers The multiple use, highly connected devices in the home receive all content over high speed network connections using several forms of transport media Ip over cable, fiber, copper, RF CATV operators will migrate to an all-IP delivery scheme and broadcasters will be hard-pressed to compete Traditional Broadcasting’s last stand will be rural areas in advance of expanding IP networks

50. Think Forward. Think ResearchChannel. Advanced Delivery Methods It took about a year for cable modems downstream speeds to increase from 2mbps to 8mbps in the Seattle area High bandwidth connectivity means non-linear viewing of multi-res content which will change the face of media delivery Global reach Old Model: Broadcast in your own geographic area Compete with local broadcasters and print media New Model: “X-cast” (Podcast, multicast, unicast etc) to the world and become part of an immense soup of content Compete with everyone for a small slice of a universal market

51. Think Forward. Think ResearchChannel. ResearchChannel Advanced on-line Services ResearchChannel satellite feed on the network 233.0.73.29 MPEG2@ 3.2mbps Live 1080i HD video of Mt Rainier 233.0.73.26 MPEG2 MP@HL @ 20mbps Live 720p HD video of Mt Rainier http://www.researchchannel.org/tech/desktopclients.asp HD VOD 720p WMV-HD http://www.researchchannel.org/visions05/hdpresentation.asp HD VOD 1080i MPEG2 ML@HL http://www.researchchannel.org/tech/desktophdsamples.asp KEXP-FM Audio-on-demand; uncompressed audio webcasting http://www.kexp.org

52. Think Forward. Think ResearchChannel. ResearchChannel Advanced on-line Services Successful demonstration home delivery of WMV- HD@720p over CATV Modems Developing VOD archive for oceanographic HD video KEXP-FM on-line services have a world-wide audience that equals Seattle broadcast listener numbers

53. Think Forward. Think ResearchChannel. ResearchChannel Advanced on-line Services Making Television History Visions ’05 - Emmy Award Nominee First-ever live HD 1080i video/IP streamed around the world SMPTE 292M multicast and unicast @ 1.5gbps MPEG 2 MP@HL multicast WMV-HD multicast with Unicast automatic failover

54. Think Forward. Think ResearchChannel. ResearchChannel Advanced on-line Services Seattle Science Foundation Project – testbed for new Medical technology with HD video archiving WWAMI: collaborative medical education via Advanced video technology

55. Think Forward. Think ResearchChannel. Internet HDTV: VISIONS’05 http://www.researchchannel.org/visions05/multimedia.asp

56. Think Forward. Think ResearchChannel. UW Medical Center: Inside Access -Brain Tumor Surgery Brain Tumor Surgery This program profiles an innovative surgical technique for maintaining the speech and language skills of a brain tumor patient. The program introduces viewers to Deborah Kelley, a remarkable patient who bravely allows a camera to follow her for several weeks, from her initial consultation at the UW Medical Center's Neurosurgery clinic and then into surgery. http://www.researchchannel.org/prog/displayevent. asp?rid=2763

57. Think Forward. Think ResearchChannel. For More Information www.researchchannel.org inquires: info@researchchannel.org Michael Wellings Director, Engineering wellings@researchchannel.org