ResearchChannel Michael Wellings, Director, Engineering Immersive Medical Telepresence Workshop Phoenix 2006 Innovations in Interactive HD Video Over High-Bandwidth Networks September 6-7, 2006

Think Forward. Think ResearchChannel. What Is ResearchChannel? As a consortium of universities and research institutions, we are an intellectual community that makes knowledge available to all by sharing our developments, insights and discoveries with a global audience. We bring together ideas from the world’s premier institutions and disseminate those ideas to the public directly. We engage our audience in the research process by communicating developments as they unfold. We experiment with technology to enable alternative, leading-edge exchanges of our resources. We are committed to looking forward, both in terms of our technological innovation and our continual diversification and expansion of resources for our audience.

Think Forward. Think ResearchChannel. Pioneering Technology Innovations To advance global networking technologies To explore new methods of media distribution and sharing for teaching learning and research To further multidisciplinary multinational scientific collaboration Because the consortium is uniquely qualified to do so

Think Forward. Think ResearchChannel. Arizona State University California State College, Monterey Bay Duke University George Mason University Indiana University, School of Informatics Johns Hopkins University Massachusetts Institute of Technology National University of Singapore New York University Pennsylvania State University Rice University Rutgers, The State University of New Jersey Stanford University Medical Center Texas A&M University Tulane University, Freeman School of Business Our Consortium of University Participants Universidad de Puerto Rico Universidade de São Paulo University of Alaska - Fairbanks University of Chicago University of Hawaii University of Kentucky University of Maryland University of Michigan University of Pennsylvania University of Southern California University of Virginia University of Washington University of Wisconsin-Madison Virginia Tech Yale University

Think Forward. Think ResearchChannel. AARNet Advanced Network Forum AJA Video Systems Inc. Fujinon Howard Hughes Medical Institute IBM Corporation Intel Corporation Internet2 Johnson & Johnson Library of Congress Microsoft Research National Academies National Academy of Engineering and Research Centers/Affiliates National Academy of Sciences National Institute of Nursing National Institute of Standards and Technology National Institutes of Health National Library of Medicine National Science Foundation National Sea Grant College Program NTT Labs Pacific Northwest Gigapop Poznañ Supercomputing and Networking Center R1edu.org SURFnet Vulcan Northwest Inc. Wisconsin Public Television

Think Forward. Think ResearchChannel. Our Newest Participants

Think Forward. Think ResearchChannel. Cable and Satellite Television DishNetwork satellite system 11.4 million homes Cable systems 10.3 million homes Our Multi-platform Distribution Streaming Worldwide Video on demand Broadband and multiple bit rate

ResearchChannel Distribution

Think Forward. Think ResearchChannel million households DishNetwork satellite system 11.5 million homes Cable systems 10.2 million homes 35 states U.S. Television Distribution

Think Forward. Think ResearchChannel. Ideally suited to VOD platform Charter Communications agreement adds 2 million VOD subscribers Launch first quarter 2006 with 15 titles per month Google Video, Open Media Network New Distribution Initiatives: Cable VOD

Think Forward. Think ResearchChannel. DigitalWell: Grid Enabled Digital Asset Management Project Focus Easy way to acquire, collect, classify, store,deliver large collections of digital media over IP networks. Proxy for any type of large data sets but initially focused on video and audio assets – content agnostic Includes broadcast/Internet Integration Exploits next generation networking to ensure high quality – Deliver Realism Easy-to-use Web services-based interface compatible with current Web browsers and computing platforms. Uses pluggable authentication to ensure security and control access to collections. Scalable architecture ensures that collections can be built, accessed, searched and shared between disparate networked communities. D-Lib/Data Grid Interoperation via SRB and OAI for content and metadata sharing.. Middleware – modular integration model Metadata, DRM/IP, AAI, WSAPI, Grid Automation – End to End Capture, Describe, Preserve, Deliver

Think Forward. Think ResearchChannel. Grid Enabled Digital Broadcast DigitalWell SRB TSM Metadata Acquisitio n Tape Ingest Dub Final Cut Edit Suites Television Scheduling Broadcast Services Storage Tape/Disk Services Encoding Captioning Services Streaming VoD Services Content Distributio n Services Manage Digital Essence Edit, Transcode, … Automate Metadata Device Acquisition MXF, AAF, SMPTE, MPEG7,… Archive/Preservation Re-purpose, Footage, … Service Flows

Think Forward. Think ResearchChannel. SRB 1 st Tier Disk Cache Stage Disk Cache Stage Disk Cache 1 st Tier Disk Cache Near-line Archive Near-line Archive Storage Abstraction Data Grid

Think Forward. Think ResearchChannel.

Data Grid - Digital Library Integration SRB and Digital Libraries Conduit for sharing metadata and/or content in a federation Platform for building a preservation environment D-Libs using or considering SRB MIT D-Space sites Cornell Fedora – +30 sites ResearchChannel DigitalWell UCSD TV CDL Data Grids WUNGrid PRAGMA Grid

Think Forward. Think ResearchChannel.

SC’05 DigitalWell SRB Data Grid Diagram – HD Collaborative Video Demonstration

Think Forward. Think ResearchChannel. DigitalWell Collections Existing, Ongoing, New … hrs ResearchChannel, UWTV +180 Ocean Science uncompressed HD Microsoft Research Lecture Series Multi-University Research Library Forestry Old Growth Satellite Imagery Deep Space Astronomy – WUNGrid Project KEXP Radio Live Broadcasts, In Studio Sessions +15,000 hrs Ethnomusicology Research Instructional Medical Datasets UW Library Collections

Innovations in Technology

Think Forward. Think ResearchChannel. Why? To advance global networking technologies To explore new methods of media distribution and sharing for teaching learning and research To further multidisciplinary multinational scientific collaboration Because the consortium is uniquely qualified to do so

Think Forward. Think ResearchChannel. ResearchChannel is a collaboration among experts in Internet networking, storage/search infrastructure development, emerging streaming media and interactive technologies, digital television engineering, and video production. On the Leading Edge

Think Forward. Think ResearchChannel. Projects First Internet HDTV transmission - iHDTV Digital Asset Management System Development - DigitalWell Automation of multiple format encoding Webcasting (SD and HD over IP in multiple formats) Streaming to handheld devices ResearchChannel Internet2 Working Group

Think Forward. Think ResearchChannel. Advanced Media Delivery Methods “Big Video” HD Multiple Unicast HD Multicast SD Multicast SD Multiple Unicast WMV VOD HD VOD “small video” Enhanced Phone unicast delivery “Podcasting” AUP of R&E networks (NLR, for example) can make 10gige Lambdas available The Commodity Internet will catch up

Think Forward. Think ResearchChannel. Advanced on-line Services 2500 hours of content on the web in multiple formats: 5.6mbps WMV 1300mbps WMV multi-resolution feed Pocket-video files being created Programming is encoded automatically and pushed to the web When the show first airs on the channel, the encoded VOD version is available on the web Google downloads of ResearchChannel programming available soon

Think Forward. Think ResearchChannel. iHDTV Software Suite iHDTV Explained iHD1500 iHD270 HD to the Desktop WindowsXP-based application suite Released as Open Source as of April 24 th, 2006 Announcement at Internet2 Spring Member Meeting

Think Forward. Think ResearchChannel. iHDTV Explained iHD1500 Uncompressed SMPTE 292M 4:2:2 Data rate total approx 1.5 gbps Requires: high-end HD capture cards PCI Express platforms Windows XP 2 x gige network connection Jumbo frame transport and routing

Think Forward. Think ResearchChannel. iHDTV Explained iHD270 (first introduced aug 99) Sony HDCam tm compression SDTI data format 270mbps AJA Xena I/O Requires: AJA Xena-HD capture cards Dual Processor P4 Windows XP Sony HDCam Hardware encoder/decoder Gige network connection

Think Forward. Think ResearchChannel. Sept iGrid San Diego Enhanced HD interactive - USA118: Global N-Way Uncompressed Interactive Conferencing Underwater research using HD from SS Thompson – USA119: 20,000 Terabits Under the Sea Nov SC05 Seattle Enhanced HD Interactive Conferencing/HD Storage, capture and editing using SRB (Storage Resource Broker) Recent Demonstrations

Think Forward. Think ResearchChannel. iGRID 2005 San Diego USA118: Global N-Way Interactive HD USA119: 20,000 Terabits under the sea

Think Forward. Think ResearchChannel. iGrid Demonstration USA118: Global N-Way Interactive HD

Think Forward. Think ResearchChannel. Technology Support

Think Forward. Think ResearchChannel. iGRID 05 – USA118 Sept iGrid San Diego Enhanced HD interactive - USA118: Global N-Way Uncompressed Interactive Conferencing Remote sites: 1.Pacific Northwest Gigapop - University of Washington - Seattle 2.The WIDE (Widely Integrated Distributed Environment) Project - Tokyo 3.University of Wisconsin - Madison 4.University of Michigan – Ann Arbor 5.SURFnet - Amsterdam

Think Forward. Think ResearchChannel. iGRID 05 – USA118 Sept iGrid San Diego Remote site equipment: 2 RX iHD1500 Hosts (multicast from iGRID) 1 TX iHD1500 Client (unicast to iGRID) Central site equipment: 6 RX iHD1500 Clients 2 TX iHD1500 Hosts (Multicast) Evertz VIP-12 HD Video Tile Generator Multichannel mix-minus audio system

Think Forward. Think ResearchChannel. iGRID 05 – USA118 iHD500 – first demonstrated at SuperComputing 2004 Real-time HD communication: Australia and Seattle > 1.5gbps each direction At that time relatively high latency (1500ms RT) 500ms hardware/software one-way 250ms network delay one-way

Think Forward. Think ResearchChannel.

iGRID USA 118 Network Diagram

Think Forward. Think ResearchChannel. iGRID USA 118

Think Forward. Think ResearchChannel. iGRID USA 118

Think Forward. Think ResearchChannel.

iGRID 05 – USA119 Sept iGrid San Diego First ever live HD/ip from a ship at sea to viewers on shore Ku-Band equipment upgrade to SeaTel antenna Careful RF engineering to design satellite Link-Budget Real-time MPEG-2 encoding Ip gateway Satellite modem 20mbps

Think Forward. Think ResearchChannel. Internet HDTV: VISIONS’05

Think Forward. Think ResearchChannel. iGRID USA 119

Think Forward. Think ResearchChannel. iGRID USA 119 Network

Think Forward. Think ResearchChannel. iHD1500 application SMPTE 292M/ip ~1.5gbps i HD video with multiplexed audio ResearchChannel partner Intel PCE-Express 3.4GHz Dual Xeon platforms ResearchChannel partner AJA Video Systems supplied initial round of Xena-HD capture boards

Think Forward. Think ResearchChannel. iHD1500 application Latency about 4 frames end to end plus network delay 4 frames=133ms or ~ 1/7 sec Network delay Australia>Philadelphia ~ 250ms Satellite latency about 250ms per hop H.323 devices about 220ms plus network delay No significant delay in video equipment

Think Forward. Think ResearchChannel. Software Enhancements iHD1500 Enhancements: tile display generated in software Audio mixing in software Audio mix-minus in software Video switching in software

Think Forward. Think ResearchChannel. iHDTV Open Source Group Launched Spring quarter 2006 iHDTV Trusted Partners Group formed Advisory groups: Executive Team Technical Team Enhancement planed as first step Wide deployment desired Multicast tunnel nodes Interoperability with other HD systems is an important goal iHD-X: Open Source Initiative

Think Forward. Think ResearchChannel. High Definition Video to the Desktop FORMATS MPEG2 VC-1 (WMV-HD) H.264/AVC/MPEG4 Part 10 HDV (MPEG2 PLAYERS VLC WM9/10 QuickTime/MPEG4 VLC

Think Forward. Think ResearchChannel. Advanced Delivery Methods The content is important, not the delivery method We will use what works best for the application Quality will scale to match the receiving device Multiple delivery methods will be used Wired delivery for stationary receivers Non-wired delivery for mobile devices As high speed connectivity proliferates, over-the-air transmission becomes less important for stationary receivers The multiple use, highly connected devices in the home receive all content over high speed network connections using several forms of transport media Ip over cable, fiber, copper, RF CATV operators will migrate to an all-IP delivery scheme and broadcasters will be hard-pressed to compete Traditional Broadcasting’s last stand will be rural areas in advance of expanding IP networks

Think Forward. Think ResearchChannel. Advanced Delivery Methods It took about a year for cable modems downstream speeds to increase from 2mbps to 8mbps in the Seattle area High bandwidth connectivity means non-linear viewing of multi-res content which will change the face of media delivery Global reach Old Model: Broadcast in your own geographic area Compete with local broadcasters and print media New Model: “X-cast” (Podcast, multicast, unicast etc) to the world and become part of an immense soup of content Compete with everyone for a small slice of a universal market

Think Forward. Think ResearchChannel. ResearchChannel Advanced on-line Services ResearchChannel satellite feed on the network mbps Live 1080i HD video of Mt Rainier mbps Live 720p HD video of Mt Rainier HD VOD 720p WMV-HD HD VOD 1080i MPEG2 KEXP-FM Audio-on-demand; uncompressed audio webcasting

Think Forward. Think ResearchChannel. ResearchChannel Advanced on-line Services Successful demonstration home delivery of WMV- over CATV Modems Developing VOD archive for oceanographic HD video KEXP-FM on-line services have a world-wide audience that equals Seattle broadcast listener numbers

Think Forward. Think ResearchChannel. ResearchChannel Advanced on-line Services Making Television History Visions ’05 - Emmy Award Nominee First-ever live HD 1080i video/IP streamed around the world SMPTE 292M multicast and 1.5gbps MPEG 2 multicast WMV-HD multicast with Unicast automatic failover

Think Forward. Think ResearchChannel. ResearchChannel Advanced on-line Services Seattle Science Foundation Project – testbed for new Medical technology with HD video archiving WWAMI: collaborative medical education via Advanced video technology

Think Forward. Think ResearchChannel. Internet HDTV: VISIONS’05

Think Forward. Think ResearchChannel. UW Medical Center: Inside Access -Brain Tumor Surgery Brain Tumor Surgery This program profiles an innovative surgical technique for maintaining the speech and language skills of a brain tumor patient. The program introduces viewers to Deborah Kelley, a remarkable patient who bravely allows a camera to follow her for several weeks, from her initial consultation at the UW Medical Center's Neurosurgery clinic and then into surgery. asp?rid=2763

Think Forward. Think ResearchChannel. For More Information inquires: Michael Wellings Director, Engineering