Multi-channel streaming for medical and multimedia industry application TNC2011 Prague, 17 May 2011 Jiří Halák 1, Milan Šárek 1, Sven Ubik 1, Petr Žejdl 1 Pavel Pečiva 2, Jan Schraml 2 1 CESNET, 2 MNUL

CESNET is a National Research and Educational Network (NREN) in Czech Republic established in Gb/s DWDM hybrid network connections to Géant, GLIF national and EU research projects CESNET

Ultra high-definition video is used in various scientific and industrial applications Low-latency sharing of such content can enable remote collaboration of distributed teams or enhance education Leveraging our experience in high-speed FPGA supported network traffic monitoring & processing Motivation

Uncompressed transfer of 4K (4096x2048) and scalable to higher resolutions Low latency (for interactive work) Working across Internet infrastructure (routers, switches) Lightweight and easy to deploy Requirements

MVTP-4K Input: 8x HD-SDIOutput: 8x HD-SDI Network – 10 Gigabit Ethernet Modular Video Transfer Platform uncompressed transfer adds less than 1 ms to networking delay full-duplex single- or dual-link embedded audio

Hardware structure

8x HD-SDI full-duplex transmission over packet network MVTP-4K

Two modes for each HD-SDI separately - full frame: approx. 1.5 Gb/s per channel - visible frame only: Gb/s depending on format Allows to pack 8x HD/2K with audio to 10GE (up to 25 fps, higher fps for 7 channels) Receiver HD-SDI outputs are synchronized No external clock source needed, receiver adapts to incoming data rate automatically Synchronization

Low-latency 4K transmissions for: real-time remote post-production streaming from events to remote auditoriums Stereoscopic and multi-view transmissions for: e-learning in medicine and other fields collaboration on scientific models (CAVE) Applications

Cinegrid Remote real time uncompressed 4K color grading - 4K content and colorist in Prague (Barrandov studios) - 4K projector and DoP in San Diego - 5 Gb/s sustained bit rate

Uncompressed 4K x 2K content edited in Prague and sent in real-time to San Diego (>10000 km) Cinegrid 2009 Director of photography Parallel videoconference

Cinegrid 2010 Remote 3D 2K post-production 2.5 Gb/s sustained bitrate

Cinegrid

Robotic surgeries are laparoscopic operations with the surgeon using 3D vision and console to manipulate instruments They generally enable minimally invasive operations with less bleeding, lower stress for the patient and less fatique for the surgeon Medical universities and conferences can use real-time low-latency transmissions of 3D vision from robotic surgeries for educational purposes Robotic surgeries

Intuitive Surgical company in more than 800 hospitals around the world cost about $1.3 million da Vinci Surgical System

3D HD transmission to conference daVinci Surgical System in Masaryk Hospital in Ústí nad Labem urological operation lead by MUDr. Jan Schraml, head of department audience at 5th International congress of mini-invasive and robotic surgery, Brno, Czech Republic, October 2010

3D HD transmission CZ to Japan Robotic surgery in Masaryk hospital in Ústí nad Labem, Czech republic 150 ms network delay + 1 ms sender & receiver delay (negligible) Parallel full HD videoconference for commentary and questions Approx miles / km 10 Gb/s path

3D HD robotic surgery to Tsukuba, Japan (Nov. 2010) Robotic surgery in Masaryk hospital in Ústí nad Labem, Czech republic 150 ms network delay + 1 ms sender & receiver delay (negligible) Parallel full HD videoconference for commentary and questions Approx miles / km

3D HD robotic surgery to APAN meeting, Hong Kong (Feb. 2011) Robotic surgery in Masaryk hospital in Ústí nad Labem, Czech republic 150 ms network delay + 1 ms sender & receiver delay Parallel full HD videoconference for commentary and questions Approx miles / km 10 Gb/s path

Projection Projection Design F10 AS3D: + two DVI inputs + one projector - cost ~$25k Consumer-grade 3D TV / projectors + low cost - one HDMI input, conversion needed

Demos at TNC 2011 Monday Zenit compressed 4K from San Diego using NTT codecs Tuesday Zenit uncompressed 4K from CESNET using MVTP-4K Tuesday Tycho uncompressed 3D HD robotic surgery (recorded) from hospital in Ústí nad Labem using MVTP-4K Wednesday Tycho uncompressed CAVE-to-3D from CTU using software and MVTP-4K

Roadmap Inter-unit synchronization for 8K transport Uncompressed 8K demo Q Practical use in medical eLearning Pre-production version available Q x full-duplex HD-SDI transport XFP pluggable transceivers