University of Illinois at Chicago OptIPuter Teleconferencing Next Steps Dan Sandin Jan 2007

University of Illinois at Chicago An Embarrassment of Riches HDV 25Mb 1 sec –Audio interleaved DVCPRO HD 100Mb 300ms –Audio interleaved HDSDI 1.5Gb < 200ms? –Audio interleaved Y U V HD.8Gb < 100ms? –Audio separate Varrier Stereo Video 225Mb < 100ms –Audio separate GigE camera.8Gb <100ms –No audio

University of Illinois at Chicago Marketing Categories Broadcast –HDSDI –Highest quality, most expensive, low Q/$ –Highly standardized, inflexible Prosumer –HDV, DVCPRO –Medium to high quality best Q/$ –Quite standardized, inflexible Industrial –Y U V, Varrier Stereo, GigE –Large range of Q and $ –Quite standardized, very flexible

University of Illinois at Chicago Organizations HDV 25Mb 1 sec –everybody DVCPRO HD 100Mb 300ms –qvidium calit2 HDSDI 1.5Gb < 200ms –research channel UltraGrid Calit2 Y U V HD.8Gb < 200ms –EVL UltraGrid Varrier Stereo Video 225Mb < 100ms –EVL Calit2 GiGE camera.8Gb <100ms –SARA EVL Calit2

University of Illinois at Chicago Bandwidth HDV 25Mb 1 sec –Audio interleaved DVCPRO HD 100Mb 300ms –Audio interleaved HDSDI 1.5Gb < 200ms –Audio interleaved Y U V HD.8Gb < 200ms –Audio separate Varrier Stereo Video 225Mb < 100ms –Audio separate GigE camera.8Gb <100ms –No audio

University of Illinois at Chicago Audio HDV 25Mb 1 sec –Audio interleaved DVCPRO HD 100Mb 300ms –Audio interleaved HDSDI 1.5Gb < 200ms –Audio interleaved Y U V HD.8Gb < 200ms –Audio separate Varrier Stereo Video 225Mb < 100ms –Audio separate GigE camera.8Gb <100ms –No audio

University of Illinois at Chicago Latency One-Way Transmission Times HDV 25Mb 1 sec –Audio interleaved DVCPRO HD 100Mb 300ms –Audio interleaved HDSDI 1.5Gb < 200ms –Audio interleaved Y U V HD.8Gb < 200ms –Audio separate Varrier Stereo Video 225Mb < 100ms –Audio separate GigE camera.8Gb <100ms –No audio

University of Illinois at Chicago Latency Why So Late Every frame takes 33 ms Every piece of hardware and every software module wants a 2 or 3 frame buffer For us, it is almost never the network –We need to change that so it is the network

University of Illinois at Chicago Compression and Resolution or Quality HDV 25Mb 1 sec –MPEG; long GOP, low Q DVCPRO HD 100Mb 300ms –JPEG-like; better Q HDSDI 1.5Gb < 200ms –None; best Q largely depends on camera Y U V HD.8Gb < 200ms –None; best Q, largely depends on camera Varrier Stereo Video 225Mb < 100ms –None; SD but in stereo GigE camera.8Gb <100ms –None; camera has Q problems

University of Illinois at Chicago Compression and Resolution or Quality Uncompressed talking heads HD at 1.5GB is a ridiculous waste of resources –Except for broadcast production –Except for science data –Except for here? or maybe a TV studio, you have never seen uncompressed HD Compression can be done in less than a frame –NTT 4K Jpeg 2000 <500Mb <100ms –spectacular quality !

University of Illinois at Chicago SAGE and Teleconferencing SAGE Visual casting supports YUV and RGB video Calit2 and EVL will make a DVCPRO HD to SAGE converter –Note: need to buy xmit box and receive software from Qvidum UltraGrid and Research Channel have expressed interest in doing conversion routines to SAGE Visual Casting

University of Illinois at Chicago SAGE and Teleconferencing SAGE Visual casting supports YUV and RGB video

University of Illinois at Chicago SAGE and Teleconferencing Support of several systems Except for SAGE Visual Casting, a receiver box for each source will be used –Potentially support a large number of video compression standards

University of Illinois at Chicago Audio Afterthoughts Echo cancellation can be accomplished with AccuMic PC –Limitations …

University of Illinois at Chicago Audio Afterthoughts SAGE has to develop an audio standard for visual casting

University of Illinois at Chicago Persistent setup first pass DVCPRO HD using Qvidium boxes CALIT2 UCSD, Calit2 UCI, EVL AccuMic Echo calculation Mono simple PCM audio

University of Illinois at Chicago Near Future HDMI camera and capture card Multi-channel audio with each SAGE window Audio localization with each window

University of Illinois at Chicago Teleconferencing Discussion