University of Illinois at Chicago Current Advanced Teleconferencing Solutions Dan Sandin EVL Feb

University of Illinois at Chicago HDV Teleconferencing Compression in camera –Use widely deployed HDV format –1920 by 1080 I px but resolution < 1400 Bayer –1200 by 720 p has less latency –Inter-frame Mpeg compression Latency –In practice > 2 sec round trip –Observed at evl > 4 sec with VLC <25 sec Bandwidth –25Mbit each way with sound

University of Illinois at Chicago HDV Teleconferencing Current State –VLC windows support –VLC Linux support ??? –SVC needs audio decode Robert Luc ?? Disadvantages –Huge latency > 2 sec round trip Advantages –Nearly done, cheep, Linux

University of Illinois at Chicago DVCPRO HD Teleconferencing Compression in camera –Will be widely deployed HDV format –1920 by 1080 px but resolution ~ 1600 Bayer –24p 30 i –AG-HVX200 P2 HD camera –intra-frame Jpeg compression –~ $6000 Latency –In practice ?? Bandwidth –100 Mbit each way with sound

University of Illinois at Chicago DVCPRO HD Teleconferencing Development –Need to test latency and quality –Need to develop software decode –I meet with Panasonic feb 8 06

University of Illinois at Chicago HDSDI Teleconferencing No compression –Use widely deployed HD format –1920 by 1080 x 30 hz Interlace Latency –In theory < 250ms round trip –calit2 installation predicted to be ~ ms round trip –Needs to measured Bandwidth – > 1.5 Gbit each way with sound Could modify software to truncate 10bit to 8 bit <1Gbit

University of Illinois at Chicago HDSDI Teleconferencing Advantages –Use widely deployed HD format –Standard broadcast equipment –Potentially low latency –Best quality of currently contemplated systems Disadvantages –Lots of unnecessary bandwidth –Needs frame grabber (SDI) –Expensive to do at full rez ( with display) $24,000 gets you ~ 1400 lines $64,000 gets you full 1920 lines

University of Illinois at Chicago HDSDI Teleconferencing Development at evl –Will purchase equipment in next weeks. –Two windows computers Transmit –HD10 Analog to HDSDI converter Analoge component to HDSDI SMPTE-292 $1,200 –Black Magic DeckLink HD Pro 4:2:2 for HDSDI to framebuffer $ 1,500 –Software that packet smpte-292 (need to find out standard?)

University of Illinois at Chicago HDSDI Teleconferencing Receive –De-packet software to frame buffer –AJA Xena HS for framebuffer to HDSDI $ 1,800 –Some HDSDI to DVI or component box to get to display –Other groups have frame buffer to computer display software that may be compatible?

University of Illinois at Chicago HDSDI Teleconferencing Development at evl –I imagine these HDSDI to frame buffer and frame buffer to HDSDI do not have Linux drivers. –Packetized smpte 292 should not be hard to decode and display –We could use taravision boards to transmit in Linux.

University of Illinois at Chicago HDSDI Teleconferencing Development at evl, How do we fit in –Copy UW system and leave it independent –Linux receive network hd, display on sage –Jpeg or jpeg 2000 compression Use hardware acceleration

University of Illinois at Chicago Varrier stereo Teleconferencing

University of Illinois at Chicago Varrier stereo Teleconferencing No Compression –Yuv – by 30fps x 2 P –Compression possible –Small c mount cameras unibran Fire-i400™ ~$500 each with lens Latency –In theory < 250ms round trip –In practice 330 ms round trip Bandwidth – 220Mb with sound each way

University of Illinois at Chicago Varrier stereo Teleconferencing Advantages –Stereo without glasses –Better than NTSC, great looking, life size images –Compression possible –EVL developed software environment with deep control –Computer interface 1394 Latency –Good 330 ms –Can be made smaller goal is 200ms round trip Bandwidth – 220Mb with sound each way –Modest, can be made smaller

University of Illinois at Chicago Varrier stereo Teleconferencing Development –Currently deployable –Add compression – in process Recording playback combining with VR compression More video formats

University of Illinois at Chicago Varrier stereo Teleconferencing Development –Currently deployable –Add compression – in process Recording playback combining with VR compression More video formats –Possible connection Use NVIDIA texture decompression for media file playback on SAGE SHD and bigger. 8 to 1 compression

University of Illinois at Chicago Varrier stereo Teleconferencing Development –Opportunities for more interoperation of varrier and SAGE

University of Illinois at Chicago GigE camera Teleconferencing GigE industrial camera –1920 by 1080 by 30hz P by 12bits/component –Bayer pattern color so rez is about 2/3??

University of Illinois at Chicago GigE camera Teleconferencing GigE industrial camera –1920 by 1080 by 30hz P by 12bits/component –Bayer pattern color so rez is lower than a 3 chip camera –Compression possible –Small c mount cameras ~$5000 each Latency –rough measurement < 400 ms round trip –In practice need to measure round trip Bandwidth – ~800 Mb with out sound each way

University of Illinois at Chicago GigE camera Teleconferencing Development at evl –Windows demonstrated –Linux driver problems –Write our own drivers for Linux –Use windows drivers –Windows send Linux receive. Add compression

University of Illinois at Chicago Teleconferencing discussion