DVTS UPDATE Keio University / WIDE Project DVTS Consortium Kazunori Sugiura Ph.D. ( January 23, 2007

Brief update of DVTS for WindowsXP

DVTSng Rev.2 Merge DVTS and HiDVTS applications on one package –DV -> use DV mode application –JVC HDV -> use HDV-JVC mode application –Sony HDV -> use HDV-SONY mode application IPv6 multicast (ASM/SSM) update –Rev.1 cannot use IPv6 multicast function getaddrinfo() doesnt run -> re-enable Download URL – other device will be supported on next revision

DV Mode Application HDV Mode Application Support IEEE1394 output Not support IEEE1394 output Please use HDVout tool instead!!

HiDVTS / Camera Output Tool Functions –HDV(MPEG2) RTP data receive IPv4, IPv6 receive port unicast, multicast (ASM/SSM) –IEEE1394(HDV device) output only support SONY device (maybe) Download URL –

Start/Stop running Quit application Select IP version Select HDV device (camera/VCR) If you want to use multicast, Specify multicast address, interface and source address (SSM)

MacOS X

New DVTS for Mac-OSX Was not available in Christmas –Some of the patent issues –Will be available soon Totally new code Internal monitoring and IEEE1394 Output

DVTS with FEC

motivation Supportive packet loss avoidance mechanism for DVTS with minimal quality loss –Using the network resource effectively –help reducing quality losses Hopefully collaborate within other Internet Dynamic FEC with rate control Mechanism –Dynamically adapting FEC rate to check network bandwidth capability –Frame rate control method reducing bandwidth and quality of video frames in case of fatal bandwidth conditions –Dynamic bandwidth proving via FEC

Practical transport technique Time bandwith FEC rate Transmission rate Packet loss rate FEC Rate control 1/1rate 1/2rate 1/3rate FEC Consumed bandwidth

DVRelay AIT / Thailand

DVRelay Frame Reduction Motion Detection Packet Loss

DVRelay combination of dvsend and dvrecv Thin-out module is added –Receives DV stream in full-rate ( 30 Mbps) –send in a lower data rate Used on the path from sender to receiver –It can be cascaded –narrower network can receive lower frame rate DVTS Sender dvrelay DVTS Receiverreceiverthin outsender

Frame Reduction (1) Frame Reduction –Some frames are selected to be dropped –Ranges from 1 to 30 based on quality required –dvrelay thins-out only video portion DVTS Sender dvrelay DVTS Receiver Internet

Frame Reduction (2) One DV frame consist from 1500 DIF blocks (NTSC format) –Audio, video, and control blocks –Video blocks are dropped from selected frames –Audio and controls blocks are relayed to keep audio quality intact Frames are selected based on RTP timestamp –It increases 3003 for every frame IP packet can carry maximum 17 DIF blocks –With 1500 bytes MTU H: header, S: subcode, VA: auxiliary audio, A: audio, V: video

Frame Reduction (3) Result –dvsend sends full-rate DV stream –dvrelay thin-outs frames from 30fps to 10fps –dvrecv receives 10fps DV stream

Motion Detection(1) Bandwidth consumption can be improved by exploiting the motion in DV stream –Sometimes DV stream does not contains much mobility –Like power-point presentations, face to face conferencing –Dynamically adjust frame rate based on amount of motion Two required elements: –Motion Detection Mechanism –Frame Rate Adjustment Mechanism - =

Motion Detection (2)

Packet Loss (1) dvrelay –Simply sends all the DIF blocks from non-discarded frames while it sends only the audio and control blocks from the discarded frames -- at incoming rate –This behavior creates traffic fluctuation in the network which generates bursty traffic hence packet loss for narrowband networks –Packet loss means incomplete VDO frames

Packet Loss (2) To prevent traffic fluctuation –A application level queue is added in dvrelay outgoing interface –First In First Out (FIFO) –Send packets a in constant bit rate –Packet sending rate is calculated from the outgoing frame rate of dvrelay

Packet Loss (3) Network operation on narrow bandwidth networks (eg. Satellite Link) –Queuing mechanism like ALTQ is used maintain the priorities for various kinds of traffic –Network administrators try to assign highest priority to DVTS streaming traffic to prevent packet loss

Future Works

What (DVTS) need to do Vista capability check Conference XP Collaboration AccessGrid Collaboration MPEG2 and QT

Some Demos

Network Collaboration Game Andrew Rivolski Andrew Rivolski is a multiplayer network game played in an environment consisting of multiple displays over the Internet. Various demos –Collaboration with USC, RZC –Demo during SIGGRAPH 2006 –DMC Symposium 2006

Multi Screen Network Collaboration Game Andrew Rivolski Maneuver satellite by using the foot panel –Avoid hit by the meteors 2 different Player A Satellite Player B

Practical Demo Remote Conference 06 Andrew Rivolski Network Game DMC Symposium 2006 Fall