D EPT. OF I NFO. & C OMM., KJIST Access Grid with High Quality DV Video JongWon Kim, Ph.D. 17 th APAN Meeting /JointTech WS Jan. 29 th, 2004 Networked Media Laboratory Dept. of Information & Communications Kwang-Ju Institute of Science & Technology (K-JIST)

D EPT. OF I NFO. & C OMM., KJIST Access Grid & Remote Collaboration Group to Group Interaction on the Grid Connecting People and Applications via the Grid  Integrating Group and Group Collaboration and Visualization.  Supporting distributed research collaborations  Distributed Lectures and seminars  Remote participation in design and development  Virtual site visits and team meetings  Complex distributed grid based applications  Long term collaborative workflows

D EPT. OF I NFO. & C OMM., KJIST Media Quality Challenge in AG (K-JIST with KISTI On-going ) VIC DV HD Stereo … Access Grid Service Manager RAT Audio dataVideo data Monitoring Module RT P RTCPRT P … Video dataAudio data RTCP statistics Traffic meter Traffic Reader Traffic analysis Traffic Manager Packet RT P RTCPRT P … High Speed Network Access Grid Service Manager Access Grid Service Manager Feedback

D EPT. OF I NFO. & C OMM., KJIST Demonstration of DVTS with AG  Demonstration  Between K-JIST, Gwangju Hawaii  Using both VIC (web camera) and DV (digital cam, ieee1394) in each PC. DV-Recv Agent DV-Send Agent DV form test_A PCDV form test_B PC Video stream (test_A PC) VIC Video stream (test_B PC) VIC RAT NodeService

D EPT. OF I NFO. & C OMM., KJIST Deploying DV to AG system  Connection scenario of the DV to AGTk2.0

D EPT. OF I NFO. & C OMM., KJIST  AG 2.0 Toolkit Architecture  Find the connection point to call VIC Video Producer Service Executes vic to transmit video stream Configurable through Node Management Client  How to connect DV into AG Upgrade Venue Server and Venue Client to aware DV Venue Server allocate DV multicast address for DV transmission Implement DVTS Agent Analysis AGTk2.0

D EPT. OF I NFO. & C OMM., KJIST Analysis AGTk2.0 (cont.)  Flow architecture in AGTk2.0

D EPT. OF I NFO. & C OMM., KJIST  Implementation of the proposed system  Modify Capability Class  Add ConfigureStreams function in AGService class Each DV stream has unique multicast address and port Send all multicast address and port of all DV stream to Service  Modify NegotiatedCapabilities function in Venue class If a client can receive DVstreams, return a set of Dvstreams Allocate new multicast address and port for each Dvstream and notify Add stream event to all clients.  Add DVProducerService, DVConsumerService  Add DVTS (Digital Video Transmission System) -agent Deploying DV to AG system ROLE [producer, consumer] ROLE [producer, consumer] TYPE [audio, video, text,DV] TYPE [audio, video, text, DV] PARAMETERS Add “DV” stream type

D EPT. OF I NFO. & C OMM., KJIST Deploying DV to AG system (Cont.)  DV (Digital Video) format  Three hierarchical structure: DIF data (10 sequences/frame) x DIF blocks(150 block/sequence) * 80 bytes/block * 8 bits/byte * frames/sec = Mbps  Video (standard NTSC quality as 525 lines, fps)  Audio (PCM format)  What is DVTS?  ‘Digital Video Transport System’ made by WIDE Project in Japan  Transmit DV streams from IEEE1394 over IP  Using RTP fixed header with same video frame  DVTS Supports Frame discard for network utilization Bandwidth: 30Mbps with standard NTSC quality (29.97 f/s) Discarding picture frames and preserving audio frames Error concealment strategies for packet loss Use the related data from the previous frame Using frame buffering for absorbing jitters Providing Multicast (Using PIM-SM routing protocol)

D EPT. OF I NFO. & C OMM., KJIST Deploying DV to AG system (Cont.)  Simple modification of DVTS  For network bandwidth Frame discarding (without quality degradation ~ 1/5 frame)  For CPU resource Removing sound rendering part in direct show.  DVTS-agent (connects DVTS into AG)  DVSend Execute DVTS for DV sending Advertise its own DV transmission multicast address  DVRecv Maintain the DVSend list DVRecv execute DVTS with DVSend address by user requests When receive ‘Start Video Message’ from DVSend adds new participant item into user list maintains the mapping information about session participant and process ID When receive ‘Stop Video Message’ from DVSend removes the participant item from user list kills the process of corresponding DVTS

D EPT. OF I NFO. & C OMM., KJIST Deploying DV to AG system (Cont.)  User Interface  DVTS Agent into AG  DVProducerService DVSend –s –v Ex.) DVSend –s –v  DVConsumerService DVRecv –s Ex.) DVRecv –s DVSend DVRecv

D EPT. OF I NFO. & C OMM., KJIST Hybrid monitoring scheme  Implementation scenario

D EPT. OF I NFO. & C OMM., KJIST Advanced Collaboration Testbed (K-JIST, Dec. 2003) Media Server Overlay Multicast Server NAS

D EPT. OF I NFO. & C OMM., KJIST Immersive Media Delivery Testbed (to be built ) Network Emulator KOREN/KREONET (1 Gbps) Admin & WWW Server Gbps SW Contents Server 3D Graphics Server HD H/W Decoder HD 2D/3D VOD Server Virtual Studio 3D HD Authoring System Set Stereo 3D Wall Access Grid

D EPT. OF I NFO. & C OMM., KJIST Questions? Thank you!