NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu

NGI Summer Research (8/02)2 Multicast Backbone (Mbone) Multicast Distribution of IP packets to many hosts Many-to-many communication Mbone Tools NSDR VAT/RAT VIC

NGI Summer Research (8/02)3 NSDR SAP listener SAP announcer

NGI Summer Research (8/02)4 VAT/RAT Audio tool Participants talk to each other

NGI Summer Research (8/02)5 VIC Viewer Encoder

NGI Summer Research (8/02)6 OpenMash Comprehensive toolkit Collection of Mbone tools Open source

NGI Summer Research (8/02)7 Problems VIC displays useless stream Save screen real estate Save resources Cache of multicast sessions Web interface

NGI Summer Research (8/02)8

9 Blue Stream Camera Off Encoder encodes default blue

NGI Summer Research (8/02)10 Algorithm to Remove Blue Stream Check YUV frame 5 blocks of 4 pixels Compare Y, U, V with known color Blue is (Y,U,V) = (35, 212, 114)

NGI Summer Research (8/02)11 Black Stream Lights Off Can’t compare Different black Error not black

NGI Summer Research (8/02)12 Algorithm to Remove Black Stream Examine 20 blocks of 4 pixels each Need more samples to detect Count number of values within ranges 4 BINS (3 Black, 1 Other) Also compute average value of pixels Black if satisfy certain condition 50% of pixels is true black (Y<16, 120<U&V <136) AvgY<28, 120<avgU&avgV<136

NGI Summer Research (8/02)13 Remove Stream Drop packets from sender Remove thumbnail Callback to test stream later Accept packet and check if still black or blue If not black or blue, put back thumbnail If still black or blue, register another callback

NGI Summer Research (8/02)14

NGI Summer Research (8/02)15 Indiva: Middleware for Streaming Media Equipment and Resources NFS metaphor Application mounts a server and issues commands High level commands e.g., encode, move, copy, link, mkses, etc. Bridge conventional audio/video environment and streaming media Hide physical connections and control interfaces Allocate paths through conventional routing switches Allocate encoding/decoding resources in a broadcast center

NGI Summer Research (8/02)16 ISAP Cache of active Mbone sessions Clone of NSDR Web interface Run continuously Well-known address for SAP /9875 A web-cast guide

NGI Summer Research (8/02)17 ISAP Parse message according to IETF protocol Execute indiva manager to create conference Associate callback After 30 minute, delete conference Future – click link to participate in session

NGI Summer Research (8/02)18

NGI Summer Research (8/02)19

NGI Summer Research (8/02)20 Future Research RTP a/v synchronization A “time-based corrector” for RTP packet streams Implement new Indiva services and applications Ncast Telepresenter service Webcast control apps …

NGI Summer Research (8/02)21 Acknowledgement NGI Larry Rowe Wei Tsang Ooi Peter Pletcher Jose Maria Gonzalez …and the entire OpenMash community

NGI Summer Research (8/02)22 For More Information /projects/indiva/