1. NGI Summer Project Streaming Media Extensions to Open Mash and Indiva Allan Gu

2. NGI Summer Research (8/02)2 Multicast Backbone (Mbone) Multicast Distribution of IP packets to many hosts Many-to-many communication Mbone Tools NSDR VAT/RAT VIC

3. NGI Summer Research (8/02)3 NSDR SAP listener SAP announcer

4. NGI Summer Research (8/02)4 VAT/RAT Audio tool Participants talk to each other

5. NGI Summer Research (8/02)5 VIC Viewer Encoder

6. NGI Summer Research (8/02)6 OpenMash Comprehensive toolkit Collection of Mbone tools Open source

7. NGI Summer Research (8/02)7 Problems VIC displays useless stream Save screen real estate Save resources Cache of multicast sessions Web interface

8. NGI Summer Research (8/02)8

9. 9 Blue Stream Camera Off Encoder encodes default blue

10. NGI Summer Research (8/02)10 Algorithm to Remove Blue Stream Check YUV frame 5 blocks of 4 pixels Compare Y, U, V with known color Blue is (Y,U,V) = (35, 212, 114)

11. NGI Summer Research (8/02)11 Black Stream Lights Off Can’t compare Different black Error not black

12. NGI Summer Research (8/02)12 Algorithm to Remove Black Stream Examine 20 blocks of 4 pixels each Need more samples to detect Count number of values within ranges 4 BINS (3 Black, 1 Other) Also compute average value of pixels Black if satisfy certain condition 50% of pixels is true black (Y<16, 120<U&V <136) AvgY<28, 120<avgU&avgV<136

13. NGI Summer Research (8/02)13 Remove Stream Drop packets from sender Remove thumbnail Callback to test stream later Accept packet and check if still black or blue If not black or blue, put back thumbnail If still black or blue, register another callback

14. NGI Summer Research (8/02)14

15. NGI Summer Research (8/02)15 Indiva: Middleware for Streaming Media Equipment and Resources NFS metaphor Application mounts a server and issues commands High level commands e.g., encode, move, copy, link, mkses, etc. Bridge conventional audio/video environment and streaming media Hide physical connections and control interfaces Allocate paths through conventional routing switches Allocate encoding/decoding resources in a broadcast center

16. NGI Summer Research (8/02)16 ISAP Cache of active Mbone sessions Clone of NSDR Web interface Run continuously Well-known address for SAP 224.2.127.254/9875 A web-cast guide

17. NGI Summer Research (8/02)17 ISAP Parse message according to IETF protocol Execute indiva manager to create conference Associate callback After 30 minute, delete conference Future – click link to participate in session

18. NGI Summer Research (8/02)18

19. NGI Summer Research (8/02)19

20. NGI Summer Research (8/02)20 Future Research RTP a/v synchronization A “time-based corrector” for RTP packet streams Implement new Indiva services and applications Ncast Telepresenter service Webcast control apps …

21. NGI Summer Research (8/02)21 Acknowledgement NGI Larry Rowe Wei Tsang Ooi Peter Pletcher Jose Maria Gonzalez …and the entire OpenMash community

22. NGI Summer Research (8/02)22 For More Information http://www.openmash.org http://www.bmrc.berkeley.edu/frame /projects/indiva/