1. Working Group What is MPEG-4 ResearchChannel/I2 L. Ross M. Wellings www.researchchannel.com

2. Compression  A Brief History  MPEG-1  MPEG-2  MPEG-7  MPEG-4

3.  VHS quality video with audio  1989-1991  Approximately 1.2 Mbps  Being replaced MPEG-1

4.  Broadcast quality video with audio  1990-1995  Up to 15 Mbps @ ML  Not interactive  Best viewing  MPEG-3 collapsed in MPEG-2 MPEG-2

5.  Research Channel has 400 hours of MPEG-2 programs  Searching, evaluating new products MPEG-2

6. Types of MPEG-2  MP@LL (Main Profile at Low Level)  MP@ML (Main Profile at Main Level)  4:2:2: Profile@ML (4:2:2:Profile at Main Level)  MP@HL (Main Profile at High Level)

7.  Search Interface  1997-2000  Not here yet  Not a compression scheme at all, but a description system for multimedia content. MPEG-7

8.  Low bit rate  Is a standard for video, audio, graphics i.e. multimedia compression with general interactivity  Began July 1993 / Release February 2000  Goal: to make low-bit rate files MPEG-4

9. Problems with MPEG-4  Not broadcast quality  Not a replacement for MPEG-2  Full specification not complete as yet  Not fully supported by Microsoft or Apple  Not inexpensive or easy (potentially high production cost)  Fast processor required at client end  Lack of interactive tools

10. Advantages to MPEG-4  Replacement for MPEG-1 Better quality Smaller files More robust

11. MPEG-4 Architecture

12. Applications MPEG-4 is Suitable for:  Low bit-rate streaming Audio, video, V.O.D. and webcast Example: ResearchChannel web site Webcams FUTURE: games, wireless, mobile, personal conferencing Future Future  Highly interactive Web sites  Complex network-based software

13. Recommendations  Use for low bit-rate applications  Delay implementation of interactive content Only beta tools available Process is complex Process is very new and little understood  Entire project must be fully planned from production to client

14. User Access to Information Random access to information, user chooses What is Interactivity?

15. How does MPEG-4 Become Interactive  Decoder-Based Compositing Picture elements dissembled by the encoder into objects, multiplexed, and transmitted. Picture elements are demultiplexed by the decoder, and composited according to:  Pre-produced rules  User selections

16. How does MPEG-4 Become Interactive Manipulation of objects of delivery system Embedded hotlinks Interactive control of delivery system Future: Possible to create new experience at the client end

17. Considerations  Hardware and Software Requirements Processor speed Software client Software and hardware integration

18.  Play  Forward  Rewind  Mouse Clicks Simple Interactivity:

19.  Hotlinks  Camera choices  Embedded video  Embedded Ads  Pop-up windows  Rotation of objects  Animation Complex Interactivity

20.  Create new information!  10 Camera shoots  Encode every element as object  Have editor spend thousands of hours on possibilities  Invent REALLY FAST processors  Move objects around  Change Background For Millionaires

21.  Think - ”special effect studio with hundreds of employees”  intellectual property considerations

22.  Video objects can be any shape  Considerations number of objects size of objects coding tools MPEG-4 s/w decoders required for special function fast processors lots of memory, bandwidth MPEG-4 Production Implications