Working Group What is MPEG-4 ResearchChannel/I2 L. Ross M. Wellings

Compression  A Brief History  MPEG-1  MPEG-2  MPEG-7  MPEG-4

 VHS quality video with audio   Approximately 1.2 Mbps  Being replaced MPEG-1

 Broadcast quality video with audio   Up to 15 ML  Not interactive  Best viewing  MPEG-3 collapsed in MPEG-2 MPEG-2

 Research Channel has 400 hours of MPEG-2 programs  Searching, evaluating new products MPEG-2

Types of MPEG-2  (Main Profile at Low Level)  (Main Profile at Main Level)  4:2:2: (4:2:2:Profile at Main Level)  (Main Profile at High Level)

 Search Interface   Not here yet  Not a compression scheme at all, but a description system for multimedia content. MPEG-7

 Low bit rate  Is a standard for video, audio, graphics i.e. multimedia compression with general interactivity  Began July 1993 / Release February 2000  Goal: to make low-bit rate files MPEG-4

Problems with MPEG-4  Not broadcast quality  Not a replacement for MPEG-2  Full specification not complete as yet  Not fully supported by Microsoft or Apple  Not inexpensive or easy (potentially high production cost)  Fast processor required at client end  Lack of interactive tools

Advantages to MPEG-4  Replacement for MPEG-1 Better quality Smaller files More robust

MPEG-4 Architecture

Applications MPEG-4 is Suitable for:  Low bit-rate streaming Audio, video, V.O.D. and webcast Example: ResearchChannel web site Webcams FUTURE: games, wireless, mobile, personal conferencing Future Future  Highly interactive Web sites  Complex network-based software

Recommendations  Use for low bit-rate applications  Delay implementation of interactive content Only beta tools available Process is complex Process is very new and little understood  Entire project must be fully planned from production to client

User Access to Information Random access to information, user chooses What is Interactivity?

How does MPEG-4 Become Interactive  Decoder-Based Compositing Picture elements dissembled by the encoder into objects, multiplexed, and transmitted. Picture elements are demultiplexed by the decoder, and composited according to:  Pre-produced rules  User selections

How does MPEG-4 Become Interactive Manipulation of objects of delivery system Embedded hotlinks Interactive control of delivery system Future: Possible to create new experience at the client end

Considerations  Hardware and Software Requirements Processor speed Software client Software and hardware integration

 Play  Forward  Rewind  Mouse Clicks Simple Interactivity:

 Hotlinks  Camera choices  Embedded video  Embedded Ads  Pop-up windows  Rotation of objects  Animation Complex Interactivity

 Create new information!  10 Camera shoots  Encode every element as object  Have editor spend thousands of hours on possibilities  Invent REALLY FAST processors  Move objects around  Change Background For Millionaires

 Think - ”special effect studio with hundreds of employees”  intellectual property considerations

 Video objects can be any shape  Considerations number of objects size of objects coding tools MPEG-4 s/w decoders required for special function fast processors lots of memory, bandwidth MPEG-4 Production Implications