2. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 1 L3 Overview L3 Standards Overview By Mike Rubinfeld Chairman, INCITS/L3 (MPEG & JPEG) NIST, Gaithersburg, Maryland Phone: (301) 975-3064 Email: miker@nist.gov

3. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 2 L3 Overview Why Standards Are Needed Provide well-constructed tool sets for developers Provide solutions for complex systems Promote fair competition Preserve intellectual property rights Provide migration path for future systems Provide optimum interoperability

4. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 3 L3 Overview L3 Standards Acronyms Moving Pictures Experts Group (MPEG) Joint Photographic Experts Group (JPEG) International Standards Organization (ISO) International Electro-technical Committee (IEC) American National Standards Institute (ANSI) International Committee for IT Standards (NCITS) Joint Technical Committee 1 (JCT1) Standards Committee 29 (SC29) Working Group 1 (WG01) Working Group 11 (WG11)

5. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 4 L3 Overview MPEG Standards Process Designation for MPEG international standards committee: –ISO/IEC/JTC1/SC29/WG11 (MPEG) Designation for MPEG standards committee in the US: –ANSI/NCITS/L3/L3.1 (US MPEG Delegation)

6. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 5 L3 Overview Designation for JPEG international standards committee: –ISO/IEC/JTC1/SC29/WG01 (JPEG) Designation for JPEG standards committee in the US: –ANSI/INCITS/L3/L3.2 (US JPEG Delegation) MPEG Standards Process JPEG Standards Process

7. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 6 L3 Overview Current MPEG Standards MPEG-1 (ISO/IEC 11172 in 5 parts) –A standard for storage and retrieval of moving pictures and audio on storage media MPEG-2 (ISO/IEC 13818 in 9 parts) –A standard for digital television MPEG-4 (ISO/IEC 14496 (Version 1, 1999), since July 1993 –A standard for multimedia applications in an object oriented way MPEG-7 (ISO/IEC 15938 Winter 2001) –A content representation standard for multimedia search and retrieval MPEG-21 (ISO/IEC 18034)– a standard for multimedia models and frameworks

8. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 7 L3 Overview MPEG Organization Requirements Systems Video Audio SNHC (Synthetic – Natural Hybrid Coding) MDS (MPEG-7 only) (Multimedia Description Structures) Test Implementation Liaison HoD (Heads of Delegations) Administrative

9. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 8 L3 Overview MPEG Design Addresses Interoperability Addresses Transport Independence Compression and Transmission of Rich Media Addresses Interactivity Addresses Scalability Incorporates Profiles

10. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 9 L3 Overview MPEG Fields of Use Digital Television Interactive graphics (synthetic content) Interactive multimedia Distribution of and access to content Integration of production and distribution

11. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 10 L3 Overview MPEG Scope & Features For Authors – enables production of content For Network Service Providers – offers transparent information For End Users – Level of interaction with content Represents visual and audiovisual content as “media objects”

12. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 11 L3 Overview Scope & Features - Continued Standardized way to describe composition of objects Create compound media objects The formation of audiovisual scenes Multiplex and synchronize the data associated with media objects for transportation over network channels Interact with the audiovisual scene generated at the receiver’s end

13. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 12 L3 Overview Coding of Media Objects Still images (e.g., as a fixed background) Video objects (e.g., a talking person without the background) Audio objects (e.g., the voice associated with that person) Natural and synthetic content types 2 or 3-dimensional Descriptive elements allowing the handling of objects in an audiovisual scene

14. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 13 L3 Overview Composition of Media Objects Primitive media objects – most elemental form Compound media objects – grouping of primitives together – e.g., talking person and associated voice Allows construction of complex scenes

15. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 14 L3 Overview Standardized Scene Description Allows the placement of media objects anywhere in a given coordinate system Apply transforms to change geometrical or acoustical appearance of a media object Group primitive media objects in order to form compound media objects Apply streamed data to media objects in order to modify their attributes Change, interactively, the user’s viewing and listening points anywhere in the scene

16. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 15 L3 Overview Interaction with Media Objects Change viewing/listening points within a scene Drag objects within a scene to a different position Trigger a cascade of events by clicking on a particular object Select a desired language amongst multiple language tracks Trigger more comlex kinds of behavior

17. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 16 L3 Overview Intellectual Property Identification Identify IP associated with media objects Storing unique identifiers issued by international numbering systems Standardized interface integrated into the systems layer – controlling access to IP

18. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 17 L3 Overview Audio Attributes Speech signals Synthesized speech General audio signals Synthesized audio Bounded-complexity Synthetic Audio Dynamic functionality –Speech change –Pitch change –Bit rate scalability –Bandwidth scalability –Encoder and decoder complexity scalability –Audio effects, mixing, reverberation, spacialization, etc.

19. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 18 L3 Overview Visual Attributes Coding of still images and video sequences Formats supported Compression efficiency Content-based functionalities Scalability of textures, images and video Shape and alpha channel coding Error resilience Face animation

20. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 19 L3 Overview MPEG Textual Format Languages Extensible MPEG-4 Textual Format (XMT) Extensible 3D (X3D) – Web 3D Consortium Synchronized Multimedia Integration Language (SMIL) – W3C Consortium Virtual Reality Multimedia Language (VRML) Scalable Vector Graphics (SVG) XMT Framework – two levels –XMT-A Format – XML-based version of MPEG-4 content –XMT-Omega – high level abstraction of MPEG-4 features based on the W3C SMIL

21. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 20 L3 Overview MPEG Textual Format Interfaces XMT MPEG-4 Representation (e.g. mp4 file) SMIL MPEG-7 SVG Parse Compile SMIL Player VRML Browser MPEG-4 Player X3D Figure - the eXtensible MPEG-4 Textual format

22. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 21 L3 Overview MPEG-4 Industry Forum (M4IF) Not-for-profit organization to further the adoption of the MPEG-4 standard Promoting use of MPEG-4 Single point of information Distribution of MPEG-4 tools Initial membership fee - $2,000/year Home page: http://www.m4if.org

23. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 22 L3 Overview MPEG-7 Industry Alliance Not-for-profit organization to further the adoption of the MPEG-7 standard Promoting use of MPEG-7 Single point of information Distribution of MPEG-7 tools Initial membership fee - $2,000/year

24. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 23 L3 Overview JPEG Standardization Activities JPEG, JPEG/LS (ISO/IEC 10918) - maintenance JBIG (ISO/IEC 14492) - maintenance JPEG 2000 Part 1 – final standard (ISO/IEC 15444) JPEG 2000 Parts 2 – final draft standard JPEG 2000 Parts 3, 4, 5, and 6 in development

25. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 24 L3 Overview NIST Activities in JPEG & MPEG NIST is host and Webmaster for WG11, WG1 and L3 (MPEG & JPEG) online data sites storing and providing accessibility to thousands of committee documents Provide leadership for the direction of the standardization process with respect to MPEG and JPEG

26. By NIST/ITL/IAD, Mike Rubinfeld, January 16, 2002 Page 25 L3 Overview Thank you for Your Attention