Metadata Presentation by Rick Pitchford Chief Engineer, School of Communication COM 633, Content Analysis Methods 3:56 PM

MPEG-7 The value of information depends on how easy it can be found, retrieved, accessed, filtered and managed. Identifying and managing resources efficiently is becoming more difficult, because of the sheer volume. MPEG-7 provides a rich set of standardized tools to describe multimedia content. Audiovisual data content that has MPEG-7 metadata associated with it, may include: still pictures, graphics, 3D models, audio, speech, and video. Metadata may contain composition information about how these elements are combined in a multimedia presentation. Special cases of these general data types may include facial expressions and personal characteristics.

IBM’s MPEG-7 Annotation Tool: One method for annotating video sequences with MPEG-7 metadata. Image from

Metadata from the field: images from Sony Electronics Inc. and Panasonic Broadcast and Digital Systems Company Optical and solid-state video recording media often allows recording original media essence, MPEG 4 “proxy” files for preview purposes and metadata including lens focal length, f-stop, focus distance, notes, text, GPS data and thumbnail images for cataloging shots.

MPEG-21: “MPEG-21 codifies the integration of the critical technologies enabling transparent and augmented use of multimedia resources across a wide range of networks and devices to support functions such as: content creation, production, packaging, distribution, consumption and usage content identification and description intellectual property management and protection financial management user privacy terminals and network resource abstraction content representation and event reporting”

MXF is a compatible subset of AAF, supporting cuts-only transitions and is “supported” by manufacturers of devices for acquisition through post-production to distribution. Complete vender-compatibility has never achieved because MXF doesn’t use any one, specific media codec. The MXF Mastering Format (limited to MPEG-2 with either I-frame encoding at 50Mbps or long GOP encoding at 25Mbps or 15Mbps) and various other Application Specifications have been developed in an attempt to cut down on some of the variables and aid in compatibility. An MXF file can be either a single large, interleaved file or a much smaller Version or Inventory File plus a folder of essence files, called the “File Package”. Material eXchange Format: image from AAF (Advanced Authoring Format) is a “Super EDL” file format including media or media pointers, effects descriptions and layering instructions for moving projects from device to device during the post-production process. AAF files may refer to other AAF files. AAF is not cross-vender compatible. OP2-C (a play list with alternate versions)

MXF Operational Patterns: Single Item OP-1 Play-list Items OP-2 Edit Items OP-3 Single Packages - A Ganged Packages - B Alternate Packages - C image based on “ EBI-UER, 11/2003 MXF files are organized as one of ten Operational Patterns. The Media Package (MP) represents the media output based the Inventory File’s display instructions. The File Package (FP) contains all the essence media (video, audio and metadata) connected with the MXF file. Think of the MP as an Avid sequence and the FPs as clips in the bins. OP-1, 2 and 3 differ based on the relationship between the MP and the associated FPs - one-to-one, sequential or sequential partial. OPs are further classed as: A, Single Programs B, programs with Ganged metadata files C, Alternate program versions video audio metadata

Application Specifications: Application Specifications are non-proprietary standards codified to constrain and simplify the use of MXF based on USERS needs as determined by the Advanced Media Workflow Association. Application Specifications specify parameters such as the OPs used, essence codec type, essence container, time code type and Key-Length-Value schema used for essence wrapping. AS01 is the new designation for the original Advanced Authoring Format Editing Protocol. AS04 provides for tagging audio track by language for use by international operations. AS05 is an extension of AS01, covering color, text and opacity effects. AS06 provides a method to ensure MXF file integrity after a file transfer or other process has occurred. image from Advanced Media Workflow Association

AS02: image from Advanced Media Workflow Association document MXF-AS02-secn doc This is an AS02 bundle, the new name for the MXF Mastering Format. This example includes two program versions, each an OP1-B Inventory File, using common video, vertical blanking interval data, vertical ancillary data and “Extra” material, but with unique audio for each. Essence files are in OP-Atom format. AS02 was designed for use within a facility. Version or Inventory Files (OP1-B: single item, ganged packages)

AS03: AS03 is a system for delivery of completed programs as a single, interleaved file containing all essence and metadata elements required for playback of a single version. AS03 constraints the video to common codecs such as MPEG 4 part 10 (H.264) or MPEG-2 Main Profile or MPEG-2 422P, using any GOP structure and with bit rates from 5 to 50 Mbps. AS03 audio must be in PCM pairs, encoded as AC3 or as Dolby E. In addition, AS03 allows for the inclusion of closed-captioning data and metadata sets to be used in secondary applications, such as program guides and libraries. image from Advanced Media Workflow Association document MXF-AS02-secn doc

Kim, Here is the PowerPoint I used plus a pdf with more information on the AS02 and AS03 mxf files. And, here are the urls for the two webpages I went to with links to metadata and MPEG tools: mlhttp://www2.sims.berkeley.edu/academics/courses/is202/f03/Online.ht ml Rick