MPEG 7 &MPEG 21

Contents Why MPEG 7? Objective of MPEG 7 MPEG 7 for Content description Advantage & Disadvantage of MPEG 7 Application area of MPEG 7 Why MPEG 21? Objective Advantage & Disadvantage Comparison of MPEG 7 & 21 Question-Answer References

Why MPEG 7? Due to the increasing availability of multimedia content. More and more situation where it is necessary to have information about the content. Difficulty to manage information. Difficult to find, select, filter what is needed. vsp.ee.nthu.edu.tw/Course/EE6650/handout/MPEG-7.PPT

MPEG 7 As Multimedia Content Descriptor-

MPEG7 Objective- Standardize content-based descriptions for various types of audio-visual information, allowing quick and efficient content identification, and addressing a large range of applications. MPEG-1, -2, and -4 represent the content itself (“ the bits”) MPEG-7 should represent information about the content (“the bits about the bits”)

MPEG-7

MPEG-7 For Content Description Data Structure Features Models Semantics Images Video Audio Multimedia Formats Layout Regions Segments Grids Mosaics Relationships (Spatio-temporal) Color Texture Shape Motion Speech Timbre Melody Clusters Classes Analytic models Probability Classifiers Objects Events Actions People Labels

Advantage of MPEG-7 Once the extraction of the features that are going to be searchable is complete, the MPEG-7 standard specifies how to describe them. It uses the XML language to create descriptions of the content of the multimedia files in a universally accessible manner. It allows content owners to store these descriptions separately from the content. http://www.ehow.com/info_12182966_advantages-disadvantages-mpeg7.html

Content Extraction Process- http://www.eptascape.com/products/mpeg7.html

Content Description -

Disadvantage of MPEG-7 It does not address how to extract the search items from the multimedia files. The features and content extraction can be automated, but requires separate software that is only applicable to a limited number of files.

Application Area of MPEG-7 Architecture, real estate, and interior design (e.g., searching for ideas) Broadcast media selection (e.g., radio channel, TV channel) E-Commerce (e.g., personalized advertising, on-line catalogues, directories of e-shops) Education (e.g., repositories of multimedia courses, multimedia search for support material) Home Entertainment (e.g., systems for the management of personal multimedia collections, including manipulation of content, e.g. home video editing, searching a game karaoke)

Continue……………… Investigation services (e.g.,human characteristics recognition, forensics) Journalism (e.g. searching speeches of a certain politician using his name, his voice or his face) Multimedia editing (e.g., personalized electronic news service, media authoring) Remote sensing (e.g., cartography, ecology, natural resources management) Shopping (e.g., searching for clothes that you like) Social (e.g. dating services)

MPEG21

Why MPEG 21? Built on top of MPEG-4 and MPEG-7 standards Much more than just an audio visual standard Meant to be a tool for delivering data in a broader sense Emphasis put on being able to distribute data over a wide range of networks and devices ISO discusses MPEG-21 as a "Multimedia Framework" used to distribute "Digital Items“ Digital items store both binary and text data Makes use of XML

MPEG 21- Framework

Digital Item Adaptation -

Status- Standard is still in being developed Started in 2000 Coordinatted by the ISO Motion Picture Group Isn’t expected to be completed for several more years

Objective- Describe an open framework which allows the integration of all components of a delivery chain necessary to generate, use, manipulate, manage, and deliver multimedia content across a wide range of networks and devices.” “Define the technology needed to support Users to exchange, access, consume, trade and otherwise manipulate Digital items in an efficient, transparent and interoperable way.

Continue...................... Underlying idea is to “bringring technology and content standards together” ISO puts emphasis on facilitating digital commerce and ensuring intellectual property rights Goals are both both ambitious and vague

MPEG 21 Parts-

Advantage of MPEG 21- Allow users to transfer still and video images between networks and devices (digital cameras, digital video cameras, PCs, webTV, PDAs, printers, etc.) using a single standard Add additional information such as voice and text to images if needed Embed descriptive data in digital items that can be used to search for them on networks or databases

Distribution of Digital Item -

Continue………… Store many different types of data and search keys in a single digital item Make each component of a digital item extractable in such a way that it maintains information about itself and its relation to other components Only allow authorized users to view or edit certain components of a digital item

Continue…………….. Allow vendors to send a digital items that contain information about products as well as forms that users could fill out to make purchases Allow user navigation of digital items (e.g. click on a map to see flight routes to a certain city) Enable digital items to automatically check periodically over a network to see if they should update themselves to reflect new developments

Continue……………… Allow vendors to send a digital items that contain information about products as well as forms that users could fill out to make purchases Allow user navigation of digital items (e.g. click on a map to see flight routes to a certain city) Enable digital items to automatically check periodically over a network to see if they should update themselves to reflect new developments

Continue……………… Allow video games to be run from a digital item Combine diverse types of media in a original and interactive ways Store both MIDI and audio tracks in a single digital item Store lyrics and score information along with audio. Videos, set designs, Max patches, etc. could also be stored Useful for collaborative compositions. Could edit all components together or separately Secure streaming of multiple types of information

Disadvantage……………. MPEG 21 define only syntax and semantics of description but does not cover the algorithm that is used to optimized the problem.

MPEG 7 VS MPEG 21 MPEG 7- Not focus compression and decompression of digital video Multimedia content description interface A standard for describing multimedia content Metadata describe Intellectual content Meta data describe imagery ,sound ,color etc. Enable complex search and discovery of media object

Continue………….. MPEG 21- Not focus on Compression and decompression of Digital video A frame work for delivery and consumption of media object Define the supply and delivery chain of media object Define the business rule and business relationship Define and manage property right over media object

Thank You

References:- 1.vsp.ee.nthu.edu.tw/Course/EE6650/handout/MPEG-7.PPT 2.http://www.ehow.com/info_12182966_advantages-disadvantages-mpeg7.html 3.http://www.eptascape.com/products/mpeg7.html 4.www.music.mcgill.ca/~ich/classes/mumt614/MPEG21.ppt