IS502:M ULTIMEDIA D ESIGN FOR I NFORMATION S YSTEM Presenter Name: Mahmood A.Moneim Supervised By: Prof. Hesham A.Hefny Winter 2012

Introduction This course gives an introduction to multimedia (MM) contents and the tools used to produce MM contents. It also covers the design and production of a MM system. The students will be able to produce MM applications that can run locally and/or over a network. By Mahmood A.Moneim2

Objectives Provide students with an overview of multimedia technologies and the latest developments in multimedia systems. Survey a variety of multimedia applications. Students will be able to gain experience in multimedia production and design. Create a multimedia application incorporating effective amount of text, image, video, sound, and animation as appropriate to delivery method and audience. Create navigation paths using links, triggers, keywords, etc., to create a variety of design models. By Mahmood A.Moneim3

Intended learning Outcomes Describe the basic components of an interactive multimedia presentation and their working relationships. Learn interactive multimedia presentation terminology. Identify various properties of audio, image, video and animation data. Describe examples of digital media: text, images, video, sound, and animation. By Mahmood A.Moneim4

Course Outline Textbook and References: – R. Steinmetz and K. Nahrstedt. Multimedia: Computing, Communications and Applications. Prentice Hall, – Ze-Nian Li and Mark S. Drew. Fundamentals of Multimedia. ISBN: , Prentice-Hall, Major Topics – Multimedia terminology, production and MM applications – Life cycle of MM project – Components of MM application: text, sound, image, video, animation – Development team and the role of each member – MM authoring systems – Color terminology and schemes Grades: – Semester Work (best 2 quizzes out of 3)30% – Final-Term Examination70% By Mahmood A.Moneim5

What is Multimedia? By Mahmood A.Moneim6

What is Multimedia? When different people mention the term multimedia, they often have quite different, or even opposing, viewpoints. – A PC vendor: a PC that has sound capability, a DVD-ROM drive, and perhaps the superiority of multimedia-enabled microprocessors that understand additional multimedia instructions. – A consumer entertainment vendor: interactive cable TV with hundreds of digital channels available, or a cable TV-like service delivered over a high- speed Internet connection. – A Computer Science (CS) student: applications that use multiple modalities, including text, images, drawings (graphics), animation, video, sound including speech, and interactivity. 7 By Mahmood A.Moneim

Digital Multimedia What is multimedia? – Multi (many) – Media (medium: a substance regarded as the means of transmission of a force or effect, but this does not fit. How about Means for distribution and presentation of information) – Multiple types of information captured, stored, manipulated, transmitted, and presented. 8 By Mahmood A.Moneim

Digital Multimedia What is digital multimedia? Digital Multimedia is the field (art ) concerned of putting together at least two of the following: text, images, sounds, video, animated film, and music where every type can be represented, stored, transmitted & processed digitally to create an integrated electronic presentation to be delivered using computer. 9 By Mahmood A.Moneim

Interactive Multimedia – When you allow an end user (the viewer of a multimedia project ) to control what elements are delivered, when they are delivered and in what order they are delivered it is called interactive multimedia. 10 By Mahmood A.Moneim

Multimedia data elements Text Document images Photographic images Geographic system maps Sound Voice commands Moving graphics (animation) Full motion video 11 By Mahmood A.Moneim

12 Multimedia is Multidisciplinary Image, audio, speech processing Computer vision, pattern recognition Computer networks, operating system Human computer interaction Computer graphics Multimedia computing By Mahmood A.Moneim

13 Multimedia is Multidisciplinary Multimedia computing InformationRetrieval DataCompression PsychologyNaturalLanguageProcessing By Mahmood A.Moneim

Old presentation include Story Telling: The story teller enhancing a story with actions and sounds Theater Dance: Multimedia without computer interaction Pictorial Representations of Reality and Imagination: Images & Symbolism 14 By Mahmood A.Moneim

Other presentation Newspaper: perhaps the first mass communication medium, uses text, graphics, and images Motion pictures: motion too rapid to be observe by the human eye. Wireless radio transmission Television: the new medium for the 20th century, established video as a commonly available medium and has since changed the world of mass communications 15 By Mahmood A.Moneim

Recently Power Point DVD video was introduced; high quality full-length movies were distributed on a single disk. The introduction of PDAs began a new period in the use of computers in multimedia Hand-held MP3 devices holding flash memory. Internet: WWW, Social Networks ….. 16 By Mahmood A.Moneim

What is HyperText and HyperMedia? Hypertext is a text which contains links to other texts. 17 By Mahmood A.Moneim

HyperText Navigation Traversal through pages of hypertext is therefore usually non-linear (as indicated below). This has implications in layout and organization of material and depends a lot on the application at hand. 18 By Mahmood A.Moneim

Hypermedia HyperMedia is not constrained to be text-based. It can include other media, e.g., graphics, images, and especially the continuous media - sound and video. Example WWW 19 By Mahmood A.Moneim

World Wide Web (WWW) WWW is the largest and most commonly used hypermedia application. Hypertext Transfer Protocol (HTTP): is a protocol that was originally designed for transmitting hypermedia, but it also supports transmission of any file type. Hypertext Markup Language (HTML): is a language for publishing hypermedia on the WWW. Extensible Markup Language (XML): there is a need for a markup language for WWW that has modularity of data, structure, and view. By Mahmood A.Moneim20

XML Specifications XML Protocol: used to exchange XML information between processes. XML Schema: A more structured and powerful language for defining XML data types (tags). Unlike DTD. XSL (XML Style sheet) : This is basically CSS for XML. SMIL (Synchronized Multimedia integrated language pronounced “smile”):This is a particular application of XML that permits specifying temporally scripted interaction among any media types and user input. By Mahmood A.Moneim21

Characteristics of Multimedia Applications Multimedia system must be computer controlled They are integrated The information they handle must be represented digitally The interface to final user permits interactivity 22 By Mahmood A.Moneim

Features of a MM Computer systems Very high processing power A File system capable of handling multimedia information File formats that exploit the inherent properties of the multimedia information Efficient and high I/O rate Multimedia operating system Storage and memory Network support Software tools 23 By Mahmood A.Moneim

Classification of Multimedia Captured from real life verses synthesized by the computer. Discrete space based. Example is text, verses continuous media space & time based example animation. Linear: a non interactive project starting from at a beginning and running through to an end verses nonlinear & interactive where users are given the navigational control and they can go through the content according to their will allowing personal gateway to information 24 By Mahmood A.Moneim

25 Challenges of Multimedia Computing Developing a successful multimedia system is non-trivial. – Continuous media types such as video need a lot of space to store and very high bandwidth to transmit. – Render different data at same time — continuously – Synchronization — inter-media scheduling for example Video and Audio — Lip synchronization is clearly important for humans to watch playback of video and audio and even animation and audio. – Automatically analyzing, indexing and organizing information in audio, image and video is much harder than from text. – Multimedia involves many different research areas and needs more complex and more efficient algorithms and hardware platforms. – Distributed Networks: Bandwidth, storage, compression. By Mahmood A.Moneim

Benefits of multimedia Easy to understand & easy to use Integrated & interactive Flexible Suitable to cooperative work environment Supportive of large audience 26 By Mahmood A.Moneim

Application Areas  Presentations  Training  Entertainment  Advertising  Reference  Learning  Simulation  Customer support services 27 By Mahmood A.Moneim

Where to use multimedia? In schools: the most needy place – Video capturing & video conferencing – Teaching process can go beyond the limits of traditional teaching methods – Reading skills grow through word recognition Read aloud Spelling – Learn be exploring & discovery – In-depth learning of new clinical techniques 28 By Mahmood A.Moneim

Applications of Multimedia Systems Scientific Applications – Data analyses – Research and development – Experimentation – Technical presentations Instructional Applications “Almost all teaching is multimedia” (Schramm, 1977) – Teaching children to read – Teaching history – Simulations – Reference materials 29 By Mahmood A.Moneim

Where to use multimedia? Multimedia at home – Gardening – Cooking – Design – Remodeling – Entertainment Play stations TV CD Internet gaming zone 30 By Mahmood A.Moneim

Where to use multimedia? In public places: providing help & information – Hotels – Train stations – Shopping centers – Museums Virtual realty – Places the user in the “life like” experience Entertainment Through Multimedia Systems – Interactive games – Sports-related products 31 By Mahmood A.Moneim

Foreseeable Future Multimedia Systems Improved virtual reality Interactive television Improved video telephony More powerful development software Improving user interface 32 By Mahmood A.Moneim

Text Title and Headlines – (What's it all about) Menus – (Where to go) Navigation – (How to get there) Content – (What you see when you get there) 33 By Mahmood A.Moneim

Graphics Reinforce text Supplement text Create impact zSources: yPaint and Drawing Programs yScanners yPhoto CDs yDigital Cameras yDigital Video Stills yWWW 34 By Mahmood A.Moneim

Computer Graphics Bitmap – photographic – paint Vector – drawing 8.5 KB 63 KB By Mahmood A.Moneim

Sound Create atmosphere Feedback Give instructions Give warnings Supplement information on screen 36 By Mahmood A.Moneim

Computer Sound MIDI – 21KB, 2min 36s Digital Audio – 612KB, 56s MP3 37 By Mahmood A.Moneim

Animation Animation can be used to add visual impact to a Multimedia application Visual effects, such as dissolves and wipes, can be used for primitive animation. More complex animations are based on Cell Animation techniques. Animations can be 2-D or 3-D 38 By Mahmood A.Moneim

Digital Movies AVI Director QuickTime MPEG Panoramic By Mahmood A.Moneim

Skills Mix Executive Producer Project Manager Creative DirectorGraphic Artist WriterProgrammer Interface DesignerAnimator ComposerSound Designer VideographerPhotographer 40 By Mahmood A.Moneim

Multimedia- Applications 41 In training By Mahmood A.Moneim

Multimedia- Applications 42 Public awareness campaign Source Interactive Multimedia Project Department of food science& nutrition, Colorado State Univ By Mahmood A.Moneim

Multimedia- Applications 43 In Medicine Source: Cardiac Imaging, YALE centre for advanced cardiac imaging By Mahmood A.Moneim

Q UESTIONS ? By Mahmood A.Moneim44