MULTIMEDIA AUTHORING AND USER INTERFACE INTRODUCTION

INTRODUCTION Multimedia system is different form others A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 INTRODUCTION Multimedia system is different form others Two Main respects Variety of information objects used in application Level of Integration achieved in using these objects in complex interconnected application Data is shared among large number of application

Multimedia Application A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 Multimedia Application Broadly in the following categories Mail Information repositories Business Processes Common Characteristics Shared Application and used by large number of users Share data object and when they needed Carried out in Sequential manner Require Distributed network operation Mail and Business Process

MULTIMEDIA AUTHORING SYSTEM A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 MULTIMEDIA AUTHORING SYSTEM Target User Professional who prepare the document , Audio or Soundtracks and full Motion video Clips for Wide distribution Average Business user preparing documents, Audio recording, or full motion video clips for stored message and presentation

MULTIMEDIA AUTHORING SYSTEM A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 MULTIMEDIA AUTHORING SYSTEM Design issues for Multimedia Authoring Setting up and maintaining Enterprise wide Guidelines and Standards Standards must be set for a number of design issues Display Resolution Data Formats for Captured data Compression Algorithm Network Interfaces Storage Formats

MULTIMEDIA AUTHORING SYSTEM A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 MULTIMEDIA AUTHORING SYSTEM Display resolution Wide variety of display systems and screen Resolution Design Issues Level of Standardization on display resolution Display protocol Standardization Corporate norms for service degradations Corporate norms for network traffic degradations as they relate to resolution Issues

MULTIMEDIA AUTHORING SYSTEM A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 MULTIMEDIA AUTHORING SYSTEM File Format and Data Compression Issues Varies data formats for image , Audio and full motion Video objects Attribute Information Compression type Estimated time to decompress and display or playback Size of Object Object Orientation Annotation markers and History Index Markers Date and Time of creation Source File Name Version Number Required software Application

MULTIMEDIA AUTHORING SYSTEM A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 MULTIMEDIA AUTHORING SYSTEM Service Degradation Policies Must be resolved at the same time that display protocol and resolution and file and data Compression formats are endorsed is that of corporate norms for service Degradations Several polices Decline the further request with a message Provide the playback services in lower resolution Provide the playback services in full resolution Provide service at full resolution and frame rate in blocks

MULTIMEDIA AUTHORING SYSTEM A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 MULTIMEDIA AUTHORING SYSTEM Design Approaches to Authoring Critical design issues Hypermedia application design Specifics User Interface Aspects Embedding / Linking Streams of objects to a Main Document or Presentation Storage and Access to Multimedia Objects Playing back combined Streams in a Synchronized manner

MULTIMEDIA AUTHORING SYSTEM A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 MULTIMEDIA AUTHORING SYSTEM Types of Multimedia Authoring Systems Depends on specific Role Classifications Dedicated Authoring System Timeline Based Authoring System Structured Authoring System Programmable Authoring System Multisource Multi-User Authoring System Telephone Authoring System

MULTIMEDIA AUTHORING SYSTEM A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 MULTIMEDIA AUTHORING SYSTEM Dedicated Authoring System simplest authoring systems It is usually designed for a single user It needs a very intuitive interface Used for single user and are at the desk of end users and the authoring is performed on objects captured by camera Used by users who may not be as knowledgeable about multimedia management

MULTIMEDIA AUTHORING SYSTEM A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 MULTIMEDIA AUTHORING SYSTEM Timeline Based Authoring System In this Objects are placed along timeline and the timeline is drawn on screen in a window in graphic manner. Here once the multimedia object has been captured in timeline, it is fixed in location and can be manipulated easily Objects are placed along a timeline The composition of objects is based on time This makes the adjustment of objects’ lengths difficult Information about the relationship between objects is lost Newer systems allow authoring on the object composition level

A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017

MULTIMEDIA AUTHORING SYSTEM A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 MULTIMEDIA AUTHORING SYSTEM Structured Authoring System This allows explicit manipulations of the structure of a multimedia presentation Explicit representation of the structure allows modular authoring of component objects Good authoring systems should allow the user to define an object hierarchy to specify the relative location of each object within that hierarchy to make temporal adjustment to objects

MULTIMEDIA AUTHORING SYSTEM A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 MULTIMEDIA AUTHORING SYSTEM Structured Authoring System This system is based on structured object level construction of complex presentations and it may be composed of video clips, music… This structured authoring systems consists of 2 stages and they are 1. Construction of structure of presentations 2. Assignment of detailed timing constraints The capabilities of this system are as follows 1. Ability to view the complex structure 2. Maintain object hierarchy 3. Capability to zoom down 4. View specific components in part 5. Provide running status of designated length of the presentation 6. Showing the timing relations 7. Ability to address all multimedia types

A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017

MULTIMEDIA AUTHORING SYSTEM A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 MULTIMEDIA AUTHORING SYSTEM Multisource Multiuser Authoring System The classes of objects that are addressed by multisource multiuser authoring system are as follows Transparent objects with no temporal qualities such as graphics Opaque objects with no temporal qualities such as images Transparent objects with no temporal qualities such as sound and audio Opaque objects with no temporal qualities such as videos

MULTIMEDIA AUTHORING SYSTEM A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 MULTIMEDIA AUTHORING SYSTEM Telephone Authoring System The interesting applications are linking the phone into multimedia electronic mail applications and the applications are The phone can be used as reading device by providing full text to speech synthesis Telephone can be used for voice command input for setting up and managing voice messages The capability to recognize continuous speech, phones can be used to create electronic mail messages where the voice is converted into ASCII text

HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS The user interface must be highly intuitive to allow the user to learn the tools quickly and be able to use them effectively By controlling desktop environments, users also need control of their environment and this control includes the following The ability to specify a primary server for each object class within a domain specified by the system administrator The ability to specify whether all multimedia objects or only references should be replicated The ability to specify that the multimedia object should be retrieved immediately for display Decompression should be performed at another network server locally

HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS The steps for the good hypermedia design are as follows Type of Hypermedia Application Structuring the information Determining the navigation through application Methodologies for accessing the information Designing user interface

HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS Integration of Application The system is used for diverse set of applications that includes the following Electronic mail Word processing Graphics and formal presentation software Spreadsheet software Access to relational or object oriented database Customized applications such as billing, portfolio management

HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS Common User Interface And Application Integration Microsoft windows has standardized the user interface for large number of applications at the following levels Overall visual look and feel Menus Dialog boxes Buttons Help features Scroll bars Tool bars File open and save

HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS Data Exchange Microsoft windows clipboard allows the exchanging data in any format and used to exchange the multimedia objects The application clipboard allows the following formats to be stored Text Bitmap Image Sound Video

HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS Distributed Data Access Application integration succeeds only if all applications required for compound object can access the sub objects that they manipulate In a fully distributed data management, the applications need access to data on any server from any workstation Fully distributed data access implies that any application at any client workstation

HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS Hypermedia Application Design Structuring the Information Information structuring is used to identify the information objects and to develop an information structure is as follows Object types and object hierarchies- this shows how the various attributes and representations of real world objects are related. The nature of information structure determines the function that can be performed on that information set Object representations – multimedia objects have a variety of objects representation and consists of several information elements as text, image, audio and video

HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS Hypermedia Application Design Structuring the Information Object connections – another issue of hypermedia design is object interconnections. In relational model, the connections are achieved through joins and in object oriented models through pointers Derived connections and representations – traditional schemes ignore derived connections between objects and representations of derived objects. Modeling of hypermedia system should attempt to take derived objects for establishing guidelines

HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 HYPERMEDIA APPLICATION DESIGN CONSIDERATIONS Attaching Sounds And Video Clips to Objects The overall process of creating sound track for a film merge along the parallel paths through recording, editing, premising, final mixing and print mastering Dialogue editing is the first step in creating a mixed language dialogue track consisting of production dialogue clips as well as dubbed studio clips The final mix brings the dialogue, music, sound effects together in terms of timing synchronization and the tracks are then combined into print master used for video tape or movie duplication The key point is that attaching video and sound object is complex process with multiple objects in fully time synchronized manner.

A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 USER INTERFACE DESIGN It is important due to number of types of interactions with the user and the four types of user interface development tools are as follows Media editor Authoring applications Hypermedia object creation Multimedia object locator and creator

USER INTERFACE DESIGN Navigation Through The Application A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 USER INTERFACE DESIGN Navigation Through The Application Navigation refers to the sequence in which application progresses and objects are created, searched and used The navigation is “direct” when the user needs to know what to expect with navigation actions to know what to expect with navigation actions The navigation is browse mode where the user does not know the precise question The operation from the display or entry of one object to display or entry of next object is called as link

USER INTERFACE DESIGN Designing User Interface A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 USER INTERFACE DESIGN Designing User Interface The effective interface design have the following guidelines Planning the overall structure of application Planning the content of the application Planning the interactive behavior Planning the look and feel of the application

USER INTERFACE DESIGN Metaphors For Multimedia Applications A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 USER INTERFACE DESIGN Metaphors For Multimedia Applications Multimedia applications have 2 key technologies and they are as follows Entertainment Business computing The entertainment consists of video recording , video playback and game systems Business computing brings phone integration with GUI and voice activated user interface and the types of metaphor are as follows Organizer metaphor Telephone metaphor Aural metaphor VCR metaphor

USER INTERFACE DESIGN Audio video indexing options A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 USER INTERFACE DESIGN Audio video indexing options The three issues for indexing audio and video tape are as follows Counters identify tape locations and the user maintains index listings Special events are used as index markers Users can specify locations for index marking

A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 INFORMATION ACCESS The information access defines the way objects can be accessed and how navigations takes place through the information objects and the types are Direct information Random selection Path selection

OBJECT DISPLAY/PLAYBACK ISSUES A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 OBJECT DISPLAY/PLAYBACK ISSUES Each object type has to address common features expected by users and to provide users with special controls and the issues are Image display issues – images are stored in compressed form and the images scanned by high quality scanners are scanned at 400 pixels Audio quality – audio files are stored In any format

OBJECT DISPLAY/PLAYBACK ISSUES A.Aruna, Assistant Professor, faculty of Information Technology 4/28/2017 OBJECT DISPLAY/PLAYBACK ISSUES Video playback – they provide video frame interleaving, scene change frame detection, video scaling, panning and zooming Three dimensional object display – planar imaging technique is used. 3D images are constructed from 2D images and special projection techniques are used to display them