T.Sharon-A.Frank 1 Multimedia Need high Bandwidth Analog vs. Digital Multi-modality Real-Time MM
2 T.Sharon-A.Frank Major Issues 1. Size of Data Frame 2. Need High Bandwidth 3. Digital vs. Analog Representation 4. Multi-Modality Integration/Blending 5. Soft Real-Time Constraints 6. Need Group Communication 7. Need Synchronization 8. Need for Standards
3 T.Sharon-A.Frank 2. Need High Bandwidth VOICE RIVER IMAGE RIVER BANDWIDTH RIVER BROADBAND RAY VIDEO RIVER DATA STREAM LAN CREEK MICROBROOK PC RUN
4 T.Sharon-A.Frank Channel Rates (Bits/Second) 1Gbps1Mbps 1Kbps Video conferencing Graphical user interfaces Video phone Compressed videoPeripheral sharing TV Information, , voice mail Remote file system Inquiry File transfer HDTVCDAlarm, pagerVoice Telemetry Fax
5 T.Sharon-A.Frank Applications Requirements Session Duration Channel Rate Min 1 Hr 1 Day KB/s1 MB/s1 GB/s High Speed Data Information Retrieval Teleconferencing CD AudioEntertainment Video
6 T.Sharon-A.Frank Increasing Throughput Requirements Increasing Burstiness Bandwidth 64K1.5M45M150M600M FRAME RELAY DEDICATED PRIVATE LINE ISDN SWITCHED T-SERIES SMDS B-ISDN X.25 PACKET SWITCHING DIAL- UP
7 T.Sharon-A.Frank LAN/WAN fit for MM? MMLAN/WAN SlowFast Need Fiber Optics, Broadband, High-Speed Networks (HSN)
8 T.Sharon-A.Frank Solutions Use High Speed Networks (HSNs) Use Lossy Compression Show/See Flash!
9 T.Sharon-A.Frank 3. Digital vs. Analog Representation Analog Sound Wave Digital Sample “ Quantized ” Sound Wave Original SoundDigital SamplingDigital Playback
10 Only certain signal values are valid: –Relatively immune to corruption by noise. –Do not degrade when copied or transmitted over network. Some information lost. Undersampling –Samples 'too far apart' so cannot accurately reconstruct original signal. Digital Signals
11 T.Sharon-A.Frank Solutions Use Standards Use Special Hardware (AD/DA)
12 T.Sharon-A.Frank 4. Multi-Modality Integration/Blending
13 T.Sharon-A.Frank Multimedia Input Eye Tracker Speech Recognizer Data Glove Put that there!
14 T.Sharon-A.Frank Multimedia Output Maps Data Graphs Natural Language Tables Video There are three types of Soviet fighters: the MIG-27 Flogger-D that travels 490 miles per hour, the MIG-29 Fulcrum that...
15 T.Sharon-A.Frank Modality Blending Syntax Semantics Pragmatics Application Mode 1Mode 2Mode 3Mode n...
16 T.Sharon-A.Frank Multimedia-Multimodal Interface Syntax Semantics Pragmatics Application Mode 1Mode 2Mode 3Mode n...
17 T.Sharon-A.Frank 5. Soft Real-Time Constraints
18 T.Sharon-A.Frank Hardware/Software Pipeline Schedule Compress Compression Transmit Initiate Transmit Network Driver Transmission Digitize Schedule Digitize Software Hardware 16.5ms33ms16.5ms20ms 1ms16.5ms ?? Depends on network load Transmitting Video Frame
19 T.Sharon-A.Frank Solutions Use Standards Use Quality of Service (QoS)