1 Multimedia Communication Multimedia Systems Summary: r Multimedia Networking Applications: Requirements r Current Networks m Limitations & Evolution.

Slides:



Advertisements
Similar presentations
Streaming Video over the Internet
Advertisements

1 Multimedia Networking EECS 489 Computer Networks Z. Morley Mao Monday March 26, 2007 Acknowledgement: Some.
Multimedia Systems As Presented by: Craig Tomastik.
Chapter 20: Multimedia Systems Silberschatz, Galvin and Gagne ©2005 Operating System Concepts Chapter 20: Multimedia Systems What is Multimedia.
29.1 Chapter 29 Multimedia Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
29.1 Chapter 29 Multimedia Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
TCP/IP Protocol Suite 1 Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. Chapter 25 Multimedia.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition Chapter 20: Multimedia Systems.
19 – Multimedia Networking. Multimedia Networking7-2 Multimedia and Quality of Service: What is it? multimedia applications: network audio and video (“continuous.
User Control of Streaming Media: RTSP
Chapter 6 outline r 6.1 Multimedia Networking Applications r 6.2 Streaming stored audio and video m RTSP r 6.3 Real-time, Interactive Multimedia: Internet.
Application layer (continued) Week 4 – Lecture 2.
1 CSE 401N Multimedia Networking Lecture Multimedia, Quality of Service: What is it? Multimedia applications: network audio and video network provides.
Multimedia Applications r Multimedia requirements r Streaming r Phone over IP r Recovering from Jitter and Loss r RTP r Diff-serv, Int-serv, RSVP.
Streaming, RTP, RTSP ITEM, 26feb02, Leif Arne Rønningen.
1 Computer Networks Transport Layer Protocols. 2 Application-layer Protocols Application-layer protocols –one “piece” of an app –define messages exchanged.
Multimedia Computer Networks 10/02/02 Xavier Appé.
Computer Networking Multimedia.
1 Video and Audio Over The Net Mahdi ZandakbariVesal Hajiabbas.
CS640: Introduction to Computer Networks
CS 218 F 2003 Nov 3 lecture:  Streaming video/audio  Adaptive encoding (eg, layered encoding)  TCP friendliness References: r J. Padhye, V.Firoiu, D.
RTSP Real Time Streaming Protocol
1 CMSCD1011 Introduction to Computer Audio Lecture 10: Streaming audio for Internet transmission Dr David England School of Computing and Mathematical.
CIS679: RTP and RTCP r Review of Last Lecture r Streaming from Web Server r RTP and RTCP.
6: Multimedia Networking6a-1 Chapter 6: Multimedia Applications r Multimedia requirements r Streaming r Phone over IP r Recovering from Jitter and Loss.
Multimedia and QoS#1#1 Multimedia Applications. Multimedia and QoS#2#2 Multimedia Applications r Multimedia requirements r Streaming r Recovering from.
7: Multimedia Networking7-1 Chapter 7 Multimedia Networking A note on the use of these ppt slides: We’re making these slides freely available to all (faculty,
Advanced Multimedia University of Palestine University of Palestine Eng. Wisam Zaqoot Eng. Wisam Zaqoot October 2010 October 2010 Ref: Computer Networking:
Streaming Stored Audio and Video (1) and Video (1) Advanced Multimedia University of Palestine University of Palestine Eng. Wisam Zaqoot Eng. Wisam Zaqoot.
XE33OSA Chapter 20: Multimedia Systems. 20.2XE33OSA Silberschatz, Galvin and Gagne ©2005 Chapter 20: Multimedia Systems What is Multimedia Compression.
November 27 th, 2012 CS1652 Jack Lange University of Pittsburgh 1.
Quality of Service in the Internet The slides of part 1-3 are adapted from the slides of chapter 7 published at the companion website of the book: Computer.
Chapter 5: Summary r principles behind data link layer services: m error detection, correction m multiple access protocols m link layer addressing, ARP.
1 How Streaming Media Works Bilguun Ginjbaatar IT 665 Nov 14, 2006.
Digital Multimedia, 2nd edition Nigel Chapman & Jenny Chapman Chapter 17 This presentation © 2004, MacAvon Media Productions Multimedia and Networks.
Multimedia Over IP: RTP, RTCP, RTSP “Computer Science” Department of Informatics Athens University of Economics and Business Λουκάς Ελευθέριος.
TCP/IP Protocol Suite 1 Chapter 25 Upon completion you will be able to: Multimedia Know the characteristics of the 3 types of services Understand the methods.
1 Lecture 17 – March 21, 2002 Content-delivery services. Multimedia services Reminder  next week individual meetings and project status report are due.
CS640: Introduction to Computer Networks Aditya Akella Lecture 19 - Multimedia Networking.
What is Multimedia? Function: noun plural but singular or plural in construction Date: 1950 : a technique (as the combining of sound, video, and text)
Multimedia, Quality of Service: What is it?
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Multimedia Systems.
Chapter 6 outline r 6.1 Multimedia Networking Applications r 6.2 Streaming stored audio and video m RTSP r 6.3 Real-time Multimedia: Internet Phone Case.
1 o characteristics – From an application-level API to the physical layer – CBR, VBR, ABR and UBR – Cell: bytes – Virtual circuits: virtual channel.
1 Multimedia Networking R. Yang. 2 Outline r Admin. and review  Introduction to multimedia networking r An architecture of stored multimedia r Network.
CMPT365 Multimedia Systems 1 Multimedia Networking/Communications Spring 2015 CMPT 365 Multimedia Systems.
03/11/2015 Michael Chai; Behrouz Forouzan Staffordshire University School of Computing Streaming 1.
Lab Assignment 15/ INF5060: Multimedia data communication using network processors.
McGraw-Hill©The McGraw-Hill Companies, Inc., 2004 Chapter 28 Multimedia.
Chapter 28. Network Management Chapter 29. Multimedia
Multimedia streaming Application Anandi Giridharan Electrical Communication Engineering, Indian Institute of Science, Bangalore – , India Querying.
Computer Networking Multimedia. 11/15/20052 Outline Multimedia requirements Streaming Phone over IP Recovering from Jitter and Loss RTP QoS Requirements.
Internet multimedia: simplest approach audio, video not streamed: r no, “pipelining,” long delays until playout! r audio or video stored in file r files.
Ch 6. Multimedia Networking Myungchul Kim
Real Time Streaming Protocol (RTSP)
TCP/IP Protocol Suite 1 Chapter 25 Upon completion you will be able to: Multimedia Know the characteristics of the 3 types of services Understand the methods.
Ch 6. Multimedia Networking Myungchul Kim
Tutorial 11 Solutions. Question 1 Q1. What is meant by interactivity for streaming stored audio/video? What is meant by interactivity for real-time interactive.
Multimedia Streaming I. Fatimah Alzahrani. Introduction We can divide audio and video services into three broad categories: streaming stored audio/video,
IT 424 Networks2 IT 424 Networks2 Ack.: Slides are adapted from the slides of the book: “Computer Networking” – J. Kurose, K. Ross Chapter 4: Multimedia.
RTP/RTCP/RTSP Ben Biro CISC 856 – Spring '10 University of Delaware Thanks to Professor Amer, Henning Schulzrinne, Colin Perkins, Amit Hetawal.
Chapter 13: Multimedia and Networking BITM1113- Multimedia Systems.
19 – Multimedia Networking
Chapter 29 Multimedia Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
University of Pittsburgh
Multimedia Applications
Chapter 25 Multimedia TCP/IP Protocol Suite
CSCD 433/533 Advanced Networks
Multimedia Applications
Presentation transcript:

1 Multimedia Communication Multimedia Systems Summary: r Multimedia Networking Applications: Requirements r Current Networks m Limitations & Evolution r RTSP Sources: r Chapter 6 from “ Computer Networking: A Top-Down Approach Featuring the Internet”, by Kurose and Ross

2 Multimedia Networking Applications r Characteristics: m Highly delay-sensitive: Packets that incur a sender-to-receiver delay of more than a few hundred milliseconds (for Internet Telephony) to a few seconds (for streaming of stored media) are essentially useless. m Loss Tolerant: Occasional losses only cause occasional glitches in the audio/video playback, and these losses can be partially of fully concealed. r Compare these against “elastic” applications like WWW (text/images), , ftp and Telnet. m Long delays are annoying but not harmful; Integrity of data is paramount.

3 Example Category 1 Streaming, Stored Audio and Video r Clients request on-demand compressed audio or video files that are stored on servers r Characteristics: m Stored Media: Content is prerecorded, the client may pause, rewind, fast-forward or index; The time from when a client makes a request until the action manifests itself at the client should be of the order of 1 to 10 seconds m Streaming: Client begins playout of the media after (a short delay, maybe zero) it begins receiving the file from server. m Continuous Playout: Once playout of the media begins, it should proceed according to the original timing of the recording; The end-to-end delay constraints for streaming, stored media are typically less stringent than those of live, interactive applications like Internet telephony and video conferencing.

4 Example Category 2 Streaming of Live Audio and Video r Similar to traditional broadcast Radio/TV, except the transmission takes place over the Internet r Characteristics: m No fast-forward of media; May use local storage for rewind and pause functionality m Distribution to large audiences can be done using Multicast m Continuous playout is required, although the timing constraints are less stringent than live interactive media. m Delays of up to tens of seconds from when the user requests the delivery/playout of a live transmission to when the playout begins can be tolerated.

5 Example Category 3 Real-Time Interactive Audio and Video r Allows people to use audio and video to communicate with each other. r Internet Phone (Audio), Microsoft’s Netmeeting (Video) r For a conversation with interaction among multiple speakers, the delay from when a user speaks or moves until the action is manifested at the receiving hosts should be less than a few hundred milliseconds r For voice, m Delays  150 ms are not perceived by a human listener m Delays between 150 and 400 ms are acceptable m Delays  400 ms can be frustrating if not completely unintelligible.

6 Internet: Limitations r Best-Effort Service m No guarantee on end-to-end delay m No promises about variation of packet delay within a packet stream (Packet Jitter) m No class based service: Totally Egalitarian m Some techniques to adapt: Use UDP for audio/video communication, to circumvent TCP’s low throughput when it enters its slow-start phase (recall TCP congestion control). Delayed (say 100 ms) playback Timestamp packets Prefetch stored media when extra bandwidth is available Send redundant information to mitigate network- induced packet loss

7 How to Evolve the Internet There are three camps of thought r Camp 1 m Philosophy: No need to make any fundamental changes to the best-effort service, just add more bandwidth to the links. m Arguments against: Additional bandwidth might be too costly, further it will soon be eaten up by bandwidth hungry applications like high-definition video on demand. r Camp 2 m Philosophy: Fundamental changes are needed to allow applications to explicitly reserve end-to-end bandwidth. Need a protocol for reservation Modify scheduling policies at intermediate routers to honor bandwidth reservations Applications must quantitatively describe their requirements and the network must police the applications to make sure they adhere to this. The network must have the means to ascertain whether a request can be satisfied given its current guarantees (Admission Control).

8 How to Evolve the Internet (Contd.) r Camp 3 m Philosophy: Differentiated Service, Make relatively small changes at the network and transport layers and introduce simple pricing and policing schemes at the edge of the network (i.e., at the interface between the user and the user’s ISP) m The idea is to introduce a small number of service classes assign each datagram to one of the service class intermediate routers prioritize datagrams according to their class charge accordingly

9 Streaming Stored Media What has led to the popularity of this class? m Cheap Storage => More stored media content on the Internet m Improvements in Internet infrastructure: ADSL, Cable, Caching of Video, new QoS-oriented Internet Protocols m Enormous demand for high-quality video streaming, a killer app that combines two existing technologies: television and on-demand Web. How? m Client: Media Player: Does decompression, jitter removal, error correction, and provide a GUI. m Server Web Server: Using HTTP (TCP) Streaming Server

10 Streaming Server Options for delivering audio/video from a streaming server to a media player: 1. Audio and Video is sent over UDP at a constant rate equal to the drain rate at the receiver 2. Same as above, however, the media player delays playout for 2-5 seconds in order to delay network-induced jitter. 3. Media sent over TCP. The server pushes the media file as quickly as it can into the TCP socket; r the media player reads from the TCP socket as quickly as it can and places the compressed video into a player buffer. r the player reads from the buffer at a rate of d and performs decompression and playback. From network Fill rate = x(t) Drain rate = d Client Buffer Prefetched Video Data To decompression and playout

11 Real Time Streaming Protocol (RTSP) Henning Schulzrinne’s site: Not to be confused with RTP; No relation whatsoever RTSP:To allow a user (of a media player) to control playback of streamed media, the media player and the server need a protocol for exchanging playback control information. What RTSP is not: m RTSP does not define compression schemes m RTSP does not define how media is encapsulated in packets for transmission over the network (RTP or like may provide this) m RTSP does not restrict how streamed media is transported; it can be transported using UDP or TCP m RTSP does not restrict how (or if) the media player buffers media. The media player may choose to play, immediately, delayed or, completely download and then play. RTSP is: m A protocol that allows a media player to control the transmission of a media stream m It’s a out-of-band protocol; uses port # 544 (UDP or TCP).

12 RTSP Example The Web browser first requests a presentation description file from a Web server. m The presentation description file can have references to several continuous- media files as well as directives for synchronization of the continuous-media files. m Each reference to a continuous-media file begins with the URL method, rtsp://.

13 Sample presentation description file Twister <track type=audio e="PCMU/8000/1“ src="rtsp://audio.example.com/twister/audio.en/lofi"> <track type=audio e="DVI4/16000/2" pt="90 DVI4/8000/1“ src="rtsp://audio.example.com/twister/audio.en/hifi"> <track type="video/jpeg" src="rtsp://video.example.com/twister/video"> In this presentation, an audio and video stream are played in parallel and in lip sync (as part of the same "group"). For the audio stream, the media player can choose ("switch") between two audio recordings, a low-fidelity recording and a high-fidelity recording.

14 RTSP Operation r The player sends an RTSP SETUP request, and the server sends an RTSP SETUP response with a session identifier. r Each RTSP session has a session identifier, which is chosen by the server. r The player sends an RTSP PLAY request, say, for low-fidelity audio, and the server sends an RTSP PLAY response. r At this point, the streaming server pumps the low-fidelity audio into its own in-band channel. r Later, the media player may send an RTSP PAUSE request to which, the server responds with an RTSP PAUSE response. r The client repeats the session identifier for each request, until the client closes the session with the TEARDOWN request.

15 RTSP Example Session r The following is a simplified example of an RTSP session between a client (C:) and a sender (S:). C: SETUP rtsp://audio.example.com/twister/audio RTSP/1.0 Transport: rtp/udp; compression; port=3056; mode=PLAY S: RTSP/ OK Session 4231 C: PLAY rtsp://audio.example.com/twister/audio.en/lofi RTSP/1.0 Session: 4231 Range: npt=0- C: PAUSE rtsp://audio.example.com/twister/audio.en/ lofi RTSP/1.0 Session: 4231 Range: npt=37 C: TEARDOWN rtsp://audio.example.com/twister/audio.en/ lofi RTSP/1.0 Session: 4231 S: OK r Notice that in this example, the player chose not to play back the complete presentation, but instead only the low- fidelity portion of the presentation. r The RTSP protocol is actually capable of doing much more than described in this brief introduction. r In particular, RTSP has facilities that allow clients to stream toward the server (for example, for recording).