Klara Nahrstedt Spring 2010

Slides:



Advertisements
Similar presentations
Packet Based Multimedia Communication Systems H.323 & Voice Over IP Outline 1. H.323 Components 2. H.323 Zone 3. Protocols specified by H Terminal.
Advertisements

29.1 Chapter 29 Multimedia Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
29.1 Chapter 29 Multimedia Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
RTP: A Transport Protocol for Real-Time Applications Provides end-to-end delivery services for data with real-time characteristics, such as interactive.
TCP/IP Protocol Suite 1 Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. Chapter 25 Multimedia.
CS Spring 2011 CS 414 – Multimedia Systems Design Lecture 18 – Multimedia Session Protocols Klara Nahrstedt Spring 2011.
User Control of Streaming Media: RTSP
Multimedia Streaming Protocols1 Multimedia Streaming: Jun Lu Xinran (Ryan) Wu CSE228 Multimedia Systems Challenges and Protocols.
1 Spring Semester 2007, Dept. of Computer Science, Technion Internet Networking recitation #2 Header Compression.
Real-time Transport Protocol Matt Boutell CS457: Computer Networks November 15, 2001.
CSc 461/561 CSc 461/561 Multimedia Systems Part C: 1. RTP/RTCP.
1 Internet Networking Spring 2006 Tutorial 14 Header Compression.
TCP/IP Protocol Suite 1 Chapter 25 Upon completion you will be able to: Multimedia Know the characteristics of the 3 types of services Understand the methods.
RTP: A Transport Protocol for Real-Time Applications
RTP/RTCP(RFC 1889) Real-time transport protocol (RTP) is the de facto standard media transport protocol in the Internet Media transport: audio, vedio,
CS640: Introduction to Computer Networks
CS 218 F 2003 Nov 3 lecture:  Streaming video/audio  Adaptive encoding (eg, layered encoding)  TCP friendliness References: r J. Padhye, V.Firoiu, D.
CIS679: RTP and RTCP r Review of Last Lecture r Streaming from Web Server r RTP and RTCP.
Computer Networks: Multimedia Applications Ivan Marsic Rutgers University Chapter 3 – Multimedia & Real-time Applications.
1 How Streaming Media Works Bilguun Ginjbaatar IT 665 Nov 14, 2006.
Multimedia Over IP: RTP, RTCP, RTSP “Computer Science” Department of Informatics Athens University of Economics and Business Λουκάς Ελευθέριος.
TCP/IP Protocol Suite 1 Chapter 25 Upon completion you will be able to: Multimedia Know the characteristics of the 3 types of services Understand the methods.
1 Lecture 17 – March 21, 2002 Content-delivery services. Multimedia services Reminder  next week individual meetings and project status report are due.
Real Time Protocol (RTP) 김 준
CS Spring 2009 CS 414 – Multimedia Systems Design Lecture 21 – Case Studies for Multimedia Network Support (Layer 3) Klara Nahrstedt Spring 2009.
8. 1 MPEG MPEG is Moving Picture Experts Group On 1992 MPEG-1 was the standard, but was replaced only a year after by MPEG-2. Nowadays, MPEG-2 is gradually.
Team Members Atcharawan Jansprasert Padmoja Roy Rana Almakabi Ehsan Eslamlouevan Manya Tarawalie.
Streaming Media Control n The protocol components of the streaming n RTP/RTCP n RVSP n Real-Time Streaming Protocol (RTSP)
Chapter 28. Network Management Chapter 29. Multimedia
CS Spring 2009 CS 414 – Multimedia Systems Design Lecture 20 – TCP Augmentations for Multimedia & Midterm Review Session Klara Nahrstedt Spring 2009.
LOG Objectives  Describe some of the VoIP implementation challenges such as Delay/Latency, Jitter, Echo, and Packet Loss  Describe the voice encoding.
CS Spring 2014 CS 414 – Multimedia Systems Design Lecture 18 – Multimedia Transport (Part 1) Klara Nahrstedt Spring 2014.
CS Spring 2014 CS 414 – Multimedia Systems Design Lecture 22 – Multimedia Session Protocols Klara Nahrstedt Spring 2014.
RTP – Real-time Transport Protocol Elbert Tsay, Brad Bargabus, Patrick Lim, Henry Quach The Five Packeteers (minus 1  )
Klara Nahrstedt Spring 2012
CS Spring 2012 CS 414 – Multimedia Systems Design Lecture 20 – Multimedia Session Protocols Klara Nahrstedt Spring 2012.
Ch 6. Multimedia Networking Myungchul Kim
CSE5803 Advanced Internet Protocols and Applications (14) Introduction Developed in recent years, for low cost phone calls (long distance in particular).
TCP/IP Protocol Suite 1 Chapter 25 Upon completion you will be able to: Multimedia Know the characteristics of the 3 types of services Understand the methods.
Ch 6. Multimedia Networking Myungchul Kim
An Extensible RTCP Control Framework for Large Multimedia Distributions Paper by: Julian Chesterfield Eve M. Schooler Presented by: Phillip H. Jones.
1 Internet Telephony: Architecture and Protocols an IETF Perspective Authors:Henning Schulzrinne, Jonathan Rosenberg. Presenter: Sambhrama Mundkur.
3/10/2016 Subject Name: Computer Networks - II Subject Code: 10CS64 Prepared By: Madhuleena Das Department: Computer Science & Engineering Date :
CS Spring 2014 CS 414 – Multimedia Systems Design Lecture 19 – Multimedia Transport Subsystem (Part 2) + Midterm Review Klara Nahrstedt Spring 2014.
11 CS716 Advanced Computer Networks By Dr. Amir Qayyum.
VoIP ALLPPT.com _ Free PowerPoint Templates, Diagrams and Charts.
The Transport Layer Congestion Control & UDP
Chapter 9: Transport Layer
RTP: A Transport Protocol for Real-Time Applications
RTP: A Transport Protocol for Real-Time Applications
Real-Time Transport Protocol
Chapter 29 Multimedia Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
Klara Nahrstedt Spring 2012
Klara Nahrstedt Spring 2010
Instructor Materials Chapter 9: Transport Layer
Chapter 5 Network and Transport Layers
Klara Nahrstedt Spring 2009
Klara Nahrstedt Spring 2009
RTP: A Transport Protocol for Real-Time Applications
Networking Applications
VOICE AND VIDEO OVER IP VOIP, RTP, RSVP.
Klara Nahrstedt Spring 2014
RTP: A Transport Protocol for Real-Time Applications
RTP – Real-time Transport Protocol
Net 431: ADVANCED COMPUTER NETWORKS
Chapter 25 Multimedia TCP/IP Protocol Suite
Networking Applications
Foreleser: Carsten Griwodz
Multimedia and Networks
Judith Molka-Danielsen, Oct. 02, 2000
Presentation transcript:

Klara Nahrstedt Spring 2010 CS 414 – Multimedia Systems Design Lecture 20 – Multimedia Session Protocols Klara Nahrstedt Spring 2010 CS 414 - Spring 2010

Administrative HW1 deadline March 5, today, midnight 11:59pm Individual effort!!! (take it as a midterm preparation) Midterm, March 8 11-11:50am in class All topics/lectures until February 26, i.e., the material covered this week March 1-8 will not be on the midterm You can bring calculator and 1 page of cheat-sheet (otherwise, exam is closed book, closed notes) Class on Friday, March 8 - discussion of midterm topics CS 414 - Spring 2010

Outline Multimedia Protocols – Standards RTP/UDP/IP – Transmission Protocol RTCP Control/Negotiation Protocol to RTP CS 414 - Spring 2010

Internet Multimedia Protocol Stack Media encaps (H.264, MPEG-4) APPLICATION RTSP RSVP RTCP Layer 5 (Session) SIP RTP Layer 4 (Transport) TCP UDP KERNEL Layer 3 (Network) IP Version 4, IP Version 6 AAL3/4 AAL5 MPLS Layer 2 (Link/MAC) Ethernet/WiFi ATM/Fiber Optics CS 414 - Spring 2010

Relation between RTP and RTCP Decoding Coding RTP RTCP UDP/IP Application Application Coding Decoding RTCP RTP UDP/IP CS 414 - Spring 2010

RTCP: Control and Management Out-of-band control information for RTP flow. Monitors QoS for RTP in the delivery and packaging of multimedia data Used periodically to transmit control packets to participants in a streaming multimedia session. Provides feedback on the quality of service being provided by RTP. Gathers statistics on media connection Bytes sent, packets sent, lost packets, jitter, feedback and round trip delay. Application may use this information to increase the quality of service, perhaps by limiting flow or using a different codec. CS 414 - Spring 2010

RTCP Functions There are several type of RTCP packets: Sender report packet, Receiver report packet, Source Description RTCP Packet, Goodbye RTCP Packet and Application Specific RTCP packets. RTCP itself does not provide any flow encryption or authentication means. SRTCP protocol can be used for that purpose. CS 414 - Spring 2010

RTP Services Payload Type Identification Sequence numbering Determination of media coding Source identification RTP works with Profiles Profile defines a set of payload type codes and their mappings to payload formats Sequence numbering Error detection Time-stamping Time monitoring, synchronization, jitter calculation Delivery monitoring , the services provided by RTP include: Payload-type identification - Indication of what kind of content is being carried Sequence numbering - PDU sequence number Time stamping - allow synchronization and jitter calculations Delivery monitoring The protocols themselves do not provide mechanisms to ensure timely delivery. They also do not give any Quality of Service (QoS) guarantees. These things have to be provided by some other mechanism. Also, out of order delivery is still possible, and flow and congestion control are not supported directly. However, the protocols do deliver the necessary data to the application to make sure it can put the received packets in the correct order. Also, RTCP provides information about reception quality which the application can use to make local adjustments. For example if a congestion is forming, the application could decide to lower the data rate. RTP was also published by the ITU-T as H.225.0, but later removed once the IETF had a stable standards-track RFC published. It exists as an Internet Standard (STD 64) defined in RFC 3550 (which obsoletes RFC 1889). RFC 3551 (STD 65) (which obsoletes RFC 1890) defines a specific profile for Audio and Video Conferences with Minimal Control. RFC 3711 defines the Secure Real-time Transport Protocol (SRTP) profile (actually an extension to RTP Profile for Audio and Video Conferences) which can be used (optionally) to provide confidentiality, message authentication, and replay protection for audio and video streams being delivered. CS 414 - Spring 2010

RTP Message MAC header IP header UDP header RTP message 00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 Ver P X CC M PT Sequence Number Timestamp SSRC CSRC [0..15] ::: Ver – Version 2 P – Padding X – Extension, if set, the fixed head is followed by exactly one header extension CC – CSRC count M – Marker – intended to allow significant events such as frame boundaries to be marked (defined by profile) PT – Payload type SSRS – synchronization source, CSRC – contribution source CS 414 - Spring 2010

RTP Services – Support of Heterogeneity Mixer service Allows for resynchronization of incoming audio packets Reconstructs constant 20 ms spacing generated by sender Mixes reconstructed audio streams into single stream Translates audio encoding to lower bandwidth Forwards lower bandwidth packet streams Translator service Allows for translation between IP and other high speed protocols May change encoding data CS 414 - Spring 2010

Difference between Mixers and Translators CS 414 - Spring 2010

Payload Formats Static Payload formats Dynamic Payload formats Established in RTP Profile Payload type 0 := µ-law audio codec Dynamic Payload formats Applications agree per session on payload format H.263, JPEG, MPEG CS 414 - Spring 2010

Session Management (Layer 5) Important part of multimedia communication Separates control aspects from transport aspects SESSION MANAGER Conference control Participant Management Session Control Protocol (e.g., RTSP) Session Control Media control Configuration control Presentation data communication whiteboard Continuous data communication video Continuous data communication audio CS 414 - Spring 2010

Session Manager Tasks: Membership control Monitoring of shared workspace Coordination of Media control management Exchange of QoS parameters Conference control management – establishment, modification, termination CS 414 - Spring 2010

Session Control Session Described by Session state Name of session, start, valid policies Session management – two steps for state processing Establishment of session Modification of session CS 414 - Spring 2010

Session Control Conference Control Media Control Configuration Control Centralized or distributed approach Media Control Synchronization Configuration Control Negotiation of QoS parameters, admission control and reservation/allocation of resources Membership Control Invitation of users; registration of users, change of membership CS 414 - Spring 2010

Conclusion RTP usage – in several application audio and video tools (vat, vic) RTP follows the principle of application level framing and integrated layer processing RTP/UDP/IP is being used by the current streaming session protocols such as RTSP Session protocols are actually negotiation/session establishment protocols that assist multimedia applications Multimedia applications such as QuickTime, Real Player and others use them CS 414 - Spring 2010

Midterm March 8 (Monday), 11-11:50am, 1302 SC Closed Book, Closed Notes You can bring calculator and 1 page cheat sheet CS 414 - Spring 2010

Covered Material Class Notes (Lectures 1-17) Book Chapters to read/study: Media Coding and Content processing book Chapter 2, Chapter 3.1-3.2, 3.8, Chapter 4.1-4.2.2.1, Chapter 4.3 (as discussed in lecture) Chapter 5, chapter 7.1-7.5, 7.7 Multimedia Systems book Chapter 2.1-2.4, (not 2.4.4 – we have not covered QoS routing ), CS 414 - Spring 2010

Material Media Characteristics Audio Characteristics Synchronous, Isochronous, Asynchronous Regular, irregular Weakly and strongly periodic streams Audio Characteristics Samples, frequency, Perception, psychoacoustic effects, loudness, pitch, decibel, intensity Sampling rate, quantization CS 414 - Spring 2010

Material Audio Characteristics Image Characteristics PCM, DPCM, ADPCM, signal-to-noise ratio Image Characteristics Sampling, quantization, pixels Image properties: color, texture, edges Simple edge detection process CS 414 - Spring 2010

Material Video technology Color perception: hue, brightness, saturation, Visual representation: horizontal and vertical resolution , aspect ratio; depth perception, luminance, temporal resolution and motion Flicker effect Color coding: YUV, YIQ, RGB NTSC vs HDTV formats CS 414 - Spring 2010

Material Basic Coding schemes Hybrid codes Run-length coding Statistical coding Huffman coding Arithmetic coding Hybrid codes JPEG: image preparation, DCT transformation, Quantization, entropy coding, JPEG-2000 characteristics CS 414 - Spring 2010

Material Hybrid Coding Video MPEG: image preparation, I, P, B frames characteristics, quantization, display vs processing/transmission order of frames Audio MPEG: role of psychoacoustic effect, masking, steps of audio compression MPEG-4: differences to MPEG-2/MPEG-1 Audio-visual objects, layering CS 414 - Spring 2010

Material Quality of Service concepts Service classes, QoS specification – deterministic, predictive, best effort, QoS classification – application, system, network QoS, relation between QoS and resources QoS operations: translation, negotiation of QoS parameters CS 414 - Spring 2010

Material Resource Management concepts QoS and resources, establishment phase and transmission/enforcement phase Admission control of resources, reservation and allocation of resources LBAP arrival model CS 414 - Spring 2010

Sample Problems Consider the following alphabet {C,S,4,1}, with probabilities: P(C) = 0.3, P(S) = 0.2, P(4)= 0.25, P(1) = 0.25. Encode the word CS414 using Huffman coding and arithmetic coding Compare which encoding requires less bits CS 414 - Spring 2010

Sample Problems Describe briefly each step in MPEG-1 audio encoding. Specify the functionality, which is performed in each step. You don’t have to provide equations, only a clear explanation of the functionality that is performed inside each step. CS 414 - Spring 2010

Sample Problems What is flicker effect and how to remove it? Explain difference between synchronous and isochronous transmission stream modes Provide five differences between MPEG-4 video encoding standard and the previous MPEG video encoding standards CS 414 - Spring 2010

Sample Problems Consider voice conversational application (like Skype). What multimedia-sensitive algorithms at the setup phase would you deploy to make sure that you start with a good voice transmission ? Specify clear design of order of algorithms/protocols to be used CS 414 - Spring 2010