TSG-C SWG1.2 Multimedia Services 1/21 3GPP2 Evolution Workshop - 2005 Multimedia Codecs and Protocols 3GPP2 TSG-C SWG1.2.

Slides:



Advertisements
Similar presentations
VoIP Models for System Performance Evaluation Farooq Khan IEEE Interim Meeting Vancouver, BC, Canada January 12-16, 2004.
Advertisements

Streaming Video over the Internet
Media: Voice and Video in your SIP Environment Jitendra Shekhawat.
Fundamentals of Multimedia Part III: Multimedia Communications and Networking Chapter 15 : Network Services and Protocols for Multimedia Communications.
29.1 Chapter 29 Multimedia Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
RTP: A Transport Protocol for Real-Time Applications Provides end-to-end delivery services for data with real-time characteristics, such as interactive.
TCP/IP Protocol Suite 1 Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. Chapter 25 Multimedia.
Doc.: IEEE /0604r1 Submission May 2014 Slide 1 Modeling and Evaluating Variable Bit rate Video Steaming for ax Date: Authors:
Presented by Scott Kristjanson CMPT-820 Multimedia Systems Instructor: Dr. Mohamed Hefeeda 1 Cross-Layer Wireless Multimedia.
Multimedia Streaming Protocols1 Multimedia Streaming: Jun Lu Xinran (Ryan) Wu CSE228 Multimedia Systems Challenges and Protocols.
Chapter 6 outline r 6.1 Multimedia Networking Applications r 6.2 Streaming stored audio and video m RTSP r 6.3 Real-time, Interactive Multimedia: Internet.
Speech codecs and DCCP with TFRC VoIP mode Magnus Westerlund
Voice over the Internet (the basics) CS 7270 Networked Applications & Services Lecture-2.
5: DataLink Layer5-1 Asynchronous Transfer Mode: ATM r 1990’s/00 standard for high-speed (155Mbps to 622 Mbps and higher) Broadband Integrated Service.
SCHOOL OF COMPUTING SCIENCE SIMON FRASER UNIVERSITY CMPT 820 : Error Mitigation Schaar and Chou, Multimedia over IP and Wireless Networks: Compression,
1 Solutions to Performance Problems in VOIP over Wireless LAN Wei Wang, Soung C. Liew Presented By Syed Zaidi.
1 EE 400 Asynchronous Transfer Mode (ATM) Abdullah AL-Harthi.
Real-time traffic Dr. Abdulaziz Almulhem. Almulhem©20012 Agenda RT traffic characteristic RT traffic profiles RT traffic requirements RT Architecture.
EE 4272Spring, 2003 Protocols & Architecture A Protocol Architecture is the layered structure of hardware & software that supports the exchange of data.
Real-time Transport Protocol Matt Boutell CS457: Computer Networks November 15, 2001.
Data Communications Architecture Models. What is a Protocol? For two entities to communicate successfully, they must “speak the same language”. What is.
Multimedia Applications r Multimedia requirements r Streaming r Phone over IP r Recovering from Jitter and Loss r RTP r Diff-serv, Int-serv, RSVP.
Multi-Path Multimedia Transmission in Ad-hoc Networks Related Work Marcin Michalak
Streaming Video Gabriel Nell UC Berkeley. Outline Scalable MPEG-4 video – Layered coding method – Integrated transport-decoder buffer model RAP streaming.
TCP/IP Protocol Suite 1 Chapter 25 Upon completion you will be able to: Multimedia Know the characteristics of the 3 types of services Understand the methods.
Protocols and the TCP/IP Suite Asynchronous Transfer Mode (ATM)
EE 4272Spring, 2003 Chapter 11. ATM and Frame Relay Overview of ATM Protocol Architecture ATM Logical Connections ATM Cells ATM Service Categories ATM.
K. Salah 1 Chapter 28 VoIP or IP Telephony. K. Salah 2 VoIP Architecture and Protocols Uses one of the two multimedia protocols SIP (Session Initiation.
Error-Resilient Coding and Decoding Strategies for Video Communication Thomas Stockhammer and Waqar Zia Presented by Li Ma.
RTP: A Transport Protocol for Real-Time Applications
CIS679: RTP and RTCP r Review of Last Lecture r Streaming from Web Server r RTP and RTCP.
Investigation of Media Streaming Service in Secure Access Network Binod Vaidya Institute of Engineering Tribhuvan University Nepal
Voice Over Packet Networks Getting the most from your voice codec Philippe Gournay VoiceAge Corp. 750 Lucerne Road, Suite 250 Montreal (Quebec) H3R 2H6.
Computer Networks: Multimedia Applications Ivan Marsic Rutgers University Chapter 3 – Multimedia & Real-time Applications.
Asynchronous Transfer Mode: ATM r 1980s/1990’s standard for high-speed (155Mbps to 622 Mbps and higher) Broadband Integrated Service Digital Network architecture.
CS Spring 2012 CS 414 – Multimedia Systems Design Lecture 29 – Buffer Management (Part 2) Klara Nahrstedt Spring 2012.
Chapter 5: Summary r principles behind data link layer services: m error detection, correction m multiple access protocols m link layer addressing, ARP.
TCP/IP Protocol Suite 1 Chapter 25 Upon completion you will be able to: Multimedia Know the characteristics of the 3 types of services Understand the methods.
1 Lecture 17 – March 21, 2002 Content-delivery services. Multimedia services Reminder  next week individual meetings and project status report are due.
Voice over IP Why Challenges/solutions Voice codec and packet delay.
Network Instruments VoIP Analysis. VoIP Basics  What is VoIP?  Packetized voice traffic sent over an IP network  Competes with other traffic on the.
© 1999, Third Generation Partnership Project 2. All Rights Reserved. Permission is granted for copying, reproducing, or duplicating this document only.
Making the Best of the Best-Effort Service (2) Advanced Multimedia University of Palestine University of Palestine Eng. Wisam Zaqoot Eng. Wisam Zaqoot.
QUALCOMM PROPRIETARY QUALCOMM Corporate R & D1 Performance of VoIP Services over 3GPP WCDMA Networks Ozcan Ozturk Qualcomm.
Experiences with Multimedia Streaming over 2.5G and 3G Networks J. Chesterfield, R. Chakravorty, J. Crowcroft, P. Rodriguez, S. Banerjee Presented by Denny.
03/11/2015 Michael Chai; Behrouz Forouzan Staffordshire University School of Computing Streaming 1.
LOG Objectives  Describe some of the VoIP implementation challenges such as Delay/Latency, Jitter, Echo, and Packet Loss  Describe the voice encoding.
3GPP2 Circuit-Switched Video Conferencing & Packet-Switched Video Telephony Services Overview Scott Droste Chair, TSG-C WG1 Applications & Services Motorola.
AIMS’99 Workshop Heidelberg, May 1999 Assessing Audio Visual Quality P905 - AQUAVIT Assessment of Quality for audio-visual signals over Internet.
Ch 6. Multimedia Networking Myungchul Kim
CSE5803 Advanced Internet Protocols and Applications (14) Introduction Developed in recent years, for low cost phone calls (long distance in particular).
Department of Electronic Engineering City University of Hong Kong EE3900 Computer Networks Protocols and Architecture Slide 1 Use of Standard Protocols.
TSG-C SWG1.2 Ad hoc, Montréal, Québec C of 40 Video Delivery in cdma2000® Networks Hari Garudadri Phoom Sagetong.
Ch 10. Multimedia Communications over WMNs Myungchul Kim
1 Protocol Layering Myungchul Kim Tel:
TCP/IP Protocol Suite 1 Chapter 25 Upon completion you will be able to: Multimedia Know the characteristics of the 3 types of services Understand the methods.
Ch 6. Multimedia Networking Myungchul Kim
Overview of Digital Video Compression Multimedia Systems and Standards S2 IF Telkom University.
3GPP2 Evolution Workshop Multimedia Codecs and Protocols 3GPP2 TSG-C SWG1.2.
Ch 10. Multimedia Communications over WMNs Myungchul Kim
CS Spring 2011 CS 414 – Multimedia Systems Design Lecture 24 – Client-Server Buffer Management Klara Nahrstedt Spring 2011.
3GPP2 TSG-C SWG1.2 Maui, HI C R2/C of 12 TSG-C WG3/SWG1.2 joint meeting 12/07/05 BCMCS FEC evaluation simulation requirements.
Multimedia Communication Systems Techniques, Standards, and Networks Chapter 6 Multimedia Communication Across Networks.
1 Wireless Networks Lecture 21 WCDMA (Part I) Dr. Ghalib A. Shah.
Networked Multimedia Basics. Network Characteristics.
19 – Multimedia Networking
Multimedia networking: outline
VoIP Models for System Performance Evaluation
VoIP Models for System Performance Evaluation
Multimedia networking: outline
Presentation transcript:

TSG-C SWG1.2 Multimedia Services 1/21 3GPP2 Evolution Workshop Multimedia Codecs and Protocols 3GPP2 TSG-C SWG1.2

TSG-C SWG1.2 Multimedia Services 2/21 Presentation Who is TSG-C SWG 1.2? Multimedia in PS Domain –Transitioning from CS to PS –IP Terminology PS Domain Challenges –IP Fragmentation –Maintain “goodput” –Jitter –“Smarter” Codecs and Packetization –Evaluation Methodology Summary

TSG-C SWG1.2 Multimedia Services 3/21 TSG-C SWG1.2 “Multimedia Services” ToR Evaluation and adoption of –Visual Codecs (Video, Image, Graphics), –Audio Codecs (synthetic and natural audio) –Audio/visual synchronization methods Evaluation and adoption of complementary protocols –RTSP/SDP, RTP/RTCP, to support real-time, near real-time and interactive multimedia services Development of fileformats to support –over the air transmission for streaming, pseudo-streaming, downloading –associated methods for content protection

TSG-C SWG1.2 Multimedia Services 4/21 Multimedia in PS Domain Transitioning from CS to PS –Dedicated channels  Shared channels –User expectation  Similar or Higher –Application Level Framing (ALF) in IP –Requires special considerations for wireless hops Codec and transport related challenges –IP fragmentation –Jitter in packet arrival –Codecs’ view of QoS: –Greater need for error resiliency and concealment –etc.

TSG-C SWG1.2 Multimedia Services 5/21 IP Terminology ADU – Application Data Unit –Independently decodable data; minimum unit of error recovery –e.g. a vocoder frame, a video slice, … SDU – Service Data Unit –One or more ADUs, including required headers for transmission MTU – Maximum (size of a) Transmission Unit, in octets –e.g octets on an Ethernet hop, 576 octets on PPP, … PDU – Protocol Data Unit –In this context, we consider physical layer frames –payload size in one physical layer frame –Not including MAC, CRC and tail bits overhead Fragmentation and Re-assembly –1 SDU  n PDU mapping, when SDU exceeds MTU on a given hop Observation: Significant fragmentation over cdma2000® hops

TSG-C SWG1.2 Multimedia Services 6/21 IP Fragmentation

TSG-C SWG1.2 Multimedia Services 7/21 “Goodput” above RTP From RFC2736, Best Current Practice for RTP payload design, –… relying on IP fragmentation is a bad design strategy as it significantly increases the effective loss rate of a network and decreases goodput –… if one fragment is lost, the remaining fragments (which have used up bottleneck bandwidth) will then need to be discarded by the receiver Pick ADU/SDU sizes not to exceed PDU sizes Do not concatenate SDUs (use stuffing bits)

TSG-C SWG1.2 Multimedia Services 8/21 IP Fragmentation – Optimal ADU? One size does not fit all –Except for Constant bitrate (CBR) Channels and CBR codecs Most 3G networks provide multiple PDU sizes to support “Bandwidth on Demand” Entropy in multimedia content (video, speech, Audio, …) is not constant over consecutive analysis windows –Variable bitrate (VBR) encoding: improved compression efficiency Examples –cdma2000 vocoders –Channel: RS-1 and RS-2 support 4 PDU sizes in addition to dtx –Source: cdma2000 vocoders generate 4 ADU sizes, based on source characteristics –SO60: ADU = PDU; CS like efficiency in PS! –ITU and MPEG Video codecs use VBR rate control –Constraints on rate control to generate ADUs of known sizes –Improved error resiliency when ADUs are matched to PDUs Significant statistical multiplexing gains when codecs are optimized to lower layers Challenges: Optimize 3G services, without cross-layer violations and maintain interoperability with other networks

TSG-C SWG1.2 Multimedia Services 9/21 Jitter in Packet Arrival

TSG-C SWG1.2 Multimedia Services 10/21 Jitter - PS Network Effects Variance in the ADU inter-arrival time –SDUs queued behind cross-traffic in routers –Routing changes in end-to-end path De-jitter buffer –a buffer to restore constant inter-packet timing prior to decoding –Increases playout delay 20ms De-jitter buffer Decoder Even delivery of voice frames 20ms of voice per frame per frame 20ms Variable Delay, in-order delivery not guaranteed

TSG-C SWG1.2 Multimedia Services 11/21 Jitter – Example packet arrival

TSG-C SWG1.2 Multimedia Services 12/21 Jitter – Example Packet Loss

TSG-C SWG1.2 Multimedia Services 13/21 “Smarter” Decoders They can reduce playout delay with variable rate rendering –Speech: Signal processing tricks such as “Time Warping” –Video: Audio visual synchronization (lip-synch) –Skewable video frame playback? They have Improved concealment techniques to mitigate packet loss –Interpolation in time and/or frequency domains Challenges –Develop improved objective metrics and subjective evaluation methodologies –Study and characterize the effects of such enhancements on user experience GoodErasureGood Playback Time line CircuitVoIP

TSG-C SWG1.2 Multimedia Services 14/21 Quality Evaluation Example: objective metrics for video

TSG-C SWG1.2 Multimedia Services 15/21 RTP Packet Loss Simulator SWG1.2 Simulation methodology to characterize multimedia content in cdma2000 wireless IP TBD: Packet loss rate due to jitter delay bound

TSG-C SWG1.2 Multimedia Services 16/21 Example: Video: Channel errors SCH 8x in RC3 (PDU size = 160 octets) Channel = Model A (Ped 3km/h) FER = 1%; Active set = 1; Geometry = 6dB Frame (10 fps) PSNR (clean)32.5 dB32.3 dB33.3 dB31.3 dB PSNR (errors)20.1 dB21.3 dB13.2 dB17.5 dB

TSG-C SWG1.2 Multimedia Services 17/21 What do we measure? Objective metric: PSNR averaged over the session –Usage is similar to that as MOS for vocoders –Not informative in error prone conditions New Objective Video Quality metrics in SWG1.2 –Percentage Degraded Video Duration (pDVD) –Standard deviation of PSNR (STD_PSNR) ovaer the session –In addition to average PSNR SWG1.2 objective metrics correlate well with subjective quality

TSG-C SWG1.2 Multimedia Services 18/21 Summary Optimize codecs and bearer protocols to lower layers for efficient IP services –e.g. VBR codecs and VBR channels in 3GPP2 CS voice –Rate control and RTP packetization to maximize “goodput” –Interoperability with other IP networks Develop smart codecs –Improved error resiliency –Better concealment techniques –Variable rate rendering Develop/adopt suitable objective metrics and subjective evaluation methodologies –Characterize user experience in realistic 3GPP2 environments

TSG-C SWG1.2 Multimedia Services 19/21 Backup Slides

TSG-C SWG1.2 Multimedia Services 20/21 1Q2Q3Q4Q 2006 TSG-C SWG 1.2 Multimedia Work-Plan H2H4Q Q2Q1Q 4Q3Q 2004 C.P0050-A File Formats C.P BCMCS Codecs Protocols Existing 3GPP2 work items Scenario only C.P MMD/PoC Codecs C.P PS Video Telephony C.P MMS Streaming C.P0050-B (Adv File Formats) C.P0046-A Adv Streaming) C.P0055-A Multiparty PS Video Telephony C.P00xx-0 (DSR) C.P MSS Char C.P BCMCS Char C.P100?-0 PSVT Char C.P0045-A MMS CodecsR&F–V&V Technical Reports Technical Specifications

TSG-C SWG1.2 Multimedia Services 21/21 SpecificationOutputStartExpected Publication Status Open Contr. Status Approved Contr. Comments MMS Codecs and Media Formats - C.P0045-A C.S0045-ADec 2005 MSS Multimedia Streaming - C.P C.S0046-0Dec 2001 MSS Advanced Multimedia Streaming - C.P0046-A C.S0046-AJul 2004 File Formats for Multimedia Services - C.P0050-A C.S0050-A PS Video Telephony -C.P C.S BCMCS Codecs and Transport Protocols - C.P C.S0070-0Jan 2005 MMD and PoC Codecs and Transport Protocols - C.P C.S0071-0Dec 2005 Multimedia Streaming Performance Characterization - C.P C.R1002-0Jul 2004 BCMCS Performance Characterization - C.P C.R1003-0Jan 2005 File Formats C.S0050-B PSVT Performance Characterization Multiparty PSVT - C.S0055-A DSR – C.S00xx TSG-C SWG 1.2 Multimedia Work-Plan