Comparisons of FEC and Codec Robustness on VoIP Quality and Bandwidth Efficiency Wenyu Jiang Henning Schulzrinne Columbia University ICN 2002, Atlanta,

Slides:



Advertisements
Similar presentations
1 IETF 88 IETF88 Vancouver Congestion control for video and priority drops Background for draft-lai-tsvwg-normalizer-02.txt Toerless Eckert,
Advertisements

Digital Fountain Codes V. S
Media: Voice and Video in your SIP Environment Jitendra Shekhawat.
David Ripplinger, Aradhana Narula-Tam, Katherine Szeto AIAA 2013 August 21, 2013 Scheduling vs Random Access in Frequency Hopped Airborne.
Presented by Scott Kristjanson CMPT-820 Multimedia Systems Instructor: Dr. Mohamed Hefeeda 1 Cross-Layer Wireless Multimedia.
Chapter 6 outline r 6.1 Multimedia Networking Applications r 6.2 Streaming stored audio and video m RTSP r 6.3 Real-time, Interactive Multimedia: Internet.
Speech codecs and DCCP with TFRC VoIP mode Magnus Westerlund
Understanding the Internet Low Bit Rate Coder Jan Linden Vice President of Engineering Global IP Sound Presented by Jan Skoglund Sr. Research Scientist.
Voice over the Internet (the basics) CS 7270 Networked Applications & Services Lecture-2.
PROJECT PRESENTATION “ Analyzing Factors that affect VoIP Call Quality ” Presented By: Vamsi Krishna Karnati 11/24/2014.
Mohamed Hefeeda 1 School of Computing Science Simon Fraser University, Canada Analysis of Multimedia Authentication Schemes Mohamed Hefeeda (Joint work.
ACM Multimedia October 4, 2001 Real-time Voice Communication over the Internet Using Packet Path Diversity Yi Liang, Eckehard Steinbach, and Bernd Girod.
QoS Measurement and Management for Multimedia Services Thesis Proposal Wenyu Jiang April 29, 2002.
Multiple Sender Distributed Video Streaming Thinh Nguyen, Avideh Zakhor appears on “IEEE Transactions On Multimedia, vol. 6, no. 2, April, 2004”
A Software Defined Radio Implementation for Voice Transmission over Wireless Ad-hoc Networks Jason Tran SURF-IT 2009 Fellow Mentors: Dr. Homayoun Yousefi’zadeh.
QoS Measurement and Management for VoIP Wenyu Jiang IRT Lab March 5, 2003.
Carrier-grade vs. Internet VoIP Henning Schulzrinne (with Wenyu Jiang) Columbia University FCC Technical Advisory Council III Washington, DC – October.
1 E-Model & MOS Speaker: Cheng-lin Tsai Adviser: Quincy Wu Date:2009/07/02.
Adaptive Delay Aware Error Control for Internet telephony Catherine Boutremans Jean-Yves Le Boudec IP Telephony Workshop’2001 Institute for computer Communication.
Multiple Sender Distributed Video Streaming Thinh Nguyen (IEEE Member) Avideh Zakhor (IEEE Fellow) IEEE Transactions on multimedia 2004.
Performance metrics and configuration strategies for group network communication Tom Z. J. FU Dah Ming Chiu John C. S. Lui.
Nov. 3, 2000 Adaptive Playout Scheduling in Packet Voice Communications.
Brian White CS529 SPEAK WITH FORWARD ERROR CORRECTION: IMPLEMENTATION AND EVALUATION.
Using Redundancy and Interleaving to Ameliorate the Effects of Packet Loss in a Video Stream Yali Zhu, Mark Claypool and Yanlin Liu Department of Computer.
Using Interleaving to Ameliorate the Effects of Packet Loss in a Video Stream Mark Claypool and Yali Zhu Computer Science Department Worcester Polytechnic.
Multiple Sender Distributed Video Streaming Nguyen, Zakhor IEEE Transactions on Multimedia April 2004.
Objective and Subjective Degradations of Transcoded Voice for Heterogeneous Radio Networks Interoperability Ľubica Blašková 1, Jan Holub 1, Michael Street.
Copyright Telchemy Inc 2001 Embedded Passive Monitoring of Voice over IP Service Quality Alan Clark Telchemy, Inc Atlanta, GA
EXPLOITING VOIP SILENCE FOR WIFI ENERGY SAVINGS IN SMART PHONES Andrew J. Pyles 1, Zhen Ren 1, Gang Zhou 1, Xue Liu 2 1 College of William and Mary, 2.
Effect of FEC mechanisms in the Performance of Low Bit Rate Codecs in Lossy Mobile Environments Rolando Herrero, PhD Northeastern University, Boston, MA,
Cisco Unified Communications Manager (CUCM)
Secure Steganography in Audio using Inactive Frames of VoIP Streams
1 Real-Time Traffic over the IEEE Medium Access Control Layer Tian He J. Sobrinho and A. krishnakumar.
An Overlay Architecture for High Quality VoIP Streams IEEE Trans. on Multimedia 2006 R 翁郁婷 R 周克遠.
Voice Over Packet Networks Getting the most from your voice codec Philippe Gournay VoiceAge Corp. 750 Lucerne Road, Suite 250 Montreal (Quebec) H3R 2H6.
Audio Henning Schulzrinne Dept. of Computer Science Columbia University Fall 2003.
Colombia, September 2013 The importance of models and procedures for planning, monitoring and control in the provision of communications services.
An Empirical Evaluation of VoIP Playout Buffer Dimensioning in Skype, Google Talk, and MSN Messenger Chen-Chi Wu, Kuan-Ta Chen, Yu-Chun Chang, and Chin-Laung.
IP Networking & MEDIACOM 2004 Workshop April 2001 Geneva Characterising End to End Quality of Service in TIPHON Systems Characterising End to End.
The Way Forward Factors Driving Video Conferencing Dr. Jan Linden, VP of Engineering Global IP Solutions.
Network Instruments VoIP Analysis. VoIP Basics  What is VoIP?  Packetized voice traffic sent over an IP network  Competes with other traffic on the.
New Models for Perceived Voice Quality Prediction and their Applications in Playout Buffer Optimization for VoIP Networks University of Plymouth United.
Department of Communication and Electronic Engineering University of Plymouth, U.K. Lingfen Sun Emmanuel Ifeachor New Methods for Voice Quality Evaluation.
University of Plymouth United Kingdom {L.Sun; ICC 2002, New York, USA1 Lingfen Sun Emmanuel Ifeachor Perceived Speech Quality.
Experiences with Multimedia Streaming over 2.5G and 3G Networks J. Chesterfield, R. Chakravorty, J. Crowcroft, P. Rodriguez, S. Banerjee Presented by Denny.
LOG Objectives  Describe some of the VoIP implementation challenges such as Delay/Latency, Jitter, Echo, and Packet Loss  Describe the voice encoding.
1 Real-Time Traffic over the IEEE Medium Access Control Layer Tian He.
Quality of Service - applications Henning Schulzrinne with Wenyu Jiang Dept. of Computer Science Columbia University NSF QoS workshop, April 2002.
CSE5803 Advanced Internet Protocols and Applications (14) Introduction Developed in recent years, for low cost phone calls (long distance in particular).
Ch 10. Multimedia Communications over WMNs Myungchul Kim
Alan Clark Telchemy Modeling the effects of Burst Packet Loss and Recency on Subjective Voice Quality Alan Clark Telchemy
2/07/03 Telchemy QoS for VoIP: Measuring its Effectiveness Bob Massad Telchemy ®, Inc
COMPARATIVE STUDY OF HEVC and H.264 INTRA FRAME CODING AND JPEG2000 BY Under the Guidance of Harshdeep Brahmasury Jain Dr. K. R. RAO ID MS Electrical.
RTP and playout delay compensation Henning Schulzrinne Dept. of Computer Science Columbia University Fall 2003.
1 Video and Voice over IP performance over a Satellite link Bob Dixon, Ohio State University/OARnet Prasad Calyam, OARnet Joint Techs Workshops, Columbus,
Ch 10. Multimedia Communications over WMNs Myungchul Kim
RTP Functionalities for RTCWEB A combined view from the authors of draft-cbran-rtcweb-media-00 draft-cbran-rtcweb-media-00 draft-perkins-rtcweb-rtp-usage-02.
Using Speech Recognition to Predict VoIP Quality
VoIP over Wireless Networks
Scalable Speech Coding for IP Networks
Scalable Speech Coding for IP Networks: Beyond iLBC
Wenyu Jiang Henning Schulzrinne Columbia University
Injong Rhee ICMCS’98 Presented by Wenyu Ren
Error recovery for Packet Audio and Video
Wenyu Jiang , Henning Schulzrinne 이주경
Assessment of VoIP Service Availability
Understanding the Internet Low Bit Rate Coder
Scalable Speech Coding for IP Networks: Beyond iLBC
Sean Coffey, Ph.D., Chris Heegard, Ph.D.
Investigation of Voice Traffic in Wi-Fi Environment
Presentation transcript:

Comparisons of FEC and Codec Robustness on VoIP Quality and Bandwidth Efficiency Wenyu Jiang Henning Schulzrinne Columbia University ICN 2002, Atlanta, GA Aug 29, 2002

Introduction to VoIP The Internet is still best-effort Subject to packet loss and delay jitter Options for repairing packet loss Forward error correction (FEC) Low complexity; bit-exact recovery Packet loss concealment (PLC) Receiver-only; no extra BW overhead More robust (error resilient) codec  better PLC quality, and higher bit-rate Question: use FEC or a more robust codec?

Metric of VoIP Quality Mean Opinion Score (MOS) [ITU P.830] Obtained via human-based listening tests Listening (MOS) vs. conversational (MOS c ) GradeQuality 5Excellent 4Good 3Fair 2Poor 1Bad

FEC and IP Header Overhead An (n,k) FEC code has (n-k)/k overhead Typical IP/UDP/RTP header is 40 bytes codecmedia pkt size (T=30ms) r media r IP iLBC (4,2) FEC 54 bytes14.4 kb/s25.1 kb/s 108 bytes28.8 kb/s39.5 kb/s G.729 (4,2) FEC 30 bytes8 kb/s18.7 kb/s 60 bytes16 kb/s26.7 kb/s G (4,2) FEC 24 bytes6.4 kb/s17.1 kb/s 48 bytes12.8 kb/s23.5 kb/s

Predicting MOS in VoIP The E-model: an alternative to human- based MOS estimation Do need a first-time calibration from an existing human MOS-loss curve In VoIP, the E-model simplifies to two main factors: loss (I e ) and delay (I d ) A gross score R is computed and translated to MOS. Loss-to-I e mapping is codec-dependent and calibrated

Predicting MOS in VoIP, contd Example mappings From loss and delay to their impairment scores and to MOS

Predicting MOS under FEC Compute final loss probability p f after FEC [Frossard 2001] Bursty loss reduces FEC performance Increasing the packet interval T makes FEC more efficient under bursty loss [Jiang 2002] Plug p f into the calibrated loss-to-I e mapping FEC delay is n*T for an (n,k) code Compute R value and translate to MOS

Quality Evaluation of FEC vs. Codec Robustness Codecs under evaluation iLBC: a recent loss-robust codec proposed at IETF; frame-independent coding G.729: a near toll quality ITU codec G.723.1: an ITU codec with even lower bit-rate, but also slightly lower quality. Utilize MOS curves from IETF presentations for FEC MOS estimation Assume some loss burstiness (conditional loss probability of 30%) Default packet interval T = 30ms

G.729+(5,3) FEC vs. iLBC Ignoring delay effect, a larger T improves FEC efficiency and its quality When considering delay, however, using a 60ms interval is overkill, due to higher FEC delay (5*60 = 300ms)

G.729+(5,2) vs. iLBC+(3,2) When iLBC also uses FEC, and still keeping similar gross bit-rate G.729 still prevails, except for low loss conditions when considering delay

G.729+(7,2) vs. iLBC+(4,2) Too much FEC redundancy (e.g., for G.729)  very long FEC block and delay  not always a good idea iLBC wins in this case, when considering delay

G.729+(3,1) vs. iLBC+(4,2) Using less FEC redundancy may actually help, if the FEC block is shorter Now G.729 performs similar to iLBC

Comparison with G MOS(G.723.1) < MOS(iLBC) at zero loss  iLBC dominates more low loss areas compared with G.729, whether delay is considered or not

G (3,1) vs. iLBC+(3,2) iLBC is still better for low loss G wins for higher loss

G (4,1) vs. iLBC+(4,2) iLBC dominates in this case whether delay is considered or not, (4,2) code already suffices for iLBC (4,1) code’s performance essentially “saturates”

The Best of Both Worlds Observations, when considering delay: iLBC is usually preferred in low loss conditions G.729 or G FEC better for high loss Example: max bandwidth 14 kb/s Consider delay impairment (use MOS c )

Max Bandwidth: kb/s

Effect of Max Bandwidth on Achievable Quality 14 to 21 kb/s: significant improvement in MOS c From 21 to 28 kb/s: marginal change due to increasing delay impairment by FEC

Conclusions Compared listening and conversational MOS achieved by conventional vs. robust codecs, with same BW constraint iLBC is better under low loss conditions Conventional codec + FEC is better under high loss, but Usefulness of FEC redundancy saturates beyond a certain point considering delay At roughly a max BW of 21 kb/s Reveals max achievable quality with current FEC mechanism

Future Work Implement the MOS prediction and optimization procedure in software Investigate the effect of jitter on conventional vs. robust codecs FEC cannot reduce jitter unless there are many out-of-order packets PLC in a robust codec like iLBC incurs a much lower delay, thus may be preferable to FEC

References W. Jiang and H. Schulzrinne, Comparison and optimization of packet loss repair methods on VoIP perceived quality under bursty loss, NOSSDAV 2002 P. Frossard, FEC performance in multimedia streaming, IEEE Comm Letter 3/2001 ITU-T, Subjective performance assessment of telephone-band and wideband digital codecs, Recommendation P.830 2/1996