University of Michigan, T-Mobile US Inc.†1

Slides:



Advertisements
Similar presentations
Unified. Simplified. Unified Communications Launch 2007.
Advertisements

Qi Alfred Chen, Haokun Luo, Sanae Rosen, Z. Morley Mao,
Audio Quality Call Reliability Dropped Calls Failed Calls Broken up Audio Delayed Audio Distorted Audio Low Volume Noise Echo One Way Audio Network.
LTE-A Carrier Aggregation
Bayesian Piggyback Control for Improving Real-Time Communication Quality Wei-Cheng Xiao 1 and Kuan-Ta Chen Institute of Information Science, Academia Sinica.
University of Michigan Electrical Engineering and Computer Science Anatomizing Application Performance Differences on Smartphones Junxian Huang, Qiang.
Fundamentals of Multimedia Part III: Multimedia Communications and Networking Chapter 15 : Network Services and Protocols for Multimedia Communications.
Enterprise Traffic Management Challenges Performance Management for Converged Networks.
Is IP Going To Take Over The World: Offense Isaac Chung Gary Bramwell.
VIPER – Voice over IP with Enhanced Resiliency Abstract: VoIP call quality is subject to Internet conditions, and users may experience periods of low quality.
Testing SIP Services Over IP. Agenda  SIP testing – advanced scenarios  SIP testing - Real Life Examples.
Video over Wireless : Performance Evaluation in the GSM Circuit-Switched Channel Almudena Konrad Amoolya Singh University of California, Berkeley December.
Semester 4 - Chapter 5 – ISDN Overview There are many types of WAN technologies that can be used to solve the problems of users who need network access.
CS158B Project By Shing Chau Jerry Ko Ying Li
CDMA X RTT Overview. Global 3G Evolution.
Junxian Huang 1 Feng Qian 2 Yihua Guo 1 Yuanyuan Zhou 1 Qiang Xu 1 Z. Morley Mao 1 Subhabrata Sen 2 Oliver Spatscheck 2 1 University of Michigan 2 AT&T.
Colombo, Sri Lanka, 7-10 April 2009 Multimedia Service Delivery on Next Generation Networks Pradeep De Almeida, Group Chief Technology Officer Dialog Telekom.
LTE pre-SI Test Suite Implementation in TTCN3: A case study 1 Pramod Shrivastava Intel Mobile Communication Nitin Bodas Larsen & Toubro Infotech Ranganath.
QoE Assurance Division Solutions for ToIP – VoIP service assurance and service performance.
Qi Alfred Chen University of Michigan
1 MultimEDia transport for mobIlE Video AppLications 9 th Concertation Meeting Brussels, 13 th February 2012 MEDIEVAL Consortium.
Mobile Communication Congestion Exposure Scenario
End-to-end QoE Optimization Through Overlay Network Deployment Bart De Vleeschauwer, Filip De Turck, Bart Dhoedt and Piet Demeester Ghent University -
IP-Based Emergency Applications and Services for Next Generation Networks PEACE Presented by Suji Gunaratne PhD.
Self-Management for Unified Heterogeneous Radio Access Networks ISWCS 2015 Twelfth International Symposium on Wireless Communication Systems Brussels,
1 Architecture and Techniques for Diagnosing Faults in IEEE Infrastructure Networks Atul Adya, Victor Bahl, Ranveer Chandra, Lili Qiu Microsoft.
Best-Case WiBro Performance for a Single Flow 1 MICNET 2009 Shinae Woo †, Keon Jang †, Sangman Kim † Soohyun Cho *, Jaehwa Lee *, Youngseok Lee ‡, Sue.
Performance Evaluation of VoIP in Different Settings Tom Christiansen Ioannis Giotis Shobhit Raj Mathur.
Physical Layer Informed Adaptive Video Streaming Over LTE Xiufeng Xie, Xinyu Zhang Unviersity of Winscosin-Madison Swarun KumarLi Erran Li MIT Bell Labs.
Highlights of the Revised VMR-WB RTP Payload and Storage File Formats Sassan Ahmadi, Ph.D. Nokia Inc. USA May 1, 2004 For more information please refer.
-1- Layer 2 Mobility for Real Time Packet Data Service in All IP Network 3GPP2 All IP Ad Hoc Boulder, CO July 17~19, 2000 Jae-Young Ahn, Kyung-Sik Kim,
1 How Streaming Media Works Bilguun Ginjbaatar IT 665 Nov 14, 2006.
Assuring Performance of Carrier-Class Networks and Enterprise Contact Centers SP-11: Ensuring Service Quality While Increasing Revenue February 4, 2009.
Design of Multi-RAT Virtualization Architectures in LTE-Advanced Wireless Network Location: 國立暨南國際大學電機系 Source: ICIC Express Letters, vol. 8, no. 5, May.
Quality of Service of Over-The-Top Services Cyril Lau
ECE 4450:427/527 - Computer Networks Spring 2015 Dr. Nghi Tran Department of Electrical & Computer Engineering Lecture 2: Overview of Computer Network.
Network Instruments VoIP Analysis. VoIP Basics  What is VoIP?  Packetized voice traffic sent over an IP network  Competes with other traffic on the.
Voice Over Internet Protocol (VoIP). Basic Components of a Telephony Network.
© 2006 Cisco Systems, Inc. All rights reserved. Optimizing Converged Cisco Networks (ONT) Module 2: Cisco VoIP Implementations.
1 Presentation_ID © 1999, Cisco Systems, Inc. Cisco All-IP Mobile Wireless Network Reference Model Presentation_ID.
Changing the Dynamics of Network Analysis J. Scott Haugdahl CTO, WildPackets, Inc.
Experiences with Multimedia Streaming over 2.5G and 3G Networks J. Chesterfield, R. Chakravorty, J. Crowcroft, P. Rodriguez, S. Banerjee Presented by Denny.
S Master’s thesis seminar 8th August 2006 QUALITY OF SERVICE AWARE ROUTING PROTOCOLS IN MOBILE AD HOC NETWORKS Thesis Author: Shan Gong Supervisor:Sven-Gustav.
1 A Framework for Measuring and Predicting the Impact of Routing Changes Ying Zhang Z. Morley Mao Jia Wang.
Kyocera Corporation Enhance radio network connectivity and maintain a Quality of IP service application Proposal of extension of IEEE /7/16.
PROTEUS: Network Performance Forecast for Real- Time, Interactive Mobile Applications Qiang Xu* Sanjeev Mehrotra# Z. Morley Mao* Jin Li# *University of.
Towards Adaptive Congestion Management for Interactive Real- Time Communications Dirk KutscherMirja KühlewindBob Briscoe IAB/IRTF Congestion Control Workshop.
CSE5803 Advanced Internet Protocols and Applications (14) Introduction Developed in recent years, for low cost phone calls (long distance in particular).
ITU Workshop on “Voice and Video Services Interoperability Over Fixed-Mobile Hybrid Environments, Including IMT-Advanced (LTE)" ” Geneva, Switzerland,
OverQos: Less Bandwidth for More Reliable Service ?? --A Criticism Hongyu Gao Gregory Peaker.
eHRPD (evolved High Rate Packet Data)
Emir Halepovic, Jeffrey Pang, Oliver Spatscheck AT&T Labs - Research
QOS OF DATA SERVICES IN MOBILE NETWORKS Ganson Lewela Head of Regulatory Airtel Networks Kenya Ltd STAKEHOLDERS FORUM ON QUALITY OF SERVICE AND CONSUMER.
© 2010 AT&T Intellectual Property. All rights reserved. AT&T and the AT&T logo are trademarks of AT&T Intellectual Property. TOP: Tail Optimization Protocol.
3GPP2 Evolution Workshop Multimedia Codecs and Protocols 3GPP2 TSG-C SWG1.2.
Video Quality Evaluation for Wireless Transmission with Robust Header Compression Fourth International Conference on Information, Communications & Signal.
An Extensible RTCP Control Framework for Large Multimedia Distributions Paper by: Julian Chesterfield Eve M. Schooler Presented by: Phillip H. Jones.
Quality of Service for Real-Time Network Management Debbie Greenstreet Product Management Director Texas Instruments.
A Theory of QoS for Wireless I-Hong Hou Vivek Borkar P.R. Kumar University of Illinois, Urbana-Champaign.
© 2006 Cisco Systems, Inc. All rights reserved. 3.2: Implementing QoS.
IEEE C /87. Status of Evaluation Criteria IEEE Evaluation Criteria CG IEEE Interim Meeting September 15-19, 2003.
Jia Uddin Embedded System Lab.  MPLS  IMANET  IMANET network model  Proposed model of IMANET with MPLS  Conclusion.
MBMS in GSM Evolution Systems – A Research Paper Magesh Annamalai – FAU Feeds – Grad Student Sr.Systems Engineer - Location Technology Group T - Mobile.
EHRPD and LTE-eHRPD/1x Interworking CDG Americas Regional Conference San Diego 11 November 2009 © 3GPP2.
Neha Jain Shashwat Yadav
Long Term Evolution (LTE)
Muhammad Taqi Raza, Fatima Muhammad Anwar and Songwu Lu
Course Project Topics for CSE5469
Dhruv Gupta EEC 273 class project Prof. Chen-Nee Chuah
Exploiting Routing Redundancy via Structured Peer-to-Peer Overlays
Presentation transcript:

University of Michigan, T-Mobile US Inc.†1 Performance Characterization & Call Reliability Diagnosis Support for Voice over LTE Yunhan Jack Jia, Qi Alfred Chen, Z. Morley Mao, Jie Hui†, Kranthi Sontinei†, Alex Yoon†, Samson Kwong†, Kevin Lau† University of Michigan, T-Mobile US Inc.†1 1 The views presented in this paper are as individuals and do not necessarily reflect any position of T-Mobile.

Your voice call needs an upgrade Data network evolution: 2G -> 3G -> 4G/LTE Carrier’s voice call: All circuit-switched before 2014 Moving to a data-centric world Voice over LTE Illustration: Serge Bloch

Circuit-Switched Core Voice over LTE Deliver voice service as data flows within LTE network VoLTE Packet-Switched Core Internet ENodeB Circuit-Switched Core Telephony Network Legacy call NodeB For operators: reduce cost. Performance benefit for users is unclear 1

Challenge 1: Guarantee VoLTE performance Guaranteeing QoS is challenging High user expectation on VoLTE Goal: Replacing legacy call Default Bearer Internet User Dedicated Bearer Gateway Bit rat: 50 kbps, Delay: 100 ms, 2

Challenge 2: Diagnose VoLTE problems VoLTE is a complex service C\\\\\\\\\\\\ LTE Coverage Constraints 3G/2G Network C\\\\\\\\\\\\ Cross-layer Interaction Device-network Interactions C\\\\\\\\\\\\ Multiple Layers Multiple Layers LTE Network C\\\\\\\\\\\\ Mobility Support Existing approach: User tickets subjective, less accurate, coarse-grained 3

Problem statement * Definition: Quality of Experience (QoE) Quality as seen by the end-user E.g., network call setup time vs. user perceived call setup time Insufficient understanding of QoE of deployed VoLTE services No effective support to capture and diagnose VoLTE problems 4

Contributions Systematic study of VoLTE in commercial deployment QoE quantification Empirical comparisons with legacy call & OTT VoIP Diagnosis support for VoLTE reliability problems Devise tool to capture audio experience problems efficiently Covers three major symptoms in user tickets Uncover potential causes lying in the VoLTE protocols E.g., Up-to-50-second muting caused by mis-coordination between two different standards 5

Outline Performance characterization Methodology overview Result summary Diagnosis support for VoLTE reliability problems Capturing audio experience problems Audio quality monitor Backend diagnosis engine Stress testing approach & diagnosis Case studies Discussion 7

VoLTE service providers Methodology overview VoLTE service providers OP-I OP-II OP-III Comparing entities Legacy call Skype Hangouts Voice Metrics we study Smooth audio experience audio quality (MOS), mouth-to-ear delay and more Energy consumption Bandwidth requirement Reliability Call setup success rate Call drop rate 8

Result overview VoLTE delivers excellent audio quality with low bandwidth requirement less user-perceived call setup time low energy consumption won’t be affected by background traffic Reliability still lags behind legacy call Higher call drop rate (5X) Higher call setup failure rate (8X) 9

Call reliability support of VoLTE Challenge: Unsatisfying and varying network conditions 2G/3G Core LTE Core IMS LTE 2G/3G CSFB Procedure SRVCC Procedure VoLTE reliability support Circuit-switched fall back Single Radio Voice call Continuity However, VoLTE still fails to achieve a comparable reliability with legacy call Not all VoLTE problems are captured by traffic-analysis based approach 12

Audio quality monitor overview Use audio channel to detect QoE problems in real-time Three types of VoLTE reliability problems Audio experience related problems Muting, garbled audio, intermittent audio, one-way audio Call setup failure Unintended call drop Normal Muting Intermittent audio Voice Call Sampler Context Collector Audio Quality Monitor 15

Audio quality monitor evaluation Implementation based on Android AudioRecord API Accuracy: FP: 0.65%, FN: 3.7%. Energy Overhead: +7% during VoLTE call Complementary to traffic-based anomaly detection Closer to user experience, easier to deploy. Useful diagnostic tool for operators Capture end-user audio problems objectively and accurately. More important: Understand the underlying causes of the problems 15

Stress testing approach & diagnosis Motivation Producing more problematic cases Gathering critical logs in lab settings Multi-Layer Logs Cross-layer Diagnosis Potential Causes Anomaly Detection Audio Quality Monitor Device Logging Automation Network Logs Signal Strength Network Events Lab settings 20

Diagnose long audio muting problem Problem capturing Up-to-50-second audio muting [Audio quality monitor] Triggered by signal strength degradation [Context collector] Problem diagnosing Gap between radio link layer timeout and RTP layer timeout Application RTP Control VoLTE call session Transmit voice packet stream RRC RLC Control the radio link connection Transmit low level protocol data unit

Lacking of coordination in cross-layer interactions RTP Timeout : Recommended minimum value = 360/bandwidth(kbps) 30 to 50 seconds! Muting Start Muting End Application RTP Timeout RTP Reestablishment Timeout Go to RRC_IDLE RRC … Radio Link Failure RLC MaxRetx Threshold Less than 5 seconds Radio Link Disconnection Radio Layer Timeout = RTT * maxRetxThreshold + min{T301, T311} 25

Lacking of coordination in cross-layer interactions RTP layer makes wrong assumption on the radio layer failure recovery Cause: Gap between RTP (defined in RFC) and RRC/RLC (defined in 3GPP) protocol Also causing similar problems in Skype and Hangouts Suggested solutions Reporting radio link events directly to application layer Other case studies detailed in the paper 26

Discussion Limitation of diagnosis support Follow-Up Coverage Not fully automated Follow-Up Integrating OEM support for QoE problem diagnosis Adding diagnosis support into protocols 27

Summary First systematic study of VoLTE QoE in the commercial deployment Provide diagnosis support for VoLTE Audio quality monitor to capture problems Stress testing approach to collect essential information Cross-layer diagnosis support to understand problems 29

Thank you! Questions?