Video QoE and Standards Sales Training 05-Nov-2007.

Slides:



Advertisements
Similar presentations
INTERNATIONAL TELECOMMUNICATION UNION Document 27 – E TELECOMMUNICATION STANDARDIZATION SECTOR TSB Directors Consultation Meeting on IPTV standardization.
Advertisements

All-IP Transition Initiatives June 17, ATIS Board of Directors’ Meeting October 20, 2011 NANC Meeting June 17, 2014 IP Transition Work within.
Arthur Webster SDOs developing Visual Quality Assessment Standards ●International Telecommunications Union (ITU)  ITU-T Study.
International Telecommunication Union Committed to connecting the world Trondheim, 21 June ITU (International Telecommunication Union) ITU-T (Telecommunication.
ITU Regional Standardization Forum For Africa Dakar, Senegal, March 2015 QoE & QoS of Multimedia Services Joachim Pomy OPTICOM GmbH Germany
ITU Regional Standardization Forum For Africa Dakar, Senegal, March 2015 QoS/QoE Assessment Methodologies (Subjective and Objective Evaluation Methods)
International Telecommunication Union Workshop on End-to-End Quality of Service.What is it? How do we get it? Geneva, 1-3 October 2003 Common VoIP Metrics.
Testing SIP Services Over IP. Agenda  SIP testing – advanced scenarios  SIP testing - Real Life Examples.
Internet Protocol Television
Real-time Transport Protocol Matt Boutell CS457: Computer Networks November 15, 2001.
QUALITY OF SERVICE TRAINING PROGRAMME Jaroslaw Ponder Coordinator, Europe Region 1.
ITU Workshop on “Quality of Service and Quality of Experience of Multimedia Services in Emerging Networks” (Istanbul, Turkey, 9-11 February 2015) Overview.
ITU Regional Standardization Forum For Africa Dakar, Senegal, March 2015 Perceptual Evaluation of OTT Video Streaming Services Joachim Pomy, Consultant.
ITU-T Study Group 13 Communications to IETF CCAMP Working Group Marco Carugi ITU-T SG13 Liaison Officer to IETF CCAMP
Halifax, 31 Oct – 3 Nov 2011ICT Accessibility For All Asok Chatterjee Vice President, Industry Relations, Ericsson ATIS Activities on IMT Standards Document.
Halifax, 31 Oct – 3 Nov 2011ICT Accessibility For All Susan Miller, President & CEO, ATIS Alliance for Telecommunications Industry Solutions (ATIS) Update.
DOCUMENT #:GSC15-PLEN-48 FOR:Presentation SOURCE: ATIS AGENDA ITEM: PLEN 6.10 CONTACT(S): James McEachern
December 5, 2003FG3 Report FOCUS GROUP 3 Interoperability Report to NRIC VI Council December 5, 2003 Cliff Naughton (Boeing)
T.Gy. Intrernetes médiakommunikáció Internetes médiakommunikáció Az Internetes Médiakommunikáció minőségének megítélése, mérése, a rendszer.
Diffusion libre A state of the art of voice quality measurement techniques and of associated standards at ITU-T SG 12 Orange Labs Vincent BARRIAC, Recherche.
1 Hybrid Bit-Stream Models (June 22-26, 2009 Berlin)
Introduction to Multimedia Networking (2) Advanced Multimedia University of Palestine University of Palestine Eng. Wisam Zaqoot Eng. Wisam Zaqoot October.
NTT Confidential Test plan for evaluation of video quality models for use with stereoscopic three-dimensional television content Taichi Kawano (NTT)
06/10/2015 End-to-End Quality of service in ITU-T Where we are, Perspectives Jean-Yves Monfort France Telecom, R&D Division ITU-T SG 12 Chairman 1GSC-9,
Applied Communications Technology Voice Over IP (VOIP) nas1, April 2012 How does VOIP work? Why are we interested? What components does it have? What standards.
1 Hybrid Bit-stream Models. 2 Hybrid bit-stream model: Type 1  Pros: Simple. All we need are open-source codecs.  Cons: May lose some available information.
AIMS’99 Workshop Heidelberg, May 1999 Linking User Acceptance and Network Performance Miles Wilkins (BT) P807 (JUPITER2)
1 Hybrid Bit-Stream Models (January 24-26, 2009 San Jose)
Core Network Technology Prof. Hamid Aghvami Centre for Telecommunications Research - King’s College London Wireless Multimedia Communications Ltd.
1 Hybrid Bit-Stream Models (January 25-29, Boulder)
1 Hybrid Bit-Stream Models (January 24-26, 2009 San Jose)
1 Hybrid Bit-Stream Models (September 25, 2008 Ghent) FINAL.
University of Plymouth United Kingdom {L.Sun; ICC 2002, New York, USA1 Lingfen Sun Emmanuel Ifeachor Perceived Speech Quality.
1 Presentation_ID Mobile Wireless Internet Forum (MWIF)
VQEG Joint Effort Group Berlin meeting A. Bourret- K. Brunnström P. Le Callet.
SwissQual AG – Your QoS Partner Workshop on Wideband Speech Quality in Terminals and Networks: Assessment and Prediction 1 8th and 9th June Mainz,
The 6th CJK NGN Working Group Meeting April 10 ~ 12, 2006, Hangzhou, China CJK NGN WG (IP-TV Ad-Hoc Group) Chae Sub Lee
Proposal for a project to develop full reference media-layer objective metric for stereoscopic three-dimension video NTT Service Integration Laboratories,
International Telecommunication Union Workshop on Satellites in IP and Multimedia Geneva, 9-11 December 2002 MediaCom 2004 ITU-T Standardisation Framework.
1 Hybrid Bit-Stream Models (June 28 – July 2, Krakow)
IRG-AVA REPORT The Role of Information and Communication Technologies in the Development of Inclusive Society Belgrade, 8 October 2015 Pilar Orero IRG-AVA.
ITU Workshop on “Voice and Video Services Interoperability Over Fixed-Mobile Hybrid Environments, Including IMT-Advanced (LTE)" ” Geneva, Switzerland,
1 Hybrid Bit-Stream Models (September 2008 Ghent).
ATIS: Work on Next Generation Networks (NGN) Presented by: Bill O’Shea Chair, ATIS NGN-FG President, Bell Laboratories & CTO & EVP, Corporate Strategy.
Status report on CJK NGN Working Group April 9, th CJK Standard Meeting Taesang Choi Chairman of CJK NGN Working Group.
1 Hybrid Bit-Stream Models (June 28 – July 2, Krakow)
2/07/03 Telchemy QoS for VoIP: Measuring its Effectiveness Bob Massad Telchemy ®, Inc
Multimedia Communications Introduction ECE 591 Pro. Honggang Wang Notes: Some slides including figures are referred from textbooks and relevant materials.
3DTV Work Group VQEG meeting Krakow 28 June – 2 July 2010.
QoS issues in Digital Financial Services Joachim Pomy OPTICOM GmbH Germany 1 ITU Regional Standardization Forum For Africa Dakar,
Standardization activities on IPTV in CCSA CCSA DOCUMENT #:GSC13-PLEN-25 FOR:Presentation SOURCE:CCSA AGENDA ITEM:Plenary; 6.6
QoE Standardization Issues QoMex September 9, 2011 Mechelen, Belgium Arthur Webster, NTIA/ITS Co-Chair of VQEG Chair of ITU-T SG9 1.
1 Hybrid Bit-Stream Models (June 28 – July 2, Krakow)
NTT Confidential Test plan for evaluation of video quality models for use with stereoscopic three-dimensional television content Taichi Kawano (NTT)
1 RRNR-TV (September 2008 Ghent). 2 Proponents NEC NTIA KWILL Yonsei.
1 Video and Voice over IP performance over a Satellite link Bob Dixon, Ohio State University/OARnet Prasad Calyam, OARnet Joint Techs Workshops, Columbus,
1 Hybrid Bit-stream Models (Sep 2007 Ottawa). 2 Basic Ideas Using information extracted from bit- stream data, it may be possible to develop better perceptual.
ATIS Home Networking (HNET) Program DOCUMENT #:GSC13-GTSC6-13 FOR:Presentation SOURCE:Alliance for Telecommunications Industry Solutions AGENDA ITEM:GTSC6;
Proposal for a project to develop full reference media-layer objective metric for stereoscopic three-dimension video NTT Service Integration Laboratories,
Hybrid Projects VQEG Rennes, June Four proponents: DT, OPTICOM, SwissQual, Yonsei Models were submitted on June 6. Next steps –Source selection.
1 Hybrid Bit-stream Models. 2 Hybrid bit-stream model: Type 1  Pros: Simple. All we need are open-source codecs.  Cons: May lose some available information.
ITU Regional Standardization Forum for Africa Livingstone, Zambia March 2016 QoS and QoE for Multimedia Services Related Work in Q14/12 Christian.
ITU Workshop on QoS and QoE of Multimedia Applications and Services Haarlem, The Netherlands 9-11 May 2016 Standards for video QoE assessment Paul Coverdale.
1 Hybrid Bit-Stream Models (January 25-29, Boulder)
Jim McEachern Senior Technology Consultant ATIS July 8, 2015.
Motion JPEG2000 Addition to Digital Motion Imagery
20th CJK UNIOT-WG (Standardization of Mobile IPTV in ITU-T)
QOS Requirements for Real-Time Services over IP
Overview of objective assessment methodologies for multimedia services
ATIS Interoperability
Presentation transcript:

Video QoE and Standards Sales Training 05-Nov-2007

What is Changing?  Current standards focus on:  QoS, not QoE  Static requirements, not dynamic measurement  Systems not relevant for IP video (e.g. J.144)  Urgent need for standardized QoE tools for IP video applications  QoS not enough  Pressure to deploy QoE solutions now

Breaking Down QoE Standards  Standard MOS  People know what MOS = 4 means  MOS prediction that is reliable  Predicted MOS matches viewer experience  Evaluation using large database and standardized subjective experiments  MOS prediction that is reproducible  Standard algorithm to compute MOS  Detailed specification (equations, parameters, etc.)  No need for protocol interoperability or network interfacing as with other standards

Relevant Groups  Video Quality Experts Group (VQEG)  ITU-T Study Group 9  ITU-T Study Group 12  ATIS IPTV Interoperability Forum (IIF)  Video Services Forum (VSF)  SCTE  IPTV Focus Group (ITU-T)  DSL Forum  Open IPTV Forum  SMPTE  CableLabs  IETF Focus on QoE model evaluation (key groups) Focus on interoperability and requirements

Summary for Service Provider  QoE monitoring solutions critical for video service success  QoS not enough, pressure to deploy QoE solutions now  Full standards to be expected by  Activities in various groups accelerate & converge  Vendors align systems with standards in  QoE standards do not involve interoperability between vendors  No protocol or network interfacing issues  Standardizes measurements only  Now safe to deploy pre-standard solutions  What to do in the meantime?  Provide input to standards groups  Use QoE solution that already works well today (providing reliable, reproducible video MOS)  Use QoE vendor active in key standards groups  Deploy solutions flexible to align to standards in future

Backup

VQEG  Established 1997 (EPFL/SYMM involvement)  ITU study group members, universities, private industry  ITU-T J.144, ITU-R BS.1367 (2003)-FR-TV (MPEG-2 only, no IP)  “Multimedia” test (content-based)  Model submission: 2Q/2007, Recommendation: late 2008  Proponents: Psytechnics, Opticom, Swissqual, NTT, Yonsei Univ., KDDI, SYMM, NTIA, Nortel  Symmetricom submitted Full Reference metric proposal  RR/NR-TV test (content-based)  Model submission: 1Q/2008, Recommendation: 2009  Proponents: NTIA, NEC, Tektronix, Yonsei Univ., BT

VQEG (Ctd).  HDTV test (content-based)  Model submission: 4Q/2008, Recommendation:  Key proponents: NTIA, NEC, Yonsei, NTT, KDDI, Opticom, Nortel  Hybrid/bitstream test (just launched)  Model submission: 4Q/2008, Recommendation:  Proponents: Psytechnics, KDDI, BT, NTT, NEC, Yonsei Univ., SwissQual, Opticom, Telchemy, Tektronix, NTIA, FT, DT, Witbe, QualiDeo, Ghent Univ., Toyama Univ.

ITU-T SG12  Performance and quality of service  Symmetricom will contribute to the P.NAMS (Non-intrusive parametric model for assessment of multimedia streaming)  Video + audio  Inputs: –Packet info (loss rate/pattern, jitter, RTP/UDP/TCP header) –Codec info –Client info (buffering, decoder)  Excludes payload information  Core model + packet parameter extraction model  G.OMVS (“Opinion model for video streaming”)  Symmetricom will contribute to the G.OMVS  Symmetricom engaged with NTT to establish a common interest working group.

VSF  Interoperability, quality metrics  Artel, AT&T, Dimetis, Evertz, Fox, Harmonic, Harris, Ineoquest, Level 3, Media Links, Net Insight, Spirent, Tandberg, Verizon, VideoClarity  Test and Measurements Activity Group  Completed work in 4Q/2006  “Recommended Video over IP Metrics”, Dec  Symmetricom started the process for establishing a QoE group at VSF meeting in Oct  Sponsored by at&t  Proposal to VSF board members complete.

ATIS IIF  QoSM Task Force  Telchemy, Tektronix, Telcordia, Verizon, AT&T, BT, Nortel, Ericsson, Motorola, Qwest, JDSU, Cisco  “QoE Model for Video, Audio, Multimedia and Transactions” (WT-005)  Plans to incorporate “Quality of Experience Requirements for IPTV” (FG-IPTV, DSL-Forum)  Symmetricom will be active participant and will support synchronization of ATIS efforts with VSF.

SCTE HMS  Hybrid Management Sub-layer (HMS) Committee  Management and monitoring interfaces for broadband technologies.  Cable MSO’s, vendors of network components, and expert industry consultants.  Quarterly meetings.  1 st proposal to be provided in January  Symmetricom sponsored by Time Warner.