1. Summary of Results Study Period 2009-2012 ITU-T Study Group 12 Performance, QoS and QoE Charles Dvorak, SG 12 Chairman

2. International Telecommunication Union 2 ITU-T Study Group 12 Performance, QoS and QoE Contents Terms of reference Highlights of achievements Proposed Terms of reference (slight mod.) Future work Conclusions Supplemental slides

3. International Telecommunication Union 3 ITU-T Study Group 12 Performance, QoS and QoE SG 12 Terms of Reference Responsible for Recommendations on performance, quality of service (QoS) and quality of experience (QoE) for the full spectrum of terminals, networks and services ranging from speech over fixed circuit-based networks to multimedia applications over networks that are mobile and packet-based. Included in this scope are the operational aspects of performance, QoS and QoE. A special focus is given to interoperability to ensure end-to-end users' satisfaction. Lead SG for QoS and Performance

4. International Telecommunication Union 4 ITU-T Study Group 12 Performance, QoS and QoE Highlights of achievements (I) Smooth integration of QoS-related work moved to SG 12 from SG 2 by WTSA-08 FG on Driver Distraction created and active New Rec. E.803 based on the work of the Regional Group for Africa and the QSDG New Rec. P.1100 and P.1110 based on the work of the FG on Car Communications Six new Rec. consented in two authorized meetings of WP 2/12 chaired by Mr. Adler Three new G.1080 Recs. on IPTV QoS/QoE

5. International Telecommunication Union 5 ITU-T Study Group 12 Performance, QoS and QoE Highlights of achievements (II) Five new Rec. in a new P.1200 Series on the Assessment of A/V Media Streaming Quality New Rec. P.863 on Perceptual Objective Listening Quality Assessment New Rec. Y.1564: Ethernet Serv. Activation Testing--already widely used by industry New Rec. Y.1566 on QoS mapping and Inter- connect of Ethernet, IP and MPLS networks New Rec. P.381 on Universal Wired Headset Interface Requirements and Test Methods

6. International Telecommunication Union 6 ITU-T Study Group 12 Performance, QoS and QoE Highlights of achievements (III) New Rec. G.107.1 on the Wideband E-model New Rec. P.1301, rel. to Telepresence QoE New Rec. Y.1565 on Home Networking Performance Parameters New Handbook on Subjective Testing Practical Procedures Revision/updating of many well-known existing Recommendations of SG 12 (e.g., G.107, P.56, P.311, Y.1221, Y.1541, etc.)

7. International Telecommunication Union 7 ITU-T Study Group 12 Performance, QoS and QoE Terms of Reference (proposed) Responsible for Recommendations on performance, quality of service (QoS) and quality of experience (QoE) for the full spectrum of terminals, networks and services ranging from speech over fixed circuit-based networks to multimedia applications over networks that are mobile and packet based. Included in this scope are the operational aspects of performance, QoS and QoE; the end-to-end quality aspects of interoperability; and the development of multimedia quality assessment methodologies, both subjective and objective. Lead SG for Performance, QoS and QoE

8. International Telecommunication Union 8 ITU-T Study Group 12 Performance, QoS and QoE Examples of Future Work QoE of Web-browsing and other apps Framework for invoking diagnostic funct. QoE requirements for telepresence; and telemeeting and conferencing services Models for Client Performance Metrics Multidimensional scaling quality assessment Objective prediction of speech intelligibility Parametric non-intrusive A/V assessment Many new subjective test methods needed

9. International Telecommunication Union 9 ITU-T Study Group 12 Performance, QoS and QoE Conclusion SG 12 works on all performance aspects (terminals, systems, networks, etc.), so the end-to-end view of the user is captured. Meaningful progress by SG 12 will happen in the future because it continues to evolve its work programme to address the performance, QoS and QoE of new technologies, networks and services, such as IPTV, advanced audio, Ethernet, home networking, multimedia, etc.

10. International Telecommunication Union 10 ITU-T Study Group 12 Performance, QoS and QoE Supplemental Slides Management team Study Group Structure General Information Acknowledgements

11. International Telecommunication Union 11 ITU-T Study Group 12 Performance, QoS and QoE Management Team Chair(s)Charles A. Dvorak(USA) Vice-Chairs:Paul Barrett(UK) Vladimir Efimushkin(Russia) Gamal Amin Elsayed(Sudan) Hyung-Soo (Hans) Kim(Korea) Feng Qi(China) Catherine Quinquis(France) Akira Takahashi(Japan) Hassan Talib(Morocco) WP Chairs:Catherine Quinquis(France) Klemens P. F. Adler(Germany) Paul Coverdale(China) TSBJudit Katona Kiss Hiroshi Ota Sarah Scott

12. International Telecommunication Union 12 ITU-T Study Group 12 Performance, QoS and QoE Study Group Structure WP1/12 Terminals & multimedia subjective assessment WP2/12 Objective models & tools for multimedia quality WP3/12 Multimedia QoS and QoE Groups reporting to SG 12: FG on Car Communications FG on Driver Distraction Quality of Service Development Group Regional Group for Africa (on QoS and QoE)

13. International Telecommunication Union 13 ITU-T Study Group 12 Performance, QoS and QoE General Information 43 New/Revised Recommendations approved 17 Questions assigned by WTSA-08 1 New or revised Questions during period 17 Questions proposed for next period 40 Rapporteurs meetings held 347 contributions received 6 SG meetings held Max/Min/Average SG participants: 118/103/111

14. International Telecommunication Union 14 ITU-T Study Group 12 Performance, QoS and QoE Acknowledgements In any standards development organization, substantial progress occurs because of the right balance of timely technical contributions and trusted, competent leadership. SG 12 is a role model for this statementbecause of the Vice-Chairs, the WP chairs, chairs of the Groups that report to SG 12, the rapporteurs, the editors, and the many active participants. Thanks to all they did--and for making it fun! Many talented people on the TSB staff supported us really well. My sincere thanks to all who worked so hard in the background so that we could be successful in our efforts. For their dedication and diligence, special thanks to the TSB staff who were assigned to SG12: Judit Katona Kiss (our recently retired Counsellor), Hiroshi Ota, and Sarah Scott.