1. 1 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 1 2010 Satisfaction survey results In early 2010 MCC conducted a survey of the satisfaction of delegates and users of the 3GPP web site.

2. 2 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 2 2010 Satisfaction survey results There were: 79 delegate responses (of which 20 were chairmen or vice- chairmen) representing a reasonable spread amongst the TSGs and WGs indicated in the chart* … and 89 non-delegate responses * Respondents could choose more than one TSG/WG. TSG or WG meetings you regularly attend Responders were asked to identify themselves as either delegates (including chairmen and vice- chairmen) or as 3GPP non- participants.

3. 3 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 3 The results in the following slides cover the responses from delegates (including chairmen and vice-chairman) and from non-delegates. 2010 Satisfaction survey results

4. 4 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 4 2010 Satisfaction survey results Questions were rated 1 (poor) to 5 (good). The scores are shown graphically, and the mean values given.

5. 5 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 5 2010 Satisfaction survey results How satisfied are you with: email exploder lists management specification groups' pages on the 3gpp web site meeting information on the 3GPP website Exploder lists - Specification groups - meeting information Mean score: delegates: 4.1

6. 6 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 6 2010 Satisfaction survey results How satisfied are you with: email exploder lists management specification groups' pages on the 3gpp web site meeting information on the 3GPP website Exploder lists - Specification groups - meeting information Mean score: delegates: 3.8

7. 7 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 7 2010 Satisfaction survey results How satisfied are you with: email exploder lists management specification groups' pages on the 3gpp web site meeting information on the 3GPP website Exploder lists - Specification groups - meeting information Mean score: delegates: 3.9

8. 8 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 8 2010 Satisfaction survey results How satisfied are you with: on-line registration document number allocation access to and robustness of the local (meeting) server speed and reliability of the public internet access TSG and WG meeting support, registration and ADN Mean score: delegates: 4.4

9. 9 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 9 2010 Satisfaction survey results How satisfied are you with: on-line registration document number allocation access to and robustness of the local (meeting) server speed and reliability of the public internet access TSG and WG meeting support, registration and ADN Mean score: delegates: 3.8

10. 10 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 10 2010 Satisfaction survey results How satisfied are you with: on-line registration document number allocation access to and robustness of the local (meeting) server speed and reliability of the public internet access TSG and WG meeting support, registration and ADN Mean score: delegates: 3.2

11. 11 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 11 2010 Satisfaction survey results How satisfied are you with: on-line registration document number allocation access to and robustness of the local (meeting) server speed and reliability of the public internet access TSG and WG meeting support, registration and ADN Mean score: delegates: 3.2

12. 12 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 12 2010 Satisfaction survey results CR implementation, MCC support How satisfied are you with the support you receive from your MCC Support officer? How satisfied are you with the accuracy timeliness of implementation of CRs Mean score: delegates: 4.2

13. 13 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 13 2010 Satisfaction survey results CR implementation, MCC support How satisfied are you with the support you receive from your MCC Support officer? How satisfied are you with the accuracy timeliness of implementation of CRs Mean score: delegates: 4.0

14. 14 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 14 2010 Satisfaction survey results CR implementation, MCC support How satisfied are you with the support you receive from your MCC Support officer? How satisfied are you with the accuracy timeliness of implementation of CRs Mean score: delegates: 4.0

15. 15 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 15 2010 Satisfaction survey results Databases Are you aware of the existence of the CR database? If yes, how easy is it to access and use? yes: 73% Mean score: delegates: 3.0

16. 16 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 16 2010 Satisfaction survey results Databases Are you aware of the existence of the Specs Status database? If yes, how easy is it to access and use? yes: 72% Mean score: delegates: 3.2

17. 17 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 17 2010 Satisfaction survey results Workplan and Liaison Statements How satisfied are you with the information provided in the 3GPP workplan the distribution and tracking of LSs Mean score: delegates: 3.3

18. 18 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 18 2010 Satisfaction survey results Workplan and Liaison Statements How satisfied are you with the information provided in th 3GPP workplan the distribution and tracking of LSs Mean score: delegates: 3.3

19. 19 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 19 2010 Satisfaction survey results Specs information Do you use the specifications homepage? When looking for specification version, do you go directly to the FTP server? Do you download specs using FTP? HTTP? delegates yes: 89.90 % non-delegates yes: 93.39 %

20. 20 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 20 2010 Satisfaction survey results Specs information Do you use the specifications homepage? When looking for specification version, do you go directly to the FTP server? Do you download specs using FTP? HTTP? delegates yes: 55 % delegates yes: 24 %

21. 21 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 21 2010 Satisfaction survey results Specs information Do you use the specifications homepage? When looking for specification version, do you go directly to the FTP server? Do you download specs using FTP? HTTP? Use of FTP uncommon for non-delegates.

22. 22 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 22 2010 Satisfaction survey results 3GPP website How satisfied are you with the 3GPP website: content ease of navigation appearance Mean score: non-delegates: delegates: 4.1 3.6

23. 23 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 23 2010 Satisfaction survey results 3GPP website How satisfied are you with the 3GPP website: content ease of navigation appearance Mean score: non-delegates: delegates: 3.2

24. 24 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 24 2010 Satisfaction survey results 3GPP website How satisfied are you with the 3GPP website: content ease of navigation appearance Mean score: non-delegates: delegates: 3.7 3.5

25. 25 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 25 2010 Satisfaction survey results 3GPP Tools - administrative information How do you rate the 3GPP website search tools? How do you rate the membership web page and other administrative information? Mean score: non-delegates: delegates: 2.7 2.8

26. 26 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 26 2010 Satisfaction survey results 3GPP Tools - administrative information How do you rate the 3GPP website search tools? How do you rate the membership web page and other administrative information? Mean score: non-delegates: delegates: 3.0 3.4

27. 27 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 27 2010 Satisfaction survey results Overall mean score: 3.5 out of 5

28. 28 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 28 2010 Satisfaction survey results Conclusions drawn from the survey (1): For “common” questions, delegates’ and non- delegates’ scores are similar. There is a very wide spread of text comments on almost every topic, from “excellent” to “execrable” – which makes it difficult to draw any coherent conclusion!

29. 29 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 29 2010 Satisfaction survey results Conclusions drawn from the survey (2): Concerning the web site, some common themes emerge … Navigation is still a problem. We will modify menus to allow quicker navigation (fewer clicks) to Specs and Working Group areas. “I can’t find …” is a frequent comment. In fact, in all cases, the information is available, but evidently not in an intuitive place. We will examine each case with a view to making access to such information more obvious.

30. 30 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 30 2010 Satisfaction survey results Conclusions drawn from the survey (3): (web site, continued) The search engines still cause distress. A variety of complaints such as too many hits on searches difficult to restrict scope of searches (eg to latest versions of specs, to recent documents, to meeting reports, …). Several requests for pushed information (RSS feeds).

31. 31 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 31 2010 Satisfaction survey results Conclusions drawn from the survey (4): (web site, continued) Not very mobile-friendly.

32. 32 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 32 2010 Satisfaction survey results Conclusions drawn from the survey (5): Pleas for information not yet readily available, such as … More tutorial text on our technologies. A guide to the structure of the specs, with “tree” style links from stage 1 to stage 2 to stage 3, or clustering of related specs. Interactive discussion threads and other collaborative tools.

33. 33 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 33 2010 Satisfaction survey results Conclusions drawn from the survey (6): MCC are carefully assessing the comments and we will do our best to implement appropriate improvements.

34. 34 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 34 2010 Satisfaction survey results Conclusions drawn from the survey (7): Food for thought … Should we move away from proprietary file formats (such as Microsoft Word) to open formats? Prepare for a short discussion at a future TSG meeting.

35. 35 3GPP TSGs SA Meeting #49, San Antonio, Texas, USA, September 2010 SP-100458 © 3GPP Organizational Partners 2010 35 See you in Istanbul !