Sponsored by the U.S. Department of Defense © 2006 by Carnegie Mellon University Version 1.0 page 1 Pittsburgh, PA SEI Professional Certifications

© 2006 by Carnegie Mellon University Version 1.0 page 2 What is Certification? Certification is the acknowledgement that an individual has attained a well-defined level of understanding and ability in a particular body of knowledge or skill set. Certification specifically: characterizes standard practices of the profession assures competencies of its practitioners employs demonstration of specific knowledge or skills establishes a vehicle for maturation of the profession

© 2006 by Carnegie Mellon University Version 1.0 page 3 Why Become Certified ? SEI-certified professionals realize an increase in knowledge and skills prestige in an organization marketability throughout the industry professional recognition from a global leader use of best practices in the profession

© 2006 by Carnegie Mellon University Version 1.0 page 4 SEI Certifications Current certifications CERT Computer Security Incident Handler PSP Developer SEMA Implementing Goal Driven Measurement Instructor Future areas for certification: TSP Coach and PSP Instructor SCAMPI High Maturity Lead Appraisers SAPP Instructor

© 2006 by Carnegie Mellon University Version 1.0 page 5 Background on SCAMPI High Maturity Lead Appraiser Certification Project CMMI SG direction provided in April/May 2006 Planning meetings held in May 2006 with program leaders. Core Team developmental meetings began in June of 2006 High Maturity focus group workshop July 2006 LA Survey September 2006 Infrastructure development July- September 2006 Initial roll-out October 2006

© 2006 by Carnegie Mellon University Version 1.0 page 6 Events Focused on High Maturity Issues SEI High Maturity Workshops (1999, 2001) SEI TR Competency Lifecycle Framework (2005) CMMI Steering Group Direction (2005/2006) SEI High Maturity Certification Focus Group Workshop (2006) SCAMPI Lead Appraiser Survey (2006) Certification announcement, process and application release of Initial phase of SCAMPI HM LA certification program

© 2006 by Carnegie Mellon University Version 1.0 page 7 SCAMPI LA Survey LA Survey of 36 questions issued to 428 LA’s 279 responses were received (65% response rate) Areas included: 1. General 2. Training and Education 3. Credentials 4. Experience 5. Competency Clusters 6. Plans for HM Appraisals

© 2006 by Carnegie Mellon University Version 1.0 page 8 SCAMPI LA Survey Results - 1 General 75% of respondents strongly agree or agree that some Lead Appraiser’s interpretations of the model are sometimes incorrect for a given situation. 45% of respondents strongly agree or agree that the SCAMPI appraisal method is not always rigorously implemented. 36% of respondents strongly agree or agree that some Lead Appraisers are engaging in unethical business practices. However 50% of respondents neither agree nor disagree or gave a No Opinion response.

© 2006 by Carnegie Mellon University Version 1.0 page 9 SCAMPI LA Survey Results - 2 General 54% of respondents strongly agree or agree that some CL or ML 4 or 5 appraisal results are not justified. 72% of respondents strongly agree or agree that some Lead Appraisers do not fully understand High Maturity CMMI concepts and issues. 55% of respondents strongly agree or agree that there is a need for certification of High Maturity Lead Appraisers 67% of the respondents strongly agree or agree that the SEI should develop a required courses specific to High Maturity Lead Appraiser topics.

© 2006 by Carnegie Mellon University Version 1.0 page 10 SCAMPI LA Survey Results - 3 Training and Education – 127 comments received Survey respondents agreed that certified individuals should have a background in CMMI, statistics, process improvement, quantitative project management, etc. Individuals should have advanced degrees with courses such as applied quantitative methods, statistical process control, business ethics, psychology, time management, team management, etc. Degrees in relevant fields such as engineering, science, business, or math.

© 2006 by Carnegie Mellon University Version 1.0 page 11 SCAMPI LA Survey Results - 4 Experience 62% of respondents strongly agree or agree that an individual should have led a High Maturity appraisal to qualify as a certified HM LA. 77% of respondents strongly agree or agree that an individual should have served as a mini-team member for High Maturity PAs in an appraisal to qualify as a certified HM LA. 41% of respondents replied that it was Not Important at All to have taught an Intro to CMMI course that included attendees from an organization that is ML4/5.

© 2006 by Carnegie Mellon University Version 1.0 page 12 SCAMPI LA Survey Results - 5 Experience 62% of the respondents replied that having taught High Maturity processes or concepts was Most Important or Somewhat Important. 39% of respondents replied that having authored presentations, articles, publications, and books on High Maturity topics was Most Important or Somewhat Important. 67% of respondents replied that having authored and/or implemented High Maturity processes was Most Important or Somewhat Important.

© 2006 by Carnegie Mellon University Version 1.0 page 13 SCAMPI LA Survey Results - 6 Competency Clusters Respondents identified that these were Most Important or Somewhat Important in all cases: Model Interpretation –93% Professionalism – 88% Understanding and Adapting to Organizational Contexts – 86% Interpersonal Communication and Facilitation – 82% Integration Articulation and Expression of Information – 80% Product or Service Tailoring Adaptation and Application – 77% Project Planning and Management – 77% Decision Making and Problem Solving – 73% Achieving and Managing Agreements – 68%

© 2006 by Carnegie Mellon University Version 1.0 page 14 SCAMPI LA Survey Results - 7 Are you planning to lead a v1.1 ML 4/5 appraisal in 2007? Yes – 41% No – 58% Are you planning to lead a v1.2 ML 4/5 appraisal between now and March 2007? Yes – 19% No – 80% Are you planning to lead a v1.2 ML 4/5 appraisal between March and October 2007? Yes – 47% (131 Respondents) No – 52% (143 Respondents)

© 2006 by Carnegie Mellon University Version 1.0 page 15 SCAMPI LA Survey Results - 8 Do you plan to become a certified SCAMPI High Maturity Lead Appraiser between now and October 2007? Yes – 84% (232 respondents) No – 15%

© 2006 by Carnegie Mellon University Version 1.0 page 16 HM LA Certification Process- Initial Phase-1 Application Submission and Review Each interested individual submits an application for review before proceeding to an Oral exam. Applications are reviewed based on the following criteria: -Training received on high maturity topics, e.g., statistical process control and probability and statistics -High maturity appraisal experience -Developed / Implemented high maturity processes -Built / Taught courses on high maturity topics Application review prioritized based on applicants planned first CMMI V1.2 HM appraisal Applicants who initially do not advance to the Oral exam, are provided the opportunity to supply additional information. Applications will be accepted through April 2007 Application will be accepted again starting in August 2007

© 2006 by Carnegie Mellon University Version 1.0 page 17 HM LA Certification Process- Initial Phase-2 SCAMPI HM LA Oral Exam - An assessment of knowledge through questions and answers between a candidate and examiners Candidates will be asked prepared questions and scenarios with “listen for” answers. Follow-up questions may be asked for clarity Quality assurance personnel will be on-hand to provide administrative oversight, logistical support, and audit candidate sessions to ensure program standardization Oral exams for 2006/2007 will conclude on June 30, 2007 Candidates will be notified of their exam results within two weeks of the exam

© 2006 by Carnegie Mellon University Version 1.0 page 18 HM LA Certification Process- Initial Phase-3 Scheduled SCAMPI HM LA Oral Exams Frankfurt, Germany: October 24-25, 2006 Denver, CO: November 14-16, 2006 India: January, 2007 (exact date and location yet to be determined) Austin, TX: March 26-29, 2007 at SEPG 2007 Amsterdam, The Netherlands: June 11-14, 2007 at European SEPG Additional dates and locations are under consideration

© 2006 by Carnegie Mellon University Version 1.0 page 19 HM LA Certification Renewal Criteria- Initial Phase Initial HM LA certifications will be valid through January, After successful completion of the SCAMPI LA exam and possible oral exam, certification is then valid for two to three years from the date of your exam. Maintenance and on-going professional requirements will need to be completed during the period of validity in order to renew your certification.

© 2006 by Carnegie Mellon University Version 1.0 page 20 HM LA Certification Process- Phase 2 Steps for New Candidates (October 2007): Successfully complete SCAMPI LA Exam Competency based exam to evaluate an applicant based on a standard body-of-knowledge for the practice Application Submission If application accepted, SCAMPI HM LA Oral Exam Renewal every two to three years from notification

© 2006 by Carnegie Mellon University Version 1.0 page 21 Next Steps and Plans- Phase 2 Conduct a Workshop to aid in the development of the SCAMPI LA Body of Knowledge (Feb 2007) Develop and Publish a SCAMPI LA Body of Knowledge Guide Develop and Implement a SCAMPI LA exam for all LA’s (tentatively October 2007)

© 2006 by Carnegie Mellon University Version 1.0 page 22 For more information contact: Jefferson Welch SEI Certification Program Team Lead

© 2006 by Carnegie Mellon University Version 1.0 page 23 Questions to Be Addressed Certification of all SCAMPI Lead Appraisers? Renewal criteria for Certified SCAMPI Lead Appraisers? Training program supporting the certification of SCAMPI LA and HM LA roles? Additional requirements for team members on high maturity appraisals?

© 2006 by Carnegie Mellon University Version 1.0 page 24 The SEI professional certification program provides recognition of a individual as a professional in his/her field of practice fosters growth of the professional community increases visibility of disciplined work integrates with quality principles (code of conduct) promotes the professional in the field Summary