1. 1 icfi.com | Social Security Administration Call Order 0002: Business Strategy for Training, Certifying and Recruiting Job Analysts Briefing of Final Project Results September 21, 2011 Jennifer Harvey, Ph.D. Lance Anderson, Ph.D.

2. 2 icfi.com | Introductions/Overview of Team –SSA –ICF –Subcontractors Introduction to Project and Purpose Methodology Conclusions and Recommendations –Training –Certification –Recruitment Summary –Strategic Decisions and Potential Resource Needs Questions? Agenda

3. 3 icfi.com | Introductions

4. 4 icfi.com | SSA Debra Tidwell-Peters David Blitz Michael Dunn Elizabeth Kennedy Mark Trapani Overview of Team ICF International Jennifer Harvey, Ph.D. Candace Cronin, Ph.D. Lance Anderson, Ph.D. Allison Cook, M.S. Jessica Jenkins, MPhil Chris Riches, M.A. Beth Heinen, Ph.D. Katina Gracien Daniel Fien-Helfman Subcontractor Joan Knapp, Ph.D.

5. 5 icfi.com | Introduction to Project and Purpose

6. 6 icfi.com | SSA developing new occupational information system (OIS) tailored specifically to SSA’s disability programs and adjudication process. –OIS will replace the Dictionary of Occupational Titles (DOT) and companion volumes, including the SCO and RHAJ. –To develop OIS, SSA needs to recruit, train and certify job analysts to perform job analysis throughout U.S. labor market. –Purpose of Call 0002 was to review training, credentialing and recruitment practices needed to prepare those job analysts who will be tasked with the rigorous data collection. Introduction to Call Order 0002

7. 7 icfi.com | How Call Order 0002 Fits Within OIS Project Decisions

8. 8 icfi.com | Relationships Between Call Order 0002 Components

9. 9 icfi.com | Methodology

10. 10 icfi.com | Task 1: Task Meetings/Discussion Task 2: Business Strategy for the Training, Certifying and Recruitment of Job Analyst Candidates Project Methodology Subtask 2.1: Documentation of a Detailed Methodology Subtask 2.2: Research and Recommend Strategy for Training Job Analyst Candidates Subtask 2.3: Research and Recommend Strategy for Certification of Job Analyst Candidates Subtask 2.4: Research and Recommend Strategy for Recruitment of Job Analyst Candidates Subtask 2.5: Development of Candidate Tracking Database for Potential Job Analyst Candidates

11. 11 icfi.com | Recommendations: Training Job Analyst Candidates

12. 12 icfi.com | Knowledge, Skills & Abilities (KSAs) and Minimum Qualifications (MQs) –Refine SSA Job Analyst KSAs based on final job analysis methodology and work analysis instrument. –Use MQs that include specific and relevant course work or experience. Existing Job Analysis Training –Re-examine existing trainings after job analysis methodology is determined. Recommendations: Training Strategy

13. 13 icfi.com | Critical Design Considerations –Link training activities to specific, measurable and observable learning objectives. –Consider background and experience levels of participants. –Address concepts first. Then, allow participants to practice. –Keep training sessions short and include review questions or an interactive component. –Do not allow budgetary concerns to dictate training material. –Use ISD ADDIE model and evaluate during each phase of training development. Recommendations: Training Strategy (cont.)

14. 14 icfi.com | Training Features –Include the following: Lecture Discussion Variety of Activities Practice Feedback Resource Materials –To increase participant engagement: Communicate the importance of the training Highlight how training can benefit beyond SSA –To increase training transfer: Emphasize expectation to adhere strictly to process Incorporate significant time for practice Provide feedback Use knowledgeable instructors Encourage peer support Recommendations: Training Strategy (cont.)

15. 15 icfi.com | Recommendations: Training Strategy (cont.) Training Content –Re-evaluate KSAs that need to be addressed in training after job analysis methodology finalized. –Dedicate significant portion to specific data collection processes. –Emphasize importance of data quality. –Include how to respond to challenges or accommodate situational differences. –Include a discussion on data security, ethics and issues with data confidentiality and sensitive information. –Emphasize consequences of failing to adhere to data security requirements. –Include practice scenarios or case studies that highlight data security concerns. –Provide opportunity to use all types of materials.

16. 16 icfi.com | Training Assessment –Tie the assessments to specific training objectives. –Include a knowledge assessment as well as a behavioral component. Training Delivery Method –Use a blended training delivery method Train the Trainer –Develop train-the-trainer sessions. Training Evaluation –Evaluate training at 3 of the 4 levels of Kirkpatrick’s training evaluation criteria: Reactions Learning Behavior Recommendations: Training Strategy (cont.)

17. 17 icfi.com | Recommendations: Certifying Job Analyst Candidates

18. 18 icfi.com | Type of Credentialing –Develop an assessment-based certificate program. Industry Standards and Accreditation –Follow one of two approved industry standards: ANSI or ICE. –Follow-up with ANSI, FBI, and the FDA. –Build program to comply with standards from the outset regardless of accreditation goals. Existing Job Analysis Credentialing –Develop own certificate program based on the method, instrument, and content model selected. Recommendations: Certifying Strategy

19. 19 icfi.com | Creating a Certificate Program –Develop clear policies and procedures for program operation and administration. –Ensure certificate program training: Is based on learning objectives Follows generally accepted training guidelines and models Uses appropriate delivery methods –Involve an assessment specialist when learning objectives are developed. –Conduct a quality control check or evaluation of the program annually. –Include both formative and summative assessments. –Maintain both participant records and records on how the program was developed and administered. –Establish a designated authority to oversee, manage and be responsible for the program. Recommendations: Certifying Strategy (cont.)

20. 20 icfi.com | Data Entry Credentialing –Develop a software program for data entry that includes data checks. –Provide a detailed data entry instruction handbook or guidebook. Audit Process –Develop an audit process. –Develop clear policies and procedures for how the auditing process will occur, how often it will occur, who will be audited, how work will be evaluated, and what measure will be used. Recommendations: Certifying Strategy (cont.)

21. 21 icfi.com | Conclusions and Recommendations: Recruiting Job Analyst Candidates

22. 22 icfi.com | Sources of Job Analyst Candidates –Focus recruiting candidates with training or experience in job analysis. –Conduct research to determine numbers and interests within potential candidate sources. Recruiting Framework –Conduct a cost-benefit analysis of various recruiting frameworks. Recruitment Logistics –Consider establishing a few temporary regional recruitment offices for the initial wave of recruitment. –Develop a recruitment and hiring process that moves candidates through the process as quickly as possible. Recommendations: Recruiting Strategy

23. 23 icfi.com | Compensation –Conduct a compensation study. –Provide a competitive compensation as an hourly rate. Candidate Tracking –Log candidate information, along with screening and selection data, and integrate with performance auditing. –Maintain data on number of analyses performed and quality of the analyses. Candidate Training Considerations –Develop and use a modular training structure if experience and educational backgrounds vary. Recommendations: Recruiting Strategy (cont.)

24. 24 icfi.com | Summary: Strategic Decisions and Potential Resource Needs

25. 25 icfi.com | Training –Select the instruments and methods for job analysis. –Establish learning objectives. –Determine the size of the candidate pool. –Identify the amount of time available to train analysts and collect all job analysis information. Certificate Program –Identify the length of time over which SSA will recruit and train job analysts. –Estimate the expected tenure and experience levels of analysts. Recruitment –Determine deployment strategy. –Articulate selection strategy. –Identify employment status for analysts. –Specify selection test battery. –Select a compensation approach. Strategic Decisions

26. 26 icfi.com | Contractor with occupational and job analysis expertise Assessment specialist or consultant with experience developing and implementing assessment-based certificate programs Contractor with training design expertise Headhunter agencies, professional organizations or societies, credentialing organizations Existing networks of providers or organizations like BTE Unemployment agencies or temporary staffing agencies Technology vendor that can provide information technology services Contractor with knowledge of existing audit software packages Software compatible with the OIS database that can be used for quality control Auditors who can evaluate OIS database entries Contractor with expertise and experience in testing Potential Resource Needs

27. 27 icfi.com | Questions? For more information, please contact: Dr. Jennifer Harvey Technical Specialist ICF International (703) 934-3664 JHarvey@icfi.com Dr. Lance Anderson Vice President ICF International (703) 934-3674 LAnderson@icfi.com