1. MSHA Performance Analysis Briefing Report Presentation Joe Breighner Allison Czapracki Tangie Gray Rashmi Jain Abi Jones October 23, 2006

2. Agenda Statement of Work Background Performance Analysis Overview Drivers and Barriers Preliminary Data Task Analysis Design Approach Conclusion Next Steps

3. Statement of Work The overall goal of this project is to develop a systematic and effective training strategy and course lessons for underground coal mine supervisors based on State-of-the-art instructional design principles, processes, and learning technologies The extensive and validated mine supervisor Job Task Analysis (JTA) developed by the Mine Safety and Heath Administration (MSHA) in cooperation with the U.S. Navy

4. Background 50% of the electricity produced in the U.S. is fueled by coal

5. Background In 2004 58.3% of coal miners were above the age of 45 In 2004, 3.4% of coal miners were under the age of 25 Coal mine positions expected to increase by 10,000 over 20 years “[The mining industry] will need to replace a major portion, approximately 50% of the underground coal mining workforce in the next 5 to 7 years.” Bruce Watzman, V.P. Safety, Health and Human Resources for the National Mining Association

6. Background Contributing factors to personnel shortage Diminishing pool of human resources Ever-changing production methods Increasing high technology environment “How these skills will be gained in advance of employment is a continuous challenge,” Bruce Watzman Mine Safety & Health Administration’s (MSHA) challenge: Formalize underground coal mine supervisor training program

7. Background 2005-06 Research The future high turnover in the coal mine industry The lack of trained and experienced coal mine supervisors 2006-07 Immersion team to transition training prototype to accessible online training materials The training must be 508 compliant Developed in Workforce Connections, a Learning Content Management System (LCMS)

8. Performance Analysis The performance analysis was conducted to Analyze and validate the prototype created by the 2005-06 MSHA Immersion Team Propose next steps for the task analysis and content analysis phases of the project

9. Performance Analysis Process Held a meeting with members of the 2005-06 MSHA Immersion Team Collected data from subject matter experts (SME), prototype evaluations, online resources, and extant data resources Identified gaps in last year’s prototype from SME interviews Identified the drivers that promote the project Identified the barriers that hinder the project

10. Performance Analysis Optimal situation Mine supervisors would possess Overall knowledge of the mining process and specific knowledge in the following areas: Safety issues Regulations Technical skills (e.g., ventilation/fluid dynamics, roof and rib control) Management skills Organizational skills Logical thinking Problem solving

11. Performance Analysis Optimal situation (contd…) Mine supervisors would possess the ability to Communicate effectively and develop a good rapport with co-workers Respond appropriately and competently during emergencies and unusual situations Job task analysis (JTA) spiders would be translated into an engaging, practical and effective training strategy

12. Performance Analysis Actual situation Expected shortage of experienced mine supervisor candidates due to attrition Few mine supervisor training programs are available Current training programs are mostly On-the-Job Training (OJT) Smaller mines do not have formal training programs

13. Drivers Access to SME’s, MSHA personnel, and mine environments Extensive mine safety resources Compiled data from 2005-06 MSHA team Target audience as usability and content testers Single expert source to validate training content High number of mining fatalities during 2006 High rate of impending retirement of experienced miners Critical role of mine supervisors and the complexity of associated tasks

14. Barriers Limitations of LCMS in light of Section 508 and SCORM compliance Access to experienced miners and mine supervisors as usability and content testers Development cycle restricted to academic year Need for supplemental training, on or off-site

15. Barriers “Creativity” of mine supervisors, reliance on prior knowledge Miners showed preference for face-to-face training over online training Ongoing MSHA administration and support of training LCMS and bulletin boards (new equipment, procedures, safety regulations)

16. Preliminary Data Human Resources Stakeholder Mr. Jeffrey Duncan, MSHA Wants a training solution with “…a management/engineering perspective [that goes] beyond compliance to understanding” Stressed creating online training for underground coal mine supervisors Training to include development of six training modules for 2006-07 in Workforce Connections MSHA will position the training as professional development for miners

17. Preliminary Data Human Resources ( contd…) SMEs Formative evaluations of the 2005-06 training prototype Interviews

18. Preliminary Data Non Human Resources Hard Data Resources MSHA Statement of Work Title 30 Code of Federal Regulations Multimedia Training Materials NIOSH Latent Imaging Exercises Colorado State Mining Exam Preparation DVD Commonwealth of Pennsylvania Mine Safety Multimedia Mine Materials MSHA Informational Reports P&M Mine Job Task Analysis Section 508 Website Online Resources http://www.msha.gov http://www.cdc.gov/niosh http://www.msha.gov/interactivetraining/tasktraining/index.html http://www.section508.gov

19. Task Analysis Cognitive task analysis divided the twelve generic duties into two rule-using categories Procedural Principle Further analysis of JTAs helped refine the task analyses for Pre-Shift Examination and Emergencies and Unusual Situations

20. Design Approach Training Environment Proposal Visually stimulating and interactive adaptive to the individual miner's level of experience Customizable and flexible Performance based 508 and Sharable Courseware Object Reference Model (SCORM) compliant Rich with multiple views and guided scenarios

21. Design Approach Web-based Electronic Performance Support System (EPSS) Scenario-driven Strategy

22. Conclusion The performance analysis has provided: An overview of the current state of the coal mining industry A closer look at the coal mine supervisory workforce A clearer understanding of the viability of the training prototype Our challenge: bridging the gap between miners’ preference for “hands-on practice” and the cognitive-building advantages of computer-based training.

23. Next Steps Continued Task Analysis A continued review of extant data A synthesis of the information collected Work on the user interface presentation and functionality Finalizing the instructional strategy for the entire training, as well as the multiple views and scenario based views.

24. Next Steps Content Analysis Synthesis of the information collected into applicable and appropriate training modules Reviewing examples of MSHA courses in Workforce Connections Selecting appropriate scenarios for the different lesson topics Developing appropriate objectives and instructions to guide users through the modules

25. MSHA Performance Analysis Briefing Report Presentation Joe Breighner Allison Czapracki Tangie Gray Rashmi Jain Abi Jones