MSHA Performance Analysis Briefing Report Presentation Joe Breighner Allison Czapracki Tangie Gray Rashmi Jain Abi Jones October 23, 2006

Agenda Statement of Work Background Performance Analysis Overview Drivers and Barriers Preliminary Data Task Analysis Design Approach Conclusion Next Steps

Statement of Work The overall goal of this project is to develop a systematic and effective training strategy and course lessons for underground coal mine supervisors based on State-of-the-art instructional design principles, processes, and learning technologies The extensive and validated mine supervisor Job Task Analysis (JTA) developed by the Mine Safety and Heath Administration (MSHA) in cooperation with the U.S. Navy

Background 50% of the electricity produced in the U.S. is fueled by coal

Background In % of coal miners were above the age of 45 In 2004, 3.4% of coal miners were under the age of 25 Coal mine positions expected to increase by 10,000 over 20 years “[The mining industry] will need to replace a major portion, approximately 50% of the underground coal mining workforce in the next 5 to 7 years.” Bruce Watzman, V.P. Safety, Health and Human Resources for the National Mining Association

Background Contributing factors to personnel shortage Diminishing pool of human resources Ever-changing production methods Increasing high technology environment “How these skills will be gained in advance of employment is a continuous challenge,” Bruce Watzman Mine Safety & Health Administration’s (MSHA) challenge: Formalize underground coal mine supervisor training program

Background Research The future high turnover in the coal mine industry The lack of trained and experienced coal mine supervisors Immersion team to transition training prototype to accessible online training materials The training must be 508 compliant Developed in Workforce Connections, a Learning Content Management System (LCMS)

Performance Analysis The performance analysis was conducted to Analyze and validate the prototype created by the MSHA Immersion Team Propose next steps for the task analysis and content analysis phases of the project

Performance Analysis Process Held a meeting with members of the MSHA Immersion Team Collected data from subject matter experts (SME), prototype evaluations, online resources, and extant data resources Identified gaps in last year’s prototype from SME interviews Identified the drivers that promote the project Identified the barriers that hinder the project

Performance Analysis Optimal situation Mine supervisors would possess Overall knowledge of the mining process and specific knowledge in the following areas: Safety issues Regulations Technical skills (e.g., ventilation/fluid dynamics, roof and rib control) Management skills Organizational skills Logical thinking Problem solving

Performance Analysis Optimal situation (contd…) Mine supervisors would possess the ability to Communicate effectively and develop a good rapport with co-workers Respond appropriately and competently during emergencies and unusual situations Job task analysis (JTA) spiders would be translated into an engaging, practical and effective training strategy

Performance Analysis Actual situation Expected shortage of experienced mine supervisor candidates due to attrition Few mine supervisor training programs are available Current training programs are mostly On-the-Job Training (OJT) Smaller mines do not have formal training programs

Drivers Access to SME’s, MSHA personnel, and mine environments Extensive mine safety resources Compiled data from MSHA team Target audience as usability and content testers Single expert source to validate training content High number of mining fatalities during 2006 High rate of impending retirement of experienced miners Critical role of mine supervisors and the complexity of associated tasks

Barriers Limitations of LCMS in light of Section 508 and SCORM compliance Access to experienced miners and mine supervisors as usability and content testers Development cycle restricted to academic year Need for supplemental training, on or off-site

Barriers “Creativity” of mine supervisors, reliance on prior knowledge Miners showed preference for face-to-face training over online training Ongoing MSHA administration and support of training LCMS and bulletin boards (new equipment, procedures, safety regulations)

Preliminary Data Human Resources Stakeholder Mr. Jeffrey Duncan, MSHA Wants a training solution with “…a management/engineering perspective [that goes] beyond compliance to understanding” Stressed creating online training for underground coal mine supervisors Training to include development of six training modules for in Workforce Connections MSHA will position the training as professional development for miners

Preliminary Data Human Resources ( contd…) SMEs Formative evaluations of the training prototype Interviews

Preliminary Data Non Human Resources Hard Data Resources MSHA Statement of Work Title 30 Code of Federal Regulations Multimedia Training Materials NIOSH Latent Imaging Exercises Colorado State Mining Exam Preparation DVD Commonwealth of Pennsylvania Mine Safety Multimedia Mine Materials MSHA Informational Reports P&M Mine Job Task Analysis Section 508 Website Online Resources

Task Analysis Cognitive task analysis divided the twelve generic duties into two rule-using categories Procedural Principle Further analysis of JTAs helped refine the task analyses for Pre-Shift Examination and Emergencies and Unusual Situations

Design Approach Training Environment Proposal Visually stimulating and interactive adaptive to the individual miner's level of experience Customizable and flexible Performance based 508 and Sharable Courseware Object Reference Model (SCORM) compliant Rich with multiple views and guided scenarios

Design Approach Web-based Electronic Performance Support System (EPSS) Scenario-driven Strategy

Conclusion The performance analysis has provided: An overview of the current state of the coal mining industry A closer look at the coal mine supervisory workforce A clearer understanding of the viability of the training prototype Our challenge: bridging the gap between miners’ preference for “hands-on practice” and the cognitive-building advantages of computer-based training.

Next Steps Continued Task Analysis A continued review of extant data A synthesis of the information collected Work on the user interface presentation and functionality Finalizing the instructional strategy for the entire training, as well as the multiple views and scenario based views.

Next Steps Content Analysis Synthesis of the information collected into applicable and appropriate training modules Reviewing examples of MSHA courses in Workforce Connections Selecting appropriate scenarios for the different lesson topics Developing appropriate objectives and instructions to guide users through the modules

MSHA Performance Analysis Briefing Report Presentation Joe Breighner Allison Czapracki Tangie Gray Rashmi Jain Abi Jones