Human Performance Improvement Process INTRODUCTION Connie Johnson

Human Performance Improvement Process EVALUATION

PHASE V EVALUATION FORMATIVE - SUMMATIVE - CONFIRMATIVE - META

Human Performance Improvement Process FORMATIVE EVALUATION

PHASE V EVALUATION FORMATIVE - SUMMATIVE - CONFIRMATIVE - META

Formative Evaluation What it is? Formative evaluation is judging the work of a program while the program or activities are forming or happening. When we do It? It involves gathering information during the early stages. Why do we do it? To determine that your message is clear. To identify if you are achieving your goals.

What are the objectives? Observe trainee behavior Have informal talks about the training activity with the trainees. Give short test to trainees Hold group discussions with trainees to gain feedback.

When the cook tastes the soup, that’s formative—When the guests taste the soup that’s summative

Human Performance Improvement Process SUMMATIVE EVALUATION

PHASE V EVALUATION FORMATIVE - SUMMATIVE - CONFIRMATIVE - META

Summative Evaluation Review results of performance intervention Is the performance gap reduced, eliminated, or solved? Does it meet the needs of the organization? Conducted during implementation phase Frequently not completed due to: Time Money Resources Management support Generally, external evaluator or organization decision makers are reviewing if working. Reviews reactions, learning and capability levels, performance levels, results to gap and bottomline.

Eight steps of Summative Evaluation Identify the decision. Translate the decision into evaluation questions. Summarize the evaluation design. Determine resources needed. Identify evaluation procedures. Outline data analysis. Identify evaluation support requirements. Document and communicate results. 1.Interview decisionmakers to seek what decisions need to be made. Translate decisions into evaluation questions. Outline the eval in terms of strategies, stds & students What is practical and possible? How will you collect the data? Instruments, procedures Does data collection provide answer to eval questions? Staffing, budgeting, reporting, etc. Prepare and distribute a design doc, status reports and a final report.

Human Performance Improvement Process CONFIRMATIVE EVALUATION

PHASE V EVALUATION FORMATIVE - SUMMATIVE - CONFIRMATIVE - META

CONFIRMATIVE EVALUATION The purpose of Confirmative Evaluation is continuous improvement. Confirmative evaluation takes a long-term view of the effectiveness, efficiency, impact , and value of the instructional and non-instructional intervention. It is outcome and impact based.

Confirmative Evaluation Human Performance Improvement Process Confirmative Evaluation Continuing Competency (Job Transfer) Continuing Effectiveness (Organizational Impact) Return on Investment

Human Performance Improvement Process

Human Performance Improvement Process META EVALUATION / VALIDATION

PHASE V EVALUATION FORMATIVE - SUMMATIVE - CONFIRMATIVE - META

Meta Evaluation / Validation Human Performance Improvement Process Meta Evaluation / Validation Meta evaluation is a quality control process that is applied to the processes, products and results of formative, summative, and confirmative evaluation. It is all about evaluating the evaluation.

Meta Evaluation / Validation Human Performance Improvement Process Meta Evaluation / Validation There are two types of Meta Evaluations: Type One Type Two

Meta Evaluation / Validation Human Performance Improvement Process Meta Evaluation / Validation Zoom in on how the evaluation was conducted. Validate the evaluation inputs, process, outputs, and outcomes.

Meta Evaluation / Validation Human Performance Improvement Process Meta Evaluation / Validation Formative, Summative, and Confirmative Processes Formative, Summative, and Confirmative Products Lessons Learned

Human Performance Technology (HPT) Model Intervention Selection and Design Cause Analysis Intervention Implementation and Change Performance Analysis

This concludes our presentation, HUMAN PERFORMANCE IMPROVEMENT PROCESS This concludes our presentation, any questions?