Program Evaluation
Evaluation Why evaluate? What to evaluate? Who to evaluate? When to evaluate? How to evaluate?
Evaluation: Tangible Benefits Meeting compliance Meeting training goals/objectives Increase in awareness Increase in desired actions High knowledge scores Mastery Wiam Younes@2014
Evaluation: Intangible Benefits Satisfaction Organizational commitment Improved work climate Fewer complaints Reduction of stress Mastery More is listed in the Text Book page 252
What to evaluate? Access Relevance to goals Quality Learning outcomes Impact Cost Effectiveness Knowledge General to Specific Instructors Methods of delivery Wiam Younes@2014
Who to Evaluate? Audience Performance Groups Individuals Roles Partners Support Responsibilities Deliverables Availability of subject matter experts
When to Evaluate? At the end of an activity Ongoing monitor for completion Access Program evaluation goals Bi-Annual or Annually Compliance Requirement Audit Requirement
How to Evaluate? (1) Questionnaire/survey Pre and Post tests Self-assessment Quizzes after training (knowledge) Access Videotape training sessions Follow up questionnaire (mastery) Monitor compliance Part of Job Performance Feedback and suggestions Wiam Younes@2014
How to Evaluate? (2) Track privacy and security incidents Simulated attacks Spot checks of personnel behavior Record user ID of web-based training Percent of attendance Expertise Material meets goals Training Logs Interviews Re-evaluate method and material Wiam Younes@2014
Questions Wiam Younes@2014