1. Program Evaluation

2. Evaluation
Why evaluate?
What to evaluate?
Who to evaluate?
When to evaluate?
How to evaluate?

3. Evaluation: Tangible Benefits
Meeting compliance
Meeting training goals/objectives
Increase in awareness
Increase in desired actions
High knowledge scores
Mastery
Wiam

4. Evaluation: Intangible Benefits
Satisfaction
Organizational commitment
Improved work climate
Fewer complaints
Reduction of stress
Mastery
More is listed in the Text Book page 252

5. What to evaluate? Access Relevance to goals Quality Learning outcomes
Impact
Cost Effectiveness
Knowledge
General to Specific
Instructors
Methods of delivery
Wiam

6. Who to Evaluate? Audience Performance Groups Individuals Roles
Partners
Support
Responsibilities
Deliverables
Availability of subject matter experts

7. When to Evaluate? At the end of an activity
Ongoing monitor for completion
Access
Program evaluation goals
Bi-Annual or Annually
Compliance Requirement
Audit Requirement

8. How to Evaluate? (1) Questionnaire/survey Pre and Post tests
Self-assessment
Quizzes after training (knowledge)
Access
Videotape training sessions
Follow up questionnaire (mastery)
Monitor compliance
Part of Job Performance
Feedback and suggestions
Wiam

9. How to Evaluate? (2) Track privacy and security incidents
Simulated attacks
Spot checks of personnel behavior
Record user ID of web-based training
Percent of attendance
Expertise
Material meets goals
Training Logs
Interviews
Re-evaluate method and material
Wiam

10. Questions
Wiam