1. Measuring Behavior Kirkpatrick’s Level 3
Katrina Kennedy

2. Kirkpatrick’s 4 Levels of Evaluation
Level 1 Reaction
Level 2 Learning
Level 3 Behavior
Level 4 Results

3. Describe Kirkpatrick’s 4 Levels of Evaluation
Did they like it?
Can they do it?
Are they doing it?
Does it matter?

4. Evaluation Instrument(s):
Evaluation Level
Evaluation Instrument(s): 1
Survey
Interview 2
Written/performance tests
Observations 3 4
Performance Records
Formative evaluation: The collection of data during a learning event or phase
Summative evaluation: The collection of data after a learning event or phase
Quantitative data: Numeric information that can be captured through highly structured methods
Qualitative data: Non-numeric information that can be captured through more flexible methods
Hybrid evaluation tool: Designed to assess more than one evaluation level

5. Level 3 Evaluation Is EASY!
If…

6. Level 1
Level 2
Level 3
Level 4
Performance Goal
Behavioral Objective

7. Audience Behavior Condition Degree Who is the intended learner?
What do you expect them to do?
Condition
What are they given to perform the task?
Degree
What is the standard of performance?

8. Active Verbs for Tasks, Objectives, and Evaluation
KNOW*
UNDERSTAND*
Recognize
Describe
Define
Identify
Select
List
Summarize
Name
Explain
State
Restate
APPLY
Choose
Demonstrate
Show
Operate
Complete
Classify
ANALYZE
EVALUATE
CREATE
Calculate
Detect
Construct
Categorize
Monitor
Design
Compare
Check
Generate
Contrast
Arrange
Plan
Differentiate
Justify
Invent
Investigate
Prioritize
Predict
*Do not use the words KNOW or UNDERSTAND, select from their category.

9. Level Three Measurements
Frequency
Effectiveness
Barriers

10. Complete Performance Evaluations
How often do you?
How well do you?
What is getting in your way?

11. Level 1
Level 2
Level 3
Level 4
Performance Goal
Behavioral Objective

12. I perform [Objective]
Yes No

13. I perform this task. Daily (once a day or more)
Weekly (1-4 times per week)
Monthly (1-4 times per month)
Occasionally (2-10 times a year)
Seldom (a few times a year)

14. The class contributed to my ability to perform this task.
Strongly agree
Agree
Neither agree nor disagree
Disagree
Strongly disagree

15. As a result of attending the [training title], indicate your current confidence level for each of the following learning objectives.
Very Confident
Confident
Somewhat Confident
Beginning Confidence
Not Confident
Objective 1
Objective 2

16. If no, please choose one of the following options.
Someone other than me performs this task.
I do not have the skills or knowledge to perform the task.
My unit uses different procedures than what I was trained in.
My unit does not have the equipment that I was trained on.
I have not had the opportunity to perform the task.

17. Are you using [Objective]?
I am using it
I don’t need to use this skill in my job
I haven’t had time or opportunity to
I don’t use it, although I’d like to or plan to
I’m not using it

18. Manger’s Question Since completing [The Course] [learner] is proficient in [The Objective]?
Strongly agree
Agree
Neither agree nor disagree
Disagree
Strongly disagree

19. CNLP Level 3 Evaluation Describe Kirkpatrick’s 4 Levels of Evaluation
Write 4-part learning objectives
Write survey questions to measure workplace behaviors after training