Measuring Behavior Kirkpatrick’s Level 3 Katrina Kennedy

Kirkpatrick’s 4 Levels of Evaluation Level 1 Reaction Level 2 Learning Level 3 Behavior Level 4 Results

Describe Kirkpatrick’s 4 Levels of Evaluation Did they like it? Can they do it? Are they doing it? Does it matter?

Evaluation Instrument(s): Evaluation Level Evaluation Instrument(s): 1 Survey Interview 2 Written/performance tests Observations 3 4 Performance Records Formative evaluation: The collection of data during a learning event or phase Summative evaluation: The collection of data after a learning event or phase Quantitative data: Numeric information that can be captured through highly structured methods Qualitative data: Non-numeric information that can be captured through more flexible methods Hybrid evaluation tool: Designed to assess more than one evaluation level

Level 3 Evaluation Is EASY! If…

Level 1 Level 2 Level 3 Level 4 Performance Goal Behavioral Objective

Audience Behavior Condition Degree Who is the intended learner? What do you expect them to do? Condition What are they given to perform the task? Degree What is the standard of performance?

Active Verbs for Tasks, Objectives, and Evaluation KNOW* UNDERSTAND* Recognize Describe Define Identify Select List Summarize Name Explain State Restate APPLY Choose Demonstrate Show Operate Complete Classify ANALYZE EVALUATE CREATE Calculate Detect Construct Categorize Monitor Design Compare Check Generate Contrast Arrange Plan Differentiate Justify Invent Investigate Prioritize Predict *Do not use the words KNOW or UNDERSTAND, select from their category.

Level Three Measurements Frequency Effectiveness Barriers

Complete Performance Evaluations How often do you? How well do you? What is getting in your way?

Level 1 Level 2 Level 3 Level 4 Performance Goal Behavioral Objective

I perform [Objective] Yes No

I perform this task. Daily (once a day or more) Weekly (1-4 times per week) Monthly (1-4 times per month) Occasionally (2-10 times a year) Seldom (a few times a year)

The class contributed to my ability to perform this task. Strongly agree Agree Neither agree nor disagree Disagree Strongly disagree

As a result of attending the [training title], indicate your current confidence level for each of the following learning objectives. Very Confident Confident Somewhat Confident Beginning Confidence Not Confident Objective 1 Objective 2

If no, please choose one of the following options. Someone other than me performs this task. I do not have the skills or knowledge to perform the task. My unit uses different procedures than what I was trained in. My unit does not have the equipment that I was trained on. I have not had the opportunity to perform the task.

Are you using [Objective]? I am using it I don’t need to use this skill in my job I haven’t had time or opportunity to I don’t use it, although I’d like to or plan to I’m not using it

Manger’s Question Since completing [The Course] [learner] is proficient in [The Objective]? Strongly agree Agree Neither agree nor disagree Disagree Strongly disagree

CNLP Level 3 Evaluation Describe Kirkpatrick’s 4 Levels of Evaluation Write 4-part learning objectives Write survey questions to measure workplace behaviors after training