1. Kansas Educator Evaluation Protocol (KEEP)
Scott Myers
KSDE at the KNEA
June 5, 2013

2. Where We Currently Are in the Process
Waiver
Districts Have Chosen Their Evaluation Systems for
Multiple Measures and Defining Significance
KEEP Repository Upgrades are Complete for 2013
KEEP Website has Numerous Training Materials
KEEP Guided Practice is Being Created
Trainings are Being Held Throughout Kansas

3. WAIVER - Principle 3: Supporting Effective Instruction and Leadership
Implement teacher & principal evaluation & support systems will:
Use for continual improvement of instruction
Use at least 3 performance levels
Use multiple measures including student growth as significant factor
Evaluate on a regular basis
Provide clear, timely, and useful feedback
Use to inform personnel decisions

4. Districts Have Chosen Their Evaluation Systems for 2013-2014
As of June 3, 2013 –
278 districts have submitted their Assurances Form
267 districts have had their Assurances Form approved
93 districts will be using the KEEP Repository
146 districts will be using vendors
46 districts will be using locally created evaluation systems

6. Multiple Measures Recent Developments
Focus Groups provided a list of possible measures
KSDE collaborates with REL to modify list of measures - Collected
KSDE will identify a “default list” of measures – See Measures Chart
KSDE will identify a “default matrix” of significant – See Examples
KSDE Flexibility Waiver work
These are examples of “multiple measures” that will adequately show levels of student growth over time. In small groups, have participants suggest others. Then, provide them with the list of suggested measures gathered from the Teaching in Kansas Commission II Focus Groups.

7. Multiple Measures Currently Used Examples
Use Multiple Measures including student growth as significant factor.
State Assessments must be used.
Other Default Measures May Include:
Student Portfolio’s
Common Assessments
MAPS
Lexile Reading Scores

8. Other Multiple Measures
We are looking at data that measures more than just academic preparedness, such as 21st Century Skills
Critical Thinking
Employability
Technical Skills
SBoE has previously approved the College and Career Ready definition.

9. Teachers and Leaders Co-Construct the Educator Evaluation
Multiple Measures
District Selections – from default list or KSDE other approved measures
Validation – REL, KSDE content area specialists, or LEA able to meet valid and reliable criteria
Significant Student Growth
Determining significant
– Matrix, Other Samples
Establishing timeline for growth
– Student Growth Percentile
KSDE is currently working with REL Denver to identify appropriate, useable measures, determining a reasonable definition(s) of significant and valid/reliable.

10. Default List of Measures Teachers are Categorized see draft list
Elementary
Pre-K K 1 2 3 4 5 6
Middle School 6 7 8
High School 9 10 11 12

11. Defining Significant

12. Significance Definition
The change in student achievement for an individual student between two points in time, determined using multiple measures
To include gains and progress toward post-secondary and workforce readiness
To include progress in academic and functional goals in an individualized education program or meeting academic student growth objectives

13. 5th Grade Curriculum Standards
85%
5.00
4.12
4.11
4.10
4.09
4.08
4.07
4.06
4.05
4.04
4.03
4.02
4.01
4.00
Aug
Sept
Oct
Nov
Dec
Jan
Feb
March
April
May
Grade Level Expectation
85%
Assuming 85% of students exiting 4th grade accomplished 4th grade curriculum, the expectation would be at least the same amount of growth would occur by completion of the 5th grade, or on any given measure used.
Example: In a class of 24 students, 20 students would be above the Grade Level Expectation line by the end of the Academic Year.
24 x .85 = 20.2
This scenario would indicate significance.
Reference: Blue Print for Reform

15. Suggestions for Using Multiple Measures Note: Multiple Measures are only part of the Educator Evaluation
Ask the audience - What are your suggestions for Multiple Measures that would ensure Significant Growth? Then capture these ideas in the PPT on this slide.

16. KEEP Repository Upgrades are Complete for 2013
After listening carefully to Pilot 2 feedback,
the following upgrades were completed in the
KEEP Repository in April 2013:
EDCS - Evaluator and Observer assignment batch selection for evaluation roles
Status Cycle options
Beginning of Cycle Assessment Rubric
The Evaluator role will have the ability to enter Observations
Ability to edit and delete the Observations the user entered
Summary Rating form available during the End-of-Cycle Conference
Ability to unlock a Summary Rating during data entry period
Ability to unlock Evaluator Conference signoffs
Display Evaluator’s name and Evaluatee’s license expiration date
Printer friendly format
Add, delete and print buttons
Additional ideas for upgrades will be taken throughout the coming school year , during Pilot 3.

17. KEEP Website has Numerous Training Materials
The KSDE KEEP Fact Sheet
The KSDE Evaluation Systems Map 2013
KSDE Board Presentation - Identifying Multiples Measures and Defining Significant, Bill Bagshaw, Tuesday, May 14, 2013
The May 2013 KEEP Schematic Map is helpful in explaining how KEEP works.
The new May 2013 KEEP Users Guide is now available.
The KEEP Handbook
The KEEP Train the Trainer PowerPoint from the March 25 and 28, 2013 workshops held in Topeka and Salina

18. KEEP Guided Practice is Being Created
Online Trainings
Individualized, Repeatable Practice
Multiple methods of learning:
Videos
Guided practice with multiple tries
Printable step-by-step instructions
PowerPoints

19. Trainings are Being Held Throughout Kansas
Trainings are being held now throughout Kansas districts
Future training are being scheduled for Fall 2013 to start in August
Service centers have been trained to offer KEEP trainings
All trainings are listed on the KEEP website

20. Inside the KEEP Repository / Archive
List of Items in the Repository – Also See KEEP Handbook and User’s Guide
Assessment Rubrics
Goals
Artifacts
Informal Observations
Conferences
Individual Growth Plan
Summary Rating
There are 7 menu items across the top of the KEEP Repository website. Each of these menu items and how they work are explained in the PPT.
These titles are the menu items across the top of the KEEP Repository webpages.

21. KEEP Repository Homepage
On the left side menu, Evaluation is where the teacher clicks to start the process and access the KEEP Rubrics.
Home screen for Teacher Evaluation

22. KEEP Repository Assessment Rubrics
Assessment Rubric screen for Teacher Evaluation.
The teacher begins to fill out the rubric here.

23. Assessment Rubrics – Adding Comments Box and Documents
KEEP Repository
Assessment Rubrics – Adding Comments Box and Documents
Second half of Assessment Rubric screen that displays the Comments and Artifacts after each Construct.

24. KEEP Repository Goals Area
Goals screen for a Teacher Evaluation

25. KEEP Repository Adding Goals
Goals screen – goal selected from drop down list, expected outcomes entered in text box before Add.

26. KEEP - Adding Goals, Timeline Resources Needed
Goal screen – After Add of Expected Outcome and before Save of the Proposed Actions/Activities, Resources Needed and Timeline

27. KEEP Repository - Adding Goals, Expected Outcomes,
Proposed Actions, Timeline, Resources Needed
Goal screen – Display of saved Expected Outcome, Proposed Actions/Activities, Resources Need and Timeline for selected Goal.

28. KEEP - Adding Artifacts
Artifacts screen – Prior to artifacts being uploaded

29. Artifact is now ready to UPLOAD
Artifacts screen – component, notes and file prior to Upload.
Artifact is now ready to UPLOAD

30. Artifact is now added.
Artifact screen – after Artifact file has been uploaded

31. Conferences – Beginning of Cycle Conference section and Save button.
Mid Cycle and End of Cycle are not open at this point.

32. KEEP – Observer Section
Observer Search page.
Observers can see a list of people that they are assigned to observe. They can then select individuals from that list.

33. Observer adds comments and can see them displayed.
Observer Informal Observation screen.
Observers add their comments and it displays underneath the Component with the date that it was submitted.

34. Observers can add artifacts.
Informal Observation screen – Observers can only add comments per Constructs and Artifacts.

35. KEEP – Evaluator Section
Home Page for Evaluator

36. KEEP – Evaluator Section
Select Educator
Evaluator Search page

37. KEEP – Evaluator Section See that the Educator Rubric
Has Been Completed
Assessment Rubric for selected Evaluatee from Evaluator Search page Evaluateee must check the box for “I have completed my self assessment.” Then the evaluator can work within this evaluation.

38. Work with the Teacher on
Expected Outcomes, Proposed Actions/Activities Timelines, Resources.
Goals page – After teacher has completed top half of page and clicked Add, the bottom half of the page opens up. The evaluator and the teacher work on this area together.

39. Conferences – Beginning of Cycle Conference section
Arrows point out The Beginning, Mid, and End of Cycle Conferences and the Save button.
End of Cycle Conference must be completed to open the Summary Rating sheet area.

40. Summary Rating Webpage
Constructs 1, 2, 3, 4
The Summary Rating sheet with arrows pointing at the 4 components and the save button.

41. Questions Scott Myers, Director Teacher Education and Licensure
Kansas State Department of Education
120 SE 10th Ave, Topeka, KS  66612
An Equal Employment/Educational Opportunity Agency
The Kansas State Department of Education does not discriminate on the basis of race, color, national origin, sex, disability, or age in its programs and activities. The following person has been designated to handle inquiries regarding the non-discrimination policies: KSDE General Counsel, 120 SE 10th Ave., Topeka, KS 66612;