Kansas Educator Evaluation Protocol (KEEP) Scott Myers KSDE at the KNEA June 5, 2013

Where We Currently Are in the Process Waiver Districts Have Chosen Their Evaluation Systems for 2013-2014 Multiple Measures and Defining Significance KEEP Repository Upgrades are Complete for 2013 KEEP Website has Numerous Training Materials KEEP Guided Practice is Being Created Trainings are Being Held Throughout Kansas

WAIVER - Principle 3: Supporting Effective Instruction and Leadership Implement teacher & principal evaluation & support systems will: Use for continual improvement of instruction Use at least 3 performance levels Use multiple measures including student growth as significant factor Evaluate on a regular basis Provide clear, timely, and useful feedback Use to inform personnel decisions

Districts Have Chosen Their Evaluation Systems for 2013-2014 As of June 3, 2013 – 278 districts have submitted their Assurances Form 267 districts have had their Assurances Form approved 93 districts will be using the KEEP Repository 146 districts will be using vendors 46 districts will be using locally created evaluation systems

Multiple Measures Recent Developments Focus Groups provided a list of possible measures KSDE collaborates with REL to modify list of measures - Collected KSDE will identify a “default list” of measures – See Measures Chart KSDE will identify a “default matrix” of significant – See Examples KSDE Flexibility Waiver work These are examples of “multiple measures” that will adequately show levels of student growth over time. In small groups, have participants suggest others. Then, provide them with the list of suggested measures gathered from the Teaching in Kansas Commission II Focus Groups.

Multiple Measures Currently Used Examples Use Multiple Measures including student growth as significant factor. State Assessments must be used. Other Default Measures May Include: Student Portfolio’s Common Assessments MAPS Lexile Reading Scores

Other Multiple Measures We are looking at data that measures more than just academic preparedness, such as 21st Century Skills Critical Thinking Employability Technical Skills SBoE has previously approved the College and Career Ready definition.

Teachers and Leaders Co-Construct the Educator Evaluation Multiple Measures District Selections – from default list or KSDE other approved measures Validation – REL, KSDE content area specialists, or LEA able to meet valid and reliable criteria Significant Student Growth Determining significant – Matrix, Other Samples Establishing timeline for growth – Student Growth Percentile KSDE is currently working with REL Denver to identify appropriate, useable measures, determining a reasonable definition(s) of significant and valid/reliable.

Default List of Measures Teachers are Categorized see draft list Elementary Pre-K K 1 2 3 4 5 6 Middle School 6 7 8 High School 9 10 11 12

Defining Significant

Significance Definition The change in student achievement for an individual student between two points in time, determined using multiple measures To include gains and progress toward post-secondary and workforce readiness To include progress in academic and functional goals in an individualized education program or meeting academic student growth objectives

5th Grade Curriculum Standards 85% 5.00 4.12 4.11 4.10 4.09 4.08 4.07 4.06 4.05 4.04 4.03 4.02 4.01 4.00 Aug Sept Oct Nov Dec Jan Feb March April May Grade Level Expectation 85% Assuming 85% of students exiting 4th grade accomplished 4th grade curriculum, the expectation would be at least the same amount of growth would occur by completion of the 5th grade, or on any given measure used. Example: In a class of 24 students, 20 students would be above the Grade Level Expectation line by the end of the Academic Year. 24 x .85 = 20.2 This scenario would indicate significance. Reference: Blue Print for Reform

Suggestions for Using Multiple Measures Note: Multiple Measures are only part of the Educator Evaluation Ask the audience - What are your suggestions for Multiple Measures that would ensure Significant Growth? Then capture these ideas in the PPT on this slide.

KEEP Repository Upgrades are Complete for 2013 After listening carefully to Pilot 2 feedback, the following upgrades were completed in the KEEP Repository in April 2013: EDCS - Evaluator and Observer assignment batch selection for evaluation roles Status Cycle options Beginning of Cycle Assessment Rubric The Evaluator role will have the ability to enter Observations Ability to edit and delete the Observations the user entered Summary Rating form available during the End-of-Cycle Conference Ability to unlock a Summary Rating during data entry period Ability to unlock Evaluator Conference signoffs Display Evaluator’s name and Evaluatee’s license expiration date Printer friendly format Add, delete and print buttons Additional ideas for upgrades will be taken throughout the coming school year 2013-2014, during Pilot 3.

KEEP Website has Numerous Training Materials The KSDE KEEP Fact Sheet The KSDE Evaluation Systems Map 2013 KSDE Board Presentation - Identifying Multiples Measures and Defining Significant, Bill Bagshaw, Tuesday, May 14, 2013 The May 2013 KEEP Schematic Map is helpful in explaining how KEEP works. The new May 2013 KEEP Users Guide is now available. The KEEP Handbook The KEEP Train the Trainer PowerPoint from the March 25 and 28, 2013 workshops held in Topeka and Salina

KEEP Guided Practice is Being Created Online Trainings Individualized, Repeatable Practice Multiple methods of learning: Videos Guided practice with multiple tries Printable step-by-step instructions PowerPoints

Trainings are Being Held Throughout Kansas Trainings are being held now throughout Kansas districts Future training are being scheduled for Fall 2013 to start in August Service centers have been trained to offer KEEP trainings All trainings are listed on the KEEP website

Inside the KEEP Repository / Archive List of Items in the Repository – Also See KEEP Handbook and User’s Guide Assessment Rubrics Goals Artifacts Informal Observations Conferences Individual Growth Plan Summary Rating There are 7 menu items across the top of the KEEP Repository website. Each of these menu items and how they work are explained in the PPT. These titles are the menu items across the top of the KEEP Repository webpages.

KEEP Repository Homepage On the left side menu, Evaluation is where the teacher clicks to start the process and access the KEEP Rubrics. Home screen for Teacher Evaluation

KEEP Repository Assessment Rubrics Assessment Rubric screen for Teacher Evaluation. The teacher begins to fill out the rubric here.

Assessment Rubrics – Adding Comments Box and Documents KEEP Repository Assessment Rubrics – Adding Comments Box and Documents Second half of Assessment Rubric screen that displays the Comments and Artifacts after each Construct.

KEEP Repository Goals Area Goals screen for a Teacher Evaluation

KEEP Repository Adding Goals Goals screen – goal selected from drop down list, expected outcomes entered in text box before Add.

KEEP - Adding Goals, Timeline Resources Needed Goal screen – After Add of Expected Outcome and before Save of the Proposed Actions/Activities, Resources Needed and Timeline

KEEP Repository - Adding Goals, Expected Outcomes, Proposed Actions, Timeline, Resources Needed Goal screen – Display of saved Expected Outcome, Proposed Actions/Activities, Resources Need and Timeline for selected Goal.

KEEP - Adding Artifacts Artifacts screen – Prior to artifacts being uploaded

Artifact is now ready to UPLOAD Artifacts screen – component, notes and file prior to Upload. Artifact is now ready to UPLOAD

Artifact is now added. Artifact screen – after Artifact file has been uploaded

Conferences – Beginning of Cycle Conference section and Save button. Mid Cycle and End of Cycle are not open at this point.

KEEP – Observer Section Observer Search page. Observers can see a list of people that they are assigned to observe. They can then select individuals from that list.

Observer adds comments and can see them displayed. Observer Informal Observation screen. Observers add their comments and it displays underneath the Component with the date that it was submitted.

Observers can add artifacts. Informal Observation screen – Observers can only add comments per Constructs and Artifacts.

KEEP – Evaluator Section Home Page for Evaluator

KEEP – Evaluator Section Select Educator Evaluator Search page

KEEP – Evaluator Section See that the Educator Rubric Has Been Completed Assessment Rubric for selected Evaluatee from Evaluator Search page Evaluateee must check the box for “I have completed my self assessment.” Then the evaluator can work within this evaluation.

Work with the Teacher on Expected Outcomes, Proposed Actions/Activities Timelines, Resources. Goals page – After teacher has completed top half of page and clicked Add, the bottom half of the page opens up. The evaluator and the teacher work on this area together.

Conferences – Beginning of Cycle Conference section Arrows point out The Beginning, Mid, and End of Cycle Conferences and the Save button. End of Cycle Conference must be completed to open the Summary Rating sheet area.

Summary Rating Webpage Constructs 1, 2, 3, 4 The Summary Rating sheet with arrows pointing at the 4 components and the save button.

Questions Scott Myers, Director Teacher Education and Licensure Kansas State Department of Education 120 SE 10th Ave, Topeka, KS  66612 An Equal Employment/Educational Opportunity Agency The Kansas State Department of Education does not discriminate on the basis of race, color, national origin, sex, disability, or age in its programs and activities. The following person has been designated to handle inquiries regarding the non-discrimination policies: KSDE General Counsel, 120 SE 10th Ave., Topeka, KS 66612; 785-296-3201