Evaluation Plan for Wisconsin’s Educator Effectiveness System Prepared for the Wisconsin Department of Public Instruction By: ●Josef Dvorak ●Daniel Marlin ●Christa Pugh ●Nels Rude ●Mai Choua Thao Source:

Background on Educator Evaluation Systems ● Emerging evaluation systems ● Multidimensional evaluation measures ● Value-added modeling (VAM) and other evidence-based metrics ● Professional development ● Summative & formative feedback Source:

Wisconsin’s Educator Effectiveness System ● Statewide implementation in 2014 ● System goal: “Provide a performance based evaluation that leads to improved student learning by supporting continuous improvement of educator practice.” ● Project goals: ● Identify recommendations for evaluating the Wisconsin Educator Effectiveness (EE) System ● Inform creation of Request for Proposal (RFP)

Logic Model InputsActivitiesOutputs Outcomes (short-term, intermediate, long-term)

Methodology ● State selection criteria ● Contacted all states with a statewide evaluation system ● Found documentation from 15 states ● Highlighted common and novel practices ● Four broad topics of research

Recommendations: Research Questions ● Implementation: How was the evaluation system enacted in each site? ● Educator perceptions: What were teachers’ and administrators’ perceptions of teacher evaluation and the classroom observation rubrics being implemented? ● Burdens of reform: What is being done in your school and/or school district to ensure the optimal implementation of the new teacher evaluation system? Source:

Recommendations: Research Questions ● Changes to educator behavior: To what extent did participants perceive that initial implementation of the new teacher effectiveness measures resulted in teachers increasingly reflecting about their practice? ● Metric and process fidelity: Do the evaluations produce ratings that are appropriate, valid, and reliable? ● Student outcomes: What is the impact on student outcomes?

Recommendations: Metrics ● Implementation ● Perceptions The number of formal classroom observations was adequate to assess my performance. ● Resources I am confident that my district will provide me with the opportunities and resources to achieve system goals. ● Quantitative measures Number of teachers evaluated, median number of observations per teacher ● Educator outcomes Whether teachers changed their educational practices or increased collaboration ● Student outcomes Value-added modeling Source:

Recommendations: Data Collection ● Qualitative ● Surveys ● Focus groups ● Interviews ● Quantitative ● Stratified sampling Source:

Recommendations: Data Analysis ● Aggregate and publish survey, focus group, and interview data ● Statistical methods ● VAM ● Interrupted time-series model Source: /

For further information: Contact the La Follette School’s publications office at or Or see Thank you!