1. Evaluation Plan for Wisconsin’s Educator Effectiveness System Prepared for the Wisconsin Department of Public Instruction By: ●Josef Dvorak ●Daniel Marlin ●Christa Pugh ●Nels Rude ●Mai Choua Thao Source: http://mashable.com/2012/07/23/technology-in-the-classroom/

2. Background on Educator Evaluation Systems ● Emerging evaluation systems ● Multidimensional evaluation measures ● Value-added modeling (VAM) and other evidence-based metrics ● Professional development ● Summative & formative feedback Source: http://twiniversity.com/2013/12/what-teachers-really-want-for-christmas/

3. Wisconsin’s Educator Effectiveness System ● Statewide implementation in 2014 ● System goal: “Provide a performance based evaluation that leads to improved student learning by supporting continuous improvement of educator practice.” ● Project goals: ● Identify recommendations for evaluating the Wisconsin Educator Effectiveness (EE) System ● Inform creation of Request for Proposal (RFP)

4. Logic Model InputsActivitiesOutputs Outcomes (short-term, intermediate, long-term)

5. Methodology ● State selection criteria ● Contacted all states with a statewide evaluation system ● Found documentation from 15 states ● Highlighted common and novel practices ● Four broad topics of research

6. Recommendations: Research Questions ● Implementation: How was the evaluation system enacted in each site? ● Educator perceptions: What were teachers’ and administrators’ perceptions of teacher evaluation and the classroom observation rubrics being implemented? ● Burdens of reform: What is being done in your school and/or school district to ensure the optimal implementation of the new teacher evaluation system? Source: http://www.c2mclean.com/smarter-students/elementary-school-students/

7. Recommendations: Research Questions ● Changes to educator behavior: To what extent did participants perceive that initial implementation of the new teacher effectiveness measures resulted in teachers increasingly reflecting about their practice? ● Metric and process fidelity: Do the evaluations produce ratings that are appropriate, valid, and reliable? ● Student outcomes: What is the impact on student outcomes?

8. Recommendations: Metrics ● Implementation ● Perceptions The number of formal classroom observations was adequate to assess my performance. ● Resources I am confident that my district will provide me with the opportunities and resources to achieve system goals. ● Quantitative measures Number of teachers evaluated, median number of observations per teacher ● Educator outcomes Whether teachers changed their educational practices or increased collaboration ● Student outcomes Value-added modeling Source: http://3forward.com/sales-leaders-blog/tips-for-sales-managers-raising-sales-effectiveness/

9. Recommendations: Data Collection ● Qualitative ● Surveys ● Focus groups ● Interviews ● Quantitative ● Stratified sampling Source: http://www.employeesurveys.com/

10. Recommendations: Data Analysis ● Aggregate and publish survey, focus group, and interview data ● Statistical methods ● VAM ● Interrupted time-series model Source: http:/Moksony_Ferenc_Statistical_Methods_for_Program_Evaluation/ch07.html /www.tankonyvtar.hu/en/tartalom/tamop425/0010_2A_04_

11. For further information: Contact the La Follette School’s publications office at 608-263-7657 or publications@lafollette.wisc.edu Or see www.lafollette.wisc.edu/publications/workshops.html Thank you!