1. Using SLDS Data to Build a Teacher Performance System 2012 MIS Conference

2. Pilot Districts Maine Schools for Excellence Program Teacher Incentive Fund 5-Year Grant Five Districts 18 Schools 458 Teachers Rigorous, transparent and fair teacher and principal evaluation using observation-based assessments, peer review, and student achievement data Maine Department of Education2

3. Grant Components School-wide, instructionally focused professional development for teachers School-wide, leadership focused professional development for principals Enhanced mentoring and induction program for all beginning teachers (3 years) with a focus on teacher quality and student achievement Maine Department of Education3

4. Grant Components Incentives for student growth based on multiple measures Incentives for teachers who assume additional responsibilities and leadership roles Extensive stakeholder involvement and communication around the design and implementation of this performance system Maine Department of Education4

5. Key Components Maine Department of Education 5 Professional Development Recognition and Reward Performance Management Total Performance System

6. Pilot Project Goals Performance-Based Compensation System Multiple measures of educator performance District, school or educator-specific models Real-time reporting of scorecard performance measures Secure, web based access to performance by educators Summary performance reporting at the classroom, grade, school and district Maine Department of Education6

7. Project Phases Phase 1 - Proof of Concept Develop Models/Measures Establish Upload Process Design Scorecard Phase 2 – Production Model Establish Model/Rubric Builder Add Professional Growth Standards (page 2) Create Additional Reports Maine Department of Education7

8. Project Phases Phase 3 Teacher/Class/Student Data Teacher of Record Identification Student Growth Calculations Direct Imports of Raw Data Maine Department of Education8

9. Governance Stakeholders LEA Representatives Maine School Management Association Maine Education Association Maine Principals Association Maine Administrators of Services for Children with Disabilities Maine Department of Education 9

10. Vendors/Partners Choice Solutions Performance Reporting System Cambridge Education Student Surveys RANDA Solutions Teacher Observation National Board for Professional Teaching Standards (NBPTS) Maine Education Policy Research Institute Maine Department of Education10

11. What data can be used Maine Department of Education 11 Staff Personal Data Staff Position Data District/ Directory Data Assessment Data Model / Rubric Builder Data Set LEA-Uploaded Data SLDS Data Warehouse Data

12. Maine Department of Education 12 Selecting Measures Please select the measures to include in the calculation: Staff PersonalStaff Position Staff Employment Assessment Results Other Select =========== AssessmentGrade Year Select ============ Attendance Rate Survey Rating Prof. Development

13. Sample Measures MeasuresStipends Additional Point- bearing measures # Behavioral Incidents NECAP Math Student Achievement %MSFE Facilitator Stipend Building Bonus Points % AP StudentsNECAP Mean ScoreMSFE Induction / Mentoring Stipend % College BoundNECAP Reading Growth %MSFE Lead Facilitator Stipend % Drop OutNWEA Language Usage Growth %MSFE PD Stipend % Honor RollNWEA Math Growth %MSFE Site Coordinator Stipend % On-time Student AttendanceNWEA Predicted Proficiency MathMSFE Stipend % Passing all coursesNWEA Predicted Proficiency ReadingNB Certified Principal Stipend % Positive Advancement - MathNWEA Math Growth %NB Certified Teacher Leader Stipend % Positive Advancement - ReadingNWEA Reading Growth %NB Certified Teacher Stipend % Pursuing Advanced StudiesNWEA Science Growth % NBCT Candidate Support Provider Stipend Accelerated Math ObjectsOn-Time Graduation RateTake One! Stipend Accelerated ReaderParent Perception Rating AIMSWEB Math Student Growth %Presidential Fitness % Meeting AIMSWEB Reading Student Growth %Professional Growth Rating DIBELS Growth %PSAT Overall District Writing Prompt: Conventions Growth %PSAT/SAT Growth % District Writing Prompt: Idea Development Growth %SAT Literacy DRA G1 Growth %SAT Math DRA GrowthSAT Overall DRA Levels-Grades K-3SAT Reading DRA ProficiencySAT Writing DRA Student Achievement %SLO Rating DRA T1 Growth %Staff Perception Rating Everyday Math Student Achievement %Student AR Participation MHSA Science AugmentationStudent Perception Rating NECAP % Meets/Exceeds

14. Calculating Scores Define the calculation model using the values below. When finished, please click “Save” to name and save your model DomainIndicatorBase Max. Goal Priority % Assessment% of students at or above65%90%30% AttendanceAttendance Rate90%98%20% AssessmentMedian Growth Percentile609020% OtherProfessional Growth Rating3420% Total90% Return to indicator Selection SaveAdd indicator

15. Saved Models Model NameDescription Last Updated Elementary-1 Used for teachers in grades 1-8 who teach subjects for which no state assessment is given. 5/12/2010 Elementary-2 Used for teachers in grades 1-8 who teach subjects for which state assessment is given. 9/17/2010 HS-1 Used for teachers in grades 9-12 who teach subjects for which no state assessment is given. 4/23/2010  HS-2 Used for teachers in grades 9-12 who teach subjects for which a state assessment is given. 7/14/2011 Below is a listing of models available for Maine School District 123. Please click on the link if you would like to see the details of a particular model BackViewDeleteEdit

16. Models - Approximately 70 Range of 5 models to 42 per District School-based models - the most granular level for which data are available Position-specific models - e.g., Math Teacher model vs. Art Teacher Model Future Phases - move to models with common measures, but with individualized base and goal/target numbers so that teachers are evaluated based on the students whom they teach, not a school-wide number. Maine Department of Education16

17. Score Card Maine Department of Education17 Measurement Feedback Accountability Recognition and Reward District Name Name. Classroom Teacher. Grade 4. School. PY2011-2012

18. Score Card (Professional Growth) Take One! Professional Development (17 Standards)

19. Average Payment Breakout Report Maine Department of Education 19 District ABC MSFE - Average Total Incentives DistrictSchool Year Average Performance Pay Average Stipends Average Total Incentives District 1232010-2011 $ 3,005 $ 789 $ 3,794 District 1232009-2010 $ 2,898 $ 543 $ 3,441 District 1232008-2009 $ 2,933 $ 489 $ 3,422 District 1232007-2008 $ 3,122 $ 504 $ 3,626 District ABC MSFE - Average Total Incentives

20. Median Payment Breakout Report Maine Department of Education 20 DistrictSchool Year Median Performance PayMedian Stipends Median Total Incentives District 1232010-2011 $ 3,005 $ 789 $ 3,794 District 1232009-2010 $ 2,898 $ 543 $ 3,441 District 1232008-2009 $ 2,933 $ 489 $ 3,422 District 1232007-2008 $ 3,122 $ 504 $ 3,626 District 123 MSFE - Median Total Incentives District 123 MSFE - Median Incentives

21. Staff Incentives by Range Report Maine Department of Education 21 District ABC MSFE - Percentage of Staff Receiving Incentives DistrictSchool Year Percentage of Staff Receiving Incentives Average Total Incentives $0-$1000 $1001- $2000$2001-$3000$3001-$4000 $4001- $5000$5001+ District1232010-201113.518.322.337.85.32.8 $ 3,123 District1232009-201013.618.522.538.24.13.1 $ 2,934 District1232008-200913.818.722.738.63.13.2 $ 2,898 District1232007-200813.918.923.034.36.53.5 $ 3,006

22. Performance Pay vs. Specific Measures Report Maine Department of Education 22 School Name Average Performance Pay Percent Gain On-time Graduation Rate Percent Gain Student Growth Reading School 12345 $ 3680.2 School 12346 $ 3,8340.50.9 School 12347 $ 4,3050.70.5 School 12348 $ 6800.20.7 School 12349 $ 5,9400.90.4 School 12350 $ 4,7360.60.8 School 12351 $ 2990.10.3 District ABC Percent Gain Student Growth vs. Performance Pay 2011-12 District ABC MSFE- Percent Gain Student Growth vs. Performance Pay 2011-12

23. Total Performance System A first step toward integrating measurement and feedback, professional development and incentives into a unified and coherent system Aligns ALL educators toward a common goal of improved student learning Pays teachers incentives that are above and beyond base pay Distributes incentives based on group (school and/or district) performance Maine Department of Education23

24. Lessons Learned Plan, Plan, Plan! Confirm availability of data Check for the right level of granularity Use models that address those areas that staff members can influence Design systems and processes that can use/re-use data that already exists Utilize school-wide numbers Maine Department of Education24

25. Questions/Contacts Maine Department of Education 25 Bill Hurwitch – SLDS Project Director Maine Department of Education bill.hurwitch@maine.gov 207-624-6816 Manos Stefanakos – Senior Data Architect Choice Solutions, Inc. manos@choiceP20.com manos@choiceP20.com 781-608-3347