Draft – March Check for Updates to this Presentationhttp:// Inter-Rater Reliability

Draft – March Check for Updates to this Presentationhttp:// Outcomes An examination of principal perceptions and actual teacher performance data Provide opportunity to participate in inter-rater reliability activity

Draft – March Check for Updates to this Presentationhttp:// NCEES Wiki

Draft – March Check for Updates to this Presentationhttp:// Standard IV Teachers Facilitate Learning for their Students Review the elements and descriptors within standard IV. What does facilitating learning look like? Use the rubric form to observe and evaluate the lesson on differentiated instruction in mathematics.

Draft – March Check for Updates to this Presentationhttp:// Classroom Lesson

Draft – March Check for Updates to this Presentationhttp:// Inter Rater Reliability How did we rate this lesson? Anonymously enter response using Poll Everywhere

Draft – March Check for Updates to this Presentationhttp:// Element A Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll.

Draft – March Check for Updates to this Presentationhttp:// Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Element B

Draft – March Check for Updates to this Presentationhttp:// Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Element C

Draft – March Check for Updates to this Presentationhttp:// Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Element D

Draft – March Check for Updates to this Presentationhttp:// Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Element E

Draft – March Check for Updates to this Presentationhttp:// Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Element F

Draft – March Check for Updates to this Presentationhttp:// Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Element G

Draft – March Check for Updates to this Presentationhttp:// Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Element H

Draft – March Check for Updates to this Presentationhttp:// Reflection How do you ensure that the behaviors in the classroom align with the rating of the behaviors?

Draft – March Check for Updates to this Presentationhttp:// Discuss Results Compare the responses at your table

Draft – March Check for Updates to this Presentationhttp:// Teachers Principals 6 Contribute to Academic Success Academic Achievement Leadership 8 Ratings Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ How will the ratings on Standards 6 & 8 work?

Draft – March Check for Updates to this Presentationhttp:// Principal Rating Categories Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ Principals 5 Rating Categories Not Demonstrated Developing Proficient Accomplished Distinguished 3 Rating Categories Does Not Meet Expected Growth Meets Expected Growth Exceeds Expected Growth Instructional Leadership Cultural Leadership Human Resource Leadership Managerial Leadership External Development Leadership Micro- political Leadership Strategic Leadership 8 Academic Achievement Leadership

Draft – March Check for Updates to this Presentationhttp:// Teacher Ratings Categories Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ Teachers Demonstrate Leadership Establish Environment Know Content Facilitate Learning Reflect on Practice Contribute to Academic Success 5 Rating Categories Not Demonstrated Developing Proficient Accomplished Distinguished 3 Rating Categories Does Not Meet Expected Growth Meets Expected Growth Exceeds Expected Growth

Draft – March Check for Updates to this Presentationhttp:// Ratings Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ Teachers Demonstrate Leadership Establish Environment Know Content Facilitate Learning Reflect on Practice Contribute to Academic Success 5 Rating Categories3 Ratings Categories Why the difference? What is the relationship? Identifying only three rating categories on standard 6 & 8 improves certainty of categorization.

Draft – March Check for Updates to this Presentationhttp:// Teacher Ratings in Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ School-wide EVAAS Growth Teacher EVAAS Growth Weighted Average Yearly Rating Does Not Meet Expected Growth Meets Expected Growth Exceeds Expected Growth Why is school-wide EVAAS growth included? To encourage collaboration and collective ownership of overall outcomes Teacher = 70% and School-wide = 30% Note: In , teachers without individual EVAAS growth will get school-wide growth for Standard 6. 6

Draft – March Check for Updates to this Presentationhttp:// Principal Ratings Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ Standard 8 rating will be determined using school- wide EVAAS growth School-wide EVAAS Growth Yearly Rating Does Not Meet Expectations Meets Expected Growth Exceeds Expected Growth 8

Draft – March Check for Updates to this Presentationhttp:// Ratings Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ Demonstrate Leadership Establish Environment Know Content Facilitate Learning Reflect on Practice Contribute to Academic Success Strategic Leadership Instructional Leadership Cultural Leadership Human Resource Leadership Managerial Leadership External Development Leadership Micro- political Leadership Academic Achievement Leadership Teachers Principals Key Note on Ratings Every educator is evaluated every year Each standard and rating stands on its own (1 out of 6, not 1/6) Ratings are used to create professional development plans each year Ratings are used to determine status

Draft – March Check for Updates to this Presentationhttp:// SBE Policy on Standard 6 The Department of Public Instruction will complete the sixth and eighth standard ratings after the results of the 2011 – 2012 testing program have been finalized and approved by the State Board of Education, and the EVAAS value-added scores have been calculated. This population should take place in mid-August 2012.

Draft – March Check for Updates to this Presentationhttp:// Status Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ How is your effectiveness status determined?

Draft – March Check for Updates to this Presentationhttp:// Status Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ RatingsStatus Teachers 6 separate ratings to help teachers grow each year Principals 8 separate ratings to help principals grow each year A single overall status that is determined once a principal or teacher has three years of growth data to populate 6 or 8 Categories for Status 1.In Need of Improvement 2.Effective 3.Highly Effective

Draft – March Check for Updates to this Presentationhttp:// Status and Standard 6 & 8 Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ An educator receives an effectiveness status only once he/she has 3 years of data on standards 6 or 8 A 3-year rolling average of growth data from standards 6 or 8 is used as part of determining overall status

Draft – March Check for Updates to this Presentationhttp:// 3-Year Rolling Average Teacher Rationale - MET Research - Standards 6 & 8 - Status - Support - MSLs ▲ 66 Contribute to Academic Success Met Expected Growth 0.8 Did not meet Expected Growth 1.2 Met Expected Growth Rating from 2 years ago Rating from 1 year ago Rating from this year Standard 3 = 1.0 Met Expected Growth 3- year average rating on standard 6 for determining status Note: A similar methodology applies to principals as well. Standard

Draft – March Check for Updates to this Presentationhttp:// Status So once an educator has a three-year average rating for Standard 6 or 8, how is status determined?

Draft – March Check for Updates to this Presentationhttp:// Status The Three Status Categories are 1.In Need of Improvement 2.Effective 3.Highly Effective

Draft – March Check for Updates to this Presentationhttp:// Principal Status In Need of Improvement Effective Highly Effective Standards 1-7 In the year Strategic Leadership Instructional Leadership Cultural Leadership Human Resource Leadership Managerial Leadership External Development Leadership Micro- political Leadership Any rating lower than proficient Standard 8 Three-year rolling average And/Or Does Not Meet Expected Growth years ago 1 year ago This year ++ / 3 ) ) Proficient or Higher on Standards 1-7 And Meets or Exceeds Expected Growth Accomplished or Higher on Standards 1-7 And Exceeds Expected Growth

Draft – March Check for Updates to this Presentationhttp:// Teacher Status In Need of Improvement Effective Highly Effective Standards 1-5 In the year Standard 6 Three-year rolling average years ago 1 year ago This year ++ / 3 ) ) Demonstrate Leadership Establish Environment Know Content Facilitate Learning Reflect on Practice Any rating lower than proficient And/Or Does Not Meet Expected Growth Proficient or Higher on Standards 1-5 And Meets or Exceeds Expected Growth Accomplished or Higher on Standards 1-5 And Exceeds Expected Growth

Draft – March Check for Updates to this Presentationhttp:// What will teachers see? Ratings on Standards 1 – 5 of the Educator Evaluation System (as recorded in online tool) Standard 6 rating (current year and 2 prior years) Three-year rolling average of student growth values and accompanying Standard 6 rating (for Status determination) Overall Effectiveness Status

Draft – March Check for Updates to this Presentationhttp:// Let’s meet Martha Washington Read the scenario, located on the ncees wiki.

Draft – March Check for Updates to this Presentationhttp:// DRAFT North Carolina Educator Evaluation System Evaluation Summary Sheet Name: Martha WashingtonSchool:Independence Elementary School LEA:Freedom County SchoolsLicensure:Career-Status Overall Status:In Need of Improvement Standard One: Teachers demonstrate leadership. Not DemonstratedDevelopingProficientAccomplishedDistinguished Standard Two: Teachers establish a respectful environment. Not DemonstratedDevelopingProficientAccomplishedDistinguished Standard Three: Teachers know the content they teach. Not DemonstratedDevelopingProficientAccomplishedDistinguished Standard Four: Teachers facilitate learning for their students. Not DemonstratedDevelopingProficientAccomplishedDistinguished Standard Five: Teachers reflect on their practice. Not DemonstratedDevelopingProficientAccomplishedDistinguished Standard Six: Teachers contribute to the academic success of students. *Only three-year rolling average is used to determine overall status* Year One (2009 – 2010)Year Two (2010 – 2011)Year Three (2011 – 2012)Three-Year Rolling Average* Individual Student Growth: -1.8 School-wide Student Growth:.1 Year One Growth: Individual Student Growth: 1.2 School-wide Student Growth:.9 Year Two Growth: 1.11 Individual Student Growth:.7 School-wide Student Growth:.9 Year Three Growth: Does not meet expected growth Meets expected growth Exceeds expected growth Overall Status: In Need of ImprovementEffectiveHighly Effective Does not meet expected growth Meets expected growth Exceeds expected growth Does not meet expected growth Meets expected growth Exceeds expected growth Does not meet expected growth Meets expected growth Exceeds expected growth

Draft – March Check for Updates to this Presentationhttp:// Standard VI How many of your teachers would need professional intervention based on your school’s data? What conversations do you need to have? What professional development do you need to provide?

Draft – March Check for Updates to this Presentationhttp:// Closure