1. NCDPI Observer Calibration Tool Introduction & Demo

2. Welcome Observation Calibration Training (OCT) Approximately 20 participants Alleghany County Schools and Newton- Conover City Schools You are the first to review!

3. Why are you here? N.C. recognizes that the accurate and reliable evaluation of teachers is more important then ever –High stakes decisions –Teachers need and want coaching Clear message from principals, human resources and superintendents- “We need more training on the NCEES”. 3

4. 4

5. 5 5

6. Agenda Introductions and overview of platform Observation Engine overview and live demo BloomBoard overview and live demo Login and debrief information Q & A 6

7. 7 BloomBoard & Observation Engine BloomBoard & Empirical Education are partnering to provide access to a marketplace of calibration and training services for school administrators across the state The easy-to-use platform will combine BloomBoard’s Professional Development resources with Empirical’s state-of-the-art observer training and calibration tool, Observation Engine - and will promote continuous NCEES improvements.

8. 8 What is Observation Engine? An online tool that uses classroom videos to ensure accurate and reliable classroom observations Videos from the MET library have been master-scored on the NCEES teacher evaluation rubric to create learning opportunities for teacher evaluators in North Carolina.

9. 9 Observation Engine will provide NC evaluators: 1.Observer Calibration Events & Reporting Provides rating practice and helps increase rater agreement to target scores using Scoring Studies 2.Supplemental Learning Exercises Provides targeted, self-paced online exercises focused on specific NCEES elements using Lessons

10. 10 1. Calibrate through Scoring Studies Improves rater agreement to target scores Builds consensus among evaluation staff and helps establish a mutual understanding of the best ratings Facilitates group learning through discussion of areas of disagreement 3b Knows Content for Specialty 3d Makes Instruction Relevant 4g Communicates Effectively 4a Knows How Learning Takes Place 4d Integrates Technology Video 1: Distribution of Ratings by NCEES Element * * * * * * = Target Score

11. 11 Calibration Reports – sample figures

12. 12 Calibration Reports – sample figures cont’d

13. 13 2. Rating practice through Lessons Self-paced practice exercises Watch and rate short video clips, focusing on one NCEES indicator at a time Receive immediate on-screen feedback

14. 14 Live Demo

15. BloomBoard Easy access to a marketplace of supplemental professional growth opportunities, resources, and services tailored to each educator’s unique needs. –Thousands of articles, videos/video clips, and links to web based resources at your fingertips. –Further support the work you’re doing through Observation Engine’s scoring studies and calibration events 15

16. BloomBoard - Live Demo 16

17. Thank you! Logins –Check your email for instructions on how to login to your own demo accounts Debrief dates/times: –Thursday 7/10 – 1 p.m. EST –Friday 7/11 – 11 a.m. EST Optional Individual Feedback Calls Q & A 17