1. NCDPI Observer Calibration Training
This year NC is piloting a Observation Calibration Training for evaluators.
Introduction & Demo

2. Agenda Introduction to OCT Overview of Platform Live Demo
Today is just a brief introduction to the OCT so as many of you as possible know about the pilot. Even if you are not participating, this information will make you aware of future pilot information.

3. Why?
N.C. recognizes that the accurate and reliable evaluation of teachers is more important then ever
High stakes decisions
Teachers need and want coaching
Clear message from principals, human resources and superintendents –
“We need more training on the NCEES”
Standard 6

5. BloomBoard & Observation Engine
BloomBoard & Empirical Education are partnering to provide access to a marketplace of calibration and training services for school administrators across the state.
The easy-to-use platform will combine BloomBoard’s Professional Development resources with Empirical’s state-of-the-art observer training and calibration tool, Observation Engine - and will promote continuous NCEES improvements.
So how are we doing this…

6. BloomBoard
Easy access to a marketplace of supplemental professional growth opportunities, resources, and services tailored to each educator’s unique needs.
Thousands of articles, videos/video clips, and links to web based resources at your fingertips
Further support the work you’re doing through Observation Engine’s scoring studies and calibration events

7. What is Observation Engine?
An online tool that uses classroom videos to ensure accurate and reliable classroom observations
Videos from the MET library have been master-scored on the NCEES teacher evaluation rubric to create learning opportunities for teacher evaluators in North Carolina

8. Observation Engine will provide NC evaluators:
Observer Calibration Events & Reporting
Provides rating practice and helps increase rater agreement to target scores using Scoring Studies
Supplemental Learning Exercises
Provides targeted, self-paced online exercises focused on specific NCEES elements using Lessons
2 Scoring Studies for Calibration
17 lessons

9. 1. Calibrate through Scoring Studies
Improves rater agreement to target scores
Builds consensus among evaluation staff and helps establish a mutual understanding of the best ratings
Facilitates group learning through discussion of areas of disagreement
3b Knows Content for Specialty
3d Makes Instruction Relevant
4g Communicates Effectively
4a Knows How Learning Takes Place
4d Integrates Technology *
* = Target Score * * * *
Video 1: Distribution of Ratings by NCEES Element

10. Calibration Reports – sample figures

11. Calibration Reports – sample figures cont’d

12. 2. Rating practice through Lessons
Self-paced practice exercises
Watch and rate short video(s) clips, focusing on NCEES indicators
Receive immediate on-screen feedback

13. Live Demo

15. Lesson Plans
Observation Rubric

16. Note Guide:

17. Poll Everywhere
Please rate the teacher in video clip 1 using Element IVc:
Teachers use a variety of instructional methods.
Text the code for your choice to 22333
Login Information for Poll Everywhere is:
URL is
Username:
Password: instructech

18. Have site pulled up to watch video
Make sure poll everywhere is turned on and cleared
To get into BloomBoard:
1. Go to beta.bloomboard.com
2. enter your address: and the password: nc2014
3. The NCEES lessons should all be at the top, but if they are not, you can enter "NCEES" into the search field and they'll all pop up.
4. Click on a lesson and click Watch, this will take you over to the lesson in Observation Engine.
I have set up 9 demo log-ins that you can use for your Principal Ready presentations. The log-ins are as follows:
Login Information for Poll Everywhere is:
URL is
Username:
Password: instructech

19. Rating feedback

21. Rating feedback

24. Table Talk What do you think of OCT?
What questions or need for clarification do you have?

25. If your LEA would like to participate, please contact: