The Dynamic Trio of Effective Teaching Measures: Classroom observations, student surveys and achievement gains Thomas Kane Harvard Graduate School of Education

Which team would you pick? Or

3  Largest study of instruction ever undertaken  3,000 teacher volunteers in 7 districts  Multiple Measures –>22,500 classroom observations –Student surveys –Student achievement gains on state tests & supplemental tests

Student Achievement Gains

? MATH 7.6 months of learning Student Achievement Gains Bottom 25% Top 25%

Actual scores for 7500 lessons. 6 Classroom Observations

Actual scores for 7500 lessons UNSATISFACTORY Yes/no questions Posed in rapid succession Few students participate 2. BASIC Some questions ask for explanation Uneven attempts to engage all students 4. PROFICIENT Most questions ask for explanation Discussion develops/teacher steps aside All students participate 4. ADVANCED All questions high quality Students initiate questions Students engage each other Creating Environment of Respect & Rapport Creating environment of respect & rapport Managing classroom procedures Engaging students in learning Managing student behavior Establishing a culture of learning Using assessment in learning Establishing a culture of learning Using questioning & discussion techniques Communicating with students Classroom Observations

Student Achievement Gains Bottom 25% Top 25% Better Observation Scores, Higher Achievement Gains Difference Managing student behavior Environment of respect & rapport Engaging students in learning Managing classroom procedures Establish culture of learning Using assessments Questioning and discussion Communicating with students

9 Student Perception Surveys

10 Student Perception Surveys

Difference Care Control Clarify Challenge Captivate Confer Consolidate Better Student Perceptions, Higher Achievement Gains Student Achievement Gains Bottom 25% Top 25%

Student Perceptions = Highest Reliability Correlation for same teacher on same measure, two different course sections Observation Scores Student Achievement Gains Student Survey Results

13 Dynamic Trio Most predicts student outcomes, No diagnostic use Most diagnostic, Potentially least reliable Predictive, Most reliable Value-Added Observations Student Surveys

14 Relative to What? Master’s Experience Dynamic Trio Months of Learning (MATH)