© 2011, Tulsa Public Schools Copyright © Tulsa Public Schools 2011 © 2011, Tulsa Public Schools Jana Burk, Tulsa Public Schools Fellow Office of Teacher and Leader Effectiveness

© 2011, Tulsa Public Schools 2 Value-Added Reporting

© 2011, Tulsa Public Schools Why Did We Become Educators? To make a difference in children's lives

© 2011, Tulsa Public Schools “The Difference” We Can Make

© 2011, Tulsa Public Schools What is Value Added? Value added is a measure of teacher and school effectiveness. Unlike a state achievement score, value-added isolates and communicates educators’ impact on students’ learning.

© 2011, Tulsa Public Schools Why Use Value-Added? Using value-added along with other data allows us to separate… what we think is happening from what is actually happening.

© 2011, Tulsa Public Schools TPS Value-Added Reporting Available now for and Used for information, analysis and improvement. Training provided in the methodology and use of the data. –Principals: June, August and October of 2011 –Teachers: October 2011 Supported by Value Added Research Center (VARC) of Univ. of Wisconsin and Battelle for Kids. 7

© 2011, Tulsa Public Schools Gardener A Gardener B The Oak Tree Analogy

© 2011, Tulsa Public Schools Achievement Model. Gardener A Gardener B 61 in. 72 in.

© 2011, Tulsa Public Schools Simple Growth Model. 61 in. 72 in. Gardener A Gardener B Oak A Age 4 (Today) Oak B Age 4 (Today) Oak A Age 3 Oak B Age 3 47 in. 52 in. +14 in. +20 in.

© 2011, Tulsa Public Schools +20 Average + 3 for Rainfall - 3 for Soil + 2 for Soil - 8 for Temp + 5 for Temp _________ +12 inches During the year _________ +22 inches During the year 59 in. 74 in. Gardener A Gardener B 47 in. 52 in. - 5 for Rainfall Actual Adjusted Prediction The Most Revealing Approach…

© 2011, Tulsa Public Schools Adjusted Prediction Oak A Adjusted Prediction Oak B Actual Oak A Actual Oak B 59 in. 74 in. Gardener A Gardener B 61 in. 72 in Comparing Actual Growth to Predicted Growth

© 2011, Tulsa Public Schools Adjusted Prediction Oak B Actual Oak B Gardener A Gardener B Avg. -2 in Adjusted Prediction Oak A Actual Oak A Avg.+2 in Value-Added Model.

© 2011, Tulsa Public Schools How do we calculate Value-Added in the education context? Calculate the gain of scale score points for students at each school using a prior-test and a post-test. Use statistical models to eliminate the effect of external factors (starting point, student demographics, etc.) Schools where students are growing faster than average are High Value-Added. Schools where students are growing slower than average are Low Value-Added.

© 2011, Tulsa Public Schools What Do We Do With Value-Added Data? Evaluate the effectiveness of –Instructional practices –Programs Identify pockets of excellence to replicate Detect and respond to ineffective practices and programs

© 2011, Tulsa Public Schools Which Grades/Courses Have Value-Added Reporting at TPS? Math (4-8) Reading (4-8) Science (5, 8) Social Studies (5, 8) Writing (5, 8) Geography (7) English II, III Algebra I, II Geometry Biology I U.S. History

© 2011, Tulsa Public Schools Control Factors 1.Prior OCCT Score 2.Grade Level 3.Gender 4.Race/Ethnicity 5.Low Income Status 6.ELL Status 7.Special Education Status 8.Mobility (Continuous Enrollment) 9. Attendance History 10.Grade Retention The VARC/TPS model uses statistical techniques to separate the impact of schooling from other factors that may influence growth. The following are the controls used in the model: It is important to note that controlling for demographic characteristics does not mean lowering expectations for any grouping of students addressed by the control variable. 17

© 2011, Tulsa Public Schools Anatomy of the Value-Added Report Subject Number of Students in Analysis (Weighted based on time in school) Confidence Interval (CI) Past Academic Year VA Results 3-Year Average VA Results District Average Growth

© 2011, Tulsa Public Schools Subgroup Detail 19

© 2011, Tulsa Public Schools Measures of Student Outcomes

© 2011, Tulsa Public Schools The Power of Two: Achievement & Growth Achievemen t Value-added Low Growth Low Achievement High Growth Low Achievement High Achievement Low Growth High Achievement High Growth School B School C School D School E School F School H School K School G School J School A

© 2011, Tulsa Public Schools Copyright © Tulsa Public Schools 2011 © 2011, Tulsa Public Schools Questions? or TPS Office of Teacher and Leader Effectiveness

© 2011, Tulsa Public Schools THANK YOU 23