The Oak Tree Analogy. For the past year, these gardeners have been tending to their oak trees trying to maximize the height of the trees. Explaining the.

Slides:



Advertisements
Similar presentations
Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the.
Advertisements

Summary of NCDPI Staff Development 12/4/12
EiS – Education iT Services Our passion in EiS is to make a real difference in education and ultimately childrens lives by providing innovative solutions.
Value-Added Online Course Preview Value-Added Research Center University of Wisconsin-Madison October 17, 2011.
EiS – Education iT Services “Our passion in EiS is to make a real difference in education and ultimately children’s lives by providing innovative solutions.
Haywood County Schools February 20,2013
Florida Department of Education Value-added Model (VAM) FY2012 Using Student Growth in Teacher and School Based Administrator Evaluations.
Comparing Growth in Student Performance David Stern, UC Berkeley Career Academy Support Network Presentation to Educating for Careers/ California Partnership.
Educator Evaluations Education Accountability Summit August 26-28,
Upper Darby School District Growth Data
Dallas ISD’s Value-Added Model School Effectiveness Index (SEI) Classroom Effectiveness Index (CEI) Data Analysis, Reporting, and Research Services.
Measuring Student Growth An introduction to Value-Added.
TEACHER EFFECTIVENESS INITIATIVE VALUE-ADDED TRAINING Value-Added Research Center (VARC)
Districts and States Working with VARC Minneapolis Milwaukee Racine Chicago Madison Tulsa Atlanta New York City Los Angeles Hillsborough County NORTH DAKOTA.
June  Articulate the impact SLG goals have on improving student learning  Identify the characteristics of assessments that measure growth and.
1 Contextual Value Added and Data For Dummies The mystery explained.
Enquiring mines wanna no.... Who is it? Coleman Report “[S]chools bring little influence to bear upon a child’s achievement that is independent of.
TEACHER EFFECTIVENESS INITIATIVE VALUE-ADDED TRAINING Value-Added Research Center (VARC)
Happy Friday Scientists!
Introduction to the Georgia Student Growth Model Student Growth Percentiles 1.
Value-Added Overview Sapulpa Public Schools August 16, 2012.
1 New York State Education Department Using Growth Measures for Educator Evaluation August 2012.
DRE Agenda Student Learning Growth – Teacher VAM – School Growth PYG Area Scorecards. PYG, and other Performance Indicators.
Overview of SB 736 Legislation Pertaining to Personnel Evaluation Systems and Race to the Top 1.
Statutory Requirements Quantitative Measures (35% of Total TLE) The State Board voted to use a Value Added Model to measure student academic growth for.
1 New York State Growth Model for Educator Evaluation 2011–12 July 2012 PRESENTATION as of 7/9/12.
Copyright ©2006. Battelle for Kids. Understanding & Using Value-Added Analysis.
PVAAS – Pennsylvania Value-Added Assessment System added_assessment_system_(pvaas)/8751.
The Impact of Including Predictors and Using Various Hierarchical Linear Models on Evaluating School Effectiveness in Mathematics Nicole Traxel & Cindy.
Florida Department of Education Value-added Model (VAM) FY2012 Using Student Growth in Teacher and School Based Administrator Evaluations.
Intro to Population: Major Concepts and Terms AP Human Geography.
VALUE-ADDED NETWORK WORKSHOP May Agenda  9:00-11:00 Value-Added Updates  11:15-11:30 Welcome, Introductions  11:30-12:15 Keynote Luncheon (Kurt.
Slide 1 Estimating Performance Below the National Level Applying Simulation Methods to TIMSS Fourth Annual IES Research Conference Dan Sherman, Ph.D. American.
TEACHER EFFECTIVENESS INITIATIVE VALUE-ADDED TRAINING Value-Added Research Center (VARC) October 2012.
© 2011, Tulsa Public Schools Copyright © Tulsa Public Schools 2011 © 2011, Tulsa Public Schools Jana Burk, Tulsa Public Schools Fellow Office of Teacher.
Growth Model for District “X” Why Use Growth Models? Showing progress over time is a more fair way of evaluating It is not just a “snap shot” in time.
Van Hise Elementary School Review of Data School Improvement Process March 3, 2009.
Boys do better at state exams The analysis of Polish national representative sample of teenagers Grazyna Wieczorkowska-Wierzbinska Malgorzata Siarkiewicz.
DRE FLDOE “Value-Added Model” School District of Palm Beach County Performance Accountability.
June  Articulate the impact SLG goals have on improving student learning  Identify the characteristics of assessments that measure growth and.
TEACHER EFFECTIVENESS INITIATIVE VALUE-ADDED TRAINING Value-Added Research Center (VARC)
Copyright © 2010, SAS Institute Inc. All rights reserved. How Do They Do That? EVAAS and the New Tests October 2013 SAS ® EVAAS ® for K-12.
MMSD Value-Added Results January 3, Attainment versus Growth Grade 3Grade 4Grade 5Grade 6Grade 7Grade 8 2.
1 New York State Growth Model for Educator Evaluation 2011–12 July 2012 PRESENTATION as of 7/9/12.
VALUE-ADDED NETWORK WORKSHOP May Agenda  8:30-10:30 Value-Added Growth Model Overview and Refresher  10:45-11:00 Welcome, Introductions  11:00-11:30.
Last Revised: 10/01/15. Senate Bill 290 has specific goal-setting requirements for all licensed and administrative staff in the State of Oregon. In ,
EVAAS Proactive and Teacher Reports: Assessing Students’ Academic Needs and Using Teacher Reports to Improve Student Progress Cherokee County Schools February.
Value Added Model and Evaluations: Keeping It Simple Polk County Schools – November 2015.
Practical Statistics Regression. There are six statistics that will answer 90% of all questions! 1. Descriptive 2. Chi-square 3. Z-tests 4. Comparison.
EVAAS and Expectations. Answers the question of how effective a schooling experience is for learners Produces reports that –Predict student success –Show.
EVAAS Proactive and Teacher Reports: Assessing Students’ Academic Needs and Using Teacher Reports to Improve Student Progress Becky Pearson and Joyce Gardner.
Effectiveness of Selected Supplemental Reading Comprehension Interventions: Impacts on a First Cohort of Fifth-Grade Students June 8, 2009 IES Annual Research.
Florida Department of Education’s Florida Department of Education’s Teacher Evaluation System Student Learning Growth.
Value Added Model Value Added Model. New Standard for Teacher EvaluationsNew Standard for Teacher Evaluations Performance of Students. At least 50% of.
Florida Algebra I EOC Value-Added Model June 2013.
Making Data Work for Kids: EVAAS Teacher Reports October 2012 SAS ® EVAAS ® for K-12.
Comparative Analysis of Aggregate Educational Data Between Children in Foster Care and the General Population Florida Department of Children and Families.
1 New York State Growth Model for Educator Evaluation June 2012 PRESENTATION as of 6/14/12.
CORE Academic Growth Model: Introduction to Growth Models
CORE Academic Growth Model: Introduction to Growth Models
What is Value Added?.
The CORE Data Collaborative and the Riverside County Office of Education Noah Bookman, Chief Strategy Officer (CORE) October 20, 2017.
TAILWINDS HEADWINDS. TAILWINDS HEADWINDS CNUSD SBAC ELA Based on the # of HW.
Dr. Robert H. Meyer Research Professor and Director
CORE Academic Growth Model: Results Interpretation
New York State Education Department Using Growth Measures for Educator Evaluation August 2012.
CORE Academic Growth Model: Step-By-Step
CORE Academic Growth Model: Step-By-Step
Measuring Student Growth
Findley Oaks Elementary Data Overview
Presentation transcript:

The Oak Tree Analogy

For the past year, these gardeners have been tending to their oak trees trying to maximize the height of the trees. Explaining the concept of value added by evaluating the performance of two gardeners Gardener A Gardener B Gardener A Gardener B Each gardener used a variety of strategies to help their own tree grow… which of these two gardeners was more successful with their strategies?

This method is analogous to using an Achievement Model. To measure the performance of the gardeners, we will measure the height of the trees today (1 year after they began tending to the trees). Using this method, Gardener B is the better gardener. Gardener A Gardener B 61 in. 72 in.

… but this achievement result does not tell the whole story. These trees are 4 years old. We need to find the starting height for each tree in order to more fairly evaluate each gardener’s performance during the past year. The trees were much shorter last year. 61 in. 72 in. Gardener A Gardener B Oak A Age 4 (Today) Oak B Age 4 (Today) Oak A Age 3 (1 year ago) Oak B Age 3 (1 year ago) 47 in. 52 in.

We can compare the height of the trees one year ago to the height today. By finding the difference between these heights, we can determine how many inches the trees grew during the year of gardener’s care. Oak B had more growth this year, so Gardener B is the better gardener. This is analogous to a Simple Growth Model, also called Gain. 61 in. 72 in. Gardener A Gardener B Oak A Age 4 (Today) Oak B Age 4 (Today) Oak A Age 3 (1 year ago) Oak B Age 3 (1 year ago) 47 in. 52 in. +14 in. +20 in.

… but this simple growth result does not tell the whole story either. We do not yet know how much of this growth was due to the strategies used by the gardeners themselves. This is an “apples to oranges” comparison. For our oak tree example, three environmental factors we will examine are: Rainfall, Soil Richness, and Temperature. Gardener A Gardener B

External condition Oak Tree AOak Tree B Rainfall amount Soil richness Temperature High Low Low High High Low Gardener A Gardener B

We can use this information to calculate a predicted height for each tree today if it was being cared for by an average gardener in the area… Gardener A Gardener B We adjust this prediction for the effect of each tree’s environmental conditions. We compare the actual height of the trees to their predicted heights to determine if the gardener’s effect was above or below average. We examine all oaks in the region to find an average height improvement for trees.

In order to find the impact of rainfall, soil richness, and temperature, we will plot the growth of each individual oak in the region compared to its environmental conditions.

Now that we have identified growth trends for each of these environmental factors, we need to convert them into a form usable for our predictions. RainfallLowMediumHigh Growth in inches relative to the average Soil RichnessLowMediumHigh Growth in inches relative to the average -3+2 TemperatureLowMediumHigh Growth in inches relative to the average Now we can go back to Oak A and Oak B to adjust for their growing conditions.

Based on our data, the average improvement for oak trees in the region was 20 inches during the past year. To make our initial prediction, we use the average height improvement for all trees Next, we will refine our prediction based on the growing conditions for each tree. When we are done, we will have an “apples to apples” comparison of the gardeners’ effect. We start with the trees’ height at age 3 and add 20 inches for our initial prediction. Oak A Age 3 (1 year ago) Oak B Age 3 (1 year ago) 67 in. 72 in. Gardener A Gardener B Oak A Prediction Oak B Prediction 47 in. 52 in. +20 Average

Similarly, for having low rainfall, Oak B’s prediction is adjusted by -5 to compensate. Based on data for all oak trees in the region, we found that high rainfall resulted in 3 inches of extra growth on average. For having high rainfall, Oak A’s prediction is adjusted by +3 to compensate. 70 in. 67 in. Gardener A Gardener B 47 in. 52 in. +20 Average + 3 for Rainfall - 5 for Rainfall

For having rich soil, Oak B’s prediction is adjusted by +2. For having poor soil, Oak A’s prediction is adjusted by in. 69 in. Gardener A Gardener B 47 in. 52 in. +20 Average + 3 for Rainfall - 3 for Soil + 2 for Soil - 5 for Rainfall

For having low temperature, Oak B’s prediction is adjusted by +5. For having high temperature, Oak A’s prediction is adjusted by in. 74 in. Gardener A Gardener B 47 in. 52 in. +20 Average + 3 for Rainfall - 3 for Soil + 2 for Soil - 8 for Temp + 5 for Temp - 5 for Rainfall

+20 Average + 3 for Rainfall - 3 for Soil + 2 for Soil - 8 for Temp + 5 for Temp _________ +12 inches During the year _________ +22 inches During the year The predicted height for trees in Oak B’s conditions is 74 inches. The predicted height for trees in Oak A’s conditions is 59 inches. Now that we have refined our predictions based on the effect of environmental conditions, our gardeners are on a level playing field. 59 in. 74 in. Gardener A Gardener B 47 in. 52 in. - 5 for Rainfall

Oak B’s actual height of 72 inches is 2 inches less than we predicted. We attribute this below-average result to the effect of Gardener B. Oak A’s actual height of 61 inches is 2 inches more than we predicted. We attribute this above-average result to the effect of Gardener A. Finally, we compare the actual height of the trees to our predictions. Predicted Oak A Predicted Oak B Actual Oak A Actual Oak B 59 in. 74 in. Gardener A Gardener B 61 in. 72 in

This is analogous to a Value-Added measure. By accounting for last year’s height and environmental conditions of the trees during this year, we found the “value” each gardener “added” to the growth of the tree. Using this method, Gardener A is the superior gardener. Above Average Value-Added Below Average Value-Added Predicted Oak A Predicted Oak B Actual Oak A Actual Oak B 59 in. 74 in. Gardener A Gardener B 61 in. 72 in

Oak Tree AnalogyValue-Added in Education What are we evaluating? Gardeners Districts Schools Grades Classrooms Programs and Interventions How does this analogy relate to value added in the education context? What are we using to measure success? Relative height improvement in inches Relative improvement on standardized test scores Sample Single oak tree Groups of students Control factors Rainfall Soil richness Temperature Students’ prior test performance (usually most significant predictor) Other demographic characteristics such as: Grade level Gender Race / Ethnicity Low-Income Status ELL Status IEP Status Homelessness Mobility