Performance Management in Public Education Heather Reid, Paul Haeberlen & Valerie Vogt July 16th, 2012 Education Resource Group, Inc. 21 Waterway Avenue, Suite 300 The Woodlands TX 77380 www.EducationResourceGroup.com Page 1 Copyright © 2005-2012 - Education Resource Group, Inc. All Rights reserved. Copyright © 2005-2010 Education Resource Group, Inc. All Rights reserved. Patent Pending Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 1

Measurement and Reporting The “Heart and Soul” of Performance Management How well is your organization doing? Where are improvements necessary? Who are the models of high performance? Are your improvement strategies working? The greatest challenge to performance improvement is the difficulty that organizations have in seeing themselves as they really are. Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 2 2

ERG Educational Performance Management System Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 3 3

Public Education Accountability System Level 4 Level 2 Level 4 01 04 162 05 26 02 Level 3 Academic Rating System Level 2 Level 1 Level 1 Level 3 Financial Integrity Rating System of Texas Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 4 4

A Level Playing Field - Academic Performance Index Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 5 5

A Level Playing Field - Financial Performance Index Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 6 6

The ERG Performance Matrix Over Forecast Under Forecast Academic Ranking Level 4 Level 2 Level 4 11 15 14 10 Level 3 12 16 14 08 Level 2 12 08 14 16 Level 1 15 11 08 16 Level 1 Level 3 Financial Ranking Under Forecast Over Forecast Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 7 7

The ERG Education Productivity Index Over Forecast Under Forecast Academic Ranking Least Value Level 4 Level 3 Most Value Level 2 Level 1 Level 1 Level 2 Level 3 Level 4 Financial Ranking Under Forecast Over Forecast Performance is Measured by Both Location and Movement Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 8 8

ERG District Performance Matrix Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 9

Activity I Login to ERGAnalytics.com Look at the “square” that your district is in and describe the meaning of your district’s position within the Matrix. Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

ERG District Performance Matrix Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 11

Activity II Using your district’s data and the Performance Table to the right of the Matrix, complete the following: 1. Did your EPI move up or down? How much did it change? 2. Did your API move up or down? How much did it change? 3. Did your SPI move up or down? How much did it change? Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

Performance Ranking Tables Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

Ranking Folders Copyright © 2005-2011 Education Resource Group, Inc. All Rights Reserved. Patent Pending

Activity III Click on the Ranking Folder next to your district’s API. Using the ranking tables, identify the following: What districts are in the 10 rankings ahead of yours? Are you surprised? Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

Longitudinal Charts Copyright © 2005-2011 Education Resource Group, Inc. All Rights Reserved. Patent Pending

Activity IV Click on the Longitudinal Icon next to your district’s API. Using your district’s API Longitudinal data and the three charts, What do the 3 charts tell you about how your district has been trending? What do you believe are the factors contributing to that trend? Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

Setting District Performance Goals Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 18

ERG Performance Prescription Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 19

Activity using the ERG Prescription Break into groups and answer the following questions. At the end we will see how you all compare. Look at the API - for each of the 5 areas, change it? Rewrite the prescription based on the groups consensus (ie. Based on DSISD’s goals, how many years do you think it should take to be the best in the group for Commended performance?) Is that long enough to achieve or too long? Adjust the goal, or adjust the years to achieve it (do you want to be the best in a particular area, or do you want to adjust (accelerate) the years to achieve it. Now the big question – what has to change if we are going to achieve these goals in less time? Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

What affects momentum??? Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

ERG Performance Profile Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 22

ERG Performance Profile Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 23

ERG Performance Comparison - Activity Break into groups. Each group will identify a district they traditionally compare themselves to What does the data tell you about this comparison district? Does DSISD compare favorably? Or, where is DSISD stronger and where is DSISD weaker? Knowing this information, is this still a district you would use in a Peer Group as a model of high performance? Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 24

ERG Performance Analysis Some statistical knowledge is helpful when using the regression charts! Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 25

ERG Performance Analysis – Independent & Dependent Variables What is a variable? A variable is an object, event, idea, feeling, time period, or any other type of category you are trying to measure. There are two types of variables-independent and dependent. Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

ERG Performance Analysis – Independent & Dependent Variables What is an “independent” variable? An independent variable is exactly what it sounds like. It is a variable that stands alone and isn't changed by the other variables you are trying to measure. For example, someone's age might be an independent variable. Other factors (such as what they eat, how much they go to school, how much television they watch) aren't going to change a person's age. In fact, when you are looking for some kind of relationship between variables you are trying to see if the independent variable causes some kind of change in the other variables, or dependent variables. Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

ERG Performance Analysis – Independent & Dependent Variables What is a “dependent” variable? Just like an independent variable, a dependent variable is exactly what it sounds like. It is something that depends on other factors. For example, a test score could be a dependent variable because it could change depending on several factors such as how much you studied, how much sleep you got the night before you took the test, or even how hungry you were when you took it. Usually when you are looking for a relationship between two things you are trying to find out what makes the dependent variable change the way it does. Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

ERG Performance Analysis What is an “R-Squared Value? R-Squared is a statistical term saying how good one term is at predicting another.  If R-Squared is 1.0 then given the value of one term, you can perfectly predict the value of another term.  If R-Squared is 0.0, then knowing one term doesn't not help you know the other term at all. Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 29

ERG Performance Analysis Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 30

ERG Performance Search Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

Activity Using the ERG Performance Search, do the following: 1. Select “Total Enrollment” as your first variable. 2. Choose to search by “Rank” and enter the necessary criteria to identify the 50 smallest districts . 3. Select “Commended Performance – DEV” why are we using this variable? 4. Choose to search by “Value” and enter the necessary criteria to identify those who are performing better than expected. 5. What districts remain? Are you surprised? Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

Accessing the Campus Analyst Select one of the following: Elementary School Middle School High School Choose your campus name Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

Selecting your Campus Peer Group The Group defaults to the “Campus Sample Group. However, you can also choose “District Similar Schools” which will compare you to other like schools within your district. Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

The Campus Analyst – The Difference Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending

“Not Everyone With a Hammer is a Carpenter” You Need Better Data: More Accurate! More Consistent! More Timely!!! You Need Better Tools To: Convert the data into actionable information Integrate inputs and outputs Rank results to identify relative performance Identify areas requiring improvement Monitor the progress of improvement strategies Information is a Strategic Resource “Without the facts, you are just another person with an opinion.” Copyright © 2005-2012 Education Resource Group, Inc. All Rights Reserved. Patent Pending 36 36