1. Outcomes-Based Accountability “Turning the Curve” The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org TM

2. SIMPLE COMMON SENSE PLAIN LANGUAGE MINIMUM PAPER USEFUL

3. Outcomes-Based Accountability is made up of two parts: Performance Accountability about the well-being of CUSTOMER POPULATIONS For Services – Agencies – and Service Systems Population Accountability about the well-being of WHOLE POPULATIONS For Communities – Cities – Counties – States - Nations

4. COMMON LANGUAGE

5. THE LANGUAGE TRAP Too many terms. Too few definitions. Too little discipline Benchmark Target IndicatorGoal Result Objective Outcome Measure Modifiers Measurable Core Urgent Qualitative Priority Programmatic Targeted Performance Incremental Strategic Systemic Lewis Carroll Center for Language Disorders Measurable urgent systemic indicators Core qualitative strategic objectives Your made up jargon here

6. DEFINITIONS Children born healthy, Children ready for school, Safe communities, Clean Environment, Prosperous Economy Rate of low-birthweight babies, Percent ready at K entry, crime rate, air quality index, unemployment rate 1. How much did we do? 2. How well did we do it? 3. Is anyone better off? OUTCOME or RESULT INDICATOR or BENCHMARK PERFORMANCE MEASURE A condition of well-being for children, adults, families or communities. A measure which helps quantify the achievement of an outcome. A measure of how well a program, agency or service system is working. Three types: Population Performance Children born healthy Rate of low-birthweight babiesPercent ready at K entry Children ready for school crime rate Safe communities air quality index Clean Environment unemployment rate Prosperous Economy INDICATOR OUTCOME PERFORMANCE MEASURE Population Performance = Customer Outcome 1. 2. 3.

7. 1. Safe Communities 2. Crime rate 3. Average police response time 4. People are physically & mentally healthy 5. Rate of heart disease 6. People have living wage jobs and income 7. % of people with living wage jobs and income 8. % of participants in job training who get living wage jobs IS IT A RESULT, INDICATOR OR PERFORMANCE MEASURE? RESULT INDICATOR PERF. MEASURE RESULT INDICATOR RESULT INDICATOR PERF. MEASURE 1 1 1 1 1 1 1 1

8. POPULATION ACCOUNTABILITY

9. Community Outcomes for Christchurch, NZ 1. A Safe City 2. A City of Inclusive and Diverse Communities 3. A City of People who Value and Protect the Natural Environment 4. A Well-Governed City 5. A Prosperous City 6. A Healthy City 7. A City for Recreation, Fun and Creativity 8. City of Lifelong Learning 9. An Attractive and Well-Designed City

10. City of London Ontario, Canada Priority Results ● A Strong Economy ● A Vibrant Diverse Community ● A Green and Growing City ● A Reliable Infrastructure ● A Safe City Source: Draft Strategic Plan Sept 2011

11. CARDIFF, WALES Community Outcomes 1. People in Cardiff are healthy 2. Cardiff has a clean attractive and sustainable environment 3. People in Cardiff are safe and feel safe 4. Cardiff has a thriving and prosperous economy 5. People in Cardiff achieve their full potential. 6. Cardiff is a great place to live, work and play. 7. Cardiff has a fair, just and inclusive society.

12. New Zealand Kruidenbuurt Tilburg, Netherlands Cardiff, Wales Santa Cruz County

16. Leaking Roof (Outcomes thinking in everyday life) Experience Measure Story behind the baseline (causes) Partners What Works Action Plan Inches of Water BASELINE ? Fixed Not OK Turning the Curve Action Plan #2

17. Baseline & Story Outcomes Indicators Experience

18. 45 people per day 75 people per day 2010 28 people per day MADD

19. Christchurch, New Zealand Number of Graffiti Sites FY 2002 to FY 2010

20. Source: Connexions Tyne and Wear, UK Newcastle, UK Revised 9 Nov 2007 Nov 08 – Jan 09 8.5

22. PERFORMANCE ACCOUNTABILITY

23. “All Performance Measures that have ever existed for any service in the history of the universe involve answering two sets of interlocking questions.”

24. How Much did we do? ( # ) How Well did we do it? ( % ) Quantity Quality Service Performance Measures

25. Effort How hard did we try? Effect Is anyone better off? Performance Measures

26. Effort Effect How Much How Well Service Performance Measures

27. How much service did we deliver? Service Performance Measures How well did we deliver it? How much change / effect did we produce? What quality of change / effect did we produce? Quantity Quality Effect Effort Output Input

28. How much did we do? Service Performance Measures How well did we do it? Is anyone better off? Quantity Quality Effect Effort # %

29. How much did we do? Education How well did we do it? Is anyone better off? Quantity Quality Effect Effort Number of students Student-teacher ratio Number of 16 olds with 5 A to C GCSE’s Number with good school attendance Percent of 16 yr olds with 5 A to C GCSE’s Percent with good school attendance

30. How much did we do? Drug/Alcohol Treatment Program How well did we do it? Is anyone better off? Number of persons treated Percent of staff with training/ certification Number of clients off of alcohol & drugs - at exit - 12 months after exit Percent of clients off of alcohol & drugs - at exit - 12 months after exit Quantity Quality Effect Effort

31. How much did we do? Waste Management Services How well did we do it? Is anyone better off? Quantity Quality Effect Effort # tonnes of residential waste Unit cost per tonne collected % to land fill % diverted from landfill #/amt to land fill #/amt diverted from landfill

32. How much did we do? Fire Department How well did we do it? Is anyone better off? Number of responses Response Time Quantity Quality Effect Effort # of fires kept to room of origin % of fires kept to room of origin

33. How much did we do? Not All Performance Measures Are Created Equal How well did we do it? Is anyone better off? Least Important Quantity Quality Effect Effort Most Important Least Most Also Very Important Quality

34. How much did we do? The Matter of Control How well did we do it? Is anyone better off? Quantity Quality Effect Effort Least Control PARTNERSHIPS Most Control

35. How much did we do? Performance Accountability Types of Measures found in each Quadrant How well did we do it? Is anyone better off? # Clients/customers served # Activities (by type of activity) % Common measures e.g. client staff ratio, workload ratio, staff turnover rate, staff morale, % staff fully trained, % clients seen in their own language, worker safety, unit cost % Skills / Knowledge (e.g. parenting skills) # % Attitude / Opinion (e.g. toward drugs) # % Behavior (e.g.school attendance) # % Circumstance (e.g. working, in stable housing) # % Activity-specific measures e.g. % timely, % clients completing activity, % correct and complete, % meeting standard Point in Time vs. 2 Point Comparison # %

36. How much did we do? Service: __________________________________ How well did we do it? Is anyone better off? Primary customers # studentspatients persons trained Primary activity # hours of instruction diagnostic testsjob coursesalarms responded to If your service works really well, how are your customer's better off? # students who graduate patients who fully recover fires kept to room of origin % Unit cost Workload ratio % of ___x___ that happen on time persons who get jobs School HospitalJob Training Fire Department

37. LR UR Primary v. Secondary Direct v. Indirect Internal v. External Baseline & Story

42. Watermain Breaks per year London Ontario

43. Advanced Baseline Display Your Baseline Comparison Baseline Goal (line) Target or Standard Instead: Count anything better than baseline as progress. Avoid publicly declaring targets by year if possible. ● Create targets only when they are: FAIR & USEFUL x Aspiration NOT Punishment

44. How Population & Performance Accountability FIT TOGETHER

45. Contribution relationship Alignment of measures Appropriate responsibility THE LINKAGE Between POPULATION and PERFORMANCE POPULATION ACCOUNTABILITY Healthy Births Rate of low birth-weight babies Children Ready for School Percent fully ready per K-entry assessment Self-sufficient Families Percent of parents earning a living wage CUSTOMER OUTCOMES # persons receiving training Unit cost per person trained # who get living wage jobs % who get living wage jobs PERFORMANCE ACCOUNTABILITY POPULATION OUTCOMES Job Training Program

46. Different Kinds of Progress 1. Data a. Population indicators Actual turned curves: movement for the better away from the baseline. b. Service performance measures: customer progress and better service: How much did we do? How well did we do it? Is anyone better off? 2. Accomplishments: Positive activities, not included above. 3. Anecdotes: Stories behind the statistics that show how individuals are better off.

47. Board of Directors Meeting AGENDA 1. New data 2. New story behind the curves 3. New partners 4. New information on what works. 5. New information on financing 6. Changes to action plan and budget 7. Adjourn 1. New data 2. New story behind the curves 3. New partners 4. New information on what works. 5. New information on financing 6. Changes to action plan and budget 7. Adjourn

48. SUMMARY

50. 3 - kinds of performance measures. How much did we do? How well did we do it? Is anyone better off? OBA in a Nutshell 2 – 3 - 7 2 - kinds of accountability Population accountability Performance accountability 7 - questions from ends to means in less than an hour. Baselines and Turning the Curve plus language discipline Outcomes & Indicators Performance measures

51. - Rosell “If I include you, you will be my partner. If I exclude you, you will be my judge.”

53. Turn the Curve Exercise POPULATION

60. Creating a Working Baseline from Group Knowledge Now Indicator or Performance Measure 65% Not OK? Backcasting Forecasting

61. Turn the Curve Exercise: Population Well-being 5 min:Starting Points - timekeeper and reporter - geographic area - two hats (yours plus partner’s) 10 min:Baseline - pick an outcome, and an indicator curve to turn - forecast to 2017 – OK or not OK? 15 min:Story behind the baseline - causes/forces at work - information & research agenda part 1 - causes 15 min:What works? (What would it take?) - what could work to do better? - each partners contribution - no-cost / low-cost ideas - information & research agenda part 2 – what works 10 min:Report convert notes to one page Two pointers to action

62. ONE PAGE Turn the Curve Report: Population Outcome: _______________ Indicator (Lay Definition) Indicator Baseline Story behind the baseline --------------------------- --------------------------- (List as many as needed) Partners --------------------------- --------------------------- (List as many as needed) Three Best Ideas – What Works 1. --------------------------- 2. --------------------------- 3. ---------No-cost / low-cost Sharp Edges 4. --------- Off the Wall

63. Turn the Curve Exercise – Lessons Talk to Action in an hour 1. How was this different from other processes? What worked and what didn’t work? 2. Why did we ask for: a. Results before indicators? b. Forecast? c. Story? d. No cost / low cost? e. Two hats? f. Crazy idea? g. Only 3 best ideas? 3. Do you think a lay audience could understand the reports? 4. How many think you could lead this exercise with a small group? (2+ curves at the same time)

64. Resources Book - DVD Orders amazon.com resultsleadership.org www.raguide.org www.resultsaccountability.com RBA Facebook Group

65. “If you do what you always did, you will get what you always got.” Kenneth W. Jenkins President, Yonkers NY NAACP

66. --------Book - DVD Orders-------- amazon.com resultsleadership.org THANK YOU ! Websites raguide.org resultsaccountability.com