1. PERFORMANCE ACCOUNTABILITY

2. Results-Based Accountability is made up of two parts: Performance Accountability is about the well-being of CUSTOMER POPULATIONS for Programs – Agencies – Service Systems Population Accountability is about the well-being of WHOLE POPULATIONS for Communities – Cities – Counties – States - Nations

6. “All performance measures that have ever existed for any program in the history of the universe involve answering two sets of interlocking questions.”

7. How Much did we do? ( # ) How Well did we do it? ( % ) Quantity Quality Performance Measures

8. Effort How hard did we try? Effect Is anyone better off? Performance Measures

9. Effort Effect How Much How Well Performance Measures

10. How much service did we deliver? Performance Measures How well did we deliver it? How much change / effect did we produce? What quality of change / effect did we produce? Quantity Quality Effect Effort Output Input

11. How much did we do? Performance Measures How well did we do it? Is anyone better off? Quantity Quality Effect Effort # %

12. How much did we do? Education How well did we do it? Is anyone better off? Quantity Quality Effect Effort Number of students Student-teacher ratio Number of high school graduates Percent of high school graduates

13. How much did we do? Education How well did we do it? Is anyone better off? Quantity Quality Effect Effort Number of students Student-teacher ratio Percent of 9 th graders who graduate on time and enter college or employment after graduation Number of 9 th graders who graduate on time and enter college or employment after graduation

14. How much did we do? Pediatric Practice How well did we do it? Is anyone better off? Number of children treated Percent of patients waiting less than 30 min in the waiting room Quantity Quality Effect Effort # children fully immunized (in the practice) % children fully immunized (in the practice)

15. How much did we do? Drug/Alcohol Treatment Program How well did we do it? Is anyone better off? Number of persons treated Percent of staff with training/ certification Number of clients off of alcohol & drugs - at exit - 12 months after exit Percent of clients off of alcohol & drugs - at exit - 12 months after exit Quantity Quality Effect Effort

16. How much did we do? Fire Department How well did we do it? Is anyone better off? Number of responses Response Time Quantity Quality Effect Effort # of fires kept to room of origin % of fires kept to room of origin

17. How much did we do? General Motors How well did we do it? Is anyone better off? # of production hrs # tons of steel Employees per vehicle produced # of cars sold $ Amount of Profit $ Car value after 2 years Quantity Quality Effect Effort Source: USA Today 9/28/98 % Market share Profit per share % Car value after 2 years

18. How much did we do? Not All Performance Measures Are Created Equal How well did we do it? Is anyone better off? Least Important Quantity Quality Effect Effort Most Important Least Most Also Very Important Quality

19. RBA Categories Account for All Performance Measures (in the history of the universe) Quantity Quality Efficiency, Admin overhead, Unit cost Staffing ratios, Staff turnover Staff morale, Access, Waiting time, Waiting lists, Worker safety Customer Satisfaction (quality service delivery & customer benefit) Cost / Benefit ratio Return on investment Client results or client outcomes Effectiveness Value added Productivity Benefit value Product Output Impact Process Input Effect Effort Cost Total Quality Mgmt (TQM) Effectiveness Efficiency Admin overhead, Unit cost

20. Quantity Quality Efficiency, Admin overhead, Unit cost Staffing ratios, Staff turnover Staff morale, Access, Waiting time, Waiting lists, Worker safety Customer Satisfaction (quality service delivery & customer benefit) Cost / Benefit ratio Return on investment Client results or client outcomes Effectiveness Value added Productivity Benefit value Process Input Effect Effort Cost Product Output Impact RBA Categories Account for All Performance Measures (in the history of the universe) Total Quality Mgmt (TQM)

21. Quantity Quality Efficiency, Admin overhead, Unit cost Staffing ratios, Staff turnover Staff morale, Access, Waiting time, Waiting lists, Worker safety Customer Satisfaction (quality service delivery & customer benefit) Cost / Benefit ratio Return on investment Client results or client outcomes Effectiveness Value added Productivity Benefit value Process Input Effect Effort Cost 1. Did we treat you well? 2. Did we help you with your problems? * Product Output Impact RBA Categories Account for All Performance Measures (in the history of the universe) * World’s simplest complete customer satisfaction survey Total Quality Mgmt (TQM)

23. Quantity Quality Efficiency, Admin overhead, Unit cost Staffing ratios, Staff turnover Staff morale, Access, Waiting time, Waiting lists, Worker safety Customer Satisfaction (quality service delivery & customer benefit) Cost / Benefit ratio Return on investment Client results or client outcomes Effectiveness Value added Productivity Benefit value Process Input Effect Effort Cost Product Output Impact OBA Categories Account for All Performance Measures (in the history of the universe) Total Quality Mgmt (TQM)

24. How much did we do? The Matter of Control How well did we do it? Is anyone better off? Quantity Quality Effect Effort Least Control PARTNERSHIPS Most Control

25. The Matter of Use 1.The first purpose of performance measurement is to IMPROVE PERFORMANCE. 2. Avoid the performance measurement equals punishment trap. ● Create a healthy organizational environment. ● Start small. ● Build bottom-up and top-down simultaneously.

26. 1. To Ourselves Can we do better than our own history? 2. To Others When it is a fair apples/apples comparison. 3. To Standards When we know what good performance is. Comparing Performance

27. 2. To Others When it is a fair apples/apples comparison. 3. To Standards When we know what good performance is. Comparing Performance 1. To Ourselves First Can we do better than our own history? Using a Baseline CHART ON THE WALL

28. CHARTS on the WALL

30. CHARTS ON THE WALL

32. Comparing Performance 1. To Ourselves First Can we do better than our own history? 2. To Others When it is a fair apples/apples comparison. Reward?Punish? 3. To Standards When we know what good performance is.

33. 1. To Ourselves First Can we do better than our own history? 2. To Others When it is a fair apples/apples comparison. Comparing Performance 3. To Standards When we know what good performance is.

34. Advanced Baseline Display Your Baseline Comparison Baseline Goal (line) Target or Standard Instead: Count anything better than baseline as progress. Avoid publicly declaring targets by year if possible. ● Create targets only when they are: FAIR & USEFUL x Aspiration NOT Punishment

35. © The Farside 1989 " Bummer of a Birthmark Hal "

36. How much did we do? Program Performance Measures How well did we do it? Is anyone better off? Quantity Quality Effect Effort # %

37. How much did we do? Performance Accountability Types of Measures found in each Quadrant How well did we do it? Is anyone better off? # Clients/customers served # Activities (by type of activity) % Common measures e.g. client staff ratio, workload ratio, staff turnover rate, staff morale, % staff fully trained, % clients seen in their own language, worker safety, unit cost % Skills / Knowledge (e.g. parenting skills) # % Attitude / Opinion (e.g. toward drugs) # % Behavior (e.g.school attendance) # % Circumstance (e.g. working, in stable housing) # % Activity-specific measures e.g. % timely, % clients completing activity, % correct and complete, % meeting standard Point in Time vs. 2 Point Comparison # %

38. How much did we do? HR / Personnel How well did we do it? Is anyone better off? Quantity Quality Effect Effort Number of Applicants Processed Average Recruitment Period Workforce New Hires Workforce Turnover Rate (non-promotions) Customer Satisfaction * * Percent of supervisory staff who report that personnel provides the support they need to do their jobs.

39. How much did we do? Audit How well did we do it? Is anyone better off? Quantity Quality Effect Effort Number of audits completed Percent of audits on schedule Rate of repeat findings $ value of corrected audit findings as percent of total agency budget ####

40. How much did we do? Service: __________________________________ How well did we do it? Is anyone better off? Primary customers # studentspatients persons trained Primary activity # hours of instruction diagnostic testsjob coursesalarms responded to If your service works really well, how are your customer's better off? # students who graduate patients who fully recover fires kept to room of origin % Unit cost Workload ratio % of ___x___ that happen on time persons who get jobs School HospitalJob Training Fire Department

41. How much did we do? Choosing Headline Measures and the Data Development Agenda How well did we do it? Is anyone better off? Quantity Quality Effect Effort # Measure 1 ---------------------------- # Measure 2 ---------------------------- # Measure 3 ---------------------------- # Measure 4 ---------------------------- # Measure 5 ---------------------------- # Measure 6 ---------------------------- # Measure 7 ---------------------------- #1 Headline #2 Headline #3 Headline #1 DDA #2 DDA #3 DDA % Measure 8 ---------------------------- % Measure 9 ----------------------------- % Measure 10 --------------------------- % Measure 11 --------------------------- % Measure 12 --------------------------- % Measure 13 --------------------------- % Measure 14 --------------------------- # Measure 15 ---------------------------- # Measure 16 ---------------------------- # Measure 17 ---------------------------- # Measure 18 ---------------------------- # Measure 19 ---------------------------- # Measure 20 ---------------------------- # Measure 21 ---------------------------- % Measure 15 ---------------------------- % Measure 16 ---------------------------- % Measure 17 ---------------------------- % Measure 18 ---------------------------- % Measure 19 ---------------------------- % Measure 20 ---------------------------- % Measure 21 ----------------------------

42. Select 3 to 5 Performance Measures ACROSS THE BOTTOM OF THE ORG CHART 3 - 5 20 – 60 – 20 Rule

43. LR UR Primary v. Secondary Direct v. Indirect Internal v. External Baseline & Story

48. New Mexico Christus St. Vincents Medical Center

49. Next Generation Contracting

50. Next Generation Contracting Contract Provisions Provision 1. Specify the 3 to 5 most important performance measures (from the How well did we do it? and Is anyone better off? categories). Provision 2. Specify that the contractor will use a continuous improvement process (the RBA 7 Questions). Provision 3. Specify how the funder and contractor will work in partnership to maximize LR customer results (quarterly meetings using the 7 questions as the agenda). Provision 4. Specify that the funder will work with the funding community to simplify and standardize contracting and performance reporting.

51. Provision 5: : Clear articulation of role in population/community well-being using the language of contribution not attribution. Provision 6: 10% for quality management and administration. Provision 7: Multi-year funding using 3 year rolling contracts Provision 8: Use of targets that are fair and useful. Provision 9: Fund flexibility and virtual funding pool: transfer of up to 10% across line items and program lines. Provision 10: Request for Results: Getting past the sometimes negative effects of competitive RFP contracting or tendering. Next Generation Contracting Contract Provisions

52. “Data is the unblinking eye of reform.” Barbary Curley, Area Director, Hyde Park Office, Boston

56. How Population & Performance Accountability FIT TOGETHER

57. Contribution relationship Alignment of measures Appropriate responsibility THE LINKAGE Between POPULATION and PERFORMANCE POPULATION ACCOUNTABILITY Healthy Births Rate of low birth-weight babies Stable Families Rate of child abuse and neglect Children Ready for School Percent fully ready per K-entry assessment CUSTOMER RESULTS # of women served % attendance Unit cost # low birth-weight births (for participating women) PERFORMANCE ACCOUNTABILITY POPULATION RESULTS Pre-natal Nutrition Program % low birth-weight births (for participating women)

58. Performance measure Population Indicator

59. Every time you present your program, Use a two-part approach. Result: to which you contribute to most directly. Indicators: Story: Partners: What would it take?: Your Role: as part of a larger strategy. Population Accountability Program: Performance measures: Story: Partners: Action plan to get better: Performance Accountability Your Role

60. Result: to which you contribute to most directly. Indicators: Story: Partners: What would it take?: Your Role: within the larger strategy. Population Accountability Program: Performance measures: Story: Partners: Action plan to get better: Performance Accountability Your Role Every time you present your program, Use a two-part approach.

61. Every time you present your program, Use a two-part approach. Result: to which you contribute to most directly. Indicators: Story: Partners: What would it take?: Your Role: as part of a larger strategy. Population Accountability Program: Performance measures: Story: Partners: Action plan to get better: Performance Accountability Your Role Shortcut

62. The Special Case of Prevention Programs (Read page 100)

64. Result: HEALTHY PEOPLE. Indicator: Story: Partners: What would it take to significantly reduce this rate? Your Role = Smoking Prevention Program + Population Accountability Program: Performance measures: Story: Partners: Action plan to get better: Smoking Prevention Program Your Role - % youth in HS assembly who change attitudes about tobacco - Ad campaign effectiveness in hitting target audience (# reached by % target demographic) Performance Accountability Contribution

65. Different Kinds of Progress 1. Data a. Population indicators Actual turned curves: movement for the better away from the baseline. b. Program performance measures: customer progress and better service: How much did we do? How well did we do it? Is anyone better off? 2. Accomplishments: Positive activities, not included above. 3. Stories behind the statistics that show how individuals are better off.

66. Board of Directors Meeting AGENDA 1. New data 2. New story behind the curves 3. New partners 4. New information on what works. 5. New information on financing 6. Changes to action plan and budget 7. Adjourn 1. New data 2. New story behind the curves 3. New partners 4. New information on what works. 5. New information on financing 6. Changes to action plan and budget 7. Adjourn

67. SUMMARY

69. 3 - kinds of performance measures. How much did we do? How well did we do it? Is anyone better off? RBA in a Nutshell 2 – 3 - 7 2 - kinds of accountability Population accountability Performance accountability 7 - questions from ends to means in less than an hour. plus language discipline Results & Indicators Performance measures Baselines & Turning the Curve

70. “If you do what you always did, you will get what you always got.” Kenneth W. Jenkins President, Yonkers NY NAACP

71. “We will succeed together… or fail separately.” - Winston Churchill or - Sonny and Cher

73. THANK YOU ! Book - DVD Orders amazon.com resultsleadership.org

76. EXERCISES

77. Creating a Working Baseline from Group Knowledge Now Indicator or Performance Measure 65% Not OK? Backcasting Forecasting

78. Turn the Curve Exercise: Program Performance 5 min:Starting Points - timekeeper and reporter - identify a program to work on - two hats (yours plus partner’s) 10 min:Performance measure baseline - choose 1 measure to work on – from the lower right quadrant - forecast (to 2017 ) – OK or not OK? 15 min:Story behind the baseline - causes/forces at work - information & research agenda part 1 - causes 15 min:What works? (What would it take?) - what could work to do better? - each partners contribution - no-cost / low-cost ideas - information & research agenda part 2 – what works 10 min:Report convert notes to one page Two pointers to action

79. Program: _______________ Performance Measure (Lay definition) Performance Measure Baseline Story behind the baseline --------------------------- --------------------------- (List as many as needed) Partners --------------------------- --------------------------- (List as many as needed) Three Best Ideas – What Works 1. --------------------------- 2. --------------------------- 3. ---------No-cost / low-cost ONE PAGE Turn the Curve Report: Performance Sharp Edges 4. --------- Off the Wall

80. Turn the Curve Exercise – Lessons Talk to Action in an hour 1. How was this different from other processes? What worked and what didn’t work? 2. Why did we ask for: a. Results before indicators? b. Forecast? c. Story? d. No cost / low cost? e. Two hats? f. Crazy idea? g. Only 3 best ideas? 3. Do you think a lay audience could understand the reports? 4. How many think you could lead this exercise with a small group? (2+ curves at the same time)

81. Next Steps: 1. What’s one thing I could personally do with what I learned today? 2. What’s one thing I would like to ask someone else to do to support this work?

82. Resources Book - DVD Orders amazon.com resultsleadership.org www.raguide.org www.resultsaccountability.com RBA Facebook Group

83. My question is: Are we making an impact? My question is: Are we making a contribution?

84. - Dave Barry Never be afraid to try something new. Remember that a lone amateur built the Ark. A large group of professionals built the Titanic.

85. THANK YOU ! Book - DVD Orders amazon.com resultsleadership.org

87. Alternative to Traditional Evaluation Methods: DEMONSTRATING a CONTRIBUTION to complex change efforts… requires 3 elements: A Curve to Turn 1 We tried a bunch of stuff that had a credible chance of making a difference … 2 …and it had a timely relationship to…. 3 …. a turn in the curve. c FPSI