1. RBA Results-Based Accountability The Fiscal Policy Studies Institute resultsaccountability.com raguide.org Book - DVD Orders amazon.com resultsleadership.org TM MASTER CLASS

2. PURPOSES of a Master Class 1. LEARN NEW STUFF 2. MEET NEW PEOPLE 3. SHARE WHAT YOU'VE LEARNED 4. ASK QUESTIONS IN A SAFE ENVIRONMENT

3. RBA is a Conversation. Work in Pairs Work as Tables

4. NOTES Write down: 1. What do you want to get out of this workshop? 2. What is your "How do we….?" question? (on cards)

5. Another View of the Agenda o Welcome & Introductions o Selecting Performance Measures o 3 RBA Success Stories o LUNCH o Performance Turn the Curve Exercise o How do we…? Questions Round 2 o Next Steps & Closing o How do we…? Questions Round 1 o Open Space – Tough Questions

6. RBA REVIEW

7. 3 - kinds of performance measures. How much did we do? How well did we do it? Is anyone better off? RBA in a Nutshell 2 – 3 - 7 2 - kinds of accountability Population accountability Performance accountability 7 - questions from ends to means in less than an hour. plus language discipline Results & Indicators Performance measures Baselines & Turning the Curve

8. The Simplest Way TO IMPLEMENT RBA POPULATION ACCOUNTABILITY 1. Pick an important indicator curve 2. Run the Population Turn the Curve Exercise 3. Take action Repeat PERFORMANCE ACCOUNTABILITY 1. Pick an important performance measure curve 2. Run the Performance Turn the Curve Exercise 3. Take action Repeat

9. How to choose Performance Measures

11. Select 3 to 5 Performance Measures ACROSS THE BOTTOM OF THE ORG CHART 3 - 5

12. How much did we do? Performance Accountability Types of Measures found in each Quadrant How well did we do it? Is anyone better off? # Clients/customers served # Activities (by type of activity) % Common measures e.g. client staff ratio, workload ratio, staff turnover rate, staff morale, % staff fully trained, % clients seen in their own language, worker safety, unit cost % Skills / Knowledge (e.g. parenting skills) # % Attitude / Opinion (e.g. toward drugs) # % Behavior (e.g.school attendance) # % Circumstance (e.g. working, in stable housing) # % Activity-specific measures e.g. % timely, % clients completing activity, % correct and complete, % meeting standard Point in Time vs. 2 Point Comparison # %

13. How much did we do? Choosing Headline Measures and the Data Development Agenda How well did we do it? Is anyone better off? Quantity Quality Effect Effort # Measure 1 ---------------------------- # Measure 2 ---------------------------- # Measure 3 ---------------------------- # Measure 4 ---------------------------- # Measure 5 ---------------------------- # Measure 6 ---------------------------- # Measure 7 ---------------------------- #1 Headline #2 Headline #3 Headline #1 DDA #2 DDA #3 DDA % Measure 8 ---------------------------- % Measure 9 ----------------------------- % Measure 10 --------------------------- % Measure 11 --------------------------- % Measure 12 --------------------------- % Measure 13 --------------------------- % Measure 14 --------------------------- # Measure 15 ---------------------------- # Measure 16 ---------------------------- # Measure 17 ---------------------------- # Measure 18 ---------------------------- # Measure 19 ---------------------------- # Measure 20 ---------------------------- # Measure 21 ---------------------------- % Measure 15 ---------------------------- % Measure 16 ---------------------------- % Measure 17 ---------------------------- % Measure 18 ---------------------------- % Measure 19 ---------------------------- % Measure 20 ---------------------------- % Measure 21 ----------------------------

14. Three Part List of Performance Measures Part 1: Primary Measures Part 2: Secondary Measures Part 3: Data Development Agenda ● 3 to 5 “Headline” Indicators ● How to explain this service's performance ● Everything else that’s any good (Nothing is wasted.) ● Used later in the Story behind the Curve ● New data ● Data in need of repair (quality,timeliness etc.)

15. Select 3 to 5 Performance Measures ACROSS THE BOTTOM OF THE ORG CHART 3 - 5

16. BREAK

17. SUCCESS STORIES What has changed? Lessons learned? Questions & Comments

18. How do we…? Questions Round 1

19. LUNCH

20. OPEN SPACE Small Groups Large Group Lessons & Questions

21. OPEN SPACE Small Groups Large Group Lessons & Questions

22. BREAK

23. Performance Turn the Curve Exercise

24. The Simplest Way TO IMPLEMENT RBA POPULATION ACCOUNTABILITY 1. Pick an important indicator curve 2. Run the Population Turn the Curve Exercise 3. Take action Repeat PERFORMANCE ACCOUNTABILITY 1. Pick an important performance measure curve 2. Run the Performance Turn the Curve Exercise 3. Take action Repeat

25. Creating a Working Baseline from Group Knowledge Now Indicator or Performance Measure 65% Not OK? Backcasting Forecasting

26. Turn the Curve Exercise: Program Performance 5 min:Starting Points - timekeeper and reporter - identify a program to work on - two hats (yours plus partner’s) 10 min:Performance measure baseline - choose 1 measure to work on – from the lower right quadrant - forecast (to 2017 ) – OK or not OK? 15 min:Story behind the baseline - causes/forces at work - information & research agenda part 1 - causes 15 min:What works? (What would it take?) - what could work to do better? - each partners contribution - no-cost / low-cost ideas - information & research agenda part 2 – what works 10 min:Report convert notes to one page Two pointers to action

27. Program: _______________ Performance Measure (Lay definition) Performance Measure Baseline Story behind the baseline --------------------------- --------------------------- (List as many as needed) Partners --------------------------- --------------------------- (List as many as needed) Three Best Ideas – What Works 1. --------------------------- 2. --------------------------- 3. ---------No-cost / low-cost ONE PAGE Turn the Curve Report: Performance Sharp Edges 4. --------- Off the Wall

28. Turn the Curve Exercise – Lessons Talk to Action in an hour 1. How was this different from other processes? What worked and what didn’t work? 2. Why did we ask for: a. Results before indicators? b. Forecast? c. Story? d. No cost / low cost? e. Two hats? f. Crazy idea? g. Only 3 best ideas? 3. Do you think a lay audience could understand the reports? 4. How many think you could lead this exercise with a small group? (2+ curves at the same time)

29. How do we…? Questions Round 2

30. Next Steps Evaluation & Closing

31. THANK YOU ! Book - DVD Orders amazon.com resultsleadership.org

33. Supplementary Slides

34. Self Assessment Questionnaire Write score anonymously on cards.

36. Two lessons One Question Put your score (anonymously) on a card and hand it in. We'll show you a distribution of scores later.

37. PERFORMANCE 20-MINUTE EXERCISE If we have time:

38. 2 customers 1 measure Discuss how we’re doing 2 partners 2 what works ideas (1 nc/lc) Discuss how to implement 20 Minute Exercise 40

39. Next Generation Contracting 1. Pick one (or more) provisions 2. Discuss how it should be implemented 3. LESSONS & QUESTIONS

40. Next Generation Contracting Contract Provisions Provision 1. Specify the 3 to 5 most important performance measures (from the How well did we do it? and Is anyone better off? categories). Provision 2. Specify that the contractor will use a continuous improvement process (the RBA 7 Questions). Provision 3. Specify how the funder and contractor will work in partnership to maximize LR customer results (quarterly meetings using the 7 questions as the agenda). Provision 4. Specify that the funder will work with the funding community to simplify and standardize contracting and performance reporting.

41. Provision 5: : Clear articulation of role in population/community well-being using the language of contribution not attribution. Provision 6: 10% for quality management and administration. Provision 7: Multi-year funding using 3 year rolling contracts Provision 8: Use of targets that are fair and useful. Provision 9: Fund flexibility and virtual funding pool: transfer of up to 10% across line items and program lines. Provision 10: Request for Results: Getting past the sometimes negative effects of competitive RFP contracting or tendering. Next Generation Contracting Contract Provisions

42. A (very) BRIEF DISCUSSION OF RESULTS-BASED BUDGETING

43. RESULTS BASED BUDGETING Do we need it? Is it working? POPULATION ACCOUNTABILITY PERFORMANCE ACCOUNTABILITY

44. THE VERMONT ACCOUNTABILITY COMPACT - Read the Compact - Would you sign an AU or NZ version of this? - How would you change it? - Do you think it would help?

48. How much did we do? Service: __________________________________ How well did we do it? Is anyone better off? Primary customers # studentspatients persons trained Primary activity # hours of instruction diagnostic testsjob coursesalarms responded to If your service works really well, how are your customer's better off? # students who graduate patients who fully recover fires kept to room of origin % Unit cost Workload ratio % of ___x___ that happen on time persons who get jobs School HospitalJob Training Fire Department

50. 1. Identify one service. 2. Identify the primary customer group. 3. What are you doing that is most effective in improving the lives of your customers? 4. What is least effective? (Least harm cut candidates) 5. How could you change the way you do your work so as to make the same, or close to the same, contribution with less resources? (Least harm cut candidates) - Time: 5 minutes for each question - Record answers for each question. - Report 3 best ideas and reasoning RBA/OBA Least Harm Cutback Exercise 2: PERFORMANCE Least harm to CUSTOMERS' quality of life (Performance Accountability)

51. 1. Identify a population result/outcome to which your organization most directly contributes. (e.g. Healthy People, Sustainable Environment, Children Ready for School) 2. What is your organization's role in contributing to this result/outcome? 3. What do you do that causes the greatest contribution? 4. What do you do that causes the least contribution? (Least harm cut candidates) 5. How could you change the way you do your work so as to make the same, or close to the same, contribution with less resources? (Least harm cut candidates) - Time: 5 minutes for each question - Record answers for each question. - Report 3 best ideas and reasoning RBA/OBA Least Harm Cutback Exercise 1: POPULATION Least harm to POPULATION quality of life (Population Accountability)