Outcome Based Accountability Adapted for Luton Children’s Services by: Carole Brooks Performance Review Manager Children & Learning Department, Luton Borough.

Slides:



Advertisements
Similar presentations
Outcome Based Accountability (OBA) The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Books & DVDs amazon.com resultsleadership.org.
Advertisements

Outcome Based Accountability Fiscal Policy Studies Institute Santa Fe, New Mexico WEBSITES BOOK ORDERS
Outcome Based Accountability Fiscal Policy Studies Institute Santa Fe, New Mexico WEBSITES BOOK ORDERS
Results/Outcomes Based Accountability Based on the Work of Mark Friedman Trying Hard is Not Good Enough (Working smarter not harder)
Making Your Work Count: Results Based Accountability in Community Schools Karen Finn, Senior Consultant
Results/Outcomes Based Accountability
1 Facilitators: Lorna McCue and Pam Kinzie, HC Link Guest Presenter: Andrew Taylor, Taylor Newbury Consulting Results-Based Accountability for community.
Results-Based Accountability (RBA) The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.
Maggie Carter Assistant Director, Learner & Family Support
Multi-agency group for Children and Young People in Care
A. Support for key statutory services Grants ProgrammesFunding CategoriesCriteria 2. Youth Work Chart of Grant Programmes, Funding Categories and Priority.
How Do Current United Way and Region of Peel Investments Align with the Population Results?
The Simplest Way TO IMPLEMENT RBA POPULATION ACCOUNTABILITY 1. Pick an important indicator curve 2. Run the Population Turn the Curve Exercise 3. Take.
Sue Richards CEO NSW Family Services (FamS) Sue Richards Managing Director Results Leadership Group Australia.
UNLEASH the POWER of the Results-Based Accountability.
Outcome Based Accountability ‘From Talk to Action’ David Burnby
Outcomes Based Accountability The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.
RBA 101 – OBA 101 Some NEW AND REVISED SLIDES 30 AUG 2013 FPSI RBA OBA Facebook.
Results Accountability The Fiscal Policy Studies Institute Santa Fe, New Mexico Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
1 Welcome! Building Assets of People, Families and Communities “What Do Outcomes Have to do with It?” Jessie Ball duPont Fund October 28-30, 2008.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
“If I include you, you will be my partner.
Measuring the Impact of Service Delivery Through Outcomes - Focused Planning and Partnership Working Parvinder Chana 2009.
Health inequalities post 2010 review – implications for action in London London Teaching Public Health Network “Towards a cohesive public health system.
Turning the curve: children’s services and outcomes based accountability Jacky Tiotto Deputy Director, Government Office planning and performance support,
Results Based Accountability is made up of two parts: Performance Accountability about the well-being of CUSTOMER POPULATIONS For Programs – Agencies –
Extended Services and all that February
Joint Area Review Overview. What is a JAR? Q. What is a Joint Area Review (JAR)? A. A JAR provides a comprehensive report on the outcomes for children.
1 Outcomes Focussed Practice; the Paradigm shift in Public Services Rob Hutchinson, CBE April 2007 Based on Results Based Accountability
14 – 24 Learning and Skills Strategy (24) KCC / YPLA Strategy & Funding Briefing 14 – 24 Learning and Skills Strategy Delivering Bold Steps A new.
Connecticut General Assembly Committee on Children Rep. Diana Urban, Co-Chair CT KIDS REPORT CARD July 24, 2013 Our Desired Result: All Connecticut children.
CHCORG610B Mange Change in a community sector organisation CHCCS503A Develop, implement and review services and programs to meet client needs
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
Outcomes-Based Accountability “Turning the Curve” The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders.
Commissioning Self Analysis and Planning Exercise activity sheets.
STOP SPINNING YOUR WHEELS: USING RBA TO STEER YOUR AGENCY TO SUCCESS! Anne McIntyre-Lahner Director of Performance Management Connecticut Department of.
Every Child Matters. Every Child Matters Support Services Parents and Carers The Church Community Teachers and Educators Families Health Professionals.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
PERFORMANCE ACCOUNTABILITY. Results-Based Accountability is made up of two parts: Performance Accountability is about the well-being of CUSTOMER POPULATIONS.
Results-Based Accountability (RBA) The Fiscal Policy Studies Institute Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com resultsleadership.org.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
Results Based Accountability Basics An Introduction to RBA Standard Training Slides Sponsored by the Ministry of Social Development.
Kimberly Scott, Literacy Funders Network Adam Luecking, Results Leadership Group Nina Sazer O’Donnell, National Results and Equity Collaborative Michael.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
Results Based Accountability Basics An Introduction to RBA Standard Training Slides Sponsored by the Ministry of Social Development.
Achieving Family Economic Success with the People We Serve Using Results Based Accountability United Way of Greater New Haven Annie E. Casey Foundation.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
Helping Families update Scrutiny Select Committee Meeting March 2013 Nick Page.
Joining the Dots… The Children’s Plan: National Strategy – Local Delivery Steve Walker Principal Consultant Children and Young People.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
Ambition, confidence and risk: holding our nerve in difficult times Andrew Cozens Strategic Adviser, Children Adults & Health Services SSRG Annual Workshop.
RBA Results-Based Accountability The Fiscal Policy Studies Institute Book - DVD Orders amazon.com resultsleadership.org.
@theEIFoundation | eif.org.uk Early Intervention to prevent gang and youth violence: ‘Maturity Matrix’ Early intervention (‘EI’) is about getting extra.
Service Accountability for programs, agencies and service systems.
Results Based Accountability. Overview of Results Based Accountability The context of the development of Results Based Accountability in New Zealand An.
Results Based Accountability The Fiscal Policy Studies Institute Santa Fe, New Mexico 1.
Results Accountability The Fiscal Policy Studies Institute Santa Fe, New Mexico Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com.
A Vision for the future of partnerships in Ealing?: the principles Review of the Local Strategic Partnership Initial Report to LSP Executive 26 May 2010.
RBA Results-Based Accountability The Fiscal Policy Studies Institute resultsaccountability.com raguide.org Book - DVD Orders amazon.com resultsleadership.org.
Results Accountability The Fiscal Policy Studies Institute Santa Fe, New Mexico Websites raguide.org resultsaccountability.com Book - DVD Orders amazon.com.
Results Based Accountability Workshops Older People Co-ordinators 20 th, 22 nd & 30th June 2011 Ffynnon Knowledge Management & Business Change Programme.
Tackling Health Inequalities using Outcome Based Accountability with a focus on BME communities David Burnby This presentation is.
Commissioning for Wellbeing Time banking and other initiatives in Plymouth Rachel Silcock.
‘It’s not always about funding and resources; it’s about working better together. As we’ve got areas of common interest if we can just coordinate our services.
Be healthy Stay safe Enjoy and achieve Make a positive contribution Achieve economic well-being.
Achieving Outcomes – Choosing Targets and Making a Difference Lynne Dean DH/CSIP.
Results Based Accountability
Presentation transcript:

Outcome Based Accountability Adapted for Luton Children’s Services by: Carole Brooks Performance Review Manager Children & Learning Department, Luton Borough Council September 2008

Mark Friedman Fiscal Policy Studies Institute Sante Fe, New Mexico

Purpose Improve outcomes Offer a partnership way of working that helps move from:  outcomes to needs analysis  to inter-agency service planning and development  to joint commissioning.

Why is it so good? Adopted by government agencies (including IdEA) Widely used in the US Used within many local authorities already Simple, flexible Common language, common sense, common ground

The Language Trap Too many terms, Too few definitions, Too little discipline Benchmark Target Indicator Goal Result Objective Outcome Measure Modifiers MeasurableCore UrgentQualitative PriorityProgrammatic TargetedPerformance IncrementalStrategic Systemic Systemic

Outcome Accountability is made up of two parts: Population Accountability about the well-being of WHOLE POPULATIONS for neighbourhoods – districts – regions - countries Performance Accountability About the well-being of CLIENT POPULATIONS for projects – agencies – service providers

Definitions Outcomes Indicators Performance Measures

Definition: OUTCOMES “A condition of well-being for children, adults, families or communities.” Children born healthy Children succeeding in school Safe communities Clean Environment Prosperous Economy Stated in plain language that people can understand Not about government jargon “A condition of well-being for people in a place......” E.g. “All Babies in Luton are born healthy”

Outcomes for Communities: Healthy Births Healthy Children and Adults Children Ready for School Children Succeeding in School Young People Staying Out of Trouble Stable Families Families with Adequate Income Safe and Supportive Communities

Every Child Matters Outcomes Being Healthy: enjoying good physical and mental health and living a healthy lifestyle. Staying Safe: being protected from harm and neglect and growing up able to look after themselves. Enjoying and Achieving: getting the most out of life and developing broad skills for adulthood. Making a Positive Contribution: to the community and to society and not engaging in anti-social or offending behaviour. Economic Well-being: overcoming socio-economic disadvantages to achieve their full potential in life.

Definition: INDICATORS A measure which helps quantify the achievement of an outcome. Rate of low birth weight babies Key stage test scores Burglary rate Air quality index Life expectancy rates How would we recognise these outcomes in measurable terms if we tripped over them? E.g. Low burglary rate helps to quantify a safe community

Definition: PERFORMANCE MEASURES A measure to evaluate how well a programme, agency or service system is working. Performance measures tell us how well service providers are working as opposed to the impact on whole populations (i.e. outcomes)

From ends to means... ENDS OUTCOMES “A condition of well-being for children, adults, families or communities” PERFORMANCE MEASURES “A measure to evaluate how well a programme, agency or service system is working” MEANS INDICATORS “A measure which helps quantify the achievement of an outcome” Population Accountability Performance Accountability

Outcome, Indicator or Performance Measure? 1. Safe Community 2. Crime Rate 3. Average Police Response Time 4. A graffiti free community 5. % of buildings surveyed without graffiti 6. Children staying safe 7. Incidences of child abuse 8. Number of abuse investigations completed Outcome Indicator P.Measure Indicator P.Measure

MEANS not ENDS: Collaboration (eg Local Strategic Partnership) System Reform (eg Progressing Integration Project) Service Integration (eg Children’s Trusts) Funding pools (eg Pooled Budgets) Strategies and Plans (eg Sustainable Community Strategy, Children and Young People Plan, Local Area Agreement) (to improving outcomes) (in themselves)

The Leaking Roof Inches of Water Time Experience Measure Story behind the baseline (causes) Partners What Works? Action Plan (Strategy) Forecast

OUTCOME “Children Being Healthy” INDICATORS Measures of the outcome 1.Infant mortality rate 2.Use of Class A Drugs 3.% Teenage Smokers BASELINES Where we’ve been Where we’re going Where we want to be STORY Behind the baselines The causes, the forces at work What’s driving the baselines? PARTNERS With a role to play Public, Private and Voluntary Sector Community groups Residents WHAT WORKS What would it take to turn the curve? Best practice Best hunches ACTION PLAN What we propose to do, how and by when Data Development Agenda (Pt 1) Data Development Agenda (Pt 2)

The 7 Population Accountability Questions 1. What are the quality of life conditions we want for the children, adults and families who live in our community? 2. What would these conditions look like if we could see them? 3. How can we measure these conditions? 4. How are we doing on the most important of these measures? 5. Who are the partners that have a role to play in doing better? 6. What works to do better, including no cost/low cost ideas? 7. What do we propose to do?

Using The Framework The outcome required State who is your population The indicators measuring this The story behind the baseline Data development agenda Key Partners Ideas to improve

Turning the Curve – report card workshop 10 mins: Starting Points Consider your theme and vulnerable group Decide what “hats” you are going to wear to ensure all key partners have a say 10 mins: Establish Your Baseline Identify your indicators. Speculate on the forecast and draw the curve to turn 30 mins: The Story Behind The Baseline What are the causes/forces at work? What factors are driving the baseline (Data Development Agenda) 30 mins: What Would It Take To Turn The Curve? What could work to do better? Each partners contribution No cost/low cost ideas 10 mins: Reivew your report and create action plan Baseline, Story, 3 best ideas (including one no cost/low cost idea) Start your action plan 10 mins: Plan to continue the work after today

Choosing Indicators Communication Power  Does the indicator communicate to a broad range of audiences? Proxy Power  Does the indicator say something of central importance about the outcome?  Does the indicator bring along the data HERD? Data Power  Is quality data available on a timely basis?

Outcome _______________________ Candidate Indicators Communication Power Proxy Power Data Power H M L H Measure 1 Measure 2 Measure 3 Measure 4 Measure 5 Measure 6 Measure 7 Measure 8 H Staying Safe H M L H M L H H H L Criteria for Choosing Indicators Data Development Agenda (Pt 1)

Criteria for Choosing Indicators Part 1:Primary Indicators  Does the indicator communicate to a broad range of audiences? Part 2:Secondary Indicators  Everything else that’s any good (Nothing is wasted.)  Used to help inform intelligence information Part 3:Data Development Agenda  New data  Data in need of repair (quality, timeliness etc.)

The Matter of Baselines H M L HistoryForecast Point to Point Improvement Turning the Curve Baselines have two parts: and forecast history OK?

Speculating on a base line Choose an indicator (e.g. under 18 conception rate)  Start with NOW “Backcasting” Where have we been? OK? The curve to turn Number Time  Forecasting Where are we going?

Story behind the baseline What are the policies are strategies? How does the process work? What factors are driving the baseline? What is research telling us? What is the history? What are the causes/forces at work Data Development Agenda: Any further data needs or information not available

Key Partners Who are the stakeholders that can have an effect on the outcome or that the outcome affects? Are they engaged in this process? How will you get them engaged?

Ideas to improve What would it take to “turn the curve”? What is best practice? What actions can be put in place to improve the outcome? Include at least one low cost/ no cost Include at least one “off the wall” Try and include one “quick win” Have ideas from all partners been included (including customers) Think SHARP

Sharp Edges SPECIFIC Is it specific enough? LEVERAGE How much difference will it make? VALUES Is it consistent with our personal and community values? REACH Is it feasible and affordable?

NOW ACTION & IMPROVE! Finalise action plan: What do we propose to do? How much will it cost? Are funds available? Ensure actions have a responsible person, timescale, costed How will you measure progress? Implement: Ensure all stakeholders are aware of actions required and take responsibility for their actions Review: How much did we do? How well did we do it? Is anyone better off?

Performance Accountability For programs, agencies and service systems

“All Performance Measures that have ever existed for any program in the history of the universe involve answering two sets of interlocking questions….”

Programme Performance Measures QUANTITYQUALITY How Much did we do? (number) How Well did we do it? (percent)

Programme Performance Measures Effort How hard did we try? Effect Is anyone any better off?

Programme Performance Measures How much service did we deliver? How well did we deliver it? How much change/effect did we produce? What quality of change/effect did we produce? QUANTITYQUALITY EFFORT EFFECT INPUT OUTPUT Cause Effect

Programme Performance Measures How much did we do? How well did we do it? QUANTITYQUALITY EFFORT EFFECT Is anyone better off? Number Percentage

Education QUANTITYQUALITY EFFORT EFFECT How much did we do? How well did we do it? Is anyone better off? Number of Students Pupil/Student Ratio Number of 16 year olds with 5 A to C GCSEs Number with good school attendance Percentage of 16 year olds with 5 A to C GCSEs Percentage with good school attendance

Health Clinic QUANTITYQUALITY EFFORT EFFECT How much did we do? How well did we do it? Is anyone better off? Number of Patients Treated Percentage of patients treated in less than one hour Recovery Number (for patients of the clinic) Recovery rate (for patients of the clinic)

Fire and Rescue Service QUANTITYQUALITY EFFORT EFFECT How much did we do? How well did we do it? Is anyone better off? Number of Respondents Response Time Number of Fire Related Deaths (in catchment area) Rate of Fire Related Deaths (in catchment area)

General Motors QUANTITYQUALITY EFFORT EFFECT How much did we do? How well did we do it? Is anyone better off? Number of Production Hours Number of tons of steel Employees per vehicle produced Number of Cars Sold Amount of Profit Residual Value after 2 years % Market Share Profit per Share % Residual Value after 2 years

Customer Satisfaction QUANTITYQUALITY EFFORT EFFECT How well did we do it? How much did we do? How much change/effect did we produce? What quality of change/effect did we produce? Did we treat you well? Did we help You with your problems? (The world’s simplest and yet complete customer satisfaction survey)

Not All Performance Measures Are Created Equal... QUANTITYQUALITY EFFORT EFFECT How much did we do? How well did we do it? Is anyone better off? LEAST important Also Very Important MOST important

The Matter of Control QUANTITYQUALITY EFFORT EFFECT How much did we do? How well did we do it? Is anyone better off? MOST control LESS control We have the least control over the most important matters

Matter of Use First purpose is to improve results and services. Avoid the “performance measurement equals punishment” trap Acknowledge the experience as real. Work to create a healthy service improvement culture that sees performance measurement as a means to an end, not the end. Don’t create perverse measures that can be ‘fixed’ or don’t reflect what you are trying to measure. If possible, use a balanced set of measures.

Comparing Performance 1. To ourselves first Can we do any better than our own history? 3. To standards When we know what good performance is Using a baseline, Chart on the Wall 2. To others When it’s a FAIR apples/apples comparison Reward? Punish?

The Matter of Standards Quantity Effect Effort 1. Quality of Effort Standards are sometimes WELL ESTABLISHED Childcare staffing ratios Application processing times Disability access facilities Child abuse report response times 2. Quality of Effect Standards are almost always EXPERIMENTAL Hospital recovery rates Employment placement and retention rates Recidivism rates 3. Both require a LEVEL PLAYING FIELD and an ESTABLISHED RECORD of what good performance is. BUT AND

Advanced Baselines Outcome (line) Target or Standard Your Baseline Comparison Baseline Avoid publicly declaring Targets by year if possible Instead: Count anything better than baseline as progress Indicator (Units) Timeline (Years) Create Targets only where they are FAIR and USEFUL

Summary of Performance Measures How much did we do?How well did we do it? Number of Customers served (by customer characteristic) Number of Activities (by type of activity) % Common measures Workload ratio, staff turnover rate, staff morale, percentage of staff fully trained, worker safety, unit cost, customer satisfaction: Did we treat you well? Etc. % Activity Specific Measures Percentage of actions timely and correct, percentage clients completing activity, percentage of actions meeting standards etc. (Percentage) Skills/Knowledge Attitude/Opinion Including customer satisfaction Did we help you with your problems? Behaviour Circumstances ( Quantity) Skills/Knowledge Attitude/Opinion Behaviour Circumstances Is anyone better off?

Performance Accountability: Getting from Talk to Action Customers Story behind the baselines (Information and Research Agenda about Causes) Partners What works (Information & Research Agenda about Solutions) Strategy and Action Plan Criteria How much did we do? How well did we do it? Is anyone better off? Turned Curve Trend (Data Development Agenda) Performance Measures Baselines

The 7 Performance Accountability Questions 1. Who are our customers? 2. How can we measure if our customers are better off? (Lower Right Quadrant Measures) 3. How can we measure if we are delivering services well? (Upper Right Quadrant measures) 4. How are we doing on the most important of these measures? 5. Who are our partners that have a role to play in doing better? 6. What works to do better, including no-cost and low-cost ideas? 7. What do we propose to do?

Identifying Performance Measures: The Five Step Method How much did we do?How well did we do it? Number of customers served (by customer characteristic) Number of Activities (by type of activity) (Percentage) (Quantity) Is anyone better off? % Common Measures % Activity measures 12 33

Identifying Performance Measures: The Five Step Method QUALITY How Well? Better Off (%)? Measure 1 Measure 2 Measure 3 Measure 4 Measure 5 Measure 6 Measure 1 Measure 2 Measure 3 Measure 4 Measure 5 Measure 6 4 Identify measures with good data Prioritise 5 Identify & Prioritise Data Development measures DD1 DD2 DD3 Headline Measures Secondary Measures Data Development Agenda How Much ? Number of customers served (by customer characteristic) Measure 1 Measure 2 Measure 3 Number of Activities (by type of activity) Measure 1 Measure 2 Measure 3 Measure 4 Better Off (#) Measure 1 Measure 2 Measure 3 Measure 4 Measure 5 Measure 6 QUANTITY 1 2 3

Fitting it all Together Population and Performance Accountability

The Linkage between Population and Customer Outcomes POPULATION ACCOUNTABILITY Being Healthy Rate of low birth-weight babies Staying Safe Rate of Child Abuse and Neglect Enjoying and Achieving % with five GCSEs Grade A-C PERFORMANCE ACCOUNTABILITY No. of Investigations completed % initiated within 24 hours of report No. of repeat abuse/neglect cases % of repeat abuse/neglect cases CUSTOMER OUTCOMES POPULATION OUTCOMES Contribution Relationship Alignment of Measures Appropriate Responsibility Child Protection Service

Relationship between Performance Measures and Indicators Programme CLIENTS Agency CLIENTS Service System CLIENTS Size of Client Population Indicator TOTAL POPULATION Performance Measure

Every time you make a presentation, use a two-part approach Outcome: to which you contribute to most directly. Indicators: Story: Partners: What would it take?: Your Role: as part of a larger strategy. Population Accountability Service: Performance measures: Story: Partners: Action plan to get better: Performance Accountability Your Role

How this fits with Narrowing the Gap Or how to turn the curve AND narrow the gap at the same time…..

Turning the curve AND Narrowing the gap Improving outcomes for vulnerable populations Use the “turning the curve” templates to narrow the gap.

Narrowing The Gap PASTNOWFUTURE Good performance is low “Backcasting” Where have we been? OK? The curve to turn: bigger for vulnerable groups to narrow the gap Indicator Result Forecasting Where are we going? Not All C&YP Vulnerable group

Three Wise Men… “Statistics: The only science that enables different experts using the same figures to draw different conclusions. “ Evan Esar “Not everything that can be counted counts, and not everything that counts can be counted.” Albert Einstein “It is a capital mistake to theorize before one has data. Insensibly one begins to twist facts to suit theories, instead of theories to suit facts.” Sir Arthur Conan Doyle

Toolkit Luton: Mark Friedman: