Presentation is loading. Please wait.

Presentation is loading. Please wait.

Evidence-Based Policy in the U.S.: An Overview and an Example April 4, 2016 Auckland, New Zealand Ron Haskins Cabot Family Chair & Co-Director, Center.

Similar presentations


Presentation on theme: "Evidence-Based Policy in the U.S.: An Overview and an Example April 4, 2016 Auckland, New Zealand Ron Haskins Cabot Family Chair & Co-Director, Center."— Presentation transcript:

1 Evidence-Based Policy in the U.S.: An Overview and an Example April 4, 2016 Auckland, New Zealand Ron Haskins Cabot Family Chair & Co-Director, Center on Children & Families The Brookings Institution Washington, DC

2 A Brief Overview of Evidence-Based Policy in U.S.

3 3 Growth of an Evidence-Based Culture Obama’s evidence-based initiatives; over 1,400 local projects Ryan-Murray Evidence-Based Policymaking Commission Clearinghouses with lists of evidence-based programs OMB’s emphasis on evaluation by agencies Chief of evaluation in executive agencies Growth of model programs with rigorous evaluations Social and Behavioral Sciences Team in White House Growth of Pay for Success approaches Results First (Pew and MacArthur; Clearinghouse) Influential lobbying groups (Results for America) Foundation support: Pew; MacArthur; Grant; Arnold; Annie E. Casey; Casey Family Programs; Edna McConnell Clark; Gates

4 4 Obama’s Evidence-Based Initiatives

5 5 Administration’s Evidence-Based Strategy for Grant Making Spend most federal dollars on evidence-based programs Continuous evaluation and program modification

6 6 Overview of Six Evidence-Based Initiatives Evidence-based initiativeInitial fundingAdministering agencyDate of first awards Teen Pregnancy Prevention (TPP)* $110 millionHHSSeptember 2010 Maternal, Infant, and Early Childhood Home Visiting* $1.5 billionHHSJuly 2010 Investing in Innovation (i3) $650 millionDepartment of EducationAugust 2010 Social Innovation Fund (SIF) $50 millionCorporation for National and Community Service July 2010 Trade Adjustment Assistance Community College and Career Training (TAACCCT) $2 billionDepartment of LaborSeptember 2011 Workforce Innovation Fund (WIF) $125 millionDepartment of LaborJune 2012 *HHS identified evidence-based programs

7 7 Obama’s Evidence-Based Initiatives: Number of Local Projects InitiativeNumber of projects Teen Pregnancy 102 Home Visiting 774 Investing in Innovation 117 Social Innovation Fund 221 Workforce Innovation Fund (defunct) 26 TAACCCT 185 Total1,425

8 8 Why the Obama Evidence-Based Initiative Worked Stellar leadership Relentless focus on using evidence Clever and persistent legislative strategies Competitive (not formula) grants Decent review panels

9 9 Issues Role of RCTs When a program fails, what’s next Innovation vs. evidence Implementation Do we enough have good model programs?

10 10 Principles and Procedures of Behavioral Economics Principles of behavioral economics:  Cognitive resources limited; can be overwhelmed  Attention is finite  Exercising restraint depletes stock of self-control Behavioral Diagnosis and Design Process:  Define  Diagnose  Design  Test Examples (from White House Behavioral and Social Sciences Team):  Summer Melt  Service Members Savings Enrollment  Delinquent Debt Repayment

11 11 Pay for Success What Is It? Method of financing government programs More than 50 projects worldwide (especially US & UK) Components:  Government agency to define outcomes  Service agency (often nonprofit)  Investors  Evaluator Advantages:  Increases funding options for government  Shifts risk from taxpayers to funders  Based on outcomes and measurement  Encourages development and use of evidence-based program

12 12 Pay for Success, cont. Examples:  Adolescent Behavioral Learning Experience (Rikers Island, NY)  Utah High Quality Preschool Program Challenges:  Measuring outcomes, costs, savings  Judging where to place the bet  Distributing costs among agencies and society

13 13 Overview of Exploration, Preparation, Implementation, Sustainment Framework Source: Cambria Walsh, Jennifer Rolls Reutz, and Rhonda Williams. (2015). "Selecting and Implementing Evidence-Based Practices: A Guide for Child and Family Serving Systems," San Diego, CA: California Evidence-Based Clearinghouse for Child Welfare.

14 14 Exploration Implementation team Problem definition Needs assessment Review of programs that might help; final selection (talk with program users; Clearinghouses; Results First) Implementation team

15 15 Preparation Team buy-in Implementation support system Work with stakeholders (including consumers) Identify funding streams Plan for integrating program into existing system Training personnel (coaching) Plans for monitoring & evaluation Anticipating challenges

16 16 Implementation Verify buy-in Priority for the new program by implementers Complete training Prepare materials Participant intake is functioning well Data being collected to monitor fidelity and outcomes Deal with problems early

17 17 Sustainment Becoming ingrained in the organization Stable funding Ongoing training Monitoring plan; ensuring fidelity Data collection for monitoring and outcomes Ongoing refinement Referral process

18 18 Results First: What Is It? Initiative of Pew and MacArthur Foundations Washington State Institute for Public Policy as Model (1983) Looking for states with top quality, influential budget or legislative agency willing to commit (N=21) Goal: Use evidence to fix or end bad programs and initiate good programs

19 19 Conditions State Agency Must Meet to Join Results First Program Buy-in from top official in agency Direct connection with legislature Expertise in analysis and statistics Respected by legislative & administrative branches Ability to communicate with public

20 20 Conducting Results First Procedure Select a social policy area (e.g., child protection, preschool, teen pregnancy) Create an inventory of current state programs Review which state programs work Compare to model programs (Clearinghouse Data Base) Conduct benefit-cost analysis to compare programs’ return on investment Use analysis results to inform policy decisions

21 21 The Results First Clearinghouse

22 22 How to Use the Results First Clearinghouse Determine problem to solve, type of intervention, and scope of funds/resources available Look at the database and filter search by intervention type and rating Screen for appropriate fit various possible programs by title and using the Learn More button Compare chosen programs on cost, effectiveness, and appropriateness to own context

23 23 A Step by Step Example: Teen Pregnancy and Risky Sexual Behavior 1.Go to website: do so by searching for Results First Clearinghouse Database 2.Click on Results First Clearinghouse Database under the Data Visualization sidebar 3.Scroll down to search toolbar and go to intervention type tab 4.Click on ‘risky sexual behavior/teen pregnancy’ 5.Go to rating color tab and select Highest rated and Second- highest rated 6.Click ‘Go’ and scroll down 7.Put mouse over dot for each program and click learn more to find out details 8.Thoroughly explore the website for each appropriate program 9.Make a table of program characteristics for selected programs

24 24

25 25

26 26

27 27

28 28


Download ppt "Evidence-Based Policy in the U.S.: An Overview and an Example April 4, 2016 Auckland, New Zealand Ron Haskins Cabot Family Chair & Co-Director, Center."

Similar presentations


Ads by Google