Developing Evidence on “What Works” in Moving TANF Recipients to Work through Job Search Assistance Karin Martinson, Abt Associates February, 20 2015.

Slides:



Advertisements
Similar presentations
Progress Towards Reading Success: The Reading First Evaluation Prepared by: Amy Kemp, Ph.D. Research Associate and Patricia A. Muller, Ph.D. Associate.
Advertisements

Child Care Subsidy Data and Measurement Challenges 1 Study of the Effects of Enhanced Subsidy Eligibility Policies In Illinois Data Collection and Measurement.
Retooling Transitional Housing
From Research to Advocacy
What type of support is available to meet our school-community integration goals and improve student outcomes?
Knowing if the RBF mechanism is working Incorporating Rigorous Impact Evaluation into your HRBF program Sebastian Martinez World Bank.
Job Search Assistance Strategies Evaluation Presentation for American Public Human Services Association February 25, 2014.
Making a difference for individuals and the economy Careers Scotland’s research on the impact of career guidance and development services IS2007 Aviemore,
Alaska Native Education Program (ANEP) Technical Assistance Meeting September 2014 Sylvia E. Lyles Valerie Randall Almita Reed.
ASSESSMENT IN HIAs Elizabeth J. Fuller, DrPH, MSPH Georgia Health Policy Center.
Requires DSHS and HCA to expend state funds on: (1) Juvenile justice programs or programs related to the prevention, treatment, or care of juvenile offenders.
S-STEM Program Evaluation S-STEM PI Meeting Arlington, VA October 2012.
Decision-Making and Strategic Information Workshop on M&E of PHN Programs July 24-August 11, 2006 Addis Ababa.
Evaluating SPP/APR Improvement Activities Presented by Jeanna Mullins, Mid-South Regional Resource Center, RRCP Document developed by members of the Systems.
PHAB's Approach to Internal and External Evaluation Jessica Kronstadt | Director of Research and Evaluation | November 18, 2014 APHA 2014 Annual Meeting.
Sustaining Local Public Health and Built Environment Programs Fit Nation NYC November 3, 2011 Annaliese Calhoun.
PAI786: Urban Policy Class 2: Evaluating Social Programs.
Evaluation of Math-Science Partnership Projects (or how to find out if you’re really getting your money’s worth)
IMPACTS OF A WORK-BASED POVERTY REDUCTION PROGRAM ON CHILDREN’S ACHIEVEMENT AND SOCIAL BEHAVIOR: THE NEW HOPE PROJECT Aletha C. Huston, Greg J. Duncan,
Evaluating NSF Programs
Dr. G. Johnson, Program Evaluation and the Logic Model Research Methods for Public Administrators Dr. Gail Johnson.
Richard J.T. Klein Stockholm Environment Institute and Centre for Climate Science and Policy Research, Linköping University.
TANF Recipients Living with a Disability: Policy Framework, Prevalence and Service Strategies Presentation to the Consortium for Citizens with Disabilities.
IPv6 Survey: Taking the Federal Pulse on IPv6 Summary Results Market Connections, Inc. June 2006.
Sociology 3322a. “…the systematic assessment of the operation and/or outcomes of a program or policy, compared to a set of explicit or implicit standards.
Copyright © 2014 by The University of Kansas Using the Evaluation System to Answer Key Questions About Your Initiative.
Designing a Random Assignment Social Experiment In the U.K.; The Employment Retention and Advancement Demonstration (ERA)
1 Promoting Evidence-Informed Practice: The BASSC Perspective Michael J. Austin, PhD, MSW, MSPH BASSC Staff Director Mack Professor of Nonprofit Management.
1 Customized Employment Strategic Service Delivery Component Disability Employment Initiative.
Providing Work Opportunities and Support for TANF Recipients with Disabilities Michelle K. Derr ACF 10 th Annual Welfare Research and Evaluation Conference.
Introduction to Evaluation. Objectives Introduce the five categories of evaluation that can be used to plan and assess ACSM activities. Demonstrate how.
Promoting a Culture of Evidence and Use of Data through Program Evaluation Session Theme 2 Presentation to: OSEP Project Directors’ Conference July 21,
Engaging Community Partners A Strategic Approach to Building Capacity and Bolstering DN Success.
Private Lives in the Public Sphere: Family-Employment Spillover among Low-Income Women Dr. Lucy P. Jordan Research Fellow University of St Andrews
General Grant Writing Tips. Research the problem/need and the program before beginning the grant proposal Review research on similar problems/needs and.
Third Sector Evaluation: Challenges and Opportunities Presentation to the Public Legal Education in Canada National Conference on “Making an Impact” 26.
Office of Special Education Programs U.S. Department of Education GRANT PERFORMANCE REPORT FOR CONTINUATION FUNDING.
0 Emerging Findings from the Employment Retention and Advancement (ERA) Evaluation Gayle Hamilton, MDRC Workforce Innovations 2005 Conference.
Impact Evaluation “Randomized Evaluations” Jim Berry Asst. Professor of Economics Cornell University.
SOFTWARE PROJECT MANAGEMENT
The National Alliance to End Homelessness presents The HEARTH Academy Training and tools to help your community achieve the goals of the HEARTH Act.
Module II: Developing a Vision and Results Orientation Cheri Hayes Consultant to Nebraska Lifespan Respite Statewide Sustainability Workshop June 23-24,
11 The CPCRN, DCPC, NCI, and the Community Guide: Areas for Collaboration and Supportive Work Shawna L. Mercer, MSc, PhD Director The Guide to Community.
Presented by: Shubha Chakravarty (Economist, AFTPM) Impact Evaluation team: Mattias Lundberg (Sr. Economist, HDNCY) Markus Goldstein (Sr. Economist, AFTPM.
Development Impact Evaluation in Finance and Private Sector 1.
Copyright © 2014 by The University of Kansas Using the Evaluation System to Answer Key Questions About Your Initiative.
NATIONAL INDABA 2015 Breakaway 3: Socio-economic impact of the lottery businesses on the South African economy.
The Disability Employment Initiative (DEI): Impact Evaluation Design October 21, 2015 Sung-Woo Cho, Ph.D.
A Capacity Building Program of the Virginia Department of Education Division Support for Substantial School Improvement 1.
Getting Inside the “Black Box” – Capitalizing on Natural and Random Variation to Learn from the HPOG Impact Study Presenters: Alan Werner, co-Principal.
Sustainability Planning Framework and Process Cheri Hayes Consultant to Nebraska Lifespan Respite Statewide Sustainability Workshop June 23-24, 2015 ©
1 YOUTHBUILD EVALUATION Building evidence about the effect of YouthBuild on the young people it serves August 17, 2011 Washington, D.C.
EVALUATION RESEARCH To know if Social programs, training programs, medical treatments, or other interventions work, we have to evaluate the outcomes systematically.
The Federal Telework Program U.S. Office of Personnel Management.
Development of Gender Sensitive M&E: Tools and Strategies.
BUILDING BRIDGES AND BONDS (B3) A rigorous, multi-site study of innovative services offered by Responsible Fatherhood/ReFORM (RF) programs Unique opportunity.
Welcome to Workforce 3 One U.S. Department of Labor Employment and Training Administration Webinar Date: November 20, 2013 Presented by: U.S. Department.
ACF Office of Community Services (OCS) Community Services Block Grant (CSBG) Survey of Grantees Satisfaction with OCS Survey of Eligible Entities Satisfaction.
[Presentation location] [Presentation date] (Confirm ABT logo) Building Bridges and Bonds (B3): An introduction.
© Copyright  People at Work Project - Overview  People at Work Project - Theoretical Underpinnings  People at.
IMPACT EVALUATION PBAF 526 Class 5, October 31, 2011.
Evaluating SPP/APR Improvement Activities
Introduction to Program Evaluation
America’s Promise Evaluation What is it and what should you expect?
Presented by: Asaph Glosser MEF Associates
Evaluating SPP/APR Improvement Activities
Monitoring and Evaluating FGM/C abandonment programs
Rapid cycle evaluation:
Program Evaluation of Nebraska’s Gamblers Assistance Program
Estimating net impacts of the European Social Fund in England
Presentation transcript:

Developing Evidence on “What Works” in Moving TANF Recipients to Work through Job Search Assistance Karin Martinson, Abt Associates February,

Abt Associates | pg 2 Why Study Job Search Assistance for TANF Recipients?  Past research shows overall positive effects for JSA services, however: –Impacts from JSA are modest: primarily increases the speed at which people find jobs, rather than affecting the quality of jobs –Some evidence that job search requirements (and associated sanctions) lead to benefit reductions through program exits –More intensive and more personalized JSA programs do not have clearly better outcomes based on existing evidence  Many unanswered questions: –What components of JSA are most effective (e.g. group job clubs, one- on-one assistance, job development)? –What “amount” of JSA in terms of length and hours is most beneficial? –Are there subgroups that JSA has the largest effects?

Abt Associates | pg 3 Job Search Assistance (JSA) Strategies Evaluation  ACF-funded high priority study to determine “what works” in providing job search assistance to TANF recipients  Study will examine the impact of JSA program approaches on TANF recipients’ employment and earnings, job quality and receipt of public assistance  Results excepted to be of great operational value to all states, but especially those that participate  Conducted by Abt Associates and Mathematica Policy Research, along with a team of consultants

Abt Associates | pg 4 JSA Evaluation Design  Impact study will randomly assign individuals to contrasting JSA approaches –Different JSA interventions implemented within a single TANF agency  Goal is develop tests of different JSA approaches; there is no “no-service” control group  RA design require large sample sizes, but possible to pool across sites  Implementation study will examine services received under each approach and provide operational lessons

Abt Associates | pg 5 Opportunity to Learn About EF-Based Models through JSA  Discussions with states and localities for this project indicated that is great interest in an “enhancement” to current job search approaches, particularly one focused on EF  Evaluation would study the effectiveness of an EF- based approach compared to “business as usual.”  Key issues that could be addressed: –Whether the approach resulted in higher employment levels and earnings, higher quality jobs (better pay and benefits), and longer job tenure –Lessons for policymakers and practitioners on operationalizing this approach as part of the TANF program

Abt Associates | pg 6 Why Random Assignment?  “Gold standard” for program evaluation.  Lottery-like process (like a coin flip) to assign eligible individuals to one of two groups, either: –A group that receives the services of interest (in this case the EF- model); or –A group that receives the standard TANFJSA services  Evaluators measure and compare outcomes for the two groups. Because groups identical at baseline, any differences over time are due to the services.  Impacts measured this way have substantial credibility among policy makers and funders because they answer, “what would have happened if TANF recipients had not experienced the program?”

Abt Associates | pg 7 Why participate in JSA?  A high-quality, funded study of program operations and effectiveness. –Each site will learn about how its program has impacted participants’ economic outcomes. Positive results directly attributable to program services. –The study will report on program operations, challenges, and successes, with an opportunity to learn from “best practices” across study sites. –In an era of scarce resources, results can provide definitive information on program effectiveness for future funding.  Technical assistance from experts around implementation of model and random assignment  National visibility, with a focus on informing future program policies, practices and funding decisions  Some funds to support study-related costs

Abt Associates | pg 8 Key Tasks and Project Timeline Q4Q1Q2Q3Q4Q1Q2Q3Q4Q1Q2Q3Q4Q1Q2Q3 Knowledge Development/Site Selection Random Assignment & Monitoring Implementation Study Impact Study Data Collection & Analysis

Abt Associates | pg 9 Next Steps  Currently working with several states that are here today on potentially participating in the JSA evaluation: Ramsey County, MI, CO, WA  Would love to include additional states and localities so please let us know it you are interested  Goal is to develop the EF-based intervention and evaluation over the next several months in each participating site

Abt Associates | pg 10 Key Contacts  Karin Martinson, Project Director  Michelle Derr, Co-Principal Investigator