CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Applying Data for System Improvement: Probation Agency Staff Daniel Webster,

Slides:



Advertisements
Similar presentations
Using Data to Plan Waiver Strategies and Drive Improvements: Key Indicators and Trends April 11, 2012.
Advertisements

Foster Care Reentry after Reunification – Reentry in One or Two years – what’s the difference? Terry V. Shaw, MSW Daniel Webster, PhD University of California,
California Child Welfare Indicators Project Q Slides Center for Social Services Research School of Social Welfare University of California, Berkeley.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Child Welfare in California: 1. A Quick Tour of the Data 2. A Racial Equity Lens.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Child Welfare: Ethnic/Racial Disproportionality and Disparity Barbara Needell,
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Data 201: The Empirical Data Strikes Back* Emily Putnam-Hornstein, MSW Center.
California’s Child Welfare Outcomes & Accountability System: Using Performance Measures to Encourage Improvement Barbara Needell, MSW, PhD Center for.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley CFSR2 Data Indicators: The Good, the Bad, and the Ugly Center for Social Services.
The C-CFSR or Some of My Best Friends are Outcome Measures National Resource Center for Child Welfare Data and Technology 8th National Child Welfare Data.
Foster Care Reentry Going Beyond 12 Months of Follow-up Terry V. Shaw, MSW, PhD Daniel Webster, MSW, PhD University of California, Berkeley School of Social.
An overview of basic California foster care data Joe Magruder, MSW Center for Social Services Research School of Social Welfare University of California.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Data Are Your Friends: California’s Child Welfare Outcomes and Accountability.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Child Welfare: Ethnic/Racial Disproportionality and Disparity Barbara Needell,
Building a Better Child Welfare System for Fresno's Children: Using Data as Our Foundation (and Friend!) Daniel Webster, MSW PhD Center for Social Services.
Reunification for Siblings in Out-of-Home Care Using a Statistical Technique for Examining Non-independent Observations Presented by: Joseph Magruder,
Increasing Child Welfare Permanency Options: The Kinship Guardianship Assistance Payment Program Daniel Webster, MSW, PhD University of California, Berkeley.
CWS Outcomes System Update: (data through April 1, 2008 ) Racial/Ethnic Disparities (data for CY 2007) Center for Social Services Research University of.
California Child Welfare Outcomes and Accountability Legislation: Evolving Toward System Improvement with Longitudinal Data & Analysis Panel on Increasing.
The California Child Welfare System: Data Snapshot Barbara Needell, MSW, PhD Emily Putnam Hornstein, MSW Joseph Magruder, MSW Center for Social Services.
Data 101: Numbers, Graphs, and More Numbers
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Making the Most of Your Composite Computational Spreadsheet: Tools from California.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley CFSR2 National Standard/Composite Scores Center for Social Services Research.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Child Welfare in California: Ethnic/Racial Disproportionality and Disparity Barbara.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Prepared for The California Disproportionality Project Center for Social Services.
Program Staff Presentation 1 Program Staff Presentation.
Taking Research to Practice: Rethinking Outcomes and Performance Measures for the Child and Family Service Reviews John D. Fluke, Child Protection Research.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Foster Care in California: What the Data Tells Us Barbara Needell, MSW, PhD Emily.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley California’s Child Welfare System: Using Data from CWS/CMS Barbara Needell, MSW,
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Black/White and Black/Hispanic Racial Disparity in Child Welfare: Controlling.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Pro Bono Publico: Avoiding Child Welfare Data Abuse Panel on Meaningful Measurement.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley The Child and Family Services Review Composite Scores: A “Great Start” Barbara.
Data Driven Practice for Program Managers: Riverside County Melissa Correia Adam Darnell Casey Family Programs Daniel Webster, MSW PhD Center for Social.
Safety and Permanence in Child Welfare Second Canadian Roundtable on Child Welfare Outcomes October 8-9, 2009 Montreal, Canada Barbara Needell, MSW, PhD.
AB 636 Mental Health/CWS Partnership Sacramento, CA 3/17/06 Barbara Needell, MSW, PhD Center for Social Services Research University of California at Berkeley.
Child Welfare in North Carolina: Ethnic and Racial Disproportionality and Disparity by D. F. Duncan UNC-CH School of Social Work June 10, 2009.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Child Welfare: Ethnic/Racial Disproportionality and Disparity Barbara Needell,
Indicating Success in Public Child Welfare Child Outcomes, System Performance and the CFSR Process Susan Smith and Lisa Tuttle Casey Family Programs July.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley California’s Child Welfare System: A Data Snapshot Barbara Needell, MSW, PhD.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley California’s Child Welfare System: Using Data from CWS/CMS Barbara Needell, MSW,
Child Welfare Administrative Data: The UCB Performance Indicators Project cssr.berkeley.edu/CWSCMSReports Barbara Needell, MSW, PhD Center for Social Services.
Presentation originally created by William C Dawson & Amy C Nuñez The Performance Indicators Project & the Administrative Office of the Courts: Toward.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Administrative Office of the Pennsylvania Courts Children’s Roundtable Summit.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Safety and Permanence in Child Welfare Second Canadian Roundtable on Child Welfare.
When permanency remains elusive: A longitudinal examination of the early foster care experiences of youth at risk of emancipating Joe Magruder, MSW Emily.
Trends in Child Welfare Outcomes CA Blue Ribbon Commission May1, 2013 The Performance Indicators Project is a collaboration of the California Department.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley CFSR2 Data Indicators: The Good, the Bad, and the Ugly Center for Social Services.
California Child Welfare Indicators Project YOUTH IN EXTENDED FOSTER CARE Center for Social Services Research School of Social Welfare University of California,
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley California’s Child Welfare Performance Indicators Project: “irresistible information”
Supervisor Core Training: Managing for Results Original presentation was created for Version 1.0 by Daniel Webster, Barbara Needell, Wendy Piccus, Aron.
Overview of California’s Child Welfare Indicator Data Barbara Needell, MSW, PhD Center for Social Services Research School of Social Welfare University.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley California’s Child Welfare System: Data Trends & Child Outcomes Center for Social.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Longitudinal Dynamics of Youth in Foster Care Joseph Magruder Emily Putnam-Hornstein.
The Child and Family Services Review (CFSR) February 2008 Update.
AB 636 presented at the joint hearing between the ASSEMBLY COMMITTEE ON HUMAN SERVICES and the ASSEMBLY SELECT COMMITTEE ON FOSTER CARE Sacramento, CA.
Measuring Child Welfare Agency Performance: Advantages and Challenges of State, County, & University Collaboration National Association of Welfare Research.
RELATIVE GUARDIANSHIPS: INCREASED OPTIONS FOR SUSTAINED PERMANENCY Joseph Magruder, PhD University of California, Berkeley Daniel Webster, PhD University.
Changing the Outcome: Achieving and Sustaining a Safe Reduction in Foster Care: A Policy Institute November 4-6, 2009 Tampa, FL Setting the Course: Unpacking.
Changing the Outcome: Achieving and Sustaining a Safe Reduction in Foster Care: A Policy Institute November 4-6, 2009 Tampa, FL Addressing Disproportionality.
CCWIP Data Analysis Training Using the CCWIP Website to Answer Questions about Key Child Welfare Outcomes Wendy Wiegmann CCWIP August 19, 2016.
Kinship Foster Care in California Testimony to Assembly Select Committee on Foster Care Sacramento, CA 2/15/06 Barbara Needell, MSW, PhD Center for Social.
CCWIP Data Analysis Training Using the CCWIP Website to Understand County Performance on CFSR 3 Measures Wendy Wiegmann CCWIP May 1, 2017.
CCWIP Data Analysis Training Using the CCWIP Website to Answer Questions about Key Child Welfare Outcomes Wendy Wiegmann CCWIP January 19, 2016.
Wendy Wiegmann ~ CCWIP ~ November 7, 2016
Everything you always wanted to know about S. - urvival Curves (
Wendy Wiegmann ~ CCWIP ~ March 27-28, 2017
Center for Social Services Research
Administrative Office of the Pennsylvania Courts Children’s Roundtable Summit November 21, 2009 Making Data Informed Decisions (Ramblings from the Left.
Foster Care in California: What we Know from CWS/CMS Barbara Needell, MSW, PhD Center for Social Services Research University of California at Berkeley.
BARBARA NEEDELL, MSW, PhD
Using the CCWIP Data Portal
Presentation transcript:

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Applying Data for System Improvement: Probation Agency Staff Daniel Webster, MSW PhD Center for Social Services Research University of California, Berkeley UC Davis Resource Center for Family-Focused Practice Project Code 123FAM260 Sacramento, CA January 2013 The Performance Indicators Project at CSSR is supported by the California Department of Social Services and the Stuart Foundation Slides in this presentation from: Emily Putnam-Hornstein, PhD Data 101: Numbers, Graphs and More Numbers

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley

Key Concepts: Longitudinal Administrative Data Analysis

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley The Current Placement System* (Highly Simplified) Child In Child Out A bunch of stuff happens * adapted from Lyle, G. L., & Barker, M.A. (1998) Patterns & Spells: New approaches to conceptualizing children’s out of home placement experiences. Chicago: American Evaluation Association Annual Conference

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Data Skepticism

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Entry Cohorts Exit Cohorts Point in Time Data 3 Key Data Samples

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley January 1, 2012January 1, 2013 How long do children stay in foster care? July 1, 2012 Child 1 Child 2 Child 3 Child 4 Child 5 Child 6 Child 7 Child 8 Child 9 Child 10

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley The Cycle of Experiences Counterbalanced Indicators of System Performance Permanency Through Reunification, Adoption, or Guardianship Shorter Lengths Of Stay Stability Of Care Rate of Referrals/ Substantiated Referrals Home-Based Services vs. Out-of-Home Care Maintain Positive Attachments To Family, Friends, and Neighbors Use of Least Restrictive Form of Care Source: Usher, C.L., Wildfire, J.B., Gogan, H.C. & Brown, E.L. (2002). Measuring Outcomes in Child Welfare. Chapel Hill: Jordan Institute for Families, Reentry to Care

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Jan. 1 Mar. 1 Dec. 31 Jul. 7 Jan. 1Dec. 31 Tracking an Entry Cohort for 1 Year

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley What the is a Rolling Year ? Jan. 1 Dec. 31Jan. 1 Last day of data prior to cut-off Sept. 30, 2012 ENTRY COHORT Oct. 1, 2010 – Sept. 30, 2011 Dec. 31 Last day of data prior to cut-off Dec. 31, 2012 Last day of data prior to cut-off March 31, 2013 ENTRY COHORT Jan. 1, 2011 – Dec. 31, 2011 April 1, 2011-March 31, 2012

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley POP QUIZ !!

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Measures of Central Tendency Mean: the average value for a range of data Median: the value of the middle item when the data are arranged from smallest to largest Mode: the value that occurs most frequently within the data = 9.7 = 9

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Exercise: Means & Medians

Computing a Percent Answers.com Dictionary: Rate A measure of a part with respect to a whole; a proportion: the mortality rate; a foster care entry rate. Raw Numbers (counts) # Reunified w/in 12m # Reunified (total) = 290 = 440 What Percentage of Children who were reunified in 2011 went home within 12 months of entering care?

Computing a Rate per 1,000 Answers.com Dictionary: Rate A measure of a part with respect to a whole; a proportion: the mortality rate; a foster care entry rate. Raw Numbers (counts) # Entered Care # Child Population = 1,333 = 363,376 What was the foster care entry rate in 2011? (i.e., how many children entered care out of all possible children?) Scales for a meaningful interpretation…

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Percent Change Time Period 1Time Period 2 10 children11 children

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Percent Change Time Period 1Time Period 2 10%12% % %

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Exercise: Percent Change Calculation Baseline Referral Rate (time period 1): Comparison Referral Rate (time period 2): Percent Change: % % Minor Differences due to Rounding…

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Disaggregation One of the most powerful ways to work with data… Disaggregation involves dismantling or separating out groups within a population to better understand the dynamics Useful for identifying critical issues that were previously undetected Aggregate Permanency Outcomes Race/Ethnicity Age County Placement Type

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley 2000 July-December First Entries California (Child Welfare) Percent Exited to Permanency 72 Months From Entry 85%

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley 2000 First Entries California (Child Welfare) Percent Exited to Permanency 72 Months From Entry 88% 79%

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley 2000 First Entries California (Child Welfare) Percent Exited to Permanency 72 Months From Entry by Relative vs. Non-Relative Placement =94% =84% =75%

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Safety S1.1 S2.1 Permanency Composite 1: Reunification Composite 2: Adoption Composite 3: Long-Term Composite 4: Placement C1.1 C1.2 C1.3 C1.4 C2.1 C2.2 C2.3 C2.4 C2.5 C3.1 C3.2 C3.3 C4.1 C4.2 C4.3

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Probation Outcomes System Summary

CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley

CSSR.BERKELEY.EDU/UCB_CHILDWELFARE Needell, B., Webster, D., Armijo, M., Lee, S., Dawson, W., Magruder, J., Exel, M., Cuccaro-Alamin, S., Putnam-Hornstein, E., Williams, D., Yee, H., Hightower, L., Lou, C., Peng, C., King, B.,& Henry, C. (2013). Child Welfare Services Reports for California. Retrieved 1/25/2013, from University of California at Berkeley Center for Social Services Research website. URL: