CCWIP Data Analysis Training Using the CCWIP Website to Understand County Performance on Federal & State C-CFSR Measures Wendy Wiegmann CCWIP September.

Slides:



Advertisements
Similar presentations
Implications of CFSR 3 for IVE Programs
Advertisements

From QA to QI: The Kentucky Journey. In the beginning, we were alone and compliance reigned.
Using Data to Plan Waiver Strategies and Drive Improvements: Key Indicators and Trends April 11, 2012.
Community Based Care in Florida and the IV-E Waiver.
1 North Dakota Children and Family Services Review Paul Ronningen, Division Director Don Snyder, Permanency Unit Manager.
Child and Family Services Reviews (CFSRs). 2 Child Welfare Final Rule (excerpt from Executive Summary) The child and family services reviews … [focus]
California Department of Social Services Program Improvement Plan
California Child Welfare Indicators Project Q Slides Center for Social Services Research School of Social Welfare University of California, Berkeley.
California’s Child Welfare Outcomes & Accountability System: Using Performance Measures to Encourage Improvement Barbara Needell, MSW, PhD Center for.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley CFSR2 Data Indicators: The Good, the Bad, and the Ugly Center for Social Services.
The C-CFSR or Some of My Best Friends are Outcome Measures National Resource Center for Child Welfare Data and Technology 8th National Child Welfare Data.
1 Child and Family Services Review Program Improvement Plan Kick-Off Division/Staff Name Date (7/30/07)
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Data Are Your Friends: California’s Child Welfare Outcomes and Accountability.
1 Agency/Court Collaboration in the CFSR: ENGAGING COURTS AND THE LEGAL SYSTEM The National Child Welfare Resource Center For Organizational Improvement.
1 Lessons Learned about the Service Array from the First Round of Child and Family Services Reviews (CFSRs) The Service Array Process National Child Welfare.
California Child Welfare Outcomes and Accountability Legislation: Evolving Toward System Improvement with Longitudinal Data & Analysis Panel on Increasing.
Findings From the Initial Child and Family Service Reviews
Inspiration  Ideas  Improvement Practice Improvement Unit District Practice Improvement Specialists District Automation Liaisons Inspiration An agent.
Program Staff Presentation 1 Program Staff Presentation.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley California’s Child Welfare System: Using Data from CWS/CMS Barbara Needell, MSW,
Minnesota Child Welfare Program Goals Safety Permanency Well-Being.
May 18, MiTEAM Is Michigan’s guide to how staff, children, families, stakeholders and community partners work together to achieve outcomes that.
10/ Introduction to the MA Department of Children and Families’ Integrated Casework Practice Model (ICPM) Fall 2009.
AB 636 Mental Health/CWS Partnership Sacramento, CA 3/17/06 Barbara Needell, MSW, PhD Center for Social Services Research University of California at Berkeley.
Indicating Success in Public Child Welfare Child Outcomes, System Performance and the CFSR Process Susan Smith and Lisa Tuttle Casey Family Programs July.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley California’s Child Welfare System: A Data Snapshot Barbara Needell, MSW, PhD.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley California’s Child Welfare System: Using Data from CWS/CMS Barbara Needell, MSW,
Child Welfare Administrative Data: The UCB Performance Indicators Project cssr.berkeley.edu/CWSCMSReports Barbara Needell, MSW, PhD Center for Social Services.
1 Bureau of Milwaukee Child Welfare Report to the Community January 13, 2006 Jan. – Dec Progress summary of 2005  Safety  Permanence  Well-Being.
DIAKON Lutheran Social Ministries/Family Design Resources Tools That Work Conference 11/03 Implementing Best Practice Standards in Permanency Planning.
1 Quality Counts: Helping Improve Outcomes for Pennsylvania’s Children & Families September 22, 2008.
Supervisor Core Training: Managing for Results Original presentation was created for Version 1.0 by Daniel Webster, Barbara Needell, Wendy Piccus, Aron.
1 CHILDREN SAFE AND THRIVING WITH FOREVER FAMILIES, SOONER DIVISION OF FAMILY & CHILDREN SERVICES Isabel Blanco, Deputy Director of Field Operations September.
The Child and Family Services Review (CFSR) February 2008 Update.
AB 636 presented at the joint hearing between the ASSEMBLY COMMITTEE ON HUMAN SERVICES and the ASSEMBLY SELECT COMMITTEE ON FOSTER CARE Sacramento, CA.
Measuring Child Welfare Agency Performance: Advantages and Challenges of State, County, & University Collaboration National Association of Welfare Research.
1 DHS Board Meeting Promoting Safe and Stable Families Program Overview Mark Washington Division of Family and Children Services August 18, 2010.
CENTER FOR SOCIAL SERVICES RESEARCH School of Social Welfare, UC Berkeley Applying Data for System Improvement: Probation Agency Staff Daniel Webster,
Improving the Lives of Mariposa County’s Children and Families System Improvement Plan October 2008 Update.
Child and Family Services Reviews Onsite Review Instrument.
1 1 Child Welfare Policy and Practice for Supervisors.
1 Department of Human Services (DHS)/Child Welfare Services (CWS) Branch Child & Family Services Review (CFSR) & Program Improvement Plan (PIP)
LOS ANGELES COUNTY. To learn about the Katie A. Settlement Agreement and its impact on the Child Welfare and Mental Health systems To appreciate the Shared.
The data Train: Bringing Child Welfare Staff on Board
PIP effective January 1, 2017 & runs through December 31, 2018
Wendy Wiegmann ~ CCWIP ~ March 23, 2017
CCWIP Data Analysis Training Using the CCWIP Website to Answer Questions about Key Child Welfare Outcomes Wendy Wiegmann CCWIP August 19, 2016.
Office of Children's Services
Bringing Continuous Quality Improvement to Operations
Tuolumne County Adult Child and Family Services
CHILD AND FAMILY SERVICES REVIEWS (CFSRs)
Wendy Wiegmann ~ CCWIP ~ October 25, 2016
CCWIP Data Analysis Training Using the CCWIP Website to Understand County Performance on CFSR 3 Measures Wendy Wiegmann CCWIP May 1, 2017.
CCWIP Data Analysis Training Using the CCWIP Website to Answer Questions about Key Child Welfare Outcomes Wendy Wiegmann CCWIP January 19, 2016.
Stakeholder Webinar September 20, 2018
Wendy Wiegmann ~ CCWIP ~ November 7, 2016
Texas Department of Family and Protective Services January 23, 2015
2016 Child & Family Annual Report
Wendy Wiegmann ~ CCWIP ~ March 27-28, 2017
GOT PERMANENCE? DIVISION OF FAMILY & CHILDREN SERVICES G-FORCE MEETING
Pathways to Permanency: Safety, Permanency and Well-Being
Stakeholder Webinar September 20, 2018
Los Angeles County Department of Children and Family Services
Texas Department of Family and Protective Services December 19, 2014
BARBARA NEEDELL, MSW, PhD
Insert Meeting Date and Presenters
Using the CCWIP Data Portal
Permanency Planning Modified Manual
Los Angeles County Department of Children and Family Services
Children Services Committee Meeting
Presentation transcript:

CCWIP Data Analysis Training Using the CCWIP Website to Understand County Performance on Federal & State C-CFSR Measures Wendy Wiegmann CCWIP September 8, 2017 September 21, 2017

Outline The CFSR & C-CFSR: History, Goals, and Process Child Welfare Data Measurement: A Primer Federal (CFSR) & Statewide (C-CFSR) Outcomes CCWIP website

The cfsr: History, goals, & Process

Federal Legislation: Child and Family Service Reviews 1994 Amendments to the Social Security Act Mandated that a process be created to ensure conformity with the Social Security Act The Adoption and Safe Families Act of 1997 Mandated creation of outcome measures 2000 Final Rule published in the Federal Register Established a review system, called the Child and Family Services Reviews (CFSRs) 1994 AMENDMENTS TO THE SOCIAL SECURITY ACT Amendments to the Social Security Act in 1994 mandated the U.S. Department of Health and Human Services (USDHHS) to determine a process for ensuring conformity with titles IV-B and IV-E of the Social Security Act ADOPTION AND SAFE FAMILIES ACT The Adoption and Safe Families Act of 1997 directed USDHHS to develop a set of outcome measures that could be used to assess state performance in achieving the goals of safety; permanency; and child and family well-being THE FINAL RULE In 2000, a final rule was published in the Federal Register that established a review system for monitoring state child welfare programs This system, called the Child and Family Services Reviews (CFSRs), is administered by the Children’s Bureau (a division of of USDHHS)

CFSR History CFSR Round 1: 2001 – 2004 CFSR Round 2: 2007 – 2010 Data indicators consisted of 6 items (2 safety/4 permanency) CFSR Round 2: 2007 – 2010 Data indicators also consisted of 6 items, expanded to 15 different measures that were distilled into four composites CFSR Round 3: 2015 – Present Data indicators consist of 7 items (2 safety/5 permanency)

CFSR: Overall Goals To ensure conformity with title IV-B and IV-E child welfare requirements in the Social Security Act Determine what is happening to children and families who have contact with the child welfare system Support states to enhance their capacity to improve outcomes and systems for children and families

CFSR Process (Simplified) Program Improvement Plan (PIP) required for any indicator that does not meet national standard Each state is held responsible for meeting “substantial conformity” on safety, permanency, and well-being outcomes and systemic factors Based on the results, an Onsite Review is conducted (either by or in collaboration with CB) Each state conducts a Statewide Assessment and submits it to CB The Children’s Bureau (CB) compiles and sends a State Data Profile to each state States submit data on maltreatment reports (annually) and children in foster care (semi-annually)

Child Welfare System Improvement and Accountability Act (AB 636) Passed in 2001; went into effect January 1, 2004 Includes additional performance indicators, above those required by the CB All 58 counties receive quarterly data reports (from CWS/CMS) on their outcomes Data inform their System Improvement Plans (SIPs), which are sent to CDSS and become part of the state’s overall accountability process

C-CFSR Process technical assistance technical assistance County Self-Assessment Peer Review System Improvement Plan Annual Progress Reports technical assistance technical assistance COUNTY SELF-ASSESSMENT (CSA) The CSA is a comprehensive review of the child welfare and probation placement programs, from prevention and protection through permanency and aftercare. The CSA is completed every five years by the county in coordination with their local community partners as outlined earlier. The CSA is the analytic vehicle by which counties determine effectiveness of current practice, programs and resources across the continuum of child welfare and probation placement services and identifies areas for targeted system improvement. Counties are encouraged to conduct focus groups, hold stakeholder forums, and administer satisfaction surveys as a means to fully engage stakeholders in the analysis of the system. PEER REVIEW The Peer Review provides counties with qualitative information about their programs by examining child welfare practices and policies that impact outcomes for children and families. The Peer Review also offers the opportunity for sharing successful efforts across counties. Peers from counties assisting with the review share information on best or promising practices used in their own county. SYSTEM IMPROVEMENT PLAN (SIP) The System Improvement Plan is the operational agreement between the CDSS and the county. The SIP is developed every five years by the lead agencies in collaboration with their local community, prevention and early intervention partners and is approved by the county Board of Supervisors (BOS). It provides an outline for how the county will improve their system of care for children and families. The SIP identifies how programs and services funded with CAPIT/CBCAP/PSSF funds will address priority needs within the CWS continuum. ANNUAL SIP PROGRESS REPORT Following the development of the five-year SIP, County Child Welfare Departments and Probation Placement Agencies, in collaboration with their community partners, will develop and submit to the CDSS an Annual SIP Progress Report. The progress report reevaluates and provides a written analysis of current performance to determine whether the SIP strategies are achieving the desired results. This provides counties an opportunity to amend or modify the SIP as necessary. The CDSS will collaborate with counties to determine if these changes warrant BOS’ approval. If the SIP Progress Report impacts CAPIT/CBCAP/PSSF funded strategies, this information will be shared with the OCAP consultant. Submission of the Annual SIP Progress Report does not relieve counties of the requirement to file an annual report for the CAPIT/CBCAP/PSSF Programs. QUARTERLY DATA REPORTS The data utilized in the C-CFSR represent the children and families receiving child welfare services in California. The CDSS issues Quarterly Data Reports that include outcome-based data focused on core safety, permanency and well-being measures for each county’s child welfare and probation placement youth populations. Analyzing data in relation to the outcome measures provides valuable information to counties about the successes and/or challenges present in the system that impact the lives of children and families served. The primary data utilized throughout the C-CFSR is derived from the Child Welfare Services/Case management System (CWS/CMS) and is extracted approximately one month after a quarter ends. Reports are released during the months of January, April, July and October. The Quarterly Data Report provides summary data for program measures as the basis for the C-CFSR and is used to track state and county performance over time. Data is used to inform and guide both the assessment and planning processes, and to analyze policies and procedures. This level of evaluation allows for a systematic assessment of program strengths and limitations in order to improve service delivery. Linking program processes and performance with outcome measures helps evaluate progress and modify the program and/or practice as appropriate. The information obtained from the Quarterly Data Reports is used by the county to make decisions about future program goals and strategies. Analysis of this type is best viewed as a continuous process of quality improvement as opposed to a one-time activity. TECHNICAL ASSISTANCE (TA) The CDSS partners with the county throughout the C-CFSR process. The CDSS staff provides technical assistance (TA) in the development, review and approval of the CSA, SIP and Annual Progress Report. State staff assists with the identification and sharing of best and promising practices between counties. The state assists counties in accessing resources and information within the CDSS, including connecting counties to other bureaus and divisions within the department. Consultants provide training to counties needing assistance in data analysis, identification of best practices, access to current literature and research on child welfare practice and support the county in the development of methods and facilitation of stakeholder engagement.  QUARTERLY CONTACT These meetings offer counties and the state the opportunity to discuss the effectiveness of the strategies contained within the SIP, trends in other outcome measures. Counties are encouraged to share changes to county programs, staffing and/or funding issues, and the progress or challenges experienced by the county in implementing action steps and reaching the target improvement goals outlined in their SIP. technical assistance technical assistance

The System Improvement Plan (SIP) An agreement between the CDSS and the county. Developed every 5 years by lead agencies in collaboration with their local stakeholders. Based on the findings from the self-assessment and peer review, provides an outline for how the county will improve their system of care for children & families. Identifies how programs and services funded with CAPIT/CBCAP/PSSF funds will address priority needs within the CWS continuum. Approved by the county Board of Supervisors CAPIT = Child Abuse Prevention Intervention and Treatment CBCAP = Community-Based Child Abuse Prevention PSSF = Promoting Safe and Stable Families

LA County System Improvement Goals CFSR 3-S2 Recurrence of Maltreatment CFSR 3-P1 Permanency in 12 Months for Children Entering Foster Care County Case Review Items 1, 12, & 13 Enhance Quality Assurance System Meet or surpass the 9.1% National Standard for 4 consecutive quarters. Focus children 0-5 and African American. Improve by 10%. Companion indication (3-P4) will continue movement towards 8.3% National Standard Increase percentage of CFSR case reviews receiving “Strength” rating on Child Well-Being Outcome 1, Items 12 & 13. Joined quarterly data-driven decision making meetings in place for DCFS, Probation child welfare and contractors

child welfare data measurement

The Current Placement System* (highly simplified) the foster care system a bunch of stuff happens CHILD IN CHILD OUT This is what people outside the system thinks happen. *Adapted from Lyle, G. L., & Barker, M.A. (1998). Patterns & Spells: New Approaches to Conceptualizing Children’s Out of Home Placement Experiences. Chicago, IL: American Evaluation Association Annual Conference. 13

Counterbalanced Indicators of System Performance rate of referrals/ substantiated referrals home-based services vs. out of home care reentry to care permanency through reunification, adoption, or guardianship use of least restrictive form of care We really know that child welfare data measurement includes many different outcomes, some which may work against others. Child welfare agencies are striving for a balance between these multiple indicators. length of stay positive attachments to family, friends, and neighbors stability of care Source: Usher, C.L., Wildfire, J.B., Gogan, H.C. & Brown, E.L. (2002). Measuring Outcomes in Child Welfare. Chapel Hill, NC:  Jordan Institute for Families,

3 Key Data Views in Child Welfare Entry Cohorts Exit Point in Time In addition to the issue of different (and sometimes competing) measures, it is also important to understand that the data can be examined multiple way, some of which give an accurate picture of what happened/happens to a child in the child welfare system, and others which may skew the picture. The first question that has to be answered is, “Whose outcomes do I want to measure?” There basic are 3 choices: Children in foster care - the active caseload (other terms: point-in-time, cross-section, or census) Children leaving foster care - children who left placement in the last year (other terms: an exit cohort) Children entering foster care - children placed during some period of time, usually one year (other terms: an admission cohort) Each of these approaches represents a different way to sample the children who have ever been in foster care

What is the difference? Cross-Sectional/Point-in-time - Only children in care Exit cohort - Only children who left care Entry cohort - All children who entered

What are the implications? It is much harder to measure outcomes over time using either a point-in-time or an exit cohort sample because the samples are missing some children: A point-in-time analysis is missing the kids who left placement An exit cohort only includes kids who leave You can’t assess change if you leave out either of these children because their experiences aren’t factored into the outcomes. All children have to be included in the system for monitoring outcomes.

PIT Snapshots vs Entry Cohorts Jan. 1, 2016 Another problem with point-in-time data: the over-capture of long-stayers. Jan. 1, 2015 Jan. 1, 2017

Tracking an Entry Cohort for 1 Year 2015 2016 Dec. 31 Dec. 31 Jul. 7 Jul. 7 Mar. 1 Mar. 1 How Entry Cohorts work Jan. 1 Dec. 31 Jan. 1 Dec. 31

federal CFSR3 measures

Outcomes: Safety Children are, first and foremost, protected from abuse and neglect. Children are safely maintained in their homes whenever possible and appropriate.

CFSR3 Data Indicators: Safety S1: Maltreatment in foster care “Of all children in care during the 12-month period, what is the rate of victimization per day?” S2: Recurrence of maltreatment “Of all children with a substantiated allegation during the 12-month period, what percent had another substantiated allegation within 12 months?” S1: Of all children in foster care during a 12-month period, what is the rate of victimization per day of foster care? What’s changed from CFSR 2? Rate of maltreatment per child days in foster care vs. percentage of children not maltreated in foster care Includes all maltreatment types by any perpetrator vs. just maltreatment by foster parents/facility staff Includes: All days in foster care during the year (across episodes) Multiple incidents of substantiated maltreatment for the same child are included in the numerator Excludes: Children in care for less than 8 days Incidents occurring before or within 7 days of the date of removal Children age 18+ Days in care after 18th birthday S2: Of all children who were victims of a substantiated report of maltreatment during a 12-month reporting period, what percent were victims of another substantiated maltreatment allegation within 12 months of their initial report? Window is 12 months vs. 6 months Recurrence vs. no recurrence Children age 18+ at initial report Substantiated allegations occurring within 14 days of initial report

S1: Maltreatment in foster care Cohort: Children in Care Between Apr 2015 – Mar 2016 Child A Days in care: 275 Instances of maltreatment: 0 Denominator: total days in care 275 + 45 + 310 + 95 + 188 = 913 1 Numerator: instances of maltreatment 0 + 1 + 2 + 0 + 0 = 3 2 Child B Days in care: 45 Instances of maltreatment: 1 Calculate rate of maltreatment per day in care 3 / 913 = 0.003286 3 Child C Days in care: 310 Instances of maltreatment: 2 S1: “Of all children in care during the 12-month period, what is the rate of victimization per day?” Days in care – across episodes Maltreatment – includes multiple instances/child Multiply by 100,000 0.003286 * 100,000 = 328.6 victimizations per 100,000 days in foster care 4 Child D Days in care (episode 1): 95 Instances of maltreatment: 0 Days in care (episode 2): 188 National Standard: <= 8.50 per 100,000

S2: Recurrence of maltreatment 04/1/14 4/1/15 4/1/16 Children with a substantiated allegation during the 12-month period: 6 Children with another substantiated allegation within 12 months: 3 Performance (P1): 50% National Standard: <=9.1% S2: “Of all children with a substantiated allegation during the 12-month period, what percent had another substantiated allegation within 12 months?” Child 1: 7 months, first substantiated allegation prior to 12-month period Child 2: 20 months, first substantiated allegation during 12-month period, second substantiated allegation after 12 months Child 3: 17 months, first substantiated allegation prior to 12-month period Child 4: 9 months, first substantiated allegation during 12-month period, second substantiated allegation within 12 months Child 5: 4 months, first substantiated allegation prior to 12-month period Child 6: 20 months, first substantiated allegation during 12-month period, no second allegation Child 7: 5 months, first substantiated allegation during 12-month period, second substantiated allegation within 12 months Child 8: 22 months, first substantiated allegation during 12-month period, second substantiated allegation after 12 months Child 9: 2 months, first substantiated allegation prior to 12-month period Child 10: 7 months, first substantiated allegation during 12-month period, second substantiated allegation within 12 months

Case Review Outcomes: Safety Case Review Item 1: Timeliness of Initiating Investigations of Reports of Child Maltreatment Item 2: Services to Family to Protect Child(ren) in the Home and Prevent Removal or Re-Entry Into Foster Care Item 3: Risk and Safety Assessment and Management

Outcomes: Permanency Children have permanency and stability in their living arrangements. The continuity of family relationships and connections is preserved for children.

CFSR3 Data Indicators Permanency P1: Permanency in 12 months for children entering foster care “Of all children who entered care in the 12-month period, what percent discharged to permanency within 12 months?” Trial Home Visit (THV) Adjustment: Children who have a discharge to reunification that was preceded by a trial home visit will have their length of stay adjusted to be at the time of the entry to the THV plus 30 days…and THV +30 will be considered the date they exited to permanency, even if the actual episode ends later. P1: Of all children who enter foster care in a 12-month period, what percent discharged to permanency within 12 months of entering foster care? What’s changed from CFSR 2? Expanded definition of permanence includes reunification, adoption, or guardianship vs. reunification only Includes all children entering foster care during the year vs. just those who were removed for the first time Entry cohort window is 12 months vs. 6 months Excluded: Children in care for less than 8 days Children entering care at age 18+

P1: Permanency in 12 months for children entering foster care 04/1/14 4/1/15 4/1/16 Children entering care during the year: 6 Children achieving permanency within 12 months: 4 Performance (P1): 67% National Standard: >=40.5% P1: “Of all children who enter foster care in a 12-month period, what percent discharged to permanency within 12 months of entering foster care?” Child 1: 7 months, entered care prior to 12-month period, exit to reunification Child 2: 2 months, entered care during 12-month period, exit to reunification Child 3: 17 months, entered care prior to 12-month period, exit to reunification, but not within 12 months Child 4: 9 months, entered care during 12-month period, exit to guardianship Child 5: 4 months, entered care prior to 12-month period, exit to reunification Child 6: 20 months, entered care during 12-month period, no exit Child 7: 5 months, entered care during 12-month period, exit to reunification Child 8: 17 months, entered care during 12-month period, exit to reunification, but not within 12 months Child 9: 2 months, entered care prior to 12-month period, exit to reunification Child 10: 7 months, entered care during 12-month period, exit to reunification

CFSR3 Data Indicators Permanency (con’t) P2/P3: Permanency in 12 months for children in foster care for 12-23 months (P2) or for 24 months or more (P3) “Of all children in care on the first day of the 12-month period who had been in care between 12 and 23 months (P2) or for 24 months or more (P3), what percent discharged to permanency within 12 months?” P2/P3: Of all children in foster care on the first day of the 12-month period, who had been in foster care (in that episode) for 12-23 months (P2) or for 24 months or more (P3), what percent discharged to permanency within 12 months of the first day? What’s changed from CFSR 2? P2 is a new measure with an intermediate time period (between 12 and 23 months) Excludes: Children who were age 18+ on the first day of the year No Trial Home Visit adjustment

P2/P3: Entry & Length of Stay for months 4/1/12 4/1/13 4/1/14 4/1/15 4/1/16 Children in care less than 12 months prior to censor date: 4 Children in care for 12-23 months prior to censor date: 6 Children in care for more than 24 months prior to censor date: 5 Child 1: No time prior to first day, exit to reunification (7 months total) Child 2: 23 months prior to first day, no exit (more than 48 months total) Child 3: 1 month prior to first day, exit to reunification (2 months total) Child 4: 36 months prior to first day, exit to adoption (46 months total) Child 5: 24 months prior to first day, exit to reunification (30 months total) Child 6: 12 months prior to first day, exit to guardianship (14 months total) Child 7: 10 months prior to first day, no exit (37 months total) Child 8: 14 months prior to the first day, exit to reunification (22 months total) Child 9: 22 months prior to the first day, exit to guardianship (46 months total) Child 10: 18 months prior to the first day, exit to adoption (20 months total) Child 11: 25 months prior to the first day, exit to adoption (38 months total) Child 12: No time prior to first day, exit to reunification (6 months total) Child 13: 27 months prior to the first day, exit to adoption (34 months total) Child 14: 14 months prior to the first day, exit to reunification (18 months total) Child 15: No time prior to the first day, exit to reunification (2 months total) Child 16: 30 months prior to the first day, exit to guardianship (48 months total) Child 17: 1 month prior to first day, exit to reunification (13 months total) Child 18: 6 months prior to the first day, exit to adoption (11 months total)

P2: Permanency in 12 months for children in care for 12-23 months 4/1/12 4/1/13 4/1/14 4/1/15 4/1/16 Children in care on the first day of the censor year who had been in care for 12-23 months: 6 Children achieving permanency within 12 months of censor date: 4 Performance (P2): 67% National Standard: >=43.6% P2: “Of all children in care on the first day of the 12-month period who had been in care between 12 and 23 months, what percent discharged to permanency within 12 months?” Child 1: No time prior to first day, exit to reunification (7 months total) Child 2: 23 months prior to first day, no exit (more than 48 months total) Child 3: 1 month prior to first day, exit to reunification (2 months total) Child 4: 36 months prior to first day, exit to adoption (46 months total) Child 5: 24 months prior to first day, exit to reunification (30 months total) Child 6: 12 months prior to first day, exit to guardianship (14 months total) Child 7: 10 months prior to first day, no exit (37 months total) Child 8: 14 months prior to the first day, exit to reunification (22 months total) Child 9: 22 months prior to the first day, exit to guardianship (46 months total) Child 10: 18 months prior to the first day, exit to adoption (20 months total) Child 11: 25 months prior to the first day, exit to adoption (38 months total) Child 12: No time prior to first day, exit to reunification (6 months total) Child 13: 27 months prior to the first day, exit to adoption (34 months total) Child 14: 14 months prior to the first day, exit to reunification (18 months total) Child 15: No time prior to the first day, exit to reunification (2 months total) Child 16: 30 months prior to the first day, exit to guardianship (48 months total) Child 17: 1 month prior to first day, exit to reunification (13 months total) Child 18: 6 months prior to the first day, exit to adoption (11 months total)

P3: Permanency in 12 months for children in care for 24+ months 4/1/12 4/1/13 4/1/14 4/1/15 4/1/16 Children in care on the first day of the censor year who had been in care for more than 24 months: 5 Children achieving permanency within 12 months of censor date: 3 Performance (P3): 60% National Standard: >=30.3% P3: “Of all children in care on the first day of the 12-month period who had been in care for 24 months or more, what percent discharged to permanency within 12 months?” Child 1: No time prior to first day, exit to reunification (7 months total) Child 2: 23 months prior to first day, no exit (more than 48 months total) Child 3: 1 month prior to first day, exit to reunification (2 months total) Child 4: 36 months prior to first day, exit to adoption (46 months total) Child 5: 24 months prior to first day, exit to reunification (30 months total) Child 6: 12 months prior to first day, exit to guardianship (14 months total) Child 7: 10 months prior to first day, no exit (37 months total) Child 8: 14 months prior to the first day, exit to reunification (22 months total) Child 9: 22 months prior to the first day, exit to guardianship (46 months total) Child 10: 18 months prior to the first day, exit to adoption (20 months total) Child 11: 25 months prior to the first day, exit to adoption (38 months total) Child 12: No time prior to first day, exit to reunification (6 months total) Child 13: 27 months prior to the first day, exit to adoption (34 months total) Child 14: 14 months prior to the first day, exit to reunification (18 months total) Child 15: No time prior to the first day, exit to reunification (2 months total) Child 16: 30 months prior to the first day, exit to guardianship (48 months total) Child 17: 1 month prior to first day, exit to reunification (13 months total) Child 18: 6 months prior to the first day, exit to adoption (11 months total)

CFSR3: Data Indicators Permanency (con’t) P4: Re-entry to foster care “Of all children who enter care in the 12-month period who discharged within 12 months to reunification or guardianship, what percent re-enter foster care within 12 months.” P5: Placement stability “Of all children who enter care in the 12-month period, what is the rate of placement moves per day?” P4: Of all children who enter foster care in a 12- month period and are discharged within 12 months to reunification or guardianship, what percent re-entered foster care within 12 months of their date of discharge? What’s changed from CFSR 2? Entry cohort (denominator includes all children who enter care during the year and exit within 12 months) vs. all children who exit during the year Includes exits to reunification and guardianship vs. reunification only Excluded: Children in care for less than 8 days Children entering or exiting care at age 18+ Note: If a child has multiple re-entries to foster care within 12 months of their discharge, only the first re-entry is selected. P5: Of all children who enter foster care in a 12- month period, what is the rate of placement moves per day of foster care? What’s changed? Entry cohort vs. all children in care for less than 12 months Controls for time in care by constructing a moves/placement day vs. the number of moves per child Accurately accounts for actual number of moves vs. the prior “2 or more” indicator The initial removal from home (and into foster care) is not counted as a placement move.

P4: Re-Entry to Foster Care 04/1/14 4/1/15 4/1/16 Children entering care during the year: 6 Children achieving permanency within 12 months: 4 Children reentering foster care within 12 months of date of discharge: 2 Performance (P4): 50% National Standard: <=8.3% 8 months P4: “Of all children who enter foster care in a 12- month period and are discharged within 12 months to reunification or guardianship, what percent re-entered foster care within 12 months of their date of discharge?” Child 1: 7 months, entered care prior to 12-month period, exit to reunification Child 2: 2 months, entered care during 12-month period, exit to reunification Child 3: 17 months, entered care prior to 12-month period, exit to reunification, but not within 12 months Child 4: 9 months, entered care during 12-month period, exit to guardianship Child 5: 4 months, entered care prior to 12-month period, exit to reunification Child 6: 20 months, entered care during 12-month period, no exit Child 7: 5 months, entered care during 12-month period, exit to reunification Child 8: 17 months, entered care during 12-month period, exit to reunification, but not within 12 months Child 9: 2 months, entered care prior to 12-month period, exit to reunification Child 10: 7 months, entered care during 12-month period, exit to reunification 4 months

P5: Placement Stability Cohort: Children Entering Care Between Apr 2013 – Mar 2014 Child A Days in care: 342 Placement moves: 2 Denominator: total days in care 342 + 196 + 35 + 167 + 154 = 894 1 Numerator: placement moves 2 + 0 + 1 + 1 + 0 = 4 2 Child B Days in care: 196 Placement moves: 0 Calculate rate of moves per day in care 4 / 894 = 0.00447 3 Child C Days in care (episode 1): 35 Placement moves: 1 Days in care (episode 2): 167 P5: “Of all children who enter care in the 12-month period, what is the rate of placement moves per day?” Days in care/placement moves – across episodes Multiply by 1,000 0.00447 * 1,000 = 4.5 placement moves per 1,000 days in foster care 4 National Standard: <= 4.12 per 1,000 Child D Days in care: 154 Placement moves: 0

Case Review Outcomes: Permanency Case Review Item 4: Stability of Foster Care Placement Item 5: Permanency Goal for Child Item 6: Achieving Reunification, Guardianship, Adoption, or Other Planned Permanent Living Arrangement

Case Review Outcomes: Permanency (con’t) Case Review Item 7: Placement with Siblings Item 8: Visiting with Parents and Siblings in Foster Care Item 9: Preserving Connections Item 10: Relative Placement Item 11: Relationship of Child in Care with Parents

Outcomes: Well-Being Families have enhanced capacity to provide for their children's needs. Children receive appropriate services to meet their educational needs. Children receive adequate services to meet their physical and mental health needs.

Case Review Outcomes: Well-Being Case Review Item 12: Needs and Services of Child (12A), Parents (12B), and Foster Parents (12C) CR Item 13: Child and Family Involvement in Case Planning CR Item 14: Caseworker Visits with Child CR Item 15: Caseworker Visits with Parents

Case Review Outcomes: Well-Being Case Review Item 16: Educational Needs of the Child CR Item 17: Physical Health of the Child CR Item 18: Mental/Behavioral Health of the Child

Additional Statewide Indicators Participation Rates Timely Response (Investigation & Visitation) Sibling Placement Least Restrictive Placement ICWA/Native American Placement Status Timely Health/Dental Exams Psychotropic Medications Individualized Education Plans Exit Outcomes for Youth Aging out of Foster Care

… Break …

examining child welfare data using the ccwip website

Website http://cssr.berkeley.edu/ucb_childwelfare/Default.aspx Demo using actual page navigation on website

Report Index: Federal (CFSR) Measures http://cssr.berkeley.edu/ucb_childwelfare/ReportDefault.aspx Demo using actual page navigation on website

Report Index: State (C-CFSR) Measures http://cssr.berkeley.edu/ucb_childwelfare/ReportDefault.aspx Demo using actual page navigation on website

LA County Portal http://cssr.berkeley.edu/ucb_childwelfare/LAHilton/ Demo using actual page navigation on website

LA County Portal http://cssr.berkeley.edu/ucb_childwelfare/LAHilton/ReportDefault.aspx Demo using actual page navigation on website

Methodology Links Demo using actual page navigation on website

Multiple Time Periods

Office Listings & Comparisons

Additional Subgroup Filters

Additional Subgroup Filters

Multi-Report Option

Diving Deeper: Data activity with measure 3-p1

From SIP: “Los Angeles County child welfare has seen significant reduction in moves to permanency since 2010. While there has been an increase in the total number of children removed, moves to all forms of permanency have decreased.” Children under age one and children age 16 through 17 experience the lowest percentage of moves to permanency in the first 12 months following removal dates. African American children consistently experience delays to timely permanency, while Asian/Pacific Islander youth more often meet or surpass the National Standard for permanency in 12 months.

From SIP: “Los Angeles County child welfare has seen significant reduction in moves to permanency since 2010. While there has been an increase in the total number of children removed, moves to all forms of permanency have decreased.” Children under age one and children age 16 through 17 experience the lowest percentage of moves to permanency in the first 12 months following removal dates. African American children consistently experience delays to timely permanency, while Asian/Pacific Islander youth more often meet or surpass the National Standard for permanency in 12 months.

From SIP: “Los Angeles County child welfare has seen significant reduction in moves to permanency since 2010. While there has been an increase in the total number of children removed, moves to all forms of permanency have decreased.” Children under age one and children age 16 through 17 experience the lowest percentage of moves to permanency in the first 12 months following removal dates. African American children consistently experience delays to timely permanency, while Asian/Pacific Islander youth more often meet or surpass the National Standard for permanency in 12 months.

Building Connections Activity Attendees are assigned an official outcome measuring child welfare performance. Outcome Group examines the CCWIP website to understand how various groups are differentially affected. They examine other CCWIP reports that may be relevant to the outcome. Nuances Groups brainstorm county resources available to influence these outcomes or measure proximate outcomes. They discuss barriers they have encountered in practice to implementing these resources. Resources & Barriers Groups strategize on how individual social workers can overcome barriers and implement the resources available to “move the needle” on their assigned outcome. Worker Action Overview of activity

Building Connections: Measure 3-P1 Outcome: What is Being Measured? Nuances: Who is Most Impacted? Barriers: What Makes Success Difficult? Resources: What Makes Success Possible? Outcome: Attendees can describe how the measure is constructed to measure child welfare performance. Nuances: Attendees examine the CCWIP website to understand how various groups are differentially affected. They examine other CCWIP reports that may be relevant to the outcome. Barriers & Resources: Attendees brainstorm county resources available to influence these outcomes or measure proximate outcomes. They discuss barriers they have encountered in practice to implementing these resources. Major Strategy in the SIP: “Utilize child and family team based practices to ensure children spend no more time than needed in out of home care.”

Upcoming

[ www.datanetwork.org ]

Thank You! The California Child Welfare Indicators Project (CCWIP) is a collaboration of the California Department of Social Services and the School of Social Welfare, University of California at Berkeley, and is supported by the California Department of Social Services, Casey Family Programs, and the Conrad N. Hilton Foundation.

Questions? Wendy Wiegmann wendy.wiegmann@berkeley.edu 510-643-0839