703: Data, Outcomes and Practice: Connecting the Dots CWTP Leadership Academy Conference September 29, The Pennsylvania Child Welfare Training Program

The DAPIM™ Model 1. Define 2. Assess 3. Plan 4. Implement 5. Monitor 2 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Define New Data Package  Population Flow  Outcome Measures Old Data Package  CFSR Composites  CFSR Measures  Permanency Measures  Safety Indicators 3 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Assess New Data Package  Trends  Geographic Comparisons  County Trends  County to Class  County to Region  County to State Old Data Package  Trends  Geographic Comparisons  Case Characteristics  Age  Race / Ethnicity  Gender  Reason for Removal  Placement Setting  JPO Status 4 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Plan – In what direction are trends moving? – What populations are positively affected? – What populations are negatively affected? – What programmatic or practice changes – internal or external to the county – impacted the results. 5 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Permanency 6 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Measure The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Implement – What lessons can be learned from populations with positive trends? – What are the needs of populations with unfavorable trends? – What steps need to be implemented to effect change? – Do policies need to be changed or implemented? – What external sources (e.g. judges) need to be involved? 8 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Measure The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Measure The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Measure 3.1 Question for the Group: What does it all mean? 11 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Monitor – Time needed to have a measurable effect – Understand concurrent influences – Set benchmarks 12 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

(break) 13 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Practical Examples A How-To Guide for Digging Deeper 14 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

How to Look at the Data Why is the data from last year? 15 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example - Adoption 16 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example - Adoption Of all children who were in foster care on the first day of the period, and who were in foster care for seventeen continuous months or longer, what percent were discharged to a finalized adoption within twelve months of the first day of the period? This measure excludes children who, as of the first day of the period, were placed in a kinship setting. 17 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Adoption Of all children who were in foster care on the first day of the period, and who were in foster care for seventeen continuous months or longer, what percent were discharged to a finalized adoption within twelve months of the first day of the period? This measure excludes children who, as of the first day of the period, were placed in a kinship setting. 18 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example 19 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

How to Look at the Data What sort of data is it? 20 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Descriptive 21 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Prescriptive 22 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

How to Look at the Data What is a trend? What does it look like? Is it really a trend? 23 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Is this a Trend? 24 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

How about this? 25 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

What To Look At Start with the graphs. Use the tables to drill down. Review: Everything in the New Data Packages CFSR Composite Scores 26 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

How to Look at the Data Why not look at everything? 27 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

How to Look at the Data OK, I understand how to look at the graphs to identify measures I need to understand better, but – How do I dig into the data? How do I identify demographic / case specific trends? 28 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Where Can We Find Demographic Data? Old Data Package – Measure worksheets. New Data Package – Case Level Data 29 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Sliced, Diced, Served » Geographic – Class, Region, Statewide » Age » Race / Ethnicity » Gender » JPO Status » Kinship Status » Removal Reason 30 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Measure 1.1 Who is driving this change? 31 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Sliced, Diced, Served » Geographic – Class, Region, Statewide » Age » Race / Ethnicity » Gender » JPO Status » Kinship Status » Removal Reason 32 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Measure The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Measure The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Excel Tricks 1.Use a Highlighter 2.Add things up, quickly 3.Compare Groups 4.Succeed with small numbers 35 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Small Numbers / Compare Groups Small Numbers Affects Small Counties & Smaller Groups It is often useful to compare two groups and get an Average 36 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Compare Groups 37 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Compare Groups 38 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Compare Groups 39 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Compare Groups 40 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Example – Compare Groups 41 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Ask Hard Questions! Think about when the trend started. Ask yourself about: – Policy Changes – Personnel Changes – External Factors – Demographic Changes 42The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Questions to Ask Yourself Basic questions included with data packages. Are only a starting point. Additional questions will depend on answers to initial questions 43 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Connect the Dots DAPIM™, Flywheels, Data Packages & You 44 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

Questions? Hornby Zeller Associates, Inc. (717) The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots