1. 703: Data, Outcomes and Practice: Connecting the Dots CWTP Leadership Academy Conference September 29, 2010 1 The Pennsylvania Child Welfare Training Program

2. The DAPIM™ Model 1. Define 2. Assess 3. Plan 4. Implement 5. Monitor 2 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

3. Define New Data Package  Population Flow  Outcome Measures Old Data Package  CFSR Composites  CFSR Measures  Permanency Measures  Safety Indicators 3 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

4. Assess New Data Package  Trends  Geographic Comparisons  County Trends  County to Class  County to Region  County to State Old Data Package  Trends  Geographic Comparisons  Case Characteristics  Age  Race / Ethnicity  Gender  Reason for Removal  Placement Setting  JPO Status 4 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

5. Plan – In what direction are trends moving? – What populations are positively affected? – What populations are negatively affected? – What programmatic or practice changes – internal or external to the county – impacted the results. 5 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

6. Example – Permanency 6 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

7. Example – Measure 3.1 7 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

8. Implement – What lessons can be learned from populations with positive trends? – What are the needs of populations with unfavorable trends? – What steps need to be implemented to effect change? – Do policies need to be changed or implemented? – What external sources (e.g. judges) need to be involved? 8 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

9. Example – Measure 3.1 9 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

10. Example – Measure 3.1 10 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

11. Example – Measure 3.1 Question for the Group: What does it all mean? 11 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

12. Monitor – Time needed to have a measurable effect – Understand concurrent influences – Set benchmarks 12 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

13. (break) 13 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

14. Practical Examples A How-To Guide for Digging Deeper 14 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

15. How to Look at the Data Why is the data from last year? 15 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

16. Example - Adoption 16 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

17. Example - Adoption Of all children who were in foster care on the first day of the period, and who were in foster care for seventeen continuous months or longer, what percent were discharged to a finalized adoption within twelve months of the first day of the period? This measure excludes children who, as of the first day of the period, were placed in a kinship setting. 17 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

18. Example – Adoption Of all children who were in foster care on the first day of the period, and who were in foster care for seventeen continuous months or longer, what percent were discharged to a finalized adoption within twelve months of the first day of the period? This measure excludes children who, as of the first day of the period, were placed in a kinship setting. 18 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

19. Example 19 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

20. How to Look at the Data What sort of data is it? 20 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

21. Example – Descriptive 21 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

22. Example – Prescriptive 22 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

23. How to Look at the Data What is a trend? What does it look like? Is it really a trend? 23 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

24. Is this a Trend? 24 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

25. How about this? 25 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

26. What To Look At Start with the graphs. Use the tables to drill down. Review: Everything in the New Data Packages CFSR Composite Scores 26 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

27. How to Look at the Data Why not look at everything? 27 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

28. How to Look at the Data OK, I understand how to look at the graphs to identify measures I need to understand better, but – How do I dig into the data? How do I identify demographic / case specific trends? 28 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

29. Where Can We Find Demographic Data? Old Data Package – Measure worksheets. New Data Package – Case Level Data 29 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

30. Sliced, Diced, Served » Geographic – Class, Region, Statewide » Age » Race / Ethnicity » Gender » JPO Status » Kinship Status » Removal Reason 30 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

31. Example – Measure 1.1 Who is driving this change? 31 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

32. Sliced, Diced, Served » Geographic – Class, Region, Statewide » Age » Race / Ethnicity » Gender » JPO Status » Kinship Status » Removal Reason 32 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

33. Example – Measure 1.1 33 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

34. Example – Measure 1.1 34 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

35. Excel Tricks 1.Use a Highlighter 2.Add things up, quickly 3.Compare Groups 4.Succeed with small numbers 35 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

36. Small Numbers / Compare Groups Small Numbers Affects Small Counties & Smaller Groups It is often useful to compare two groups and get an Average 36 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

37. Example – Compare Groups 37 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

38. Example – Compare Groups 38 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

39. Example – Compare Groups 39 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

40. Example – Compare Groups 40 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

41. Example – Compare Groups 41 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

42. Ask Hard Questions! Think about when the trend started. Ask yourself about: – Policy Changes – Personnel Changes – External Factors – Demographic Changes 42The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

43. Questions to Ask Yourself Basic questions included with data packages. Are only a starting point. Additional questions will depend on answers to initial questions 43 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

44. Connect the Dots DAPIM™, Flywheels, Data Packages & You 44 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots

45. Questions? Hornby Zeller Associates, Inc. (717) 540-7740 45 The Pennsylvania Child Welfare Training Program Data, Outcomes, Practice: Connecting the Dots