1. Implementation of the WFI-EZ in a Multi-Site Wraparound Agency March 3, 2014

2. Choices Care Management Entity – System of Care – Wraparound – Managed Care Established in 1997 Over 1500 youth served daily

3. Agenda Choices experience with the WFI Integrating the WFI-EZ into Practice Using the WFI for Quality Improvement

4. Experience with WFI 3.0 and 4.0 Wraparound Comparison Study – Dawn Project – University of Maryland Choices Technical Assistance Center – Subcontractor – Choices Outcomes and Evaluation Staff

5. Experience with WFI 3.0 and 4.0 Advantages – External evaluation – Trained interviewers – Alignment with phases and principles Disadvantages – Staff resources – Completion rates – Limited assessment options

6. WFI-EZ Short-form – Wraparound Fidelity – Youth Outcomes – Satisfaction Self-Report – Paper – On-line – Interview

7. Part 1 Integrating the WFI-EZ into Practice

8. Administration Options On-line – Care Coordinators introduce – Email to caregivers – Survey Monkey Challenges – Caregivers have limited access to Internet – Reading levels

9. Administration Options Paper – Care Coordinators introduce – CCs give survey to families Sign sealed envelope and return Mail in stamped envelope Challenges – Potential for bias – Reading levels

10. Administration Options Interviews – Program staff – CCs introduces – Conducted by phone Challenges – Resource cost – Successful contacts with caregivers – WFI-EZ format

11. Implementation Process Allowed sites to select method Generated random samples CCs completed WFI-EZ on one youth 30 days to get completed surveys from caregivers

12. Results 3 of 4 sites selected paper surveys 1 site conducted phone interviews Response rates – Interviews (44%) – Paper (22-36%)

13. Results Consistent data quality Bias from CC involvement not observed Cost/benefit analysis

14. Next Steps 2 nd administration underway Improve CC introduction to WFI-EZ Formalize mechanism for returning paper surveys Incentives for caregivers and youth

15. Part 2 Using the WFI-EZ for Quality Improvement

16. Importance of the WFI-EZ Family voice Fidelity monitoring vs. task management Opportunities for quality improvement

17. Quality Improvement Multiple levels of analysis Opportunities for celebration Common areas for improvement Site-specific strengths and needs

18. Total Caregiver Fidelity Score 18 WFI Louisiana - October 2013

19. Wraparound Fidelity Principles

20. Strength and Family Driven

21. Satisfaction

22. Outcomes

23. Quality Improvement Multiple Levels – Agency – Programs – Teams Multiple Data Sources – Fidelity – Process measures – Outcomes

24. Conclusions Integrate WFI-EZ into practice Balance response rates and resources Quality improvement requires multiple types of data Ongoing assessment is important

25. Thank You! Vicki Sprague Effland, Ph.D. Director, Outcomes and Evaluation Choices, Inc. 4701 N. Keystone Ave., #150 Indianapolis, IN 46205 (317) 205-8232 Veffland@ChoicesTeam.org