1. We work with you to create the change you envision, planning progress through knowledge and action

2. 2 Federal Evaluation of Linkages: Supporting Sustainability Prepared For CFPIC October 16, 2007

3. 3 Sustainability Starts with a Theory of Change

4. 4 Linkages Participation Linkages v1 Linkages v2 Linkages v3 No linked services Service Coordinatio n (TDM) Outcomes Organizational Change Family to Family or similar Alternative Impact Local CBO assistanc e programs CFPIC support Privatel y- funded change s Child Welfare policy changes Other policy change s CalWORKs policy changes Economic changes Linkages Theory of Change Precursors Implementation Outputs Outcomes External FactorsImplementation to Implementation

5. 5

6. 6 Sustainability Built in to Evaluation Design

7. 7 Three-Pronged Design  Retrospective Evaluation  Outcome-focused for existing programs Provides justification for sustainability  Prospective Evaluation  Links rigorous process evaluation with outcomes Supports sustainability by investigating what org change and implementation elements are needed for maintaining successful outcomes over time  Case Studies  Detailed description of three county Linkages programs Elaborates on sustainability process of existing programs

8. 8 Retrospective Design  Timeframe  Historical data from 1999-2006  Sample  Del Norte, Calaveras, Merced, Orange, San Francisco, Santa Barbara, Stanislaus  “Historical” comparison group  Measures  Organizational change  Implementation  Outcomes  External factors  Data Sources  State and County databases: CWSCMS, ISAWS, Leader, C-IV, CalWIN, EDD  Historical documents describing program development and implementation

9. 9 Prospective Design  Timeframe  2007- 2011  Sample  Selected Pioneer, Phase II, and Phase III Counties  Comparison counties with no Linkages-like programs  Measures  Rigorous process and implementation evaluation  Outcomes  External factors  Data Sources  State and County databases: CWSCMS, ISAWS, Leader, C-IV, CalWIN, EDD  Surveys of Linkages staff

10. 10 Case Studies  Timeframe  2007-2011  Sample (proposed)  Stanislaus, Los Angeles, Santa Clara  Research Questions  How is Linkages implemented?  How do Linkages activities produce outcomes?  Data Sources  Interviews with Linkages staff  Focus groups with Linkages clients

11. 11 Contact Paul Harder pharder@harderco.com Erika Lehmann, Ph.D. elehmann@harderco.com 530.757.8420 harderco.com

12. 12 Organizational Change Elements Culture Leadership Policy Administration **

13. 13 Implementation Elements Confidentiality Data Sharing Coordinated Services Co-location Training Accountability Staff Support **

14. 14 Outcomes Children experience less abuse Children safe in their homes Parents have resources to support their children Children in foster care achieve permanency **