Getting to Outcomes: How to do strategic planning with your CRP Theresa Costello National Resource Center for Child Protective Services May 25, 2007

If you don’t know where you are going, how will you know when you get there? -Yogi Berra

Logic Model A picture of how your program works – the theory and assumptions underlying the program. It links outcomes with program activities/processes and the theoretical assumptions/principles of the program. Provides a roadmap of your program and how desired outcomes are achieved. (W.K. Kellogg Foundation, 1998, p. 35).

Inputs Anything a system uses to accomplish its purposes. Resources & raw materials (e.g., funding, staff, facilities, equipment, clients, presenting problems) that go into a human service program. Martin & Kettner, 1996

Outputs Anything a system produces (time, contact units, material units). Examples: –# of hours of individual counseling provided this month (time units) –# of home visits delivered this month (contact units) –# of parenting group sessions provided this month (contact units) –# of bus tokens provided to clients (material units) Martin & Kettner, 1996

Outcome The results or accomplishments that are at least partially attributable to a service or program. –Quality of life changes in client conditions, status, behavior, functioning, attitudes, feelings, perceptions. Martin and Kettner (1996)

Outcome Indicator A measure, for which data are available, which helps quantify the achievement of an outcome. –Child safety: % of families without an indicated report of child maltreatment within a 12-month period of case opening –Child well-being: % of children who graduate from high school Martin and Kettner (1996)

SMART Indicators Specific Measurable Achievable Realistic Time Limited

Link between problems, assumptions, programs, & outcomes The assumptions about what causes the problem should lead to the purpose of the program and the services that are provided. The assumptions about the purpose of the program should lead to the selection about program outcomes. Revised from Martin & Kettner, 1996, p. 21

Developing Logic Models

Logic Model A graphic representation that shows logical relationships between inputs, outputs and outcomes relative to a situation SITUATIONSITUATION INPUTSOUTCOMESOUTPUTS Taylor-Powell, n.d.

HEADACHEHEADACHE Headache gone; Return to work Get pillsTake pills Everyday Logic Model Taylor-Powell, n.d.

Logic Model Frameworks Differ by purpose –Program design & planning –Program implementation –Program evaluation & strategic reporting –Outcomes measurement & strategic reporting Can be simple or complex depending on your audience

LOGIC MODEL: Program Performance Framework INPUTS OUTPUTS Activities Participation What we invest Staff Volunteers Time Money Materials Equipment Technology Partners What we do Workshops Meetings Counseling Facilitation Assessments Product dev. Media work Recruitment Training Who we reach Participants Customers Citizens What the short term results are Learning Awareness Knowledge Attitudes Skills Opinions Aspirations Motivations What the medium term results are Action Behavior Practice Decisions Policies Social action What the ultimate impact(s) is Conditions Social Economic Civic Environmental ASSUMPTIONS 1) 2) 3) 4) ENVIRONMENT Influential factors S I T U A T I O N Short Medium Long Term OUTCOMES – IMPACT

Staff Money Partners Design parent ed curriculum Provide 6 training session Targeted parents attend Parents increase knowledge of child dev Parents learn new ways to discipline Parents use improved parenting skills Reduced rates of child abuse & neglect INPUTSOUTPUTS OUTCOMES

Logic Model: Family Connections Inputs Diverse Funding Eligibility Criteria and Referral Procedures Trained Staff Program Objectives Examples of Core Interventions/Activities Emergency Assistance Comprehensive Family Assessment Service Plan Development Direct Counseling Services Advocacy Outputs Number of families who receive services Short-Term/ Intermediate Outcomes Increase Protective Factors Parenting Attitudes Parenting Competence Social Support Family Functioning Spirituality Caregiver Health Decrease Risk Factors Everyday Stress Parental Stress Mental Health problems Alcohol and Drug abuse Family Conflict Long-Term Outcomes Increase child safety Increase child well-being Increase child permanency/ stability Adapted from Alison Metz, JBA Associates

Logic Model: Family Connections InputsActivities Long-Term Outcomes *OCAN *Annie E. Casey *DHR *Title IVE *Emergency Services *Family Assessment *Service Planning *Advocacy *Multi-Family *Home Health *Legal Child Safety Child Well-Being Permanency/Stability Short-Term Outcomes Increase Protective Factors Decrease Risk Factors Resources Services IntermediateBenefits

(Sample) Family Connections’ Logic Model Program Purpose Outputs (provided per quarter) Program Outcome & Indicators Quality Outputs (per quarter) Assumptions: Child neglect is the result of the complex interplay between protective and risk factors related to the child, parents, family, environment, and society. To prevent neglect & increase safety by helping families enhance protective factors & reduce risk factors # of hrs family advocacy services (time) # of individualized family assessments (contact) # of hrs of home-based counseling (time) # of food certificates (material) % of first contacts with the family advocate within 1 business day (responsiveness) % of family assessments completed within 30 days (conformity) % of families with at least weekly home based counseling (conformity) Standardized final output: # of families closed due to completion of six months of services Child Safety -children are safe from maltreatment % of families w/out an indicated CPS report at the end of services % of families w/out an indicated CPS report 12 months after the end of services

Theresa Costello