1. Betty Bekemeier Follow-up iLinc session May 31, 2007 & Making sense of what happens as a result of our efforts Logic Models Outcome Measurement

2. W ays to Think about Outcome Measurement  Performance measurement  Evaluation  Logic models...these are not mutually exclusive!

3. W hy Do We Need to Do This?  To provide accountability.  To improve program quality.  To make decisions about resource allocation.  To help programs market themselves.  To understand our contribution to our community’s health.

4. H ow Do We Do This?  Set a goal.  Define activities.  Identify inputs or resources.  Define outcomes.  Develop outcome measures or indicators.  Build consensus around these measures. ActivitiesOutputsOutcomesGoalsResources

5. L ogic Models: “So That” Chains ResourcesOutputsOutcomesGoalActivities So That

6. Process D eveloping an Outcome Evaluation Logic Model Program inputs. Elements or ingredients that constitute the program. RESOURCES

7. Process D eveloping an Outcome Evaluation Logic Model Program inputs. Elements or ingredients that constitute the program. RESOURCES Methods for providing the program. Specific processes or events undertaken. ACTIVITIES

8. Process D eveloping an Outcome Evaluation Logic Model Program inputs. Elements or ingredients that constitute the program. RESOURCES Methods for providing the program. Specific processes or events undertaken. Units of service or product units. How many, over what duration? ACTIVITIESOUTPUTS

9. Process D eveloping an Outcome Evaluation Logic Model Program inputs. Elements or ingredients that constitute the program. RESOURCES Methods for providing the program. Specific processes or events undertaken. Units of service or product units. How many, over what duration? Short, intermediate, or longer-term changes anticipated in participants’ lives or in organizational or community conditions. Outcomes ACTIVITIESOUTPUTSOUTCOMES

10. Process D eveloping an Outcome Evaluation Logic Model Program inputs. Elements or ingredients that constitute the program. RESOURCES Methods for providing the program. Specific processes or events undertaken. Units of service or product units. How many, over what duration? Short, intermediate, or longer-term changes anticipated in participants’ lives or in organizational or community conditions. Ultimate impact(s) expected to occur, usually beyond what one program alone can achieve. Outcomes ACTIVITIESOUTPUTSGOALSOUTCOMES

11. Process D eveloping an Outcome Evaluation Logic Model Program inputs. Elements or ingredients that constitute the program. RESOURCES Methods for providing the program. Specific processes or events undertaken. Units of service or product units. How many, over what duration? Short, intermediate, or longer-term changes anticipated in participants’ lives or in organizational or community conditions. Ultimate impact(s) expected to occur, usually beyond what one program alone can achieve. Outcomes ACTIVITIESOUTPUTSGOALSOUTCOMES

12. W hy a Logic Model? A logic model:  Clarifies each program element.  Shows the relationship of resources and activities to expected outcomes.  Summarizes how program parts relate to the whole.  Makes explicit the theory of how the program works.  Identifies categories to measure in the program evaluation.

13. Material was used and adapted from:  Organizational Research Services, Inc.  The Washington State Public Health Nursing Directors Sponsors are:  NWCPHP  The Washington State Department of Health  The federal Health Resources and Services Administration (HRSA) A cknowledgements

14. 100% of CH program managers use logic model outcome measures to annually evaluate program effectiveness by Dec. 2008 100% of CH Programs have identified at least two outcome measures that demonstrate program benefits to the community by Dec. 2008 90% of all CH staff receiving logic model training can define the components of the model and describe at least two benefits of using this model when surveyed 6 months post training Number of CH staff trained in logic model development Number of program staff meetings allocating time for work on logic models Number of logic models developed Number of contacts with NWCPHP for technical assistance with logic model development Number of outcome measure consultations with KCHD Epidemiology staff 7 CH staff trained in Logic Model 101 Additional logic model training is available from NWCPHP (iLinc) and other sources Technical assistance in logic model development is available from NWCPHP KCHD Epidemiology staff are available for consultation in developing outcome measures E xample: Kitsap County Health District Integrating the Use of Logic Models into all KCHD Community Health Programs ResourcesActivities OutputsOutcomes Goal Train all CH staff in logic models Allocate time at monthly staff meetings for logic model development, critique and mentoring Use program logic model as annual work plan Incorporate the use of logic models into performance expectations for CH Program Managers All CH Programs use outcome measures as an evaluation tool to guide practice

15. CME breakfast with peer educator at the staff meeting for OB and family practice MDs Contact partners to initiate a new standing order at Snohomish Co. hospitals for post- partum Tdap Develop education for providers and patients: Brochures Flyers Worked with IACW Adult Committee in developing chart for pregnancy and immunizations E xample: Snohomish Health District Logic Model Description: Prevention of Pertussis in Newborns ResourcesActivities OutputsOutcomes Goals One breakfast meeting with 22 providers attending Education developed: 1 brochure 1 letter 5 flyers for different ethnic groups Contacted medical directors at 5 hospitals to discuss the initiation of standing orders for Tdap Mailed 2000 pregnancy and immunization charts to OB and family practice MDs in WA Providers educated about the importance of Tdap in post-partum women Patients educated through flyers of the need to get a Tdap vaccine Standing orders in place in all 5 hospitals that deliver babies in Snohomish Co. Stronger partnership with drug representatives in promoting education of physicians Increased request from practitioners for pregnancy and immunization charts Reduction of pertussis in un- or under-immunized newborns and infants in Snohomish Co. Staff: D and Gayle Journal articles: research and statistics Existing dept meeting for OB and family practice MDs in Snohomish Co. Knowledge of standing order process: Hospital medical directors Drug reps: Speaker IACW partnership

16.  Session 2: Live iLinc presentation on June 6, 2007, 1:00–2:30 am  Same format as this session: further interactive support, working through participants’ logic models in process.  Online module  30-minute narrated, web-based module http://www.nwcphp.org/outcome A dditional Opportunities