Program Design Global Health Fellowship St Luke’s/Roosevelt New York

When developing a new program, it is especially important that an organization address a few key points when applying for funds to finance the program. The following guidelines cover these crucial steps, which include: Assessment of community needs ↔ Goal Program design Performance measurement Program evaluation Program Development Logic Model/Causal Hypothesis

Community Needs Assessment The Situation Before designing a program, an organization should conduct a community needs assessment to determine that the program is addressing a need that exists in the community. In order to get an accurate picture, assessment should involve people representing various aspects of the community. In gathering research, the following questions may serve as a guideline: Who does the problem affect? How many people are affected? How is this problem addressed in other locations affected by it? What has and has not worked? Is this problem already being addressed in this community? How?

A new program should not be replicating services already provided in the community. If the needs assessment determines that the problem is already being addressed adequately by other organizations in the community, it may be best to narrow or broaden the program’s approach to address the problem in a unique manner. Visit other organizations addressing the problem, in the community or not, to assess what approaches do and do not work, and how services can be improved upon. Community Needs Assessment

Program Design Some basic qualities of a good program are that it: Describes & gives evidence of a community need that can be addressed. Identifies a gap in services available in the community which address the need. Explains why this program is an appropriate strategy to meet the need. Outlines the activities of program members in addressing the need. Establishes community partnerships in the process of addressing the community need. Anticipates the positive outcome of the program in the community. Defines the method of measuring results (see the following section on Performance Measurement).

Program

A program is a sequence of intentional actions and events organized in a manner that they result in valued outcomes for a clearly defined audience.

How does a program work?

We do stuff. Good things happen.

ABC If Then

Logic Model (logic modeling, program planning, program design, outcome engineering)

A recommended method of program design is to use a logic model to plan & evaluate the proposed program. A logic model is a depiction of the processes & targeted outcomes of the program. This should help the organization to specify goals, identify what resources are needed, identify indicators of progress and measurements of success, & communicate the program’s potential value. The Logic Model

Logic Model A graphic representation of a program, supported by a program theory, depicted as a logical chain of “if-then” relationships, & guides program implementation & evaluation.

The components of a basic logic model include: Needs: The community need as identified in the Community Needs Assessment. Inputs: The resources needed to complete activities. Activities: What staff, volunteers, etc. actually do. Outputs: A measurement of the actual amount of service completed. Intermediate Outcomes: Measurable change and improvements in the program’s constituents and/or community. End Outcomes: The target changes that the organization hopes to achieve in the program’s constituents and/or community. The Logic Model – Components

Causal Pathway Causal: based on premise that activities should logically cause desirable results to occur Pathway: based on the idea that the causal links form a technically & programmatically sound logical progression

Causal Pathway: 5 Main Components Impact Change in the health, socio-economic status of the population of interest thru sector specific contributions Effects Change in the knowledge, attitudes, skills, intentions &/or behaviors of the population of interest that contributes to desired IMPACT Outputs Products & services that must be in place for the EFFECTS to be achieved Activities The technical & support tasks required to → OUTPUTS Inputs Resources required to support your ACTIVITIES

Steps in Logic Modeling Convene a planning group Large room and lots of paper Template or free form Create a model beginning with outcomes Get feedback from outside Revise Plan evaluation & select indicators

Three Major Components of Logic Models

Defining Outputs

Three Types of Outcomes

A Simple Linear Model

Inputs OutputsOutcomes ActivitiesAudienceInitialIntermediateLong-Term Resources deployed to address situation Staff Volunteers Time Money Materials Equipment Technology Partners Activities supported by resources invested Workshops Meetings Field Days Demonstration Camps Trainings Web Sites Home Visits Individuals or groups who participate in the activities Number Characteristics Reactions Learning that results from participation Awareness Knowledge Opinions Skills Aspirations Actions that results from learning Practices Behaviors Policies Social Action Choices Conditions which change as a result of action Social Economic Environmental Contextual Factors Generic Program Logic Model

Inputs OutputsOutcomes ActivitiesAudienceInitialIntermediateLong-Term Resources deployed to address situation Activities supported by resources invested Individuals or groups who participate in the activities Learning that results from participation Actions that results from learning Conditions which change as a result of action Contextual Factors Program Planning Worksheet

Let’s look at some logic models for specific programs.

Jul-16Office of Faith-Based and Community Initiatives26 Sample Logic Model NeedInputsActivitiesOutputsInter- mediate Outcomes End Outcomes Low third- grade reading performance Staff Books Space Volunteers 20 volunteers will tutor children one- on-one in reading 3 times a week (x) number of children tutored Increased number of books read, increased reading on own Increased reading performance, improved grades

Purdue University is an Equal Opportunity/Equal Access institution. LOGIC MODEL Situation Implementation Inputs and Outputs Outcomes - Impact Trends / Desired Situations Social Economic Civic Environment Contributing Factors Needed Action Behavior Practice Decisions Policies Social action Learning Needs (Objectives) Awareness Knowledge Attitudes Opinions Aspirations Motivations Skills Inputs (Resources) Staff Volunteers Time Money Materials Equipment Technology Partners Activities Workshops Meetings Counseling Facilitation Assessment Product dev Media work Recruitment Training Participation (Audience) Participants Customers / Consumers Citizens Short term Learning Outcomes Awareness Knowledge Attitudes Opinions Aspirations Motivations Skills Medium term Action Outcomes Behavior Practice Decisions Policies Social action Long Term Impact Economic Viability Strong Ind. Fam. & Com Healthy Environment Indicators Logic Model

Why Use Logic Models? Planning Tool Blueprint for Implementation Guides Evaluation Strengthens Case for Investment Simple Image of a Complex Phenomenon Reflect Shared Understanding Diagnose Program Flaws

Who Uses Logic Models? W.K. Kellogg Foundation Centers for Disease Control United Way of America Harvard Family Research Project Cooperative Extension Service

The purpose of performance measures is to capture the ongoing progress the program is making. It should provide a snapshot of the impact of the work that the organization is doing. This is an especially important step in establishing accountability to any funder. Identify all of the services the organization provides & the likely impact these services will have on the community. Performance Measurement

Determine tracking tools for use in measuring the results of services offered. These measures should focus on goal outputs & outcomes, as identified by the community needs assessment & defined by the program’s logic model. The measures should be in quantifiable terms & clearly defined. A good guide for determining performance measures is the acronym SMART. They should be: Specific Measurable Attainable Realistic Timely Performance Measurement – Tracking Tools

Analytical study which measures the progress & impact the program has made. Evaluations should be scheduled & carried out throughout the course of the program. Should consist of thorough & objective research conducted by an experienced evaluator, starting at the beginning of the program year. Resources for finding a program evaluator include colleges & universities, research firms, & community organizations. Evaluator should collect data relevant to the program’s activities & programs & evaluate the organization’s impact. The organization should be consistently involved in the evaluation process & should adjust the programs offered according to performance measures & program evaluations in order to best serve the community. Program Evaluation

CNCS Program Toolkit: e/sustainability_toolkit.pdf e/sustainability_toolkit.pdf Logic Models: nf05.ppt nf05.ppt Logic Model Development Guide: Logic Model - University of Idaho: Resources

Logic Modeling Resources This Powerpoint Presentation Program Design Publication Logic Modeling Course on the Web www1.uwex.edu/ces/lmcourse/ W.K. Kellogg Foundation Logic Modeling Guide