Edward M. Haugh Jr. ESC Consultant

By the end of the session you will be able to help your nonprofit clients:  develop and begin to use a logic model, and  prepare a simple outcomes framework to help them monitor and evaluate the results of their programs

 Review the elements of a logic model (outcomes, outputs, activities, inputs)  Prepare a logic model  Define outcome indicators  Develop a few sample outcome indicators  Have lunch and enjoy  Develop a simple outcomes framework

Answers the question: What difference did the program make.

 A communication tool  Ensure programs on right track  Focus on programs that really make difference  Helps strategic planning  Puts clients in the center  Produces data to show quality  Useful information for decision making  Communicates value to funders  Promotes accountability and cost effectiveness

A tangible benefit or change for individuals or populations produced by a program, or project or other intervention

A change or result produced by a project or program: What participants know, think, can do or behave differently after intervention

Outcomes Benefits or changes for individuals or communities What participants know, think, can do or behave differently after intervention

 Improved (nutrition, morale)  Increased (employment)  Reduced (HIV transmission)  Enhanced (knowledge)  Maintained (vaccination coverage)

The logic model

Logic Models are a key tool for designing, monitoring, and evaluating outcomes

 A graphic way to organize information, and display thinking  A visual approach to the maps we carry in our minds  A description of our planned actions and anticipated results

Inputs Processes Outputs Outcomes Impact

Input: Equipment and Facilities

Activity: Health Education

Output: Fathers acquire parenting skills

Outcome: Healthy newborns

Impact: Healthy Community

Inputs Activities Outputs Short- term Outcome Medium- term Outcome Long- term Outcome Impact

 What can the logic model be used for?

InputsProcesses Outputs Outcomes Impact

InputsProcesses Outputs Outcomes Impact

InputsProcesses Outputs Outcomes Impact

InputsPrograms Outputs Outcomes Impact

InputsPrograms Outputs Outcomes Impact

 Can be used for:  Design & Planning  Monitoring & Evaluation  Communications  Strategic Planning  Understanding a new nonprofit

Inputs The resources a program uses to achieve objectives. Staff, funds, equipment, curricula, volunteers, management, board

Activities or Programs What the agency does with its inputs – programs or services Sheltering the homeless, delivering hot meals, counselling teenagers about smoking, providing clothes for interviews

Outputs The direct products of program activities Contracts completed, classes taught, mosquito nets distributed, shelter nights provided

 Outcomes are the results  Outputs are the tangible products produced by an intervention ◦ Usually expressed as nouns ◦ Can be counted

 Classes taught  Brochures distributed  Clients served  Contracts completed  Board retreats completed  Strategic plans prepared

Inputs Meeting space Interview space Computer stations (6) Job counselor Job coaches Job prep curriculum XYZ job assessment tool Activities 1 on 1 intake and job skills assessment Group training sessions conducted daily Link clients with select employers Weekly 1 on 1 meetings Recruit partner companies Outputs clients enrolled Clients attending daily group sessions Clients completing initial skills training Clients companies signing partner agreements Short- term Outcome Clients learn: What jobs match their skills and interests How to dress and groom How to prep a resume and application Interview skills How to complete job search Medium- term Outcome Clients prepare a resume Clients demonstrate strong interview skills during practice Clients plan transportation and day care Clients apply for jobs that match their skills Clients appear well groomed and neatly dressed Long- term Outcome Clients obtain and retain a full time job

40

 Exercise 1: Develop a Simple Logic Model  (Use format)

Outcome Indicators Terms that describe how success would be measured.

Example of Outcome Indicators Outcome: participants lead a healthy lifestyle No. and % of participants who maintain recommended weight, blood pressure, and cholesterol levels.

Example of Outcome Indicators Outcome: reduced tobacco use by teens No. and % of teen participants who report that they have not smoked cigarettes for six months

 Outcomes sometimes confused with outcome indicators ◦ Outcome - girls participating in a training program obtain formal employment ◦ Outcome indicators – the # and % of participants employed within 3 months of completing the program

Outcome: Participants in a job training program obtain a job in a timely manner  # (%) of participants employed within 6 weeks  # (%) of participants still employed 3 months after completing the program

Outcome: Homeless people obtain secure housing  # (%) of homeless moved into temporary quarters and stayed for 6 weeks  # (%) of homeless who moved into permanent housing and remained there for 6 months

◦ Outcome: A social marketing program aims to ensure that teens understand how HIV is spread. ◦ Outcomes: Young adults practice safe sex ◦ Outcome: Teens in a job training program obtain permanent employment. ◦ Outcome: Adult “shut ins” have improved nutrition ◦ Outcome: Kid’s in a summer reading program are ready for school in the fall. ◦ Outcome: Homeless people obtain secure housing

Targets Numerical performance objectives for achievement of outcomes 80% of participants will be able to identify 6 jobs that match their interest and skill levels.

 # (%) of participants employed within 6 weeks  # (%) of participants still employed 3 months after completing the program  60% of participants will gain employment within 6 weeks  95% of participants who obtained employment will still be employed in 3 months

 Indicates how the data will be gathered ◦ Interviews (self reporting) ◦ Reports ◦ Budgets ◦ Patient records ◦ Government records ◦ Report cards ◦ Observation (walking around) ◦ Minutes of meetings ◦ Scales, measurements (weights, heights) ◦ Other – systems – pain scale

 Permission will be obtained from parents/students to review report cards  Patient approval to review clinical records  Review of monthly progress reports

 Develop a Logical Framework for a training program that is designed to help clients learn how to get a job. It provides training, interview skills, a set of clothes for interviewing. What else might be needed?

OutcomesIndicatorsPerformance Targets Data SourcesMethods Long-term Outcome Clients attain long- term financial sustainability Medium-term Outcome Clients get a full time job Short-term Outcome Clients learn how to conduct an interview Outputs ??? Activities Seminars on interviewing Seminars on “dressing for success: Provision of clothing for interviews This is a training program designed to help clients get a permanent job.

1. Choose the Outcomes to Measure 2. Specify the Indicators for the Outcomes 3. Prepare to collect data on the Indicators 4. Try out the Measurement System 5. Analyze and Report Findings 6. Improve the System 7. Use the Findings

Inputs Processes Outputs Short-term Outcomes Medium- term Outcome Staff time CRM Time ESC manageme nt time Board time Funds from scholarship Board & Mgt meeting w ESC Consultants Financial review Develop projections for expanding access Develop plan for access Gap analysis and ED training Progress reports Meetings completed Projections prepared and approved Expansion plan approved Gap analysis finalized Final report ED training completed Improved fiduciary management Improved financial performance Improved ED performance Improved access to oral health Long- term Outcome Improved Health Logic model for the ESC Engagement Deliverables Impact Improved health, economic productivity and lowered emergency room costs for the county

 ESC Project planning  Strategic Planning  Program Monitoring  Program Evaluation

Measuring Program Outcomes: A Practical Approach: nt/Accreditation/COAPRT/Measuring_Program_Outcomes-UW.pdf nt/Accreditation/COAPRT/Measuring_Program_Outcomes-UW.pdf United Way of Greater Richmond and Petersburg: Outcome Measurements: measurementshttp:// measurements Basic Guide to Outcomes-Based Evaluation for Nonprofit Organizations with Very Limited Resources guide.htm#anchor guide.htm#anchor146822

Thank you!