1. Edward M. Haugh Jr. ESC Consultant

2. By the end of the session you will be able to help your nonprofit clients:  develop and begin to use a logic model, and  prepare a simple outcomes framework to help them monitor and evaluate the results of their programs

3.  Review the elements of a logic model (outcomes, outputs, activities, inputs)  Prepare a logic model  Define outcome indicators  Develop a few sample outcome indicators  Have lunch and enjoy  Develop a simple outcomes framework

4. Answers the question: What difference did the program make.

5.  A communication tool  Ensure programs on right track  Focus on programs that really make difference  Helps strategic planning  Puts clients in the center  Produces data to show quality  Useful information for decision making  Communicates value to funders  Promotes accountability and cost effectiveness

8. A tangible benefit or change for individuals or populations produced by a program, or project or other intervention

9. A change or result produced by a project or program: What participants know, think, can do or behave differently after intervention

10. Outcomes Benefits or changes for individuals or communities What participants know, think, can do or behave differently after intervention

11.  Improved (nutrition, morale)  Increased (employment)  Reduced (HIV transmission)  Enhanced (knowledge)  Maintained (vaccination coverage)

12. The logic model

13. Logic Models are a key tool for designing, monitoring, and evaluating outcomes

14.  A graphic way to organize information, and display thinking  A visual approach to the maps we carry in our minds  A description of our planned actions and anticipated results

15. Inputs Processes Outputs Outcomes Impact

16. Input: Equipment and Facilities

17. Activity: Health Education

18. Output: Fathers acquire parenting skills

19. Outcome: Healthy newborns

20. Impact: Healthy Community

21. Inputs Activities Outputs Short- term Outcome Medium- term Outcome Long- term Outcome Impact

27.  What can the logic model be used for?

28. InputsProcesses Outputs Outcomes Impact

29. InputsProcesses Outputs Outcomes Impact

30. InputsProcesses Outputs Outcomes Impact

31. InputsPrograms Outputs Outcomes Impact

32. InputsPrograms Outputs Outcomes Impact

33.  Can be used for:  Design & Planning  Monitoring & Evaluation  Communications  Strategic Planning  Understanding a new nonprofit

34. Inputs The resources a program uses to achieve objectives. Staff, funds, equipment, curricula, volunteers, management, board

35. Activities or Programs What the agency does with its inputs – programs or services Sheltering the homeless, delivering hot meals, counselling teenagers about smoking, providing clothes for interviews

36. Outputs The direct products of program activities Contracts completed, classes taught, mosquito nets distributed, shelter nights provided

37.  Outcomes are the results  Outputs are the tangible products produced by an intervention ◦ Usually expressed as nouns ◦ Can be counted

38.  Classes taught  Brochures distributed  Clients served  Contracts completed  Board retreats completed  Strategic plans prepared

39. Inputs Meeting space Interview space Computer stations (6) Job counselor Job coaches Job prep curriculum XYZ job assessment tool Activities 1 on 1 intake and job skills assessment Group training sessions conducted daily Link clients with select employers Weekly 1 on 1 meetings Recruit partner companies Outputs clients enrolled Clients attending daily group sessions Clients completing initial skills training Clients companies signing partner agreements Short- term Outcome Clients learn: What jobs match their skills and interests How to dress and groom How to prep a resume and application Interview skills How to complete job search Medium- term Outcome Clients prepare a resume Clients demonstrate strong interview skills during practice Clients plan transportation and day care Clients apply for jobs that match their skills Clients appear well groomed and neatly dressed Long- term Outcome Clients obtain and retain a full time job

40. 40

41.  Exercise 1: Develop a Simple Logic Model  (Use format)

42. Outcome Indicators Terms that describe how success would be measured.

43. Example of Outcome Indicators Outcome: participants lead a healthy lifestyle No. and % of participants who maintain recommended weight, blood pressure, and cholesterol levels.

44. Example of Outcome Indicators Outcome: reduced tobacco use by teens No. and % of teen participants who report that they have not smoked cigarettes for six months

45.  Outcomes sometimes confused with outcome indicators ◦ Outcome - girls participating in a training program obtain formal employment ◦ Outcome indicators – the # and % of participants employed within 3 months of completing the program

46. Outcome: Participants in a job training program obtain a job in a timely manner  # (%) of participants employed within 6 weeks  # (%) of participants still employed 3 months after completing the program

47. Outcome: Homeless people obtain secure housing  # (%) of homeless moved into temporary quarters and stayed for 6 weeks  # (%) of homeless who moved into permanent housing and remained there for 6 months

48. ◦ Outcome: A social marketing program aims to ensure that teens understand how HIV is spread. ◦ Outcomes: Young adults practice safe sex ◦ Outcome: Teens in a job training program obtain permanent employment. ◦ Outcome: Adult “shut ins” have improved nutrition ◦ Outcome: Kid’s in a summer reading program are ready for school in the fall. ◦ Outcome: Homeless people obtain secure housing

49. Targets Numerical performance objectives for achievement of outcomes 80% of participants will be able to identify 6 jobs that match their interest and skill levels.

50.  # (%) of participants employed within 6 weeks  # (%) of participants still employed 3 months after completing the program  60% of participants will gain employment within 6 weeks  95% of participants who obtained employment will still be employed in 3 months

51.  Indicates how the data will be gathered ◦ Interviews (self reporting) ◦ Reports ◦ Budgets ◦ Patient records ◦ Government records ◦ Report cards ◦ Observation (walking around) ◦ Minutes of meetings ◦ Scales, measurements (weights, heights) ◦ Other – systems – pain scale

52.  Permission will be obtained from parents/students to review report cards  Patient approval to review clinical records  Review of monthly progress reports

53.  Develop a Logical Framework for a training program that is designed to help clients learn how to get a job. It provides training, interview skills, a set of clothes for interviewing. What else might be needed?

54. OutcomesIndicatorsPerformance Targets Data SourcesMethods Long-term Outcome Clients attain long- term financial sustainability Medium-term Outcome Clients get a full time job Short-term Outcome Clients learn how to conduct an interview Outputs ??? Activities Seminars on interviewing Seminars on “dressing for success: Provision of clothing for interviews This is a training program designed to help clients get a permanent job.

55. 1. Choose the Outcomes to Measure 2. Specify the Indicators for the Outcomes 3. Prepare to collect data on the Indicators 4. Try out the Measurement System 5. Analyze and Report Findings 6. Improve the System 7. Use the Findings

57. Inputs Processes Outputs Short-term Outcomes Medium- term Outcome Staff time CRM Time ESC manageme nt time Board time Funds from scholarship Board & Mgt meeting w ESC Consultants Financial review Develop projections for expanding access Develop plan for access Gap analysis and ED training Progress reports Meetings completed Projections prepared and approved Expansion plan approved Gap analysis finalized Final report ED training completed Improved fiduciary management Improved financial performance Improved ED performance Improved access to oral health Long- term Outcome Improved Health Logic model for the ESC Engagement Deliverables Impact Improved health, economic productivity and lowered emergency room costs for the county

58.  ESC Project planning  Strategic Planning  Program Monitoring  Program Evaluation

59. Measuring Program Outcomes: A Practical Approach: http://www.nrpa.org/uploadedFiles/nrpa.org/Professional_Developme nt/Accreditation/COAPRT/Measuring_Program_Outcomes-UW.pdf http://www.nrpa.org/uploadedFiles/nrpa.org/Professional_Developme nt/Accreditation/COAPRT/Measuring_Program_Outcomes-UW.pdf United Way of Greater Richmond and Petersburg: Outcome Measurements: http://www.yourunitedway.org/outcome- measurementshttp://www.yourunitedway.org/outcome- measurements Basic Guide to Outcomes-Based Evaluation for Nonprofit Organizations with Very Limited Resources http://managementhelp.org/evaluation/outcomes-evaluation- guide.htm#anchor146822 http://managementhelp.org/evaluation/outcomes-evaluation- guide.htm#anchor146822

60. Thank you!