1. evaluation a tool for success jill@theimprovegroup.com Facebook.com/TheImproveGroup @TheImproveGroup

3. Overview Purpose and benefits of evaluation Designing an evaluation Logic Modeling

4. what is evaluation?

5. Assessing strengths and weaknesses …to improve effectiveness “ ”

6. Let’s do a quick evaluation! -What criteria would you use? -What are your data collection methods? -How important is it that everyone agrees?

7. why evaluate?

8. Demonstrate Results

9. Reflect

10. Create a learning community

11. Photo by woodleywonderworks 2011 httpsflic.krp9esZtm Influence others

12. Build support

13. Plan for sustainability

14. Planning your evaluation

15. The evaluation process Define Purpose Develop questions Prepare methods Measure Analyze Interpret Improve

16. Define project outcomes What do you want to DO at the end of your evaluation?

17. Clarify Purpose Who are the key stakeholders of the evaluation? What are they interested in learning? What you hope to learn as part of the evaluation? Prioritize competing interests

18. Logic models Good for evaluation and management Describe what programs do & why

19. TheoryGoalsActivitiesOutputsOutcomesMeasures

22. Example GOAL: For all students to be at or above their grade reading level ACTIVITIES: -Tutoring Theater Book club OUTPUT: # of tutoring sessions # of books/articles read INTENDED OUTCOMES: -Students are more confident in reading -Students think reading is fun TOOLS: -Survey -Check-in form

23. Tricky Definitions Tangible results you control Ex: How many people received a service. Results you hope to influence. Pre-conditions for broader societal change. Ex: People’s behavior change after receiving a service. OutputsOutcomes

25. PRACTICE: LOGIC MODEL Evaluation question: How well has the program achieved its outcomes?

26. Logic Model Activity

27. measures & indicators

28. Methods… Arts, Stories, Activities, “Big Data”

29. Photo by Andy Melton 2007 https://flic.kr/p/wmMp4

30. Surveys Tests Focus groups Interviews Records (intake, case notes, etc.)

31. Creative options Art: photos, drawings, diagrams Stories & metaphors Activities

32. Matching evaluation tools to your work Use available resources Use knowledge of staff Honor the wisdom of all of your stakeholders Supported by infrastructure

33. i  evaluation