1. Insights from an evaluator and professor HOW TO MEASURE IMPACT Paul Penley, PhD Director of Research in theological education Excellence in Giving

2. External Communication WHY MEASURE OUTCOMES

3. “I always wanted to know the measurable difference made from our significant investment of time and money in the Global Leadership Summit. Like many ministries, we had stories of impact but no concrete figures. Excellence in Giving's research changed all that. The data has now sharpened our strategies and given us confidence to approach donors we didn’t have before. I’ve been sharing the results with every financial and ministry partner we have around the world since we received the first Impact Report!” - Gary Schwammlein, WCA President

4. Internal Improvement WHY MEASURE OUTCOMES

5. DOES THE ALLIANCE ACCELERATE IMPACT?

8. #1 Internal Improvement #2 External Communication WHY MEASURE OUTCOMES

9. How to Measure Impact

10. How do you know when your mission is accomplished? WHAT TO MEASURE

11. DEFINITIONS DEFINE THE MISSION DEFINE GOALS Specific Attainable Measurable

12. DEFINITIONS DEFINE KEY TERMS  Leaders trained HOW? 1.Clarify the problem 2.Define success

14. WHAT TO MEASURE INPUTS ACTIVITIES OUTPUTS OUTCOMES

15. We had 220 Graduates VS. 68% of Graduates started a church, school, or ministry within 5 years WHAT TO MEASURE

17. How to Measure Impact

18. Practical EXERCISE: 1)Write down your organization’s mission statement and 1 goal. 2)Find a word (usually verbs) or phrase that needs to be defined more clearly. 3)Identify 1 long-term outcome you could measure and which activities and outputs are related to it. WHAT TO MEASURE

19. “Measuring outcomes is important, but our ministry can’t do it.” - every ministry leader HOW TO MEASURE “Our mission is so important we can't afford to lead blindly.” - humble ministry leader

20. 1.ACTIVITIES & OUTPUTS  Organizational Data 2.OUTCOMES  Beneficiary Surveys HOW TO MEASURE Where do we get the data?

21. Where do we start? Too many outcomes to measure. How do you decide which ones to include in the survey? HOW TO MEASURE

22. #1 Intended OUTCOMES #2 Observed OUTCOMES HOW TO MEASURE Gather & Categorize:

23. INTENDED OUTCOMES

24. Where to find Observed OUTCOMES to gather and categorize:  Impact stories  Structured interviews  Focus groups HOW TO MEASURE

26. (Qualitative Research) FIND Outcome THEMES CREATE Closed-Ended QUESTIONS (Quantitative Research) HOW TO MEASURE

27. Quantitative DATA answers key question about stories of impact: Is this story the exception or the rule for program impact? HOW TO MEASURE

28. After being rescued from a brothel in Thailand, Nani is the first girl to graduate high school from her family. of girls in aftercare graduate high school without returning to the sex trade 89%

29. Track Impact VARIABLES:  Location  Experience  Age  Depth of Participation HOW TO MEASURE

31. 5 Steps to Survey RELIABILITY: 1. Ask it 3 different ways 2. Require specific details 3. Avoid leading questions 4. Use validated instruments 5. Get 360 degree feedback HOW TO CREATE SURVEYS

32. Survey USEFULNESS:  Test it with small group  Create templates for how you will report the data HOW TO CREATE SURVEYS

33. 1)IMPACT REPORT  Acceleration  Lasting Outcomes 2)IMPROVEMENT REPORT  Negative trends  Success Factors HOW TO CREATE SURVEYS

34. How to Measure Impact

35. Practical EXERCISE: 1)OUTCOME : Write down 3 common actions your graduates do because of their training. 2)OUTCOME INDICATORS : For 1 action, write down 3-5 ways graduates do those common actions differently in their context. 3)SURVEY QUESTION : Use the different ways graduates do one of the common actions to create 1 multiple-choice survey question. HOW TO MEASURE

36. 1.Which is better? 1-time longitudinal studies OR ongoing feedback loops? 2.When does transformation happen? WHEN TO MEASURE

37. TRANSFORMATION BEFORE AFTER

38. 3 typical times to MEASURE: 1)BEFORE program participation 2)END of program participation 3)1-5 Years AFTER program completion WHEN TO MEASURE

40. How to Measure Impact

41. Practical EXERCISE: 1)MEASUREMENT INTERVALS: Pick up to 3 times when you could survey your beneficiaries. 2)SURVEY INTEGRATION: Identify current paperwork in which you could integrate surveys. WHEN TO MEASURE

42. Insights from a professor and evaluator HOW TO MEASURE IMPACT Paul Penley, PhD Director of Research in theological education Excellence in Giving