GET READY 1 Task 1: Assemble and Orient an Outcome Measurement Workgroup Workgroup: Task 3: Develop Timeline Task 4: Distribute your game plan to Key Players Task 2: Decide which programs to start with. Program: Communication Plan: 8 Steps of Measuring Program Outcomes InputsActivitiesOutputs

Initial & Intermediate Increased Improved Reduction Gain Create Admitted Receive See Develop Attract Begin Expand Enhance Client Satisfaction Enroll Participate Recruit Identify Classify Attend Report Meet Follow Sign Up Utilize Common Action Verbs Used for Outcome Statements Long Term Are Met Satisfied Maintain Improve Increased Achieve Sustain Client Satisfaction Continued Established Graduate Moved to Next Level Avoid Retain Reduce Positive Response Implement CHOOSE THE OUTCOMES YOU WANT TO MEASURE 2

Knowledge/Learning/Attitude a) Skills (knowledge, learning) Common Indicators: % increase in scores after attending % that believe skills were increased after attending % increase in knowledge (before/after program) b) Attitude Common Indicators: % improvement reported by parent, teacher, co-worker, other % improvement as reported by participant c) Readiness (qualification) Common Indicators: % feeling well-prepared for a particular task/undertaking % meeting minimum qualifications for next level/undertaking Behavior a)Incidence of bad behavior Common Indicators: Incidence rate Relapse/recidivism rate % reduction in reported behavior frequency b) Incidence of desirable activity Common Indicators: Success rate % that achieve goal Rate of improvement c) Maintenance of new behavior Common Indicators: Number weeks/months/years continued % change over time % moving to next level/condition/status % that do not reenter the program/system Condition/Status a) Participant social status Common Indicators: % with improved relationships % who graduate % who move to next level/condition/status % who maintain current level/condition/status % who avoid undesirable course of action/behavior b) Participant economic condition Common Indicators: % who establish career/employment % who move to long term housing % who maintain safe and permanent housing % enrolled in education programs % who retain employment % with increased earnings c) Participant health condition Common Indicators: % with reduced incidence of health problem % with immediate positive response % that report positive response post-90 days Common Framework of Outcomes Building A Common Outcomes Framework to Measure Non-Profit Performance – Urban Institute

CHOOSE THE OUTCOMES YOU WANT TO MEASURE 2 Who/What (the target subject) Change desired (action verb) In what (expected results) By when Imagine your client in program or day after leaving program. What new knowledge, attitude and skills are seen? Initial Imagine your client 3-9 months after leaving program. What improved attitudes or behaviors are seen? Intermediate Imagine your client 6+ months after leaving program. How has condition or status improved? Ideal, ultimate goal Long -Term

EXAMPLE

SPECIFY INDICATORS FOR YOUR OUTCOMES 3 *Refer to Common Outcome and Performance Indicator Packet

Task 2: Decide what factors could influence participant Outcomes SPECIFY INDICATORS FOR YOUR OUTCOMES 3 Demographics (age, gender, education,income level, disability, single parent…) Level of Difficulty (very difficult to help, moderate difficulty, minor difficulty) Level of Involvement (high, moderate, low participation) Organizational unit (if more than one service delivery facility) Service Delivery (group session vs 1-on-1,live vs taped) PREPARE TO COLLECT DATA ON YOUR INDICATORS 4 _ Task 1: Identify data sources for your indicators _ Task 2: Data Collection _ Task 3: Pretest your data collection instruments and procedures

TRY OUT YOUR OUTCOME MEASUREMENT 5 Task 1: Describe your trial strategy Task 2: Who are your data collectors? How will you train data collectors on instrument used? (How often do you survey/pre-post?, How long between, How to approach participant, What demographics are we really needing to ensure are represented…) Task 3: Track and collect outcome data (create a data collection spreadsheet – refer to sample)

Sample Data Collection Form

ANALYZE AND REPORT YOUR FINDINGS 6 _Task 1: Enter the data and check for errors _Task 2: Tabulate the data _Task 3: Analyze data broken out by key characteristics _Task 4: Provide Explanatory Information related to your findings _Task 5: Present your data in Clear and Understandable form Tips for Formatting Your Reports Consider the needs of your audience: what information are they looking for? Keep it Simple Include a summary of major points Don’t crowd too much on a page Define unfamiliar terms Define each outcome indicator Highlight points of interest with bold type, circles or arrows Use color to help highlight key findings Label charts and tables clearly – titles, rows, columns, axes… Identify source and date of the data and note limitations Provide context (history or comparisons) Add variety to data presentation by using bar or pie charts Internal repots should be much more detailed than external

IMPROVE YOUR SYSTEM 7 Task 1: Review Your Trial Run Experience, Make Necessary Adjustments, and Start Full-Scale Implementation Workgroup Review QuestionsYesNo Did you get all of the data you needed? Did you measure what you intended to measure? Does what you measured still seem to represent important outcomes for which your program should be held accountable? Task 2: Monitor and Review your system periodically Reviewed?Aspects to Review Data Collection Instruments Training of data collectors Data collection procedures Data entry procedures Time and Cost in collecting and analyzing data Monitor procedures used during trial run

USE YOUR FINDINGS 8 _ Detect Needed Improvements _ Motivate Staff, Volunteers and Clients _ Use in Program Planning _ Report to Board _ Report to Funders _ Report to Community Make Your Data Pay Off