1.  1. Methods of evaluation are thorough, feasible, and appropriate  2. Use of objective measures to produce quantitative and qualitative data  3. Methods provide performance feedback 1

2.  Evaluation as a means to determine:  How you are doing  What you have accomplished  What can be improved 2

3.  Goals and objectives  How will you show your successes?  How will you track your outcomes? 3

4.  Quality of Services  How will you track the services being provided?  How will you assess the quality of services?  How will you measure consumer satisfaction with services? 4

5.  Management Plan  Track your milestones  How will you ensure the project is progressing in a timely manner? 5

6.  Formative Evaluation: on-going process; a management tool for program improvement.  Summative Evaluation: final evaluation; overall appraisal at the end of the project.  Performance Monitoring  Evaluation of Outcomes  Evaluation of Costs and Benefits 6

7.  Progress towards project goals and objectives  Consumers’ satisfaction with VR services  Project performance and efficacy  Compliance with RSA Performance Measures 7

8.  Describe your evaluation instruments and provide copy in appendices if available  Include an evaluation procedure to assess each objective  Describe your data gathering methods, time lines, and how you will analyze the data 8

9.  Consists of numbers or quantity  Closed ended questions  Was this workshop helpful?  Limited choices to provide answer  Number of consumers served  Number of consumers who become employed  Scale of 0-5 to consider consumer satisfaction  Number of specific types of treatments (visits to sweat lodge) 9

10.  Looks at quality  Open Ended Questions  How did you benefit from the program?  What would you recommend to improve program services?  Unlimited choice in answers  Focus groups  Time consuming but worthwhile  Learn about the strengths of program from the consumers’ perspectives 10

11.  How will you use the evaluation data in relation to progress and outcomes?  Consumer satisfaction surveys will be administered semi-annually with outcomes reported to the advisory committee, along with information regarding the number of consumers served and the number of consumers with successful employment outcomes. 11

12.  How will evaluation activities be coordinated with other project tasks?  How will evaluation results be used to modify the project during the grant period? 12