1. Program Evaluation Useful Sources of Information Carol Pilcher Department of Entomology Iowa State University

2. Program Evaluation Collecting Data –Surveys Analyzing Data Developing Reports Useful Sources

3. Program Evaluation http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html

4. Program Evaluation Seevers B., Graham D., Gamon J., Conklin K. 1997. Education through Cooperative Extension. Albany, NY: Delmar Publishers. 288 p.

5. Program Evaluation Patton MQ. 1997. Utilization-Focused Evaluation. 3 rd ed. Thousand Oaks, CA: Sage Publications. 430 p.

6. Collecting Data Existing records Observations Focus groups End of meeting questionnaires Mailed questionnaires Telephone surveys Face to face interviews

7. Developing Surveys Salant P. and Dillman DA. 1994. How to Conduct Your Own Survey. New York, NY: John Wiley & Sons, Inc. 232 p.

8. Questionnaires What types of questions will you ask? –Close-ended –Open-ended

9. Questionnaires Scales –Try to make scales consistent –Likert Scales Try to have at least five categories Must have positive and negative items of equal value SD, D, U, A, SA

10. Tips for Questionnaires Make sure instrument looks professional –Handwritten signature on cover letter Always leave space at the end for participant to write additional comments End survey with Thank You –Thank you for your participation!!

11. Sample Size? Size of population Sample or census

12. Mail Survey Procedures Personalized, advance notice letter (optional) Personalized cover letter, survey instrument, return envelope Follow-up postcard Personalized cover letter, survey instrument, return envelope

13. Analyzing Data Sproull, NL. 1995. Handbook of Research Methods: A Guide for Practitioners and Students in the Social Sciences. 2 nd ed. Metuchen, NJ: The Scarecrow Press, Inc. 430 p.

14. Analyzing Data Develop a plan Analysis depends on level of data –Nominal, ordinal, interval –Description, correlation, comparisons SPSS –Statistical software package

15. Reporting Results Description and analysis Interpretation Judgment Recommendations

16. Sources of Information Evaluation –Bennett CF. March/April 1975. Up the Hierarchy. Journal of Extension 13(1) 7-12. –Patton MQ. 1997. Utilization-Focused Evaluation. 3 rd ed. Thousand Oaks, CA: Sage Publications. 430 p. –Rossi PH. And Freeman, HE. 1993. Evaluation: A Systematic Approach. 5 th ed. Newbury Park, CA: Sage Publications. 488 p. –Seevers B., Graham D., Gamon J., Conklin K. 1997. Education through Cooperative Extension. Albany, NY: Delmar Publishers. 288 p. –University of Wisconsin-Extension. (2004). Program Development and Evaluation. Retrieved April 2005, from University of Wisconsin-Extension-Cooperative Extension, Program Development and Evaluation Unit Web site http://www.uwex.edu/ces/pdande/progdev/index.html Collecting Data –Salant P. and Dillman DA. 1994. How to Conduct Your Own Survey. New York, NY: John Wiley & Sons, Inc. 232 p. Analyzing Data –Sproull, NL. 1995. Handbook of Research Methods: A Guide for Practitioners and Students in the Social Sciences. 2 nd ed. Metuchen, NJ: The Scarecrow Press, Inc. 430 p.