ASC 607 Day 2

S ESSION S UCCESS C RITERIA Participants can explain the purpose and rationale for conducting evaluations develop evaluation criteria and standards, and make a judgment of worth of an object they evaluate create evaluation questions for a program/service they will evaluate determine the most appropriate ways to collect data to answer their evaluation questions analyze their evaluation data both qualitatively and/or quantitatively, interpret the data, and provide recommendations communicate the findings of an evaluation study to an audience

E VALUATION P URPOSE Read the “Definitions” handout and answer the following questions: What are some commonalities among these definitions? How do these definitions differ? Which of these definitions resonate with your own experiences? How important is it to have a common definition of evaluation?

E VALUATION P URPOSE Working in pairs, complete the “Types of Evaluation” handout Debrief What new insights did you gain from these activities? How would you now describe evaluation to someone? How is your current understanding of evaluation different from you understanding before this activity?

E VALUATING C OOKIES Evaluating Chocolate Chip Cookies Using Logic Handout Complete the first two columns Evaluating Chocolate Chip Cookies Using Logic Matrix Handout Complete after tasting each cookie

E VALUATING C OOKIES Debrief How would you describe your experience establishing criteria? How did you determine what standard to use? Were you in agreement? How did you reconcile differences? How comfortable were you with your final judgment about which cookies was best?

E VALUATION Q UESTIONS Part I Label the page with the title of your evaluation study. Develop a purpose statement for your evaluation…why are you evaluating this program or service?

E VALUATION Q UESTIONS Part II On sticky notes, construct 3-5 questions that your evaluation seeks to answer. Place sticky notes on your paper. In groups of 3, work collaboratively to prioritize and categorize your questions.

E VALUATION Q UESTIONS Debrief What makes a good evaluation question?

C HOOSING D ATA C OLLECTION M ETHODS Using the “Matrix of Methods” handout… Type each of your evaluation questions in the first column Select the MOST appropriate method to answer the question Answer the criteria questions on the left side of the matrix

C HOOSING D ATA C OLLECTION M ETHODS With a partner discuss the advantages and disadvantages of one of your method’s decisions and consider the following… What influenced your decisions to choose a particular method? What are some challenges of collecting data using the methods you selected? How would you support your decisions with stakeholders?

Q UALITATIVE D ATA A NALYSIS In groups of 3-5… Read the comic strips and reach consensus on how they should be categorized using the 3 handouts Keep notes on how you selected the category

Q UALITATIVE D ATA A NALYSIS Debrief What similarities and difference did you experience in trying to categorize the strips? How do you explain the similarities and differences between groups’ decision rules? What implication do these decisions have when analyzing qualitative data? How would you communicate these decisions to stakeholders?

I NTERPRETATION AND R ECOMMENDATIONS Complete the “Analyzing and Interpreting Qualitative Data” handout Summarize the data for each question and develop a set of recommendations based on the findings

Q UANTITATIVE D ATA A NALYSIS In groups of 3-5… Examine the survey data on the sheet with pre/post mean scores and the correlations. Complete the interpretation and recommendation part of the handout

Q UANTITATIVE D ATA A NALYSIS Debrief What does the analyses say about these data? Did the workshop work? What other questions do you have? How might you increase the usefulness of the findings?

C OMMUNICATING AND R EPORTING Read through the various ways to communicate and report evaluation findings Begin planning stages for evaluation poster