1. Agriculture & Food Systems Evaluation SHANNON DILL, AGRICULTURE EXTENSION EDUCATOR TERESA MCCOY, ASSISTANT DIRECTOR, EVALUATION & ASSESSMENT FEBRUARY 24 & 25, 2016

2. Statewide Impacts vs My Impacts  Annual Reviews  Promotion and Tenure  Grants  Specific or detailed questions regarding a program

3. Statewide Impacts vs My Impacts  Responsibility:  To contribute to statewide measures  To continue your own program evaluation work

4. Next Steps: Action Team Measures  We have the statewide measures (questions)  Need to start development of specific action team areas

5. How (or Five Easy Steps on Paper) 1)Choose the statewide measures that fit with your program effort. 2)Decide on which method to use for data collection. 3)Prepare your evaluation instrument. 4)Administer the evaluation instrument. 5)Submit your data

6. How (the Real World) 1)Choose the statewide measures that fit with your program effort.  “A Few Good Measures” It may be that only one measure is needed. Do not think that you have to “force” a lot of measures. I would rather have one good measure of a program’s effectiveness than 10 that don’t fit.  “Don’t Shop Around” Try to be consistent with the measures you use. If measure “X” fits your program, use it consistently.  “Don’t Fool Around” Don’t change the questions!

7. How (the Real World) 2)Decide on which method to use for data collection.  Pen and paper—you collect the instruments, make a copy for your files, print a label, put them in an envelope, affix postage, and drop in mail to 1208 Symons. We aggregate the data.  Pen and paper—you collect the instruments, scan the instruments, and email to 1208 Symons.  Pen and paper—you collect the instruments, enter the data into a pre- formatted Excel spreadsheet and email to 1208 Symons.  Clickers—you collect the data via PPT and Turning Technologies and send the tpzx file to Chenzi.  You create a survey in Qualtrics and make T, Shannon, and Chenzi collaborators.

8. How (the Real World) 3)Prepare your evaluation instrument.  Develop a generic template that you can use over and over (one that you can put questions into)  Develop a program template that you can use over and over (if you are doing the same types of programs with the same measures)  Be sure to brand with the UME logo.  Once you develop your IEP for the year, you can develop these templates.  Put your templates in the Ag Evaluation Box folder and share!

11. How (the Real World) 4)Administer the evaluation instrument.  Think about your time and what is possible.  Think about the user burden.  Think about what you need to report.  Realize that you always have to allocate time at the end of the session for evaluation.

12. How (the Real World) 4)Administer the evaluation instrument.  For a 30 minute session, 1-2 questions is fine and dandy.  For a 60 minute session, 3-4 questions is fine and dandy  For 1-2 hour session, I would still try to stay at around 6 questions, if possible.  Evaluation questions on front; demographics on back  Strategically deploy teaching evaluations.  Don’t be intimidated by on-line surveys.  The move to the mobile world

13. How (the Real World) 5)Submit your data:  Web-based into Box  Electronic (email)  Paper (remember Murphy’s law—mail a copy and keep your original!)

14. Questions?