1. Effective Youth Evaluation in CNEP Debra Garrard-Foster CNEP State Nutrition Ed. Program Coordinator Brenda Sheik CNEP Evaluator June 2013

2. What is Program Evaluation? Program Evaluation: The thoughtful process of focusing on questions and topics of concern, collecting appropriate information, and then analyzing and interpreting the information for a specific use and purpose.

3. Why Evaluate Youth Programs? Why Evaluate Youth Programs? CNEP evaluates youth programs to:  Help us improve the program -Are youth learning the most important concepts?  Help us improve our teaching -Is there a better way to communicate what we are trying to teach, or is it working “as is” in our program?  Help others understand the value of our program - Provides program information and accountability to program funders

4. New Youth Evaluation System National committee commissioned to look at youth evaluation in EFNEP Goal was to have a uniform set of evaluation questions used by all EFNEP programs Committee released “starter” questions in early October 2012 Committee will continue to test reliability and validity of the questions Additional changes to questions likely

5. New Youth Evaluation System Questions are not curriculum-specific, rather they are based on the goals and objectives of CNEP Two year phase in time for project with full use by FY 2015 Questions are intended for use with WebNEERS system Evaluation tools only in English

6. New Youth Evaluation System During the phase-in period OSU CNEP has: –Determined best strategies for using evaluation questions with our groups –Determined best method for matching pre and post evaluations We need your help as front-line youth NEAs to help make this transition a good one!

7. Youth Questions The National Committee Prepared 4 Sets of Evaluation Tools: 1.Kindergarten to Second Grade 2.Third Grade to Fifth Grade 3.Sixth Grade to Eighth Grade 4.Ninth Grade to Twelfth Grade The evaluation tools include questions aligned with what children should be learning about nutrition…

8. WHAT TOOLS WILL CNEP USE? 3RD GRADE TO 5TH GRADE TOOL Will be used with 3 rd and 4 th grades

9. Parent and/or child can opt out Child will use ID code on pre/post Youth pre/post matched NEAs will use survey script (at first!) Data entry in WebNEERS Other Changes?

10. Required by IRB Sent from and returned to school Give at least one week to return Teacher to help track Parent/Guardian Information Sheet

11. PARENTS’/YOUTH CHOICES 1.No return/no signature= Evaluation OK 2.Tell child to opt out = NO Evaluation 3.Child opts out on own = NO Evaluation 4.Parent signs & returns = NO Evaluation No Evaluation if parents not given form or time to complete!

12. No evaluation No evaluation means no evaluations are even handed to the child……it does not mean that the child can take the survey and then the survey can be destroyed.

13. Youth Pre/Post Students will now write ID on pre/post Can use student’s 2 or 3 initials or school assigned ID for surveys No student names on surveys Do not make any changes to surveys or write school or teacher names, etc. Be consistent with IDs……use same method of ID on both sets of pre and post

14. Youth Pre/Post Matched 2-3 student initials or school assigned student ID……unit may want to decide! Prefill date and indicate pre or post before copied. NEA NEA is to match each student’s pre and post Submit unmatched: (same initials, absent from pre or post, etc.)

15. Script: instructions for student code keeps all on same question reassures not a TEST! Use at first……you will know when you can stop. Script IMPORTANT!

16. Data Entry Youth groups entered as always Matched surveys entered into Youth Checklist tab Select 3 rd -5 th tool and “Add Checklist” Enter student ID, survey dates and responses You can’t enter more checklists than you have youth enrolled in the group

17. 1.Parent Info Form to schools 2.Complete youth group enrollment 3.Pre Survey at/before first lesson (did any parent opt out?) 4.Submit 4.Submit group enrollment to unit office/hold Pre Survey 5.Lessons 6.Post Survey at last lesson Start to Finish Process

18. 7.Match Pre/Post and complete exit form. 8.Submit 8.Submit exit form, matched pre/post and mismatched surveys to unit office Submit Submit paperwork as soon as that step is complete. Do not hold till quarterly reports!!! Start to Finish Process (cont.)

19. What are your questions so far?

20. THIRD TO FIFTH GRADE EVALUATION TOOL

22. 3 rd – 5 th Grade Questions

23. Thanks Texas! This presentation was adapted from a PowerPoint prepared by (we still plan to beat you in football!!)

24. Questions?