1. Evaluation as Positive Youth Development Ben Silliman, Barbara Swanson, Bill Stone North Carolina 4-H Webinar website: http://nc4-heval.wikispaces.com eXtension E-CoP website: http://collaborate.extension.org/wiki/PDCoP_Evaluation

2. Evaluation as PYD Who we are eXtension Evaluation Community of Practice monthly webinar …targeting 4-H community professionals and programs A place to network and encourage each other A place to learn together across the continuum A place to make the best better Webinar website: http://nc4-heval.wikispaces.com eXtension E-CoP website: http://collaborate.extension.org/wiki/PDCoP_Evaluation

3. Evaluation as PYD What about today? Do volunteers and youth love to tell you what difference a program made or do they struggle to describe anything beyond ‘what they did’?  Evaluation is as good as the trust, clarity, and insight of program participants

4. Evaluation as PYD What about today? Do your programs “search for impacts” or “plan for impacts”?  Evaluations cannot track what programs have not tried

5. Evaluation as PYD What about today? Do evaluation activities tend to disrupt or enhance relationships with youth?  How you evaluate affects how well you evaluate

6. Evaluation as PYD What about today? Do volunteers and youth love to tell you what difference a program made or struggle to describe anything beyond ‘what they did’?  Begin with relationships Do your programs “search for impacts” or “plan for impacts”?  See the big picture Do evaluation activities tend to disrupt or enhance relationships with youth?  Blend evaluation & programs  Evaluation is in our youth development DNA!

7. Evaluation as PYD Learning together with youth How do we know 4-H makes a difference? We listen to their stories and dreams We see it in their faces We watch them grow

8. Evaluation as PYD Learning together with youth We live the difference

9. Evaluation as PYD Learning together with youth But how do we capture the learning, the leadership and teamwork, the confidence, the commitment to citizenship and service that comes from 4-H experiences?

10. Evaluation as PYD Learning together with youth …and why is it important?

11. Evaluation as PYD What we know CAN help us Capturing the impact of a youth program helps program leaders… Show accountability for investments of time & money Grow capacities of individuals and organizations to conduct quality programs and measure results Know how to improve programs and innovate Bestow youth with stronger relationships Go forward with clear, accurate DATA and insightful, inspiring ideas to support program success and renew the organization

12. Evaluation as PYD What we know CAN help us Capture and use impacts Accountability: PYD study (national, state, local) Capacity-building: Youth Summit/Civic Education Conference presentations, community awareness Program improvement: Opportunities with youth, community college School-age Care providers Relationships: Talking about bullying w/families

13. Evaluation as PYD Plan the work and work the plan Planning for quality and impact (program development) helps youth leaders… Develop programs with the right “dosage” to make a difference (intensity-frequency-duration) Train and support staff for maximum effectiveness Develop and test those programs gradually for maximum quality and impact (initiating-refining- maturing program and evaluation)

14. Evaluation as PYD Plan the work and work the plan Planning programs, not just activities “Dosage”: School enrichment units  Outcomes Training/Support: Coaching volunteer leaders (appropriate goals, continuity across activities) Maturing programs/evaluations: Needs/Experiences …Quality/Outcomes…Individual & Community Impact

15. Evaluation as PYD How we find out is what we are about Blending programming and evaluation strategies can help youth leaders… Create authentic and empowering assessment processes that… reflect youth development best practices yield rich and diverse data that can be used by many stakeholders for many different purposes

16. Evaluation as PYD How we find out is what we are about Integrate relationships, programming, and evaluation: It’s all youth development Authentic and empowering assessment YDBP: positive climate, guided discovery, teachable moment at camp Data mining: camp observations, mentoring, experiential learning, decision-making…debriefing …training…accountability reports…funding proposals

17. Evaluation as PYD What we’re doing about it Evaluation Learning Circles are learning skills “hands-on” with peers nationwide Self-assessment (and growth!) on evaluation skills, focus group ‘markers’ on goals, achievements Collaborative planning, programming, evaluation on shared program-of-interest (that fits 4-H LRFAs) Leading and participating in national webinars Reporting, publishing results and making a difference

18. Evaluation as PYD What we’re doing about it Evaluation Learning Circles are all over: Camp Millstone* (2006-11): Quality and Impact Northwest* (2007): Presentation Contest North Central (2009-11): Record Books/STEM Northeast (2009-10): PYD/Youth Leadership Southwest (2009-11): Science Fair South Central (2010-11): Club Outcomes Southeast + (2010-11): Presentation Contest Shooting Sports (2011): Training Quality, Outcomes * Results published in Journal of Youth Development

19. Evaluation as PYD Question and Answer Are these the right questions for keeping evaluations positive youth development experiences? Do volunteers and youth love to tell you what difference a program made or struggle to describe anything beyond ‘what they did’? Do your programs “search for impacts” or “plan for impacts”? Do evaluation activities tend to disrupt or enhance relationships with youth?

20. Evaluation as PYD Question and Answer What work do we need to do to answer these questions in our own programs? (comments and questions) Do volunteers and youth love to tell you what difference a program made or struggle to describe anything beyond ‘what they did’? Do your programs “search for impacts” or “plan for impacts”? Do evaluation activities tend to disrupt or enhance relationships with youth?

21. Evaluation as PYD Feedback to Presenters What should presenters keep or change? Content Delivery

22. Evaluation as PYD Take-away What insights, skills, or tools will you take away from this webinar?

23. 4-H Evaluation Community of Practice Next Month Join us as Dr. Robert Horton applies today’s theme with the Experiential Learning Model

24. Evaluation as PYD Adios! Thanks for joining in—it’s your Community of Practice! Webinar website: http://nc4-heval.wikispaces.com eXtension E-CoP website: http://collaborate.extension.org/wiki/PDCoP_Evaluation

25. Evaluation as PYD Debriefing Delivery LRSLevel/Relevance/Specificity EEEEnthusiasm/Engagement/Empathy Content KASAKnowledge/Attitude/Skills/Aspiration gains BABehavior Change/Application Community OIAOpen/Inclusive/Affirming