National 4-H Common Measures Suzanne Le Menestrel, Ph.D. National Institute of Food and Agriculture, USDA Jill Walahoski, Ph.D. University of Nebraska-Lincoln Jessie Bauman University of Nebraska-Lincoln Dennis Sorensen Qualtrics An Introduction to the 4-H Common Measures: Phase 2

Head. Heart. Hands. Health. 4-H Common Measures  Project Goals  Benefits, Why Common Measures?  Development Process  Overview of the Outcomes and Tools

Head. Heart. Hands. Health. Goals for Common Measures  Provide state 4-H programs with resources to assist in the planning of local, state-wide, and regional evaluations  Identify a common core of child/youth outcomes and indicators that are included in the National Institute of Food and Agriculture Plan of Work system  Identify a common core of outcomes, indicators and measures to create a standard survey tool that will be used by National 4-H Council grantees

Head. Heart. Hands. Health. What was needed?  Ability to aggregate data at the local, state, and national levels  Ability to pinpoint successes and areas for improvement  A “common language”  Accessible instruments

Head. Heart. Hands. Health. Benefits to 4-H  Writing impact statements for county, state and federal reports  Easy ability to populate other reports that you are already doing  Ability to describe 4-H consistently and simply  Friendly, feasible and brief  Open access to the product-free and readily available  Measures applicable to a broad range of programs

Head. Heart. Hands. Health. Development Process  Started with National 4-H Logic Models  Spring, 2012: Common outcomes indicators and items were identified for all outcome areas for both 4-7 and 8-12 grade  Summer, 2012: Surveys were pilot tested in LA, MT, WV, NE, and VA with Hers; included facilitator input  Fall, 2012: Print versions were made available

Head. Heart. Hands. Health. Development Process  Spring, 2013: Phase 1 online data collection system launched; training delivered to 35 LGUs and 4-H Council grant managers  Spring, 2013: Year one implementation study including psychometric analysis, report available in Spring 2014  Winter, 2013: Transition to Phase 2; Qualtrics platform and preliminary psychometric analysis  Spring, 2014: Phase 2 training and a measures development meeting for Workforce Preparation/Development items

Head. Heart. Hands. Health. Overview of the Tools The 4-H Common Measures Tool and Outcomes

Head. Heart. Hands. Health. Overview of the Tools  Eight Surveys designed to assess the outcomes found on the National 4-H Logic Models  4-7 and 8-12 Grade Universal Measures  4-7 and 8-12 Grade Citizenship Measures  4-7 and 8-12 Grade Healthy Living Measures  4-7 and 8-12 Grade 4-H Science Measures 

Head. Heart. Hands. Health. Overview of the Tools  Intended for use by 4-H programs  Unique Program Evaluation  Annual Cross-Sectional Sample “State of 4-H Youth”  Needs Assessment  Benchmark Local Data against National Samples  Grants  Paper and Pencil and Web-Based  Voluntary (Unless Grant Designated)

Head. Heart. Hands. Health. Universal Outcomes  Make positive choices  Effectively communicate  Build connections  Apply content  Contribute to the health, growth and well- being of self, family, community, nation and the world

Head. Heart. Hands. Health. 4-H Science Outcomes  Interest and engagement in Science  Positive attitudes and aspirations toward Science  Develop Science skills and abilities  Apply learning, make a contribution through Science

Head. Heart. Hands. Health. Citizenship Outcomes  Awareness of community and community issues  Appreciation of cultural diversity  Engagement in community and engagement with community issues  Understanding of the Democratic process

Head. Heart. Hands. Health. Healthy Living Outcomes  Choose food consistent with dietary guidelines  Improve physical activity practices  Avoid and prevent negative risk behaviors  Assess and regulate emotions & behaviors  Establish & maintain healthy relationships

Head. Heart. Hands. Health. Phase 2 Transition The Qualtrics platform was selected in response to the needs reported in year one, benefits include:  Customizable tools  Pre-post compatible  Improved Analysis  Improved technical support  Potential for language translation

Head. Heart. Hands. Health. Phase 2 Transition  Features of the Qualtrics Platform  Security  Access to the 4-H items in the library  Ability to customize tools  Paper and electronic survey administration  Import data entry process for paper copies  Analysis and reporting tools

Head. Heart. Hands. Health. Next steps…  Development of Workforce Preparation/Workforce Development measures  Phase 2 Training, live series and self-guided video modules  Complete the transition of data collected in the original platform  Updated online resources including the IRB guide and FAQ document  New resource development including a report template  Continue psychometric analysis  Annual feedback survey to State Program Leaders

Head. Heart. Hands. Health. Access to the Tools  LGU Account Manager  Each LGU will have an account manager that will coordinate the access at LGUs  Grant Account Manager  National 4-H Council Grantees will receive the tools necessary to administer surveys and enter data  Survey-link, paper copy and import file  Each LGU continues to be responsible for securing their own IRB approval

Head. Heart. Hands. Health. Entering Data  An anonymous link can be created for each survey and the survey can be administered electronically  Paper copies can also be generated and data can be keyed into an excel file for easy import, the formatted file can be generated in Qualtrics or responses can be individually keyed as responses to the anonymous link

Head. Heart. Hands. Health. Running a Report I’m not an account manager, how will I access my reports?  You will need to work with the account manager at your LGU or with the Grant to export data or run reports  Data and reports can be made available in Excel, Word or Pdf formats

Head. Heart. Hands. Health. Questions?

Head. Heart. Hands. Health. Contact Information  Jill Walahoski -  Jessie Bauman –  Suzanne LeMenestrel –  Information and Resources  Qualtrics Support