UC CalFresh Physical Activity (PA) Evaluation UC CalFresh Town Hall 4/7/2019 UC CalFresh Physical Activity (PA) Evaluation Angie Keihner, MS

Piloting New PA Surveys PA evaluation tools for PSE efforts UC CalFresh Town Hall 4/7/2019 Presentation Focus Piloting New PA Surveys PA evaluation tools for PSE efforts Highlighting UC CalFresh PA Results

Piloting New PA Surveys UC CalFresh Town Hall 4/7/2019 Piloting New PA Surveys

Adult Physical Activity Survey UC CalFresh Town Hall 4/7/2019 Adult Physical Activity Survey https://uccalfresh.ucdavis.edu/evaluation/adult These questions come from the EFNEP FPAQ. I would like to acknowledge the work of EFNEP to develop, pilot test, and share these PA questions with UC CalFresh. I will READ the three QUESTIONS (see survey), so you can consider whether they are relevant to your PA programming with adults. NOTE: This tool includes a reference to “10 minutes or more at a time”, which does not reflect the 2018 PAG – which removes this criteria and emphasizes the messaging “Everything Counts”. We will keep you posted regarding any updates to the survey, but not likely before the next FFY.

Adult PA Survey (APAS) – continued UC CalFresh Town Hall 4/7/2019 Adult PA Survey (APAS) – continued Administration: Pre/post survey Use to Evaluate: Series-based DE and PSE interventions that aim to improve adult PA. Piloting w/ Curricula: Eating Smart, Being Active Eat Smart, Live Strong Eat and Play Together! MyPlate for My Family Piloting w/ PSEs: Walking clubs, Bailoterapia, Zumba, etc. Delivered w/ DE (series or workshops) Data Entry: PEARS Program Activity module

Activity #1: PA Evaluation Planning UC CalFresh Town Hall 4/7/2019 Activity #1: PA Evaluation Planning Thinking of your PA programming, how might you incorporate the Adult PA Survey? Please type your responses into the chat box.

Physical Activity Teacher Observation Tool UC CalFresh Town Hall 4/7/2019 Physical Activity Teacher Observation Tool https://uccalfresh.ucdavis.edu/evaluation/youth I would like to recognize the Butte, Alameda, and Imperial teams who collaborated with the state office to develop and review this tool. Thank you for your contributions! The PA TOT was developed to provide a systematic method of capturing the PA-specific outcomes that county staff are hearing from the partners they have trained to deliver CATCH activities. Whereas the existing TOT covers nutrition, food safety, and PA promotion more generally with ONLY ONE PA QUESTION The PA TOT covers student enjoyment of PA, requests for PA, PE practices and PA standards as well as teacher enthusiasm for PA, PA promotion and inclusivity, incorporation of brain breaks, and teaching academic concepts through movement

PA Teacher Observation Tool (PA TOT) – continued UC CalFresh Town Hall 4/7/2019 PA Teacher Observation Tool (PA TOT) – continued Administration: Retrospective survey Use to Evaluate: Series-based direct education delivered w/ CATCH that aims to improve youth PA behaviors and opportunities. Piloting w/ CATCH Activity Boxes: CATCH ECE CATCH PE K-2, 3-5, 6-8 CATCH Kids Club K-5, 6-8 (afterschool) Data Entry: Online Data Entry Portal (Qualtrics) If PA breaks only, no CATCH Activity Box – use standard TOT

Activity #2: PA Evaluation Planning UC CalFresh Town Hall 4/7/2019 Activity #2: PA Evaluation Planning Thinking of your PA programming, how might you incorporate the PA TOT? Please type your responses into the chat box.

PA Intent to Change (PA ITC) UC CalFresh Town Hall 4/7/2019 PA Intent to Change (PA ITC) https://uccalfresh.ucdavis.edu/evaluation/adult

UC CalFresh Curricula with PA Messaging UC CalFresh Town Hall 4/7/2019 PA Intent to Change (PA ITCs) – continued Administration: Immediately following single session Use to Evaluate: DE single sessions or workshops that aims to improve adult intentions for PA behavior. Piloting w/ Curricula and which PA ITC to Use: Data Entry: Online Data Entry Portal (ANR Portal) UC CalFresh Curricula with PA Messaging PA ITCs Eating Smart, Being Active PA mins Eat Healthy, Be Active Community Workshop PA hrs Eat Smart, Live Strong Eat and Play Together! MyPlate for My Family

Activity #3: PA Evaluation Planning UC CalFresh Town Hall 4/7/2019 Activity #3: PA Evaluation Planning If your team delivers PA focused single sessions/ workshops in English and Spanish and has interest in piloting the PA ITCs,… Please type ‘YES’ into the chat box.

Please share in your questions… UC CalFresh Town Hall 4/7/2019 Please share in your questions…

PA Evaluation Tools for PSE Efforts UC CalFresh Town Hall 4/7/2019 PA Evaluation Tools for PSE Efforts

Playground Stencil Assessment UC CalFresh Town Hall 4/7/2019 Playground Stencil Assessment https://uccalfresh.ucdavis.edu/initiatives/pa

CATCH Lesson Observation UC CalFresh Town Hall 4/7/2019 CATCH Lesson Observation https://uccalfresh.ucdavis.edu/initiatives/pa

Activity #4: PA Evaluation Learning UC CalFresh Town Hall 4/7/2019 Activity #4: PA Evaluation Learning If your team piloted the Stencil Assessment or CATCH Lesson Observation, can you share one valuable contribution to your program? Please unmute to share or type into the chat box.

Please share in your questions… UC CalFresh Town Hall 4/7/2019 Please share in your questions…

Highlighting UC CalFresh PA Results UC CalFresh Town Hall 4/7/2019 Highlighting UC CalFresh PA Results

Top PSE changes for PA include improved: UC CalFresh Town Hall 4/7/2019 FFY 2018 PSE Results for PA Over 180 sites in 27 counties made at least one PA related PSE change reaching nearly 82,000 people Top PSE changes for PA include improved: Quality of structured PA (88 sites) and PE (28 sites) Access/opportunities for structured (on site–86 sites, before/afterschool–19 sites) and unstructured PA (44 sites) PA facilities/equipment (43 sites) Playground stencils (30 sites)

# of Groups/ Classrooms UC CalFresh Town Hall 4/7/2019 CATCH Delivery Results FFY 2018 PEARS Program Activity Data Curricula # of Sites # of Groups/ Classrooms Youth Reach CATCH - Activity Boxes (K-5)** 128 66 (+62 additional sites where this was not the primary curricula) 320 167 (+153 additional sites where this was not the primary curricula) 9,684 5,876 (+3,808) CATCH - Nutrition Curricula (K-5)*,** 40 36 (+4 additional sites where this was not the primary curricula) 139 129 (+10 additional sites where this was not the primary curricula) 6,399 6,191 (+208) CATCH Kids Club (K-8) Afterschool* 13 55 1,378 TOTALS*** 155 514 17,461 Review table To help interpret these results, we would like your feedback about which CATCH curricula you/your extenders delivered in FFY 2018. Please type ‘YES’ into the chat box if your team used CATCH NUTRITION CURRICULA last year, ‘NO’ if you only used CATCH ACTIVITY BOXES and KIDS CLUB, and ‘DON’T KNOW’ if you aren’t sure. REPEAT RESPONSE OPTIONS Thank you for your feedback! To help address these reporting challenges, the CATCH curricula list in PEARS will be updated in FFY 2019 to better reflect the different curricula types and age/grade groups. We will let you know when this update is live. With CATCH program data now being systematically reported in PEARS, we want to continue to up our game by using the PA TOT to capture the potential outcomes related to CATCH delivery. NOTES: *4 sites with 16 classes reaching 360 students reported CATCH Kids Club Afterschool as primary curricula ‘other’ as well as CATCH - Nutrition Curricula as ‘additional curricula – other’. These are reported under CATCH Kids Club Afterschool and excluded from CATCH - Nutrition Curricula to avoid duplication. **4 sites with 7 classes reaching 185 students reported CATCH Activity Boxes and Nutrition Curricula as ‘additional curricula – other’. These are reported under CATCH - Activity Boxes and excluded from CATCH - Nutrition Curricula (K-5) to avoid duplication. ***181 sites includes duplication across CATCH categories; total unique sites is 155.

Lesson Learned: Reporting CATCH in PEARS UC CalFresh Town Hall 4/7/2019 Lesson Learned: Reporting CATCH in PEARS When CATCH is delivered by educators, report CATCH DE delivery as a PEARS Program Activity. When extenders are trained and delivering CATCH, report CATCH DE delivery as a PEARS Program Activity and also include as a PSE Site Activity.

FFY 2017 Stencil Evaluation Methods UC CalFresh Town Hall 4/7/2019 FFY 2017 Stencil Evaluation Methods Evaluation Methods Tool: Playground Stencil Assessment Two Components: (1) environmental scan and (2) teacher interviews/surveys Administration: Collected by educators during outdoor play times before and after painting the stencils Sample: 9 (60%) of 15 new stencil sites used assessment Sites: 6 preschools and 3 elementary schools Counties: Alameda, Kern, Tehama, Shasta, El Dorado, and Glenn

FFY 2017 Stencil Evaluation Results UC CalFresh Town Hall 4/7/2019 FFY 2017 Stencil Evaluation Results Improved Environments 68 new stencils painted reaching nearly 1000 students Top Types: Hopscotch, ponds w/plants/animals, movement words, and fruit/veggies Improved Student Behaviors 23% more students were actively playing 31% more students were playing in the stencil areas 23% fewer students were sitting down, not walking or very inactive Teaching Practices Support Student Physical Activity 88% encourage students to be physically active 86% participate in PA with students using playground stencils 76% facilitate PA for students using playground stencils 62% use playground stencils to infuse PA into school day 77% use playground to teach academic concepts through movement

Lessons Learned: Stencil Pilot Findings UC CalFresh Town Hall 4/7/2019 Lessons Learned: Stencil Pilot Findings Use the assessment to capture outcomes See TIP SHEET for Implementing the Playground Stencil Assessment Includes guidance on how to conduct student counts to ensure consistent reporting Survey the SAME teachers at pre and post Only submit matched pre/post surveys Teachers want training/resources to support stencil use Good News! Provide CATCH training to teachers who observe outdoor play times Developing online portal to expedite results summaries and support PEARS reporting The STENCIL TIP SHEET provides detailed guidance on how to conduct student counts when observing outdoor play times. Please review this guidance, before conducting the environmental scan, to ensure student counts are interpreted and conducted consistently across county teams.

Please share in your questions… UC CalFresh Town Hall 4/7/2019 Please share in your questions…

Thank you! In you have questions, please contact: Angie Keihner, MS UC CalFresh Town Hall 4/7/2019 Thank you! In you have questions, please contact: Angie Keihner, MS akeihner@ucdavis.edu (530) 752-8813