1. Results of the 2010-2011 Pilot Fitness Assessment Training and Looking Ahead to Statewide Implementation Mike Metzler (Georgia State University) Christi Kay (HealthMPowers) Shannon Williams (GSU) Jeff Rupp (GSU) Rodney Lyn (GSU) Mary Ann Phillips (GSU) Kari Hunt (GSU)

2.  Legislation and DOE Rules  S.H.A.P.E. partnership  Selection of fitness assessments  2010-2011 fitness assessment training pilot  Evaluation of fitness assessment training and testing  Looking ahead to 2011-2012  Q&A Overview 2

3.  Beginning in 2011 an annual fitness assessment in grades 1-12 (Pre + post optional)  All classes taught by a certified physical education teacher  Individual results communicated to parents or guardians  Aggregate results reported to DOE Georgia Official Code (20-2-777) 3

4.  At least minimum amount of physical education instruction provided: -- Elementary: 90 clock hours/year -- MS H/PE instruction provided -- HS 1 semester Health/1 semester Personal Fitness  Recognition Georgia Official Code (20-2-777), con’t 4

5. Governor's Office Georgia Department of Education Georgia Department of Public Health Maternal and Child Health, Division of Public Health Children’s Healthcare of Atlanta Atlanta Falcons Youth Foundation (AFYF) The Arthur M. Blank Family Foundation The Atlanta Braves Foundation Student Health and Physical Education (S.H.A.P.E.) Partners 5

6.  Selects five components of FITNESSGRAM®  Determines requirements for each grade re: assessments  Plans to implement pilot training in five counties 2010-2011  Decides to conduct evaluation of the pilot training DOE Fitness Advisory Committee 6

7.  Combines both an educational assessment and a reporting software program  Designed to promote lifelong physical activity  Based on the latest research on children’s fitness  Health related  Uses criterion-referenced standards FITNESSGRAM® 7

8.  PACER /Mile Run – Aerobic Capacity  Curl-Ups – Muscular Strength and Endurance  90 0 Push-Ups – Muscular Strength and Endurance  Back-Saver Sit and Reach - Flexibility  Height and Weight – To Calculate Body Composition as BMI Fitness Assessment Components 8

9. GA DOE Fitness Assessment and Reporting Requirements 9

10.  Fall of 2010  Designed and coordinated by HealthMPowers  Eight hours, in one day  Used three certified FG trainers  Trained 290 teachers in four counties: --Bibb, Hall, White, Gwinnett, Lowndes (selected but completed testing early) 2010-2011 Pilot FITNESSGRAM® Training 10

11.  Level 1– Trained by certified trainers  Level 2– Trained fully by Level 1’s  Level 3—Untrained (e.g. substitute teacher, parent) 2010-2011 FITNESSGRAM® Training 11

12.  Information about the Fitness Assessment Program  FITNESSGRAM® testing training  Fitness testing  Data entry accuracy and management  Preparing and distributing FITNESSGRAM® reports Scope of the Evaluation of the Pilot 12

13.  “Ticket out the Door” (comment slips after the training sessions)  Observations of teachers conducting fitness testing  Analysis of time to administer FITNESSGRAM®  Teacher item responses on surveys (after completing testing)  Teacher comments on surveys (after completing testing) Evaluation of Pilot FITNESSGRAM® Testing Training 13

14. The teachers were very complimentary about the design of the training materials and the quality of the instructors:  “Seeing the tests in practice. Hearing a thorough explanation of each test”  “Seeing the tests on video then actually doing them to make sure we were accurate”  “Mistakes to look for were outlined. Helpful hints to teach tests to kids” “Ticket out the Door” 14

15. The teachers expressed some challenges, including:  “Pre/post test all students in 9 weeks. It will reduce instructional time”  “Getting the students to buy into the testing. Being serious about doing their best”  “Getting ‘old timers’ to get on board” “Ticket Out The Door” 15

16. A trained observer and certified FITNESSGRAM® test administrator observed 22 teachers administering different combinations of the testing components between December of 2010 and May of 2011. The observations were made at 4 elementary schools, 4 middle schools, and 2 high schools. The purpose was to check teachers’ adherence to FG protocols taught in the training sessions. Observations of Teachers Conducting Fitness Testing 16

17. Observations of Teachers Conducting Fitness Testing Test component # of items on checklist Mean percent correct and included Low % -- High % Push Ups777.6%28.6% -- 100% PACER673.8%28.6% -- 100% Back Saver Sit & Reach966.7%44.4% -- 100% Curl Ups1156.4%*9.1% -- 81.8% *This mean would be 68.1% without the very low score of 9.1% by a Level 3 tester 17

18. Observations of Teachers Conducting Fitness Testing Percent Correct and Included Level 1 74.5% Level 2 47.5% Level 3* 33.3% *Only one Level 3 tester was observed 18

19. Reliability observations checked for differences between scores recorded by teachers/volunteers/students and those recorded by independent, trained recorders. The trained observers’ counts would be made strictly according to each test’s protocol, and then recorded along with the count made by the teacher, volunteer, or student who was assigned that responsibility. We conducted 296 observations and comparisons across all components of the FITNESSGRAM® test. Observations of Teachers Conducting Fitness Testing 19

20. Observations of Teachers Conducting Fitness Testing Test componentDifference (%) Push-Ups45.0 Curl Ups40.7 Sit and Reach33.3 PACER4.9 Height0.3 Weight0.3 20

21. During the on-site observations, one of the trained observers recorded the start/stop times for each group of tested children, and noted how many students were being tested at that time. From that, it was possible to calculate a time estimate for testing a (hypothetical) group of 30 students in the same physical education class. It should be noted that the number of students to be tested at one time in each test was based on the recommendations of a trained and highly experienced certified FITNESSGRAM® trainer. Analysis of Time to Administer FITNESSGRAM® 21

22. TestTest at once Time ~Total Time PACER 6 15:00 mins 75 mins Sit & Reach 1 2:45 mins 80 mins Height & Weight 1 1:00 mins 30 mins Push Ups 4 2:30 mins 20 mins Curl Ups 4 2:30 mins 20 mins The total estimated time to properly test those 30 students is 225 minutes, almost 4 hours of class time. Analysis of Time to Administer FITNESSGRAM® 22

23. Analysis of Time to Administer FITNESSGRAM® Scenarios: PE for 1 day/week for 30 mins:8 classes/8 weeks~20% of annual PE PE for 2 days/week for 30 mins:8 classes/4weeks~10% of annual PE PE for 3 days/week for 30 mins.8 classes/~3 weeks~7% of annual PE PE for 5 days/week (9 weeks) for 45 mins:5 classes/1 week~11% of 9 weeks 23

24. Analysis of Time to Administer FITNESSGRAM® Time Accuracy 24

25. The FITNESSGRAM® training was well-organized and effectively presented: Strongly agree52% Agree40% Teacher Item Responses on Surveys (After Testing) 25

26. I feel well-prepared to test the students at my school using the FITNESSGRAM® assessments: Strongly agree51% Agree37% Teacher Item Responses on Surveys (After Testing) 26

27. The teachers still expressed that the training was beneficial and effective, but after testing they again expressed concerns about time and other constraints: “It is very time consuming. It's hard doing the testing by yourself.” “I don’t feel I can trust students to watch for form breaks and give accurate scores on those [sit and reach, curl ups, push up], so it is taking quite a long time to get those done.” Teacher Comments on Surveys (After Testing) 27

28.  To provide an extensive information campaign so teachers can better understand why they are conducting the fitness tests.  To provide suggestions for teachers who have to test large numbers of students at one time, such as how to conduct the test and how to keep the other students occupied.  To urge teachers to re-familiarize themselves with the instruction checklist prior to administering each of the tests and have it with them during the testing. Selected Recommendations from the Pilot 28

29.  To urge teachers not to exceed the recommended number of students taking a test at the same time, based on their level of experience with FG.  To urge teachers not to use students in elementary grades to count and record scores for other students.  To develop an on-line “booster” training module to refresh teachers’ memory right before testing.  To require that the training of Level 2 and Level 3 testers be documented for compliance with level 1 training. Selected Recommendations from the Pilot 29

30. -- June - December 2011: Training ~2,500 teachers trained for testing (Level 1) -- November - December 2011: Import student information into FITNESSGRAM® -- January 2012 - February 2012: Practice testing/pretesting (optional) -- March 1 - May 5 2012: Implement assessment; record and report scores -- May 1 – June 15 2012: Schools deliver student reports to parents -- October 2012 : The first Georgia Report to the Governor 2011-2012 Timeline 30

31.  Training is scheduled for 150 local systems  Provide information for IT and student information representatives from local systems  Student information imported into FG 9.0  Teachers trained via webinar on how to enter student assessment data ( December 2011 – January 2012)  Data entry, and reporting available after January 1, 2012  Data collection will be done via a secure web based location using Fitnessgram 9.0 2011-2012 Statewide Implementation 31

32.  Equipment for assessment: -- Sit and Reach Box -- Scale -- Height Measure Strip -- FG Kit (additional items needed to test)  Data and reporting: -- FG 9.0 web based program -- Licensing -- Data Collection Space 2011-2012 Statewide Implementation 32

33. Funding has been secured to develop an e-learning module to help improve teacher observation. Proposed 4 parts: 1. Tutorial of correct performance 2. Tutorial of common form breaks 3. Game/Activity to evaluate form breaks of a single execution (sit and reach, curl ups and push ups) 4. Game/Activity to evaluate correct execution in a series of 10 (curl ups and push ups) 2011-2012 Statewide Implementation 33

34. FERPA: The parties will safeguard the confidentiality of the student data as required by the Federal Family Educational Rights and Privacy Act (FERPA) and other applicable laws and regulations. No release of data, reports, information, or output of any kind based on the data will include any information that could be identifiable or linked to a specific person. 2011-2012 Statewide Implementation 34

35.  FITNESSGRAM® Georgia (http://www.fitnessgram.net/Georgia/)http://www.fitnessgram.net/Georgia/  FITNESSGRAM® (http://www.fitnessgram.net/home/)http://www.fitnessgram.net/home/  The S.H.A.P.E partnership (http://georgiashape.org/)http://georgiashape.org/  Georgia Department of Education – Health and Physical Education (http://www.doe.k12.ga.us/ci_services.aspx?PageReq=CIServHealthPhys (http://www.doe.k12.ga.us/ci_services.aspx?PageReq=CIServHealthPhys) Website includes all materials provided in the training manual. (e.g. all training PPTs, all communication pieces including sample letters, newsletters, frequently asked questions, information for school websites, tips for success from the field, fitness testing one pagers and station cards, and more. Resources 35

36. Therese McGuire Program Specialist Health and Physical Education Georgia Department of Education tmcguire@doe.k12.ga.us 404.651.7859 DOE Contact 36

37. Time for Questions 37