1. How Effective is Your Science Program? Really? How to do a district-wide science program evaluation. George W. Stickel & Sally Creel Cobb County Public Schools, Georgia NSTA Presentation 30 March 2008

2. Why Do a Program Evaluation? An external reason An internal reason –Navigation--where we are & want to be A district reason –GAPSS

3. Data (backward design then & now) Backward design--then, go back to some early notes Backward design--now, GAPPS & strategic planning

4. Data Techniques, Processes, Procedures of reporting used to gather data

5. Data Collection [explicate each of these with handouts] Assessments –CRCT –ITBS –EOCT –GHSGT Surveys Observations

6. Data Analysis National scene State scene Metro-Atlanta (similar districts) Similar out-of-state districts

7. Data Reporting District Teachers –Instructional Material Adoption –Strategic planning Board of Education –Why do they care? They spent $ for texts Ultimately responsible

8. The Report (what it looked like) For text adoption Physical report (the tome) Board presentation

9. Report: Instructional Materials Adoption Philosophy and Principles Current Trends & Issues in Science Educ Summary of Science Needs Test Data Implications for Selecting Science Materials Identifying Effective Instructional Resources Professional Development FAQs

10. Report: The Actual Document Five components Data Survey Questions Analysis Conclusions

11. Report: Board Presentation What to include What not to include (Own sandbox) The actual slides

12. Investigating the Cobb County Science Education Program K-12 Program Evaluation January 29, 2008 Cobb county Public Schools

13. International & National Science Trends Economic concerns STEM initiatives

14. State and Local Science Trends Georgia Performance Standards Assessment Results

15. 2007 CRCT was GPS for Grades 3-7; 2006 CRCT was GPS for Grades 6 & 7. All 8th grade scores are based on QCC, not GPS.

16. Scores for FY 07 are GPS assessed and are more performance based.

19. Observations of Science Teaching in Cobb Schools All elementary observations were announced. Middle and high observations were unannounced.

20. Teacher Survey & Classroom Observation Results Teachers are comfortable with labs & performance tasks Laboratory & performance tasks use limited Teachers knowledgeable of science content & process Characteristics and content of science integration is minimal Teachers use writing assignments Writing use ineffective for critical thinking and comprehension Teachers use some effective strategies Strategies not used systematically or comprehensively

21. Comparable Science Programs Cobb students comparable with national & state trends –Limited comprehension of science concepts –Limited ability to apply concepts –Limited number seek STEM or medical careers

22. Strengths in Cobb Science Education Teachers (gifted, flexible, sensitive of student needs) Strong State Science Curriculum Good science facilities with adequate resources at many schools

23. Science successes F1 Racing, 1st 5 places at State Teachers receiving grants Elementary science teacher of the year, State of GA

24. Weaknesses in Cobb Science Education District focus on English/Language Arts & Math Effective use of performance based learning Limited classroom use of higher level thinking Teachers understanding of science (particularly as you move from 12-K) Science resources Use of data Student readiness for science

25. Recommendations (old) Cultivating science literacy Cultivate strong elementary science program –Designated time for science –Establish lab supply ordering system Increased funding for laboratory supplies Comprehensive use of performance tasks Systematic use of critical thinking

26. Recommendation 1 Cultivate strong elementary science program –Designate time for science –Increase science understanding among teachers

27. Recommendation 2 Build capacity for teaching inquiry- based GPS science –Increase the focus on student-centered inquiry tasks –Make critical thinking explicit within inquiry –Incorporate student self assessments strategies

28. Recommendation 3 Commit to consistently funding science consumable resources K-12 Improve effectiveness assessment techniques (formative & summative) Align science performance tasks with GPS Refine science pedagogy K-12 Transitions years….

29. Recommendation Require performance-based science in the elementary classroom

30. Where we wanted to go then, Where we want to go now

31. Now What? Data based decision making A Strategic Plan