Louisiana Math and Science Partnership State Coordinator Meeting Washington, DC June 2008
Key Question Can teacher participation in the MSP program transfer effectively into the classroom and improve student learning?
How to Address Key Question? Standard Assessment of teacher content knowledge Qualitative data from teacher surveys Difficult Collection and analysis of student data
Components of Evaluation Teacher Content Assessment On-line Survey State Data System
Teacher Content Assessment Pre-tests and post-tests for content knowledge Submitted to Assessment Research and Technology Section of the Louisiana Department of Education High School and Elementary Projects Same Test – state-wide
On-line Survey Pre-survey and post-survey on-line Multiple choice and open-ended responses Teachers’ demographic background, educational level, teaching experiences, previous professional development opportunities, level of knowledge or ability in teaching math/science, personal Rating of training experience Feedback about programs (strengths and weaknesses) Comfort level in teaching math/science after training
State Data System Create on-line state system compatible with state test data bases Require district agreement to provide access to data Identify students who are taught by teachers participating in the MSP programs Construct comparison groups using students who are similar in demographic background but who were not taught by MSP teacher participants Access student data on high-stakes test for comparison
Data Analyses Mean scaled scores Percent of students scoring “proficient” on the Louisiana standardized tests Program level and state level analyses Report by grade and content area Student demographics and comparison groups
Student Demographics MathScience NumberPercentNumberPercent Grade 51,3309%1,40510% 64,04127%3,52624% 72,60018%3,72625% 84,19929%3,68425% 92,54217%2,41816% Gender Male7,62750%7,71150% Female7,58350%7,58750% Ethnicity Native American1281%670% Asian1761%1701% African American7,77951%7,10146% Hispanic3082%3422% White6,83445%7,63650% Free/Reduced Lunch 9,68966% 9,39663% Statewide Total15,237100%15,329100%
State MSP Scores - Grade 6 iLEAP Mean Scaled ScorePercent Proficient Non-MSP Participant MSP ParticipantDifference Non-MSP Participant MSP ParticipantDifference Education Classification Regular Education %70%+14% Special Education %35%+13% Ethnicity Native American %70%+15% Asian %87%+10% African American %54%+12% Hispanic %61%+19% White %82%+13% Free/Reduced Lunch %59%+15% Paid Lunch %84%+12% Statewide Total %67%+16%
Scores by Project - Grade 6 iLEAP Taught by Non-MSP ParticipantTaught by MSP Participant Mean Score Difference Project Name Total NumberMean Score Total NumberMean Score EBR High School EBR Middle School Math Iberville High School Iberville Middle School Math Jefferson MSMSP Livingston Math Institute Math TIPS Meaningful Math through Modeling Monroe City Impacts Math Northwest M&S Middle School Project Prism SAVE Math Concordia Parish Math Program Statewide Total4, ,
Louisiana MSP Evaluation Plan Questions?