September 2009 Copyright © 2009 Mississippi Department of Education 1 Mississippi Department of Education Office of Research and Statistics District Test Coordinator Training September 9, 2009 Making Accountability Count

What to cover…. Senior Snapshot ELL/OARS Application Scores in MSIS Science Test Requirements New State Accountability System September 2009 Copyright © 2009 Mississippi Department of Education 2

Senior Snapshot Based on Month 8 enrollment Month 8 data typically available late May meaning we can get it to you early to mid June Too late to do anything but verify September 2009 Copyright © 2009 Mississippi Department of Education 3

Sr. Snapshot New This Year Preliminary Snapshot provided Late August  Scientific guess based on last year’s Month 8 enrollment –Assume all students from will be around in –Assume all students were promoted –Used Month 8 11 th graders as this year’s seniors. –Used Month 8 grade 56, 58, and 78 students who were 18 on September 1, September 2009 Copyright © 2009 Mississippi Department of Education 4

Sr. Snapshot New This Year Meant to be a scheduling tool only!! September 2009 Copyright © 2009 Mississippi Department of Education 5

Sr. Snapshot New This Year An updated Sr. Snapshot based on this year’s enrollment will be provided after Month 1 – probably mid to late November A third snapshot will be provided after Month 4 – Late December/Early January Final Official Sr Snapshot provided after Month 8 – Late May/Early June September 2009 Copyright © 2009 Mississippi Department of Education 6

ELL/OARS Application Collected ELL enrollment through OARS application Gave us the ability to provide file for Pre-ID labels to WiDA Did Not collect served/monitored status of ELL students We will collect served/monitored status of ELL students in September 2009 Copyright © 2009 Mississippi Department of Education 7

ELL/OARS Application – cont’d Collect information as close as possible to testing window to ensure the file is as complete as possible. More guidance/webinar closer to testing window. September 2009 Copyright © 2009 Mississippi Department of Education 8

Test Scores in MSIS – What’s the issue??? Inaccurate data is worse than no data We realize time is of the essence We don’t get the scores at the same time you do Can not load scores until MSIS ID’s are verified  Pre-ID labels are no problem  New flag to indicate pre-id students this year September 2009 Copyright © 2009 Mississippi Department of Education 9

Test Scores in MSIS – What’s the issue???  Hand-gridded answer documents must be verified –MSIS numbers with invalid characters –First and last names reversed –Names with numbers  Approximately 1500 MCT2 scores and 1500 Subject Area scores had to be hand-verified in Work with MIS to get the scores loaded September 2009 Copyright © 2009 Mississippi Department of Education 10

Science Testing – What’s required State Model –  Biology I test required this year  Grade 5/8 Science Test required next year September 2009 Copyright © 2009 Mississippi Department of Education 11

Science Testing – What’s required Federal Model – AYP –  Requires students to be tested in Science – Once in Elementary School (Grade 5) – Once in Middle School (Grade 8) – Once in High School (Biology I) September 2009 Copyright © 2009 Mississippi Department of Education 12

Science Testing – What’s required Federal Model – AYP –  Only requires the student to be tested and reported  Does NOT require the inclusion of the score in the calculation of AYP September 2009 Copyright © 2009 Mississippi Department of Education 13

Science Testing – What’s required HOWEVER… No Child Left Behind is up for reauthorization  General consensus is that science will be included in calculations after reauthorization  Remember, for high school, we use the Sr Snapshot. This could possibly put us looking back 4 years for Biology scores under a new education bill September 2009 Copyright © 2009 Mississippi Department of Education 14

August 2009 Copyright © 2009 Mississippi Department of Education 15 New State Accountability Model Don’t know whether to laugh… … or cry??? Just don’t let it drive you crazy!!! When it comes to the New State Accountability Model...

August 2009 Copyright © 2009 Mississippi Department of Education 16 New State Accountability Model A Little History No school performance classifications based on the results. Accountability Task Force to develop recommendations for revising the state accountability system. Made recommendations to the Commission on School Accreditation (CSA). The CSA recommended the revised accountability system to the State Board of Education. The State Board of Education approved the revised accountability system at its March 2009 meeting. The first ratings assigned based on the revised system will be made in fall 2009.

August 2009 Copyright © 2009 Mississippi Department of Education 17 Copyright © 2009 Mississippi Department of Education 17 What is included Reading/Language Arts grades 3-8 Mathematics grades 3-8 Algebra I Biology I English II Multiple-Choice U.S. History from 1877 Alternate Assessments Note: A student will contribute equally to the Achievement Model based on his performance level (Minimal, Basic, Proficient, or Advanced) on the assessment regardless of the grade level at which the assessment is first taken. Achievement Model (Quality of Distribution Index)

August 2009 Copyright © 2009 Mississippi Department of Education 18 Copyright © 2009 Mississippi Department of Education 18 Back-Mapping Easy to tell where a student has been Scores only back-map within the same district Algebra I – any school within the district beginning with 8 th grade that the student has attended will share the Algebra I score Achievement Model Back-Mapping and Forward-Mapping

August 2009 Copyright © 2009 Mississippi Department of Education 19 Copyright © 2009 Mississippi Department of Education 19 Back-Mapping Biology I – any school within the district beginning with 9 th grade the student has attended will share the Biology I score Unlike AYP, state model uses current year’s tests Achievement Model Back-Mapping and Forward-Mapping

August 2009 Copyright © 2009 Mississippi Department of Education 20 Copyright © 2009 Mississippi Department of Education 20 Forward-Mapping Not as easy as back-mapping – impossible to read the future Based on feeder patterns within the district In most districts, feeder patterns are obvious and straight-forward In districts where we couldn’t discern the feeder pattern, we contacted the district In districts where there is no set feeder- pattern, there is no forward-mapping Achievement Model Back-Mapping and Forward-Mapping

August 2009 Copyright © 2009 Mississippi Department of Education 21 Copyright © 2009 Mississippi Department of Education 21 The formula for the Quality of Distribution (QDI) is: QDI = % Basic + (2 X % Proficient) + (3 X % Advanced) Achievement Model (Quality of Distribution Index)

August 2009 Copyright © 2009 Mississippi Department of Education 22 Copyright © 2009 Mississippi Department of Education 22 Achievement Model (Quality of Distribution Index) % Minimal% Basic% Proficient% Advanced Example 1 QDI = (2 X 21.8) + (3 X 5.5) = % Minimal% Basic% Proficient% Advanced Example 2 QDI = (2 X 43.7) + (3 X 10.3) = % Minimal% Basic% Proficient% Advanced Example 3 QDI = (2 X 36.8) + (3 X 34.7) = 199.8

QDI Calculator September

24

August 2009 Copyright © 2009 Mississippi Department of Education 25 Copyright © 2009 Mississippi Department of Education 25 What is planned for inclusion in the model Measured against the amount of improvement or growth that occurs in one school year  Reading/Language Arts grades 4-8  Mathematics grades 4-8  Algebra I  Biology I  English II Multiple-Choice  U.S. History from 1877 Growth Model (Still under development)

August 2009 Copyright © 2009 Mississippi Department of Education 26 Copyright © 2009 Mississippi Department of Education 26 High School Completion Index / Graduation Rate HSCI Included in determining the accountability rating of schools with grades 9-12 and districts Based on the status of students five years after first entering ninth grade Eventually the HSCI should be based on the status of students seven years after first entering seventh grade

August 2009 Copyright © 2009 Mississippi Department of Education 27 Copyright © 2009 Mississippi Department of Education 27 High School Completion Index / Graduation Rate Standard Diploma300 Met Requirements Except Graduation Test 150 Occupational Diploma150 Certificate of Attendance150 GED125 Still Enrolled50 Dropout-300

August 2009 Copyright © 2009 Mississippi Department of Education 28 Copyright © 2009 Mississippi Department of Education 28 Putting the Pieces Together: The Accountability Labels

200 – 300 QDI 166 – 199 QDI 133 – 165 QDI 100 – 132 QDI 0 – 99 QDI State Accountability Ratings Inadequate Growth Appropriate Growth Outstanding Growth Achievement (QDI) Graduation Rate / HSCI High Performing Star School Successful High Performing High Performing Successful Academic Watch Academic Watch Academic Watch At Risk of Failing Low Performing Low Performing For Schools with a grade 12, high school completion must be considered for the top two achievement tiers meeting growth: Graduation Rate HSCI Graduation Rate > 75% OR HSCI > 200 Graduation Rate > 80% OR HSCI > 230 September 2009 Copyright © 2009 Mississippi Department of Education 29

State Accountability Ratings Inadequate Growth Appropriate Growth Outstanding Growth Achievement (QDI) Graduation Rate / HSCI High Performing Star School Successful High Performing High Performing Successful Academic Watch Academic Watch Academic Watch At Risk of Failing Low Performing Low Performing Graduation Rate > 75% OR HSCI > 200 Graduation Rate > 80% OR HSCI > 230 High Performing High Performing Successful Met Not Met Met Not Met September 2009 Copyright © 2009 Mississippi Department of Education 30

August 2009 Copyright © 2009 Mississippi Department of Education 31

September 2009 Copyright © 2009 Mississippi Department of Education 32 State Accountability System l State Achievement Model - a high jump with three bars. The more students you get over each bar, the better. l Growth Model - a high jump where the bar is adjusted for each athlete

September 2009 Copyright © 2009 Mississippi Department of Education 33 Where Do I Get All This Stuff???? Sr. Snapshot QDI Calculator Sign Up for the Accountability Listserv

September 2009 Copyright © 2009 Mississippi Department of Education 34 Resources l MAARS – Ken Thompson Research and Statistics (601)