Using Data to Identify Student Needs for MME Stan Masters Coordinator of Curriculum, Assessment, and School Improvement Lenawee ISD August 26, 2008

POP Purpose –Understand the potential in using student achievement data to identify student readiness for the Michigan Merit Exam Objectives –Analyze the Spring 2008 MME results, using a case study –Develop steps for preparing for 2009 MME and beyond Procedure –PowerPoint slides for presenting information

Spring 2007 MME Results August 15, LANSING – More than 94 percent of Michigan 11th graders participating in the new Michigan Merit Exam (MME) this spring qualified to receive the $4,000 Michigan Promise Scholarship for their post-secondary education, the Michigan Department of Education reported today. To qualify for the up-front installment payments of the Michigan Promise Scholarship, students are required to meet or exceed state standards in reading, writing, mathematics, and science. They will receive $1,000 during their freshman and sophomore years and earn the remaining $2,000 after successfully completing two years of post- secondary education. Those students who did not meet or exceed Michigan standards in all four of those subjects as 11th graders have an opportunity to test again as seniors to qualify for early receipt of scholarship funds, or receive the $4,000 Promise Scholarship after successfully completing two years of a post-secondary education program.

What were the components of each MME test score? MME Reading – –ACT Reading and WorkKeys Reading MME Writing – –ACT English, ACT Writing, and Michigan Writing MME Math – –ACT Math, WorkKeys Math, ACT Science, and Michigan Math MME Science – –ACT Science and Michigan Science

What about… MME English Language Arts? –Used for purposes of Adequate Yearly Progress (AYP) –A student’s total ELA scale score is the average of the reading and writing scale scores. MME Social Studies –Entirely a Michigan test –Must be taken as part of MME, but scores are not used to qualify for the Michigan Promise Scholarship –Not part of Michigan’s AYP formula

What do we know about these “proficient” MME students? They took the MEAP tests in –Winter of 2003 (Reading and Writing) –Winter of 2004 (Math and Science) What evidence could indicate that these students would show success on the Spring 2007 MME?

MME 2008 Some 12 th grade re-testers in the Fall of 2008 –Free ACT on National Test Date in October –Opportunity to improve scores to receive Michigan Promise Scholarship as incoming Freshmen –Does not impact AYP –MDE decides to end Fall Retake after 2008 March 2008 – Spring MME with 11 th graders –Same formats as Spring 2007

What do we know about these “proficient” MME students? They took the MEAP tests in –Winter of 2004 (Reading and Writing) –Winter of 2005 (Math and Science) What evidence could indicate that these students would show success on the Spring 2008 MME?

WE MUST UTILIZE AN INQUIRY APPROACH TO DATA ANALYSIS WE MUST USE MULTIPLE SOURCES OF DATA We need a data warehouse for our 21 st century schools WE MUST FOCUS ON DATA TO INCREASE STUDENT ACHIEVEMENT Talking Points for the Purpose of Implementing a Data Warehouse in Lenawee Schools

Potential Data Sources for Predicting Student Success on MME Previous MEAP Previous ACT PLAN EXPLORE NWEA

What else can we use to predict student success on MME? ACT Score –Benchmark Scores for College Readiness Reading Score of 21 »97% Proficient on MME Reading Math Score of 22 »99% Proficient on MME Math Science Score of 24 »100% Proficient on MME Science English Score of 18 »17% Proficient on MME Writing Bauer, E. and Treder, D. (December 13, 2007). Banging on the MME. Presentation at Michigan Educational Research Association Inc., Frankenmuth, Michigan.

What else can we use to predict student success on MME? PLAN –Benchmark Scores for College Readiness Reading Score of 17 »70% Proficient on MME Reading Math Score of 19 »87% Proficient on MME Math Science Score of 21 »95% Proficient on MME Science English Score of 15 »25% Proficient on MME Writing Bauer, E. and Treder, D. (December 13, 2007). Banging on the MME. Presentation at Michigan Educational Research Association Inc., Frankenmuth, Michigan.

Changes in tests and components of 2009 MME may change the predictability MME Reading – –Some ACT Reading and some WorkKeys Reading for Information MME Writing – –Some ACT English and ACT Writing MME Math – –Some ACT Math, some WorkKeys Applied Mathematics, some WorkKeys Locating Information, and Michigan Mathematics MME Science – –Some ACT Science and Michigan Science MME Social Studies – –Some WorkKeys Locating Information and Michigan Social Studies

What else could we use to predict student success on MME? Transcripts of Student Courses Grades of Students in Courses Curriculum Alignment to: –Michigan Curriculum Framework –New High School Course Expectations –ACT College Readiness Standards –Work Keys Skill Sets

So, what can you do for Spring 2009 MME? Use data points on this year’s juniors to: –Identify students who have “assets” for success Previous MEAP Scores –Winter 2005 and Fall 2005 Previous ACT Scores Previous PLAN Scores Previous EXPLORE Scores NWEA results –Identify students who need assistance with the testing formats Persuasive writings using MME rubrics Analyzing data in graphs, charts, and tables Use of released items from MDE Teach strategies for completing MME

What We Already Know About Data Analysis and Change in Instructional Practices Zellmer (1997) –Without specific expectations and professional development, teachers will simply ignore data and continue to use the same instructional practices. Price-Baugh (1997) –Without data regarding alignment to State standards, teachers will not supplement their use of instructional resources to help students meet the standards. Moss-Mitchell (1998) –Student learning increases across socio-economic and gender predictors when coupled with: filling in gaps between tests and instructional materials supervision to monitor curriculum alignment focused professional development public copies of aligned district curriculum the involvement of school principals Source: English and Steffy, (2001), Deep Curriculum Alignment, pp

So, what can you do beyond 2009? Analyze student scores from recent MEAP –Performance levels, scaled scores, strands, constructed responses Analyze the students’ current courses –Academic success? Work Habits? Social Behaviors? Analyze the students’ demographic factors –Attendance, parent involvement, peer group support, special education services Look for patterns…investigate a case study –Gaps in content knowledge, misconceptions on concepts, lack of efficacy in reasoning or writing

This stuff can’t hurt you… Align your curriculum to the High School Course Expectations (HSCEs) –Create local documents, develop common assessments, hold team meetings to study student work Increase the use of formative assessment Educate parents about their role in a standards-based educational system Expect all students to succeed; publicly celebrate their achievements

Questions? Stan Masters Coordinator of Instructional Data Services Lenawee Intermediate School District 2946 Sutton Road Adrian, Michigan (phone) (fax)