1. 1 Michigan Merit Examination - Plans and Prospects Edward Roeber, Mike Radke & Jim Griffiths, MDE Diane Walters & John Nelson, ACT

2. 2 Current MEAP High School Test Spring testing (March-April, 2006) Fall retesting (late October-early November, 2006) English Language Arts (Reading and Writing), Mathematics, Science count for the Merit Award Social Studies also assessed but does not count for the Merit Award

3. 3 Current Program Grade 10 Students take the MEAP High School Assessment to qualify for dual enrollment (assessment in fall or spring) Grade 11 Students take the MEAP High School Assessment to qualify for dual enrollment (in the fall) and the Merit Award All students take the MEAP in the spring (if they have not already passed the MEAP) Grade 12 Students take the MEAP in the fall or spring to qualify for the Merit Award

4. 4 Current Program Merit Award: $2,500 for passing the English language arts tests (reading and writing), mathematics and science at the high school level Merit Award: $500 for passing the same subjects in grade 7 and 8 (each is assessed in each of these two grades) The Merit Award program may change Please contact the Michigan Department of Treasury with ALL Michigan Merit Award questions

5. 5 MME Legislation PA 592 of 2004 - MME inserted into Career and Technical Preparation Act PA 593 of 2004 - Replaces high school MEAP with MME in School Aid Act PA 594 of 2004 - Replaces high school MEAP with MME in Postsecondary Enrollment Options Act PA 595 of 2004 - Replaces high school MEAP with MME for determining Merit Award Scholarships PA 596 of 2004 - Replaces the high school MEAP with MME in the School Code

6. 6 Steps Used to Implement MME Visited potential vendors to share/obtain ideas Competitively bid the MME program Reviewed the bids Selected new contractor(s) - Pearson/ACT Determined the content of each MME test Conducted statistical alignment study (pilot test)

7. 7 Spring 2006 Pilot High Schools

8. 8 Steps Needed to Implement MME Conduct additional content alignment studies needed Set cut scores on MME and MEAP Grade 11, to be used for the Merit Award and NCLB AYP Prepare revisions to the NCLB Accountability Workbook Establish PLAN and PSAT cut scores for dual enrollment purposes

9. 9 Steps Needed to Implement MME Submit application for approval to U.S. Department of Education by July 1, 2006 November 1 is the “drop-dead date” for the MME versus MEAP HST decision for Spring 2007 Receive approval from USED prior to drop-dead date OR continue MEAP High School Assessment (if approval is not received by that date) Implement the MME in grades 11 in the 2006-07 school year; maintain MEAP HST for Grade 12 only

10. 10 MME Assessment Design Grade 10: College entrance readiness test (PLAN and PSAT - local school/student choice) Grades 11 and 12: Michigan Merit Examination English Language Arts - ACT Reading, Writing, and English; WorkKeys Reading for Information; Michigan Social Studies constructed response item Mathematics - ACT Mathematics; items from ACT Science; WorkKeys Applied Mathematics; Michigan items Science - ACT Science; Michigan items Social Studies - Michigan items

11. 11 Michigan Merit Examination Components and Score Contributions Assessments Administered Contributes to an English Language Arts Score Contributes to a Mathematics Score Contributes to a Science Score Contributes to a Social Studies Score ACT Plus Writing WorkKeys Applied Mathematics & Reading for Information, plus Michigan Mathematics Michigan Science and Social Studies Total ELA Score Reading ACT Reading (MC) WorkKeys Reading for Information items (MC) Writing ACT English (MC) ACT Writing (CR) Michigan Social Studies CR item - writing score ACT Mathematics (MC) WorkKeys Applied Mathematics (MC) Selected ACT Science items (MC) Michigan items (Approximately 14 MC) ACT Science (MC) Michigan Science (46 MC) Michigan Social Studies (57 MC and 2 CR - social studies score) Note: The number of Michigan items shown includes field-test items to replace those released annually.

12. 12 MME Assessment Administration (Spring 2007) Grades 11 and 12 - Spring Administration March 13 - ACT Plus Writing March 14 - WorkKeys + Michigan Mathematics March 14-21 - Michigan Science and Social Studies March 27 - Makeup ACT Plus Writing March 28 - Makeup WorkKeys + Michigan Mathematics March 28-April 4 Makeup Michigan Science and Social Studies

13. 13 MME Assessment Administration (Fall 2007) Grade 12 - Fall Administration Saturday, October 27, 2007 (ACT National Test Date) - ACT Plus Writing Tuesday, October 30, 2007 - WorkKeys + Michigan Math October 30 -November 6 - Michigan Science and Social Studies

14. 14 Future Administration Dates SessionComponent200820092010 InitialACT Plus Writing WorkKeys+Math Science & SS 3/11 3/12 3/12-19 3/10 3/11 3/11-18 3/9 3/10 3/10-17 MakeupACT Plus Writing WorkKeys+Math Science & SS 3/25 3/26 3/26-4/2 3/24 3/25 3/25- 4/1 3/23 3/24 3/24-31

15. 15 MME Test Center Establishment Review several key documents (Spring 2006) Standard Testing Requirements School Schedule and Site Options for Administration of the 2007 Michigan Merit Examination Summary of Test Administration Policies Qualifications and Responsibilities for Test Supervisors and Back-up Test Supervisors Qualifications for Test Accommodations Coordinators Consider staffing requirements and decide possible staff to fill these positions Plan for testing rooms/facilities

16. 16 MME Test Center Establishment (Fall 2006) Week of September 4 Test Establishment Packets sent to high school principals September 12MME 2007 Briefing Video Conference September 29Establishment packets due back to ACT - Staff and facilities October 2-13Administrator Training Workshop invitations mailed

17. 17 MME Test Center Establishment (Fall 2006) October 20Administrator Training Workshop reservations due to ACT Week of October 23 Administrator Workshop Training confirmations sent via e-mail November - December Administrator Workshop Training conducted at 12 sites statewide December 1Offsite testing requests due to ACT

18. 18 Assessment Sites Preferred site is in a quiet wing of the high school School in session for all students, or School for juniors only Off-site administration Community College ISD/RESA Other public facility Church Other private facility Each site must be approved by ACT

19. 19 Assessment Facilities Choice of testing rooms for standard time administration Uncrowded seating – prefer classrooms with 25-30 examinees Manageable security – prefer no more than 100 examinees in one room (if more than 100, see personnel requirements) Good lighting, comfortable temperature, quiet atmosphere Adequate writing surfaces No lapboards permitted; temporary surfaces resting on chair arms or back of chair in front must be reviewed and approved by ACT Must accommodate both test booklet and answer document

20. 20 Assessment Facilities Seating arrangements (Applies Equally to Desks and Tables) Seats must be assigned by testing staff as students enter room Minimum of 3 feet apart side-to-side (measured shoulder- to-shoulder) Minimum of 3 feet apart front-to-back (measured head-to- head) All students must face the same direction, directly behind one another

21. 21 Assessment Facilities Freedom from distractions No one not involved in testing may be in the room Uninterrupted testing period required for all days of testing No unnecessary noises (bells, public address systems, etc. must be turned off) Testing rooms must be separated from regular school activities

22. 22 Assessment Personnel Required number of qualified assistants per room 1 room supervisor required for each room, Plus 1 proctor for every 25 examinees in the room after the first 25 (i.e., 26-50=1; 51-75=2; 76-100=3) Testing staff may not be Involved in test preparation outside of normal teaching responsibilities Enrolled in high school

23. 23 Avoiding Conflicts of Interest Test (and Back-up) Test Supervisors have access to secure test materials prior to testing. To avoid the appearance of a conflict of interest, and to protect relatives (siblings, children, step- children, grandchildren, nieces, nephews) and wards from allegations of impropriety: Test (and Backup) Supervisors may not be related to any examinee taking the ACT/WorkKeys in 2006-2007 anywhere in Michigan. Room supervisors and proctors may not assist in a room where any relative is being tested

24. 24 Adequate Training for all Staff ALL Test Supervisors (TS), Back-up Test Supervisors (Back-up TS), and Test Accommodations Coordinators (TAC) are REQUIRED to attend training in November- December, 2006. Testing staff must have read and be familiar with both the Day 1 and Day 2 supervisor’s manuals (included with training materials)

25. 25 Adequate Training for all Staff A local training session for all staff is required before testing (conducted by the Test Supervisor at each school) Each room supervisor must have a complete copy of that day's supervisor’s manual in the test room

26. 26 Attentiveness During testing, the testing staff must: Focus on monitoring testing (reading, grading papers, other personal work is not permitted) Circulate frequently around the room to monitor examinees Recognize the potential for cheating and take action as instructed in supervisor’s manuals Exact compliance with supervisor’s manuals is required…including reading spoken instructions verbatim

27. 27 Assessment Administration All test sites must test on the designated days The testing activity should be the first activity of the day for students Assessment administration staff will need to review procedures 30 minutes prior to the start of testing. No food or drink are permitted in testing room(s) – this applies to both staff and examinees.

28. 28 Security Receipt, check-in, and verification of test booklets are by serial numbers Restricted access at all times from moment of receipt to return (documented “chain of custody”) Answer documents not returned to students after test responses are gridded All test sites must test on the designated test days with testing as the first activity of the morning. Immediate and complete return of all Day 1 materials to ACT and all Day 2 materials to Pearson

29. 29 Security Proper identification of examinees by room supervisor (personal recognition or photo ID) Direct consultation with ACT to handle testing irregularities Unannounced observation of assessment administration in selected schools

30. 30 Exact Timing of the Tests More than one timepiece must be used in each room to ensure back-up Time remaining may not be posted Five-minute warning must be read verbatim from the supervisor’s manuals

31. 31 Documentation of Test Day Procedures State Testing Staff List returned with answer documents Seating Diagram, Test Book Count Form, and Testing Time Verification Form returned for each room Supervisor’s Report Form (Day 1) and School ID Sheet (Day 2) completed accurately Testing Irregularity Report Form(s) returned with answer documents

32. 32 MME Year-by-Year Implementation 2005-2006 Fall - MEAP HST (grades 10, 11, 12) Spring - MEAP HST plus statistical pilot linking ACT to the MEAP HST (grade 11 only) 2006-2007 (Assuming Federal Approval) Grade 10 - use PLAN or PSAT for dual enrollment Local district selects test; state sets qualification score(s) Student or school district pays the testing cost (no state reimbursement) Grade 11 - Offer MME in the Spring for Merit Award Grade 12 - Offer MEAP HST to complete Merit Award (one year only) OR MME

33. 33 MME Year-by-Year Implementation 2007-08 (No More MEAP) Grade 10 - use PLAN or PSAT for dual enrollment Local district selects test; state sets qualification score(s) Student or school district pays the testing cost (no state reimbursement) Grade 11 - Offer MME in the Spring for Merit Award Grade 12 - Offer MME in the Fall and Spring Students get one free (state-paid) re-take

34. 34 Key 2006-07 MME Dates March 6, 2006 - Video conference on MME assessment accommodations (DVD/videotape available from Wayne RESA; videostreamed as well: http://www.mistreamnet.com, click on 'Archived Stream.’) April 27, 2006 - V ideo conference on 2006-2007 MME plans (DVD/videotape available from Wayne RESA; videostreamed as well: http://www.mistreamnet.com, click on 'Archived Stream.’) May - June 2006 - Analyze pilot school information; prepare application to USED to change to MME July 2006 - Submit application to USED July-August, 2006 - Select Michigan items

35. 35 Key 2006-07 MME Dates September 12, 2006 - Statewide video conference on 2007 MME September-October 2006 - ACT establishes schools as test centers September-October 2006 – Home school students notify district high school of intent to test November 1, 2006 - Drop-dead date for USED approval to implement the MME; use MEAP HST if approval not received November-December 2006 - Mandatory training for Test Supervisors, Backup Test Supervisors, and Test Accommodations Coordinators

36. 36 Key 2006-07 MME Dates December 1, 2006 - ACT-approved accommodations requests due to ACT for Day 1 Testing (ACT Plus Writing)* January 10, 2007 - State-allowed accommodations requests due to ACT for Day 1 Testing (ACT Plus Writing)* For Day 2 (WorkKeys + Michigan Mathematics) & Day 2-7 (Michigan Science and Social Studies), tests accommodations should be similar to those approved for Day 1 Accommodations decisions for Day 2 and Day 2-7 are the local school district responsibility *Dates also apply to home school and non-public school students

37. 37 Key 2006-07 MME Dates January 10, 2007 (Estimated) - Materials orders for ALL students are due for Day 2 (WorkKeys + Michigan Mathematics) & Day 2-7 (Michigan Science and Social Studies tests) Submitted via Pearson School House for all students November 2006-January 2007 (Estimated) - Non-public school students using test centers registered for the MME February 2007 - Accommodations determined and materials ordered February-March 2007 - Test Supervisors train test administrators and proctors

38. 38 Key 2006-07 MME Dates MME Testing Day 1 - ACT Plus Writing (March 13, 2007) Day 2 - + Michigan Math (March 14, 2007) Day 2-7 - Michigan Science and Social Studies (March 14-21, 2007) Special Testing Windows (March 13-28, 2007)

39. 39 Key 2006-07 MME Dates MME Makeup Testing Day 1 - ACT Plus Writing (March 27, 2007) Day 2 - WorkKeys + Michigan Math (March 28, 2007) Day 2-7 - Michigan Science and Social Studies (March 28-April 4, 2007) Special Testing Windows (March 27-April 11, 2007)

40. 40 Key 2006-07 MME Dates May-July, 2007 Students receive their reports Regular ACT reports (college-reportable) WorkKeys reports MME score reports Schools receive ACT, WorkKeys, and MME score reports MME scores used for EducationYES! accreditation and NCLB AYP accountability purposes

41. 41 Key 2006-07 MME Dates August-September - Students register for MME October Retake via ACT (using a voucher available at their school) MME Fall Retake Day 1 - ACT Plus Writing (Saturday, October 27, 2007) Day 2 - WorkKeys+Michigan Math (Tuesday, October 30, 2007) Days 2-7 - Michigan Science and Social Studies (Tuesday, October 30-Wednesday, November 6, 2007) Special Testing (October 27-November 13, 2007)

42. 42 How do Students benefit from taking the ACT? The ACT is universally accepted for college admission. The ACT is curriculum-based. The ACT is more than a test.

43. 43 How do Schools benefit from taking the ACT? Evaluate student readiness Evaluate/inform instructional programs Document Progress and Success with the EPAS ® system Effectively advise & guide students

44. 44...a foundational skills development system, best known for translating a vague statement like "we need more math" into a precise set of teachable skills really used in a career. Educators - tailor development plans and certify career readiness Employers - determine hiring qualifications and training needs Economic and workforce developers - match employers and communities

45. 45 Job Profiles Sept 00 - Aug 05 4,136 6%6% 17 % 32 % 43 % 1%1% All Examinees Sept 04 - Aug 05 379,546 17 % 9%9% 7%7% 25 % 24 % Applied Mathematics 6 3 5 4 7

46. 46 Getting Started Now Consider how and where the MME will be administered Make sure IEP teams are considering accommodations needed for both high school assessments MEAP HST MME Think about who will manage the MME Test Supervisor and Back-up Test Supervisor Test Accommodations Coordinator Review information posted on www.michigan.gov/mme website www.michigan.gov/mme

47. 47 Helping Students Prepare for MME Assure that the high school’s curriculum is aligned to state standards and benchmarks, the new high school content expectations, and ACT-assessed standards Assure that course content matches course titles Encourage students to enroll in rigorous college preparatory classes (or equivalent ones that address the same content with the similar rigor)

48. 48 Helping Students Prepare for MME Have students participate in reasonable ACT prep activities Use ACT or commercial products to practice taking a timed test Become comfortable with the test formats Focus on learning the skills defined in the standards and benchmarks rather than just practicing test-taking skills

49. 49 Getting Started Now Review past ACT high school assessment reports What percent of students take the ACT? What percent of students take recommended college core courses? What is the performance of students taking college core versus those who did not? What are the trends over time? What are the implications of ACT results? For counselors - better course-taking advice? For academic departments - improved rigor of courses? For districts - More rigorous graduations requirements?

50. 50 Challenges Assuring adequate assessment administration preparation - for very secure tests (ACT) Participation of students with disabilities What accommodations will be needed? See MME website – “Spring 2007 Michigan Merit Exam (MME) Accommodations Summary Table.” Will MI-Access be used by some students? Participation of English language learners What accommodations will be offered and under what conditions? See MME website – “Spring 2007 Michigan Merit Exam (MME) Accommodations Summary Table.”

51. 51 For Questions and Comments Edward Roeber (517) 373-0739 voice Roebere@michigan.gov Mike Radke (517) 241-0206 voice Radkem@michigan.gov Jim Griffiths (517) 373-4332 voice Griffithsj@michigan.gov Michigan Department of Education Office of Educational Assessment & Accountability P.O. Box 30008 Lansing, MI 48909

52. 52 For More Information For more information on MME www.michigan.gov/mme For MDE assessment questions (877) 560-TEST (8378) For ACT- or WorkKeys-specific questions mi.mme@act.org For Pearson Educational Measurement (800) 204-4109

53. 53 Thank you! Video conference sites around Michigan Wayne RESA TCOM Consortium, Mistreamnet and the Sustained Learning Regions Sam LoPresto Presenters and staff And You!

54. 54 VHS Copies: $10.00 + $4.00 S & H DVD Copies: $15.00 + $4.00 S & H Contact: Brenda Hose, 734-334-1437 hoseb@resa.net hoseb@resa.net Rebroadcast archived at http://www.mistreamnet.com http://www.mistreamnet.com Powerpoint and attachments available on MEAP website: www.michigan.gov/meap