Training Workshop September 12, 2006 Michigan Merit Examination (MME)

2 Welcome and Introductions

3 Edward Roeber Office of Educational Assessment & Accountability Pat King Office of Educational Assessment & Accountability Brian StraussPearson Educational Measurement Craig WalkerACT

4 Introducing the Michigan Merit Exam (MME)

5 MEAP or MME? Use of the MME has not been approved yet MDE has applied for permission to use MME USED Peer Review is now under way Deadline for approval is November 1 Proceeding on the assumption that MME will occur in Spring 2007 Will notify schools later if MME will NOT occur this spring

6 Fall MEAP High School Test Fall MEAP retesting (late October-early November, 2006) for high school seniors ONLY English Language Arts (Reading and Writing), Mathematics, and Science for the Merit Award Social Studies also assessed but does not count for the Merit Award NO MEAP assessment for sophomores or juniors Dual enrollment candidates need to take the PLAN or PSAT to seek dual enrollment

High School Assessment (Assuming Federal Approval) Tenth Graders - PLAN or PSAT for dual enrollment Local district selects test; state sets qualification score(s) Student or school district pays the testing cost (no state reimbursement) Eleventh Graders MME in the Spring only Twelfth Graders MEAP HST to complete Merit Award (Fall and/or Spring)

8 MME Assessment Design English Language Arts ACT Reading, Writing, and English WorkKeys Reading for Information test Michigan Social Studies constructed response item Mathematics ACT Mathematics Selected ACT Science items WorkKeys Applied Mathematics test Michigan items Science ACT Science Michigan items Social Studies All Michigan items

9 Michigan Merit Examination Components and Score Contributions Assessments Administered Contributes to an English Language Arts Score Contributes to a Mathematics Score Contributes to a Science Score Contributes to a Social Studies Score ACT Plus Writing WorkKeys Applied Mathematics & Reading for Information, plus Michigan Mathematics Michigan Science and Social Studies Total ELA Score Reading ACT Reading (MC) WorkKeys Reading for Information items (MC) Writing ACT English (MC) ACT Writing (CR) Michigan Social Studies CR item - writing score ACT Mathematics (MC) WorkKeys Applied Mathematics (MC) Selected ACT Science items (MC) Michigan items (Approximately 13 MC) ACT Science (MC) Michigan Science (53 MC) Michigan Social Studies (57 MC and 2 CR - social studies score) Note: The number of Michigan items shown includes field-test items to replace those released annually.

10 Today’s Agenda

11 Today’s Agenda How to conduct a successful test administration Review of the MME schedule and critical dates Review of the test site establishment process Review of testing requirements (facilities & staffing) Training workshops – what to expect, who must attend Students testing with accommodations Home school students

12 Today’s Agenda - continued Non-public school students Enrollment & materials orders Helping students prepare for the MME Sources of Information Questions and Answers

13 How to Conduct a Successful Test Administration Become familiar with MME procedures and calendar Assign responsibilities Manage the test day schedule Read all training materials and supervisor manuals DON’T Wait until it’s too late DON’T miss DUE DATES Ask Questions – Don’t assume STATE TESTING is NOT ACT National Testing or MEAP

14 Review of the MME Schedule and Critical Dates

15 MME Assessment Administration Initial Testing (Spring 2007) March 13: ACT Plus Writing March 14: WorkKeys + Michigan Mathematics March 14, 15, or 16: Michigan Science and Social Studies Makeup Testing (Spring 2007) March 27: ACT Plus Writing March 28: WorkKeys + Michigan Mathematics March 28, 29, or 30: Michigan Science and Social Studies Accommodations Testing Windows (Spring 2007) Day 1 - March 13 – March 27 Day 2 - March 14 – March 28 Day 2, 3, or 4 - March 14 – March 30 Reminder: Only for high school juniors

16 MME Assessment Administration Grade 12 - Retest Administration (Fall 2007) Saturday, October 27, 2007 (ACT National Test Date) ACT Plus Writing Tuesday, October 30, WorkKeys + Michigan Math October 30, 31, or November 1 - Michigan Science and Social Studies Accommodations Testing Windows (Fall 2007) ACT Plus WritingOct 27 – Nov 10 WorkKeys + Michigan MathOct 30 – Nov 13 Michigan Science and SSOct 30 – Nov 15

17 Future Administration Dates SessionComponent InitialACT Plus Writing WorkKeys+Math Science & SS 3/11 3/12 3/ /10 3/11 3/ /9 3/10 3/10-12 MakeupACT Plus Writing WorkKeys+Math Science & SS 3/25 3/26 3/ /24 3/25 3/ /23 3/24 3/24-26

18 Major Fall (2006) MME Activities Establish Michigan high schools as test sites Identify key staff Test Supervisor Back-up Test Supervisor Test Accommodations Coordinator Apply for testing accommodations Train key staff Test Supervisor Back-up Test Supervisor Test Accommodations Coordinator

19 MME Fall (2006) Schedule Week of August 28 Test Site Establishment Packets sent to high school principals September 12MME 2007 Video Conference September 29Test Site Establishment Packets due back to ACT - Staff and facilities October 2-13Required Administrator Training Workshop invitations mailed

20 MME Fall (2006)Schedule October 18Accommodations Training – Video Conference (for TACs) October 20Administrator Training Workshop reservations due to ACT Beginning Week of October 23 Administrator Workshop Training confirmations sent via November - December Testing Staff Workshop Training conducted at 12 sites statewide

21 MME ( )Schedule November 17Day 2 and Day 2,3,or 4 materials orders due December 1Off-site testing requests due to ACT December 1Receipt deadline for applying for ACT-approved accommodations January 10Receipt deadline for applying for state-approved accommodations

22 Review of the Test Site Establishment Process

23 MME Test Center Establishment Establishment Packets sent to high schools just before Labor Day Sent to HS principals Courtesy copy sent to ISD & District Assessment Coordinators Principals – select your school’s Test Supervisor, Back-up Test Supervisor, and Test Accommodations Coordinator. Then complete the MME Appointment of Testing Staff & School Information form. Deadline for return of Principal’s materials September 29

24 MME Test Center Establishment Review key documents Standard Testing Requirements School Schedule and Site Options for Administration of the 2007 Michigan Merit Examination Summary of Test Administration Policies Qualifications and Responsibilities for Test Supervisors and Back-up Test Supervisors Qualifications for Test Accommodations Coordinators

25 MME Test Center Establishment Documents to be returned by September 29, 2006: Principals – MME Appointment of Testing Staff & School Information form. Test Supervisors - ACT State Testing 2007 Test Supervisor and Facilities Profile Back-up Test Supervisors - ACT State Testing 2007 Back-up Test Supervisor Profile Test Accommodations Coordinators - Michigan (MME) ACT State Testing 2007 Test Accommodations Coordinator Profile

26 Review of Testing Requirements – Facilities and Staffing

27 Assessment Sites Preferred site is in a quiet wing of the high school School in session for all students, or School for juniors only Off-site administration Community College ISD/RESA Other public facility Other private facility Each site must be approved by ACT

28 Assessment Facilities Choice of testing rooms for standard time administration Uncrowded seating – prefer classrooms with examinees Manageable security – prefer no more than 100 examinees in one room Good lighting, comfortable temperature, quiet atmosphere Adequate writing surfaces No lapboards permitted; temporary surfaces resting on chair arms or back of chair in front must be reviewed and approved by ACT Must accommodate both test booklet and answer document

29 Assessment Facilities Seating arrangements (Applies Equally to Desks and Tables) Seats must be assigned by testing staff as students enter room Minimum of 3 feet apart side-to-side (measured shoulder- to-shoulder) Minimum of 3 feet apart front-to-back (measured head-to- head) All students must face the same direction, directly behind one another

30 Assessment Facilities Freedom from distractions No one not involved in testing may be in the room Uninterrupted testing period required for all days of testing No unnecessary noises (bells, public address systems, etc. must be turned off) Testing rooms must be separated from regular school activities

31 Required MME Personnel Test Supervisor Responsible for all MME assessment activities Responsible for all testing materials Back-up Test Supervisor Responsible to serve if Test Supervisor unable to do so Will assist the Test Supervisor Test Accommodations Coordinator Assures that each student requiring accommodations applies for them - ACT-approved or state-allowed Coordinates all Accommodations Testing for your school These personnel needed in each high school Named by September 29

32 Avoiding Conflicts of Interest Test (and Back-up) Test Supervisors have access to secure test materials prior to testing. To avoid the appearance of a conflict of interest, and to protect relatives (siblings, children, step- children, grandchildren, nieces, nephews) and wards from allegations of impropriety: Test (and Backup) Supervisors may not be related to any examinee taking the ACT/WorkKeys in anywhere in Michigan. Room supervisors and proctors may not assist in a room where any relative is being tested

33 Avoiding Conflicts of Interest TACs – May not be related to or guardian of any examinee participating in MME accommodations testing anywhere in Michigan this year. (see list of relatives / guardians on prior slide) Testing staff supporting accommodations – May not be involved in coaching high school athletics or college athletics (applicable only if student testing with accommodations participates in athletics)

34 Other Assessment Personnel Required number of qualified assistants per room 1 room supervisor required for each room, Plus 1 proctor for every 25 examinees in the room after the first 25 (i.e., 26-50=1; 51-75=2; =3) Testing staff may not be Involved in test preparation for commercial gain outside of normal teaching responsibilities Enrolled in high school

35 Other Test Administration Requirements

36 Assessment Administration Test Supervisors and TACs are responsible for training the staff that will assist them during the testing (e.g., room supervisor, proctors, readers) Assessment administration staff will need to review procedures at least 30 minutes prior to the start of testing. Students assigned seating

37 Assessment Administration No food or drink are permitted in testing room(s) – this applies to both staff and examinees. Schedule adjustments will be necessary for students with different schedules (e.g., night classes) All test sites must test on the designated test days with testing as the first activity of the morning, starting no later than 9 am.

38 Security Receipt, check-in, and verification of test booklets by serial numbers Restricted access at all times from moment of receipt to return (documented “chain of custody”) Answer documents not returned to students after test responses are gridded Immediate and complete return of all Day 1 materials to ACT and all Day 2 (2, 3, or 4) materials to Pearson Educational Measurement as outlined in “return of materials” procedures

39 Security Identification of examinees at check in (personal recognition or photo ID) Direct consultation with ACT to handle testing irregularities for Day 1 Direct consultation with Pearson Educational Measurement to handle testing irregularities for Day 2 & Day 2,3, or 4 Unannounced observation of assessment administration in selected schools

40 Exact Timing of the Tests More than one timepiece must be used in each room to ensure back-up Time remaining may not be posted All timing instructions must be read verbatim from the supervisor’s manuals

41 Documentation of Test Day Procedures Testing Staff List returned with answer documents Roster, Seating Diagram, Test Book Count Form, and Testing Time Verification Form returned for each room Testing Irregularity Report Form(s) returned with answer documents Scanable - Supervisor’s Report Form (Day 1) and School ID Sheet (Day 2 & Day 2,3,or 4) completed accurately

42 Training Workshops

43 Training Workshops – what to expect, who must attend Half – Day Training Sessions Workshop materials available at each session ONLY for “Named” Test Staff -- ALL Test Supervisors, Back-up Test Supervisors, and Test Accommodations Coordinators are Required to Attend. Ideally, testing staff from each school will attend the same workshop session.

44 Training Workshops – what to expect, who must attend What will be covered: Testing Requirements – before, during, and after testing Procedures for Day 1, Day 2, and Days 2, 3, or 4 Ordering materials Returning materials Avoiding the Pitfalls Testing with Accommodations In-school training – room supervisors and proctors Question and Answers

45 Training Workshops – what to expect, who must attend Arrive Early – All Attendees must sign-in THIS TRAINING IS ONLY FOR TS, Backup TS, Test Accommodations Coordinators, and District Coordinators. A portion of the training will be via video – you will have the opportunity to take a copy of the video with you following your training. If your school staff has not been trained – YOUR School will NOT be allowed to participate in MME.

46 Training Dates and Locations Training will be conducted: November Nov 7 – Marquette Nov 7 – Alpena Nov 8 – Escanaba Nov 8 – Mt Pleasant Nov 9 – Traverse City Nov 13 – Kent County Nov 13 – Oakland County Nov 14 – Kalamazoo Nov 14 – Macomb County

47 Training Dates and Locations December 2006: Dec 6 – Wayne County Dec 14 – Lansing

48 Following the Training Testing staff must read and be familiar with both the Day 1 and Days 2 (2-4) supervisor’s manuals (included with training materials) The Test Supervisor must organize an in-school (before test day) completion of all Day 1 pre-test information sections of the ACT Plus Writing and ensure ID labels are correctly affixed to each Day 1 answer folder.

49 Following the Training The Test Supervisor must organize a separate in-school (before test day) completion of Day 2 and Day 2, 3, or 4 Answer Folder demographic information and ensure ID labels are correctly affixed to each Day 2 and Day 2,3,or 4 answer folder. A local training session for all staff is required before testing (conducted by the Test Supervisor at each school) A separate training session is required for all staff who will be supporting students testing with accommodations (conducted by the TAC at each school). Plan ahead!

50 Students testing with accommodations

51 Students testing with accommodations For the MME two types of Accommodations will be available: ACT Approved Accommodations State – Allowed Accommodations

52 Training for TACs October 18, 2006 – MME Accommodations Training Workshop Training video conference from Wayne RESA 2:30 – 4:00 PM Information about the session will be available shortly Especially for Test Accommodations Coordinators (TAC) Does not replace the required workshops in Nov & Dec Principals – ensure your TACs attend this training

53 Before the October 18 th TAC Training Review materials on the MME website – MME Accommodations Summary Table, Spring 2007 Procedures for Requesting ACT Test Accommodations for Day 1 of the Michigan Merit Examination (MME) – March 2007 March 2007 Michigan Merit Examination (MME) Day 1 – Request for ACT-Approved Test Accommodations Application for State Allowed – Accommodations – March 2007 Michigan Merit Examination (MME) – Day 1 Test Accommodations Coordinator Header (for 2007 ACT State Testing)

54 Home School and Non-Public School Students

55 Home School Students Home School students wishing to participate in the MME will test at their local public high school The home school community has been notified of this opportunity Local Public Schools – will need to work with local home school students wishing to take the MME

56 Non-Public School Students Non-Public Schools may participate in MME Participation Model #1 – fully participate in all facets of MME to support your students and establish your school as an MME test site Participation Model #2 – allow your students who are interested in taking the MME to test at one of 8 auxiliary test sites throughout the state on the designated weekday test dates. If any of your interested students require accommodations, agree to submit the necessary documentation and administer the accommodated testing in your school on the designated testing dates. Complete the appropriate test site establishment and testing staff forms and return to ACT by Sept 29

57 Enrollment and Materials Ordering

58 On Line Enrollment Log into the state site: New users will need to obtain a user ID and password from their school district administrator of the OEAA secure site. OEAA Secure Site user manual is located on OEAA-login screen. Provides step by step instruction on how to maneuver through the site. with any questions or concerns with the OEAA site.

59 Select Additional Orders & Shipment Tracking

60 Select Appropriate Tab

61 Select Profile Tab

62 Profile Tab Verify that the MME Test Supervisor, Back up Test Supervisor and Test Accommodation Coordinator information is accurate. Changes can NOT be made to this screen. Contact ACT if updates are needed.

63 Enrollment Tab Select MME Test Cycle

64 Enrollment Tab The Enrollment Screen has links: Detail Instructions Enrollment Supplemental Enrollment Please read detailed instructions then select the enrollment link.

65 Select Enrollment Link

66 Enrollment Link Test Supervisor will need to update the enrollment screen. Enrollment window Nov 1 -17, Validate the number of students taking assessment. Update if necessary. Enter the number and type of accommodation materials needed per subject for WorkKeys and Michigan components.

67 Select Supplemental Enrollment Link

68 Supplemental Enrollment Link Provide Spring Break dates for your school. Identify your school’s hours of operation for materials delivery and pickup.

69 Next Steps Obtain a user ID and password for the OEAA secure site if you don’t currently have one. Validate the MME Test Supervisor, Back Up Test Supervisor and Test Accommodations Coordinator information is accurate Enrollment window of November 1-17 Verify student enrollment Order accommodation materials

70 Helping Students Prepare for the MME

71 Helping Students Prepare for MME Assure that the high school’s curriculum is aligned to state standards and benchmarks, the new high school content expectations, and ACT-assessed standards Assure that course content matches course titles Encourage students to enroll in rigorous college preparatory classes (or equivalent ones that address the same content with the similar rigor)

72 Helping Students Prepare for MME Have students participate in reasonable ACT prep activities Use ACT or commercial products to practice taking a timed test Become comfortable with the test formats Focus on learning the skills defined in the standards and benchmarks rather than just practicing test-taking skills

73 Getting Started Now Review past ACT high school reports What percent of students take the ACT? What percent of students take recommended college core courses? What is the performance of students taking college core versus those who did not? What are the trends over time? What are the implications of ACT results? For counselors - better course-taking advice? For academic departments - improved rigor of courses? For districts - More rigorous graduations requirements?

74 Sources of Information

75 Key Resources March 6, Video conference on MME assessment accommodations (DVD/videotape available from Wayne RESA; videostreamed as well: click on 'Archived Stream.’ April 27, V ideo conference on MME plans (DVD/videotape available from Wayne RESA; videostreamed as well: click on 'Archived Stream.’ - website has considerable resources; check it periodically

76 For Questions and Comments Edward Roeber (517) voice Pat King (517) voice Michigan Department of Education Office of Educational Assessment & Accountability P.O. Box Lansing, MI

77 For Questions and Comments Regarding Accommodations Peggy Dutcher (for questions regarding accommodations for student with disabilities) (517) voice Marilyn Roberts (for questions regarding accommodations for English Language Learners (ELL)) (517) voice

78 For More Information For more information on MME For MDE assessment questions (877) 560-TEST (8378) For ACT specific questions ACT State Testing (800) x 2800 ACT State Testing Accommodations (800) x 1788 For Pearson Educational Measurement (800)

79 Questions and Answers