Fall 2012 MEAP Online Social Studies Pilot Presented September 27, 2012

Welcome and Introductions Kate Cermak Bureau of Assessment and Accountability Michigan Department of Education Gayle deJong Rachel Hoke Measurement Incorporated

Meeting Objectives By the end of this meeting you should: Know your role and responsibilities Be familiar with the MIST Tester Station Be familiar with the MIST Administrator Website Recognize the importance of Test Security and Integrity Be able to evaluate your school’s preparedness to administer the online test

Pilot Timeline Date Activity August 20 Download and install MIST September 4 Student Practice Test site opens September 26 Test Administrator site opens October 3 Pre ID Rosters available October 17 Test window opens November 7 Test window closes November 9 Test Administrator site closes Note: the online test administration window 10/17 – 11/07 differs from the paper-and pencil test administration window 10/17 – 10/26 Pre ID, adding, removing students occurs in the BAA Secure site—be sure to reference open and close dates of the BAA secure site

Roles and Responsibilities District/Building MEAP Coordinators Before Testing Pre-ID students on BAA Secure Site Unselect students taking paper-and-pencil test versions Work with IT staff to install MIST software Provide professional development on test administration Develop test schedule Pre ID and adding, removing students occurs in the BAA Secure site

Roles and Responsibilities District/Building MEAP Coordinators (cont.) During Testing Support Test Administrator, troubleshoot technical issues Work with IT staff to solve technical issues After Testing Check test roster including demographics Report testing irregularities Verify that student test tickets are destroyed

Roles and Responsibilities MEAP Test Administrators and Proctors Before Testing Prepare testing room and make seating arrangements Administer MIST Student Practice Test Check test roster on MIST Test Administrator Website Prepare for student login process: proctor login or use student test tickets If using student test tickets, print and store in a secure location Test Tickets—One per test part (i.e. two per student for this Pilot); Accesses only the test material in that test part; Only valid until the test part is submitted—recommend collecting Student Test Tickets immediately after student login (you can reissue them if they are needed later in the test session)

Roles and Responsibilities MEAP Test Administrators and Proctors (cont.) During Testing Distribute student test tickets or login students Administer and monitor testing Troubleshoot technical problems Report testing irregularities to Building MEAP Coordinator After Testing Destroy student test tickets Check test roster including demographics

Roles and Responsibilities District /Building IT Staff Before Testing Install MIST software on computers used for testing Ensure MIST software is functioning as expected Troubleshoot and report technical problems During Testing Troubleshoot technical problems After Testing Remove MIST executable from testing computers

Overview of the Online Test Social Studies assessment included in state accountability measures Criterion-referenced test based on Michigan Grade Level Content Expectations Mirrors the paper-and-pencil test; fixed form 6th grade 60 multiple-choice items 9th grade 66 multiple-choice items Please Note: Michigan’s application for ESEA Flexibility was approved by the U.S. Department of Education (USED) in July of 2012. One of the important changes that will take effect this year is the inclusion of all tested subjects into district and school report cards. Please be aware that for the 2012-13 school year, science, social studies and writing will contribute to district and school report cards for participation and proficiency requirements, in addition to reading and mathematics. For MEAP, MME, MI-Access, and MEAP-Access, each tested subject will be held to a 95% participation requirement and Full Academic Year (FAY) student scores will contribute to proficiency calculations for the district and school.

Overview of the Online Test (cont.) Administered in two parts: Part 1 then Part 2 Administered untimed Administered to all students, excluding: Students whose IEP, 504, or ELL Plan specify an accommodated version of MEAP Students whose IEP team determine that the online assessment is not appropriate Home-schooled students who do not have a UIC Students excluded from online test take the appropriate paper-and-pencil versions Note: the online test administration window 10/17 – 11/07 differs from the paper-and pencil test administration window 10/17 – 10/26

MIST Tester Station Demonstrate MIST Tester Station; focus on login and navigation tools Ask: How many have completed practice test? Did the students appear comfortable navigating the test Site? Note difference between practice and online test—login and no highlighter

MIST Test Administrator Website Demonstrate Test Administrator Website Log in with the School-Specific MIST username and password District MEAP coordinators will receive via FedEx by 9/26 Ask: Have you received School-Specific MIST username and password? If not, please contact your building MEAP Coordinator

MIST Administrator Website Navigate the website Set up a MIST Tester Station Check the test roster Prepare for testing Plan for make-up tests Monitor testing Verify post-test follow-up Demonstrate Test Administrator Website—cover content listed above Show resources on website—administration guides, videos, FAQs After 11/7/12, any updates to student records should be made on the BAA secure site rather than via MIST. Any questions?

MIST Administrator Website Print Student Test Tickets Edit student demographics Add research codes Add accommodation or report codes (including student prohibited behavior) Print Test Tickets: Click on the test name in the list of tests. Click on the checkboxes next to the students’ tickets you want to print. Click the ticket button to the upper right. Tickets are generated in a PDF either in a tab or downloaded to your default download location. Send them to a local printer so no one can pick them up. Treat them like test booklets.

MIST Administrator Website Monitor Testing Pause and resume test for approved absences Move student to another computer Emphasize Pause and resume test; be sure to log out; no need to be in system after 3:30 Any Questions? Pause and Resume Method 1: For a student who needs to go to the bathroom or have some other approved absence and will be returning to the same computer without ever losing internet connectivity to the MIST website. Steps are: Click on test name Click on student’s check box Click on Pause When student returns, Click on student’s checkbox Click on Resume Instruct them to click CONTINUE Pause and Resume Method2: For times when a student loses their connection to the MIST website Pause the student’s test Re-establish their Tester Station Resume the student’s test Instruct them to resume testing

MIST Administrator Website Work with Building Coordinator to troubleshoot: Lost internet connectivity, computer malfunction Fire drill, school emergency Latency Mark a test Do Not Score, if necessary: DNS-Partial Test, Completed Emergency Form DNS-Partial Test, Exited Student DNS-Misadministration DNS-Emergency Evacuation (requires Emergency Test) DNS-Other

Test Security Log off of all applications before logging into MIST. Ensure adequate spacing between work stations—use visual barriers if necessary Remove visual materials that provide students with clues or answers to test questions Maintain a quiet test environment Allow students to leave testing room only when absolutely necessary and only one at a time Treat Student Test Tickets and system passwords as secure materials Note: Online testing needs to be taken seriously by staff and students

Test Integrity and Security Contact Building Coordinator and MEAP Call Center for assistance if: Student submits a test part before finished Situation occurs in which student cannot finish online test Building emergency (i.e. fire drill) where test security is not maintained Other incidents that interfere with the testing process Note: include high level pause screen here?

Resources and Tools Fall 2012 Social Studies Online Pilot Website http://www.michigan.gov/MEAP MIST Administrator Website https://mi.misttest.com/ MEAP Call Center Phone number: 877-560-8378 option 2 Email: BAA@Michigan.gov

MIST Evaluate Preparedness to Administer Tests

MIST Installation Checklist Has your school: Selected computers for testing Configured the network Installed the MIST executable Verified installation

Verify MIST Installation Log into the operating system as a student-level user Verify that you can see the MIST.exe icon on the desktop Double-click the icon Verify that the login screen loads If using Windows operating system: Start Internet Explorer (not another browser) Go to https://mi.mistttest.com/practice/ and verify that the test opens up when you click on the link Model this in system

Optimize MIST MIST uses an active internet connection to deliver test content so: Minimize competing internet traffic Disable or do not schedule automatic updates Run MIST software off of wired computers

Questions Thank you