MSA Science Online Testing MAG Conference November 16, 2006

Agenda High-level overview: Next five years 2007 Test Edition Electronic Testing Introduction Hands-on practice using eMS

Terminology eMeasurement (eMS) TestNav Artificial Intelligence (AI) Scoring Training Center vs. Operational Users vs. Students

Facts Several states currently use Pearson’s online testing: 1.Maryland 2.Texas 3.Virginia 4.South Carolina 5.Georgia 6.Utah 7.Minnesota

Five Year Plan – Year 1 Spring 2007 Census Field Test –Online- and Paper-Based Testing in Spring (April 18-May 8) –Standard Setting –Results Reported to Students –Separate AI Scoring Pilot (scoring FT items)

Five Year Plan – Year 2 Spring 2008 Operational Test –Electronic Practice Test –Online and Paper-Based Testing in Spring (April 23-May 13) –Test is operational with embedded FT –Separate AI Scoring Pilot (scoring operational and FT items) –Field testing innovative items

Five Year Plan – Years 3-5 Spring Operational Test –Electronic Practice Test available in October 2008 (released items) –Online and Paper-Based Testing in Spring –Test is operational with embedded FT –Second Scoring using AI Software (operational) - Potentially –Operational innovative items - Potentially

Year 1 Milestones Item Development for Spring 2007 and 2008 – in progress Assemble Test Forms – 11/6-2/1/07 TACM available – 2/27/07. Examiner Manual available – 4/5/07

Year 1 Milestones (cont.) Test Material Delivery – 4/2 – 4/5/06 Test Administration – 4/18-5/8/07 Rangefinding – 5/14-6/1/07 Scoring – 6/18-7/25/07 Standard Setting – 9/12-9/14/07 Reporting – End of October 2007

Benefits Online testing: No test booklets No Pre-ID labels Less paper Less security concerns

Resources for your use Infrastructure Guidelines for Electronic Testing User’s Guide –Electronic Test Delivery 96-Hour Checklist Proctor Caching User’s Guide Enhanced Early Warning System “What If….” questions Toll Free Support Number –Technical Support ( ext 821) All tools posted on the MSA Science web-site for your convenience.

Navigating to Admin Site

Exercise 1 1.Navigate to Maryland eMS Home Page

Creating a Session

Exercise 2 1.Create a session using the username provided 2.Name the session anything you want 3.Put three demo students in your session

Adding a Student

When would you need to manually add a student? –A student transfers to your school right before the beginning of testing window. –A student switched to online testing from paper on the day of testing. –A student can not be found in eMS. –A home school student tests at your school.

Fill out as much information as possible for identification purposes

Exercise 3 1.Manually enter a student 2.Move your new student into your session for testing. 3.Start your session for testing

Student Authorization Tickets

Will open a PDF of all Student Authorization Tickets ready to print

Exercise 4 1.Get Student Authorization Tickets for your section

Session Monitoring

Error Messages

“Cheating” Message Error Message Demo

Seal Codes

Write Seal Code on the board for students. All students will use the same seal code.

Taking a Test

Exercise 5 1.Use the provided Student Authorization Ticket to login to TestNav. 2.Take the test and experience online testing and TestNav.

Questions