Spring 2011 Administration of the Measurements of Student Progress (MSP) Grades 3 – 8 School Assessment Coordinator (SAC) Training April 14, 2011

Purpose of this training To provide you what you need to know to lead the administration of MSP in your building in May Why this is important Validity Estimated Volume of State Testing in Shoreline, May 2011

Organization of this training Before testing The SAC notebook Policies and procedures Participation Accommodations for Students with IEPS (Holly) Accommodations for ELLs (Ellen) Receiving materials / preparing environment During testing Proctoring Handling irregularities Following testing Preparing test booklets for shipment

The SAC Notebook

Glossary of Terms MSP Measurements of Student Progress DAC District Assessment Coordinator SAC School Assessment Coordinator SSS Statistical Sample School ACM Assessment Coordinators Manual DFA Directions for Administration

Testing materials delivered to buildings TESTING WINDOW Booklet processing & packaging SPRING BREAK Testing materials delivered to buildings MSP Ships Party! MSP Testing Calendar of Events

Whom to contact District Assessment Coordinator Jack Monpas-Huber, x4774 Assistant to the District Assessment Coordinator Mary Crandell, x4771 OSPI

Responsibilities of the DAC Before testing Order testing materials Approve building plans Coordinate with and provide training for SACs Confirm security protocols During testing Available to SACs for questions, concerns, problem- solving Ensure security protocols are followed Document an irregularities and report to OSPI as indicated Following testing Inventory and ship test materials to OSPI Complete District Security Reports and submit to OSPI

Responsibilities of the Principal Before testing Attend required training for principals related to testing Ensure that proctors attend their required training Read and comply with OSPI instructions Include information about testing practices and assessment security in the school staff handbook Appoint a school assessment coordinator (SAC) Store testing materials a secure, locked area During testing Implement adequate student supervision and staffing levels to ensure a secure testing environment in all test sessions, including testing of students with behavior or discipline problems Monitor testing process and test security during the testing window Implement the district’s policies and procedures Ensure school personnel know the content of state and local testing policies Assign trained test proctors, scribes and persons needing to assist with sign language/Braille/large print for each test Report all testing irregularities Following testing Complete a School/Site Administration and Security Report

Responsibilities of the SAC Before testing Communicate with parents, staff and students Receive test materials Ensure proper testing environment Provide Proctor training Ensure security protocols are in place During testing Monitor proper test administration Available to staff for questions/concerns/problems Ensure security protocols are followed Report and document any irregularities to the DAC Following testing Inventory and return test materials Complete Security Reports and documentation

Communicating with Families School staff should communicate information to students and parents about the administration of the MSP tests and how the results will be used Communication should describe: –The purpose of the tests –When the tests will be administered –What the tests will be like –How the results will be used –How student, school and district results will be reported –The use of accommodations for individual students Many handouts and publications are available on state testing and graduation requirements at

Participation of English Language Learners: New Non-English Proficient (NNEP) Students NNEP Students First enrolled in a U.S. public school within the past 12 calendar months NOT required to take the Reading and Writing assessments ARE required (by NCLB) to take the Mathematics and Science assessments Test scores (including math) not counted in any way (i.e., AYP results). If don’t take math, will be counted as non- participants. NCLB requires 95% participation Indicate NNEP students on your Pre-ID Roster and Bubble “Y” in Box 10 of the Demographic Page of test booklet

Accommodations for Special Education Students Presentation Response Setting Timing and Scheduling

Accommodations for English Language Learners Presentation Response Setting Timing and Scheduling

Preparation for testing Come to the SAC training Review the SAC notebook, including the ACM and DFA Train building proctors –Model PowerPoint training available –Familiarize your team with the tools and accommodations allowed Testing time needed: –Allow an additional 15–20 minutes for proctor activities

Test Security State Laws Governing Security All test content is confidential and secure. No part of any test booklet or accommodated CDs may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording or placement in any information storage and retrieval system. Ensuring Test Security 1.Tests must be maintained in a secure manner (locked, limited-access) and not revealed to students or teachers prior to testing. 2.Distribution and collection process: chain of custody must be maintained, including the collection of scratch paper or glossaries. 3.Students must not be given inappropriate assistance during the time they are taking the test (e.g., visual, tactile or audible clues that lead the students to the correct answer, materials on the walls or blackboards that assist students in finding correct answers, or explanations that lead the student to the correct answers). 4.Test must be maintained in a secure manner before and after administration because items are reused over time.

When do we get our tests? Tests will be delivered to schools on April 25–26 1.Find a nice, quiet, locked place to process and keep your tests. A room with long tables will let you spread out items for processing. 2.Tests must be maintained in a secure manner (locked, limited-access) and not revealed to students or teachers prior to testing. 3.Distribution and collection process: chain of custody must be maintained, including the collection of scratch paper or glossaries. Take a look at what you’ve received You’re the best judge of if you have what you need. 1.Look early, and let the DAC know if you need any additional items. 2.Inventory what you’ve received to make sure you have a test for each student. This will give you time to process new booklets if needed. What else will be included? 1.Tools & manipulatives will be included with your tests. Here’s what can be used: Grades 3–6: manipulatives and tools may be used; calculators may not be used Grades 7–8: manipulatives and tools, including calculators may be used 2.Tools & manipulatives will be provided for each student in grades 3–6. Please contact the DAC if you need to check out calculators.

Organization of this training Before testing The SAC notebook Policies and procedures Participation Accommodations for Students with IEPS (Holly) Accommodations for ELLs (Ellen) Receiving materials / preparing environment During testing Proctoring Handling irregularities Following testing Preparing test booklets for shipment

Responsibilities of the test proctors, scribes, and persons assisting with Sign Language/Braille/Large Print Attend all required training sessions and read all assigned materials Provide a positive test taking environment Administer assessments according to Directions for Administration (DFA) and any supplemental materials Ensure that assessment documents are given only to the student identified in the coding Maintain confidentiality concerning secure assessment content Document and report immediately any testing irregularities/breach in test security to SAC/DAC Complete a Test Security Assurance Form

Essential proctor training New or changed procedures Receiving and handling test booklets, alternative assessments, accommodated forms Maintaining test security before, during, after administration Handling and coding blank booklets for students who do not have Pre-IDed booklets Arranging for appropriate accommodations as necessary Administering the assessments Reporting a perceived error on a test Preparing all booklets for return Documenting student absences and accommodations used Document test irregularities for SAC review

Moving In and Moving Out What happens if a student moves during the testing window? A pre-identified student booklet may follow a student to any other school in the district. –If a Pre-ID test booklet from another district is used, the testing district must apply a School/Site Label over the Pre-ID student information on the front cover of the student test booklet. Boxes 1–5 (MSP/HSPE/WAAS-DAPE) and Boxes 1–6 (EOC) on the back cover (demographic page) of the student test booklet must be completed. –In the absence of receiving a Pre-ID booklet from the previous school/district, a blank overage test booklet should be used. –Contact the DAC with specific questions. Students Who Enter or Withdraw During the Testing Window In grades 3–8, districts/schools are encouraged to administer the MSP to all “partially enrolled” students per professional judgment. –Testing the first day a student arrives in a district would not generally be recommended. Districts/schools may be able to administer just reading and/or mathematics to a late-enrolling student. –Score reports from these tests could help inform educational decision making.

Absenteeism What happens if a student is absent? Students who are absent with a valid excuse and do not take the MSP/HSPE/EOC state assessments will not be included in Adequate Yearly Progress (AYP) or state results. –They will be counted as non-participants for AYP purposes. –Make a note of the absence on your Pre-ID roster. Students who are absent without a valid excuse (absent unexcused) will be treated as not having been tested. –These students will be included in calculations of percentages of students meeting standards, as not meeting standard. Student absences need to be reported on the back cover (demographic page) of the test booklet as either excused or unexcused. –This documentation must follow local school board policy on excused absences. Return test booklets of students in grades 3–8 and 10 with your scorable materials. –Make a note of the absence on your Pre-ID roster.

Proctors should consult SAC regarding all irregularities SAC should consult DAC regarding all group irregularities (i.e. fire alarm, students starting in wrong place, etc.) All individual and group testing irregularities must be documented on the Demographic Page of the test booklet AND OSPI Irregularity Form If group irregularity, DAC needs proctor roster immediately Invalidations for individual students will be determined by district and must be approved by DAC Coordinators submit a list of invalidated student booklets, including a Testing Irregularity Report, to the DAC. Invalidated test booklets must be packaged with To-Be- Processed and scored materials Handling irregularities, 1/2

Proctor calls the SAC (note on Test Security Assurance form) SAC calls DAC (Mary Crandell x4771) SAC makes a notation in the Note section on the Booklet Cover or instructs the Proctor to note on the Booklet cover SAC will hand-grid box 12, if instructed by the DAC SAC notes the irregularity on the Pre-ID Roster SAC completes the corresponding irregularity report Handling irregularities, 2/2

Acts of unprofessional conduct that may result in invalid scores include, but are not limited to: Improper test preparation activities Improper test administration Providing access to tools or materials not allowed on that test Reproduction/retention of test content Student misconduct (cheating) Guidelines for Investigation School district investigation and reporting must include: Summary of the facts of the case Statements from persons with knowledge about the case Gathering and examination of evidence Conclusion based on interviews and gathered evidence Disciplinary actions, if any, that should be imposed Determination regarding any invalidation of tests is based on investigation/consultation with the OSPI State Test Coordinator Plan of action to prevent future occurrence of the irregularity

Tests may be invalidated when: Student is discovered cheating on a test test administration is disrupted test was improperly administered Specific reasons include use of a cell phone, improper use of a calculator, access to purse or backpack or a fire alarm during testing Invalidations for individual students will be determined by DAC in consultation with the SAC. Invalidations for student groups will be investigated by the DAC, reported to OSPI, and invalidated as determined by OSPI. –Note: a decision of whether or not to invalidate a test may be deferred until after student scores are available and it is determined if the irregularity impacted what the student knows and is capable to doing (impact data). Invalidations

Organization of this training Before testing The SAC notebook Policies and procedures Participation Accommodations for Students with IEPS (Holly) Accommodations for ELLs (Ellen) Receiving materials / preparing environment During testing Proctoring Handling irregularities Following testing Preparing test booklets for shipment

Packing It Up New process for packing up In order to quickly troubleshoot and expedite packing, the DAC will be coming to schools for pack-up. Schedule available today: please identify a good time. If needed, a separate day for Science pick-up is fine. Preparing materials for confirmation Please have all the tests sorted by type (math, science, etc) and in numeric order, even the X'd out tests. This will help us shoot through the full list quickly. DAC will bring packing supplies like labels and tape and stuffing and boxes. Booklets without pre-ids will be listed on blank student roster sheets. Those can be prelisted (in numeric order) in order to save time. Please look at your unused (and open) booklets to make sure they're all recorded on the handwritten student roster. Things to keep in mind Please identify whether an absence is excused or unexcused. Are there any irregularities to write up? Please make a note of other reasons that a test might have not been completed (NNEP, etc).

What’s Next? Results will be available… Here is the date for the SSS school results and public announcements. Here is the date for actual school results. Here is our plan for getting these results communicated to the community. Feedback needed What questions did you have during testing that could have been covered in the training? We would like to schedule the SAC training earlier. When would you suggest? How was the pack-up? How can we make that easier? Celebration of a job well-done! Here is where we suggest school recognition and district recognition of getting through OSPI testing.

Best Practices Let’s take a minute to share your ideas Do you have a process that has worked well that you’d like to share Building Discussions Take a minute or two to talk to your compadres about planning