Christoph Brunder Testing Manager NMSBA Spring 2010 Christoph Brunder Testing Manager

New Mexico State Assessment Program New Mexico High School Competency Examination (NMHSCE) Grades 11-12+ (required for High School diploma) Reading, Language Arts, Mathematics, Science, Social Studies, Written Composition English and Spanish versions New Mexico Standards-Based Assessment (NMSBA) Grades 3-8 & 11 – English and Spanish Reading, Writing, Mathematics, Science, (Grades 3-8) Social Studies (Grade 11) Only Reading and Math are factored in the AYP calculation RDA/cb/SBA Training 2010

New Mexico State Assessment Program New Mexico Alternate Performance Assessment (NMAPA) Grades 3-12+ Available to students with significant cognitive disabilities who meet the eligibility criteria established by the New Mexico Public Education Department ACCESS for ELLs Grades K-12 RDA/cb/SBA Training 2010

NMAPA - Second Rater Every person administering the test and every rater must attend the PED training (you don’t have to attend if you have been trained) A 25% random sample will be required to have a rater RDA/cb/SBA Training 2010

Testing Schedule Testing Windows Optimal Testing Times NMHSCE (Grades 11-12):March 1 – March 12, 2010 NMSBA (Grades 3-8 & 11): March 22– April 23, 2010 ACCESS (all grades): January 25,– February 26, 2010 NMAPA: March 1 – April 9, 2010 Optimal Testing Times Mornings Tuesdays, Wednesdays, Thursdays RDA/cb/SBA Training 2010

SBA Testing Schedule = 11 Subtests Reading Writing Mathematics Science 3 Subtests Subtests are untimed, but for planning give a minimum of 75-minutes per subtest 2 Subtests These subtests must be given in order and can’t be broken over a week-end RDA/cb/SBA Training 2010

Schedule Options May adjust order of sessions to accommodate scheduling needs of school. Students within the same building must take the same session(s) at the same time. Writing Subtests should be scheduled on the same day. Please have no weekend between the sessions. EXCEPTIONS: Students who are provided with accommodations Make-up tests RDA/cb/SBA Training 2010

Principles of Test Security Protect the student Protect your staff Protect the test Protect yourself RDA/cb/SBA Training 2010

Test Security and Training Test security is everybody’s responsibility. Training and test security requirements are outlined in NM PED regulation 6.10.7 NMAC. The regulation may be found on the web at: http://sde.state.nm.us/AssessmentAccountability/AssessmentEvaluation/ index.html RDA/cb/SBA Training 2010

Reporting Testing Irregularities A testing irregularity is “any circumstance within or beyond the control of a school district that in the opinion of the Public Education Department (PED) or a school district raises doubts about the propriety of standardized testing procedures, preparation materials, standardized test administration, standardized testing security, student scores attained from standardized testing, or teacher or student conduct observed during standardized testing.” [6.10.7.7 NMAC] Suspected testing irregularities should be reported in accordance with procedures outlined in PED Regulation [6.10.7.13 NMAC]. Referred to as (7) Test Irregularities on the Student Biogrid RDA/cb/SBA Training 2010

Test Security: The Basics Keep test booklets secure before, during, and after testing. Keep track of and return every test booklet, used or unused. Ensure that no student has exposure to the assessment prior to test administration. Never photocopy, discuss, or reproduce in any manner items from any secure test. Report testing irregularities immediately to RDA! (DO NOT INVALIDATE !) RDA/cb/SBA Training 2010

Security of Student Test Booklets Test booklets must be assigned to each student based on the Serial Number of the book RDA will provide the serial numbers when the tests are distributed Tests must be stored overnight in a secure area with limited access. No individuals (including staff members) can review secure tests without approval from the NM PED Tests must not be left unattended in an unlocked room. RDA/cb/SBA Training 2010

Security of Student Test Booklets When collecting materials after testing each day, Test Administrators (TAs) must inventory booklets. If a test booklet is missing, the TA must immediately contact the STC to report the loss and commence a search for the missing booklet. If the test booklet is not found, this incident must be reported to the DTC. RDA/cb/SBA Training 2010

Test Security: Before Testing DO NOT: use materials for test preparation when you are not sure of the source. Samples may not match NM standards post test vocabulary from test directions or items on school walls as part of the school or classroom test preparation. review specific vocabulary known to be on the test. RDA/cb/SBA Training 2010

Test Security: During Testing DO: Have a proctor in the room and test monitors in the halls to assist with medical emergencies or obtaining additional test materials. Allow bathroom breaks during sessions if necessary. Students may be allowed to use the restroom as long as they are escorted to and from the facility by a proctor. RDA/cb/SBA Training 2010

Test Security: During Testing DO NOT: Give students breaks that allow them to leave the room or talk with one another in the middle of a test session. Allow students to start a test session who arrive late and/or who miss the test directions. (Schedule a make-up session for these students). RDA/cb/SBA Training 2010

Test Security: During Testing DO NOT: Test students on different subtests at the same time when they are all in the same room together. Read the test to students or a groups of students who don’t qualify for such an accommodation. (Never read the reading part of the test!!!) RDA/cb/SBA Training 2010

Who can administer the tests? Only trained, certified staff are permitted to administer tests. The Test Administrator must be a certified staff member who has received training from the DTC/STC. In the event schools require additional staff to administer the NMSBA/NMHSCE, other staff members (who have received training) may be used to: - provide one-on-one accommodations to Special Ed or ELL students (i.e., scribing, oral presentation of directions), or - provide one-on-one administration because of other documented IEP accommodations. RDA/cb/SBA Training 2010

Who can serve as test proctors? Parents cannot proctor in their own child’s or relative’s classroom. Proctors can assist, but may not act as test administrators. Proctors must sign a non-disclosure form. RDA/cb/SBA Training 2010

Assessment Support System Do not contact the PED! If questions, check manuals. (both are online) If Test Administrator (TA) still has questions, ask School Test Coordinator (STC). If STC still has questions, ask District Test Coordinator (DTC). RDA/cb/SBA Training 2010

Responsibilities Before Testing: STC Verify receipt of sufficient test materials. Schedule testing for school. Notify parents of test administration. Plan for testing students who are eligible for allowable accommodations. Plan for make-ups (scores are not reported for a content area if even one session is missed). RDA/cb/SBA Training 2010

Responsibilities Before Testing: TA Become very familiar with administration manual. Identify students who have documented accommodation needs; confer with others if necessary. Identify students who will require separate settings or who will not be participating in one or more subtests with the larger group. RDA/cb/SBA Training 2010

Responsibilities During Testing: TA Prepare for testing: Verify that you have a sufficient supply of test booklets and answer booklets. Obtain sufficient supplies of #2 pencils, erasers, and calculators (for grades 8 and 11 only). Post a “Do Not Disturb” or “Testing in Progress” sign on the classroom door. Distribute Test Booklets When you distribute the test booklets for the first time, have students write their name on the front of test and answer book. RDA/cb/SBA Training 2010

Responsibilities During Testing: TA Ensure adequate lighting, temperature, and quiet atmosphere Ideally, a testing room should be a typical classroom or familiar environment Larger rooms may be used but must have adequate security. Follow all directions for a standardized administration. Students who have cell phones in their possession are to turn them off and place them in their own backpacks to be stored at the front of the testing room during the test session. RDA/cb/SBA Training 2010

Test Administration: TAs Follow directions and scripts in the test administration manuals exactly. Do not coach students before, during, or after testing; or influence, alter, or interfere with students’ responses in any way. Remind students to answer every question before there is a break in a testing session. Monitor for testing irregularities. RDA/cb/SBA Training 2010

Helpful Hints: TAs Under the direction of the TA, students may look through their test booklets just before they start testing to ensure that all pages are properly printed. If a student asks, you must repeat oral directions in the script of the administration manual to the whole class. If students finish early, they may read but not write. RDA/cb/SBA Training 2010

Pre-ID Labels Process Review verification sheet and make corrections in School Max February Submit February snapshot Late February Data sent to vendors Difficult to overemphasize the importance of accuracy and getting it done early. Districts and schools can begin checking accuracy of data in November. Common problems with ID errors (ID, DOB and Gender can be corrected on Sate ID System). Derived Fields (FAY-issues: check enrollment for last year 120th day, this year 40th day) Vendor sends labels & rosters to districts March Districts distribute labels to schools RDA/cb/SBA Training 2010

Destroy PreID Label When… Student’s name is wrong (first, last, middle) State Student ID number is incorrect (not matched in NMSIS) Date of Birth is wrong (not matched in NMSIS) X An error in any of these five fields means that you destroy the label and fill out a Biogrid for the student. Fill out name, ID, and DOB on Biogrid RDA/cb/SBA Training 2010

X Use Only One! Use the label Bubble ! Correct Identifiers? Use the label X Incorrect Identifiers? Bubble ! There is no need to submit a test booklet for a student that is no longer enrolled. Destroy the label. The purpose of identifiers is to find an ID match in STARS RDA/cb/SBA Training 2010

Do I Ever Bubble Demographics? No However, if new to public education the student must be submitted to STARS in the next available snapshot There is no need to submit a test booklet for a student that is no longer enrolled. Destroy the label. RDA/cb/SBA Training 2010

What are the Demographics (…and why are they so important)? AYP groups: Ethnicity ELL (include exited yrs 1 & 2) Special Ed (not gifted) FRL (District Use Only – Box 12) Additionally reported: gender, migrant, bilingual, Title I, immigrant AYP Proficiencies are computed for all AYP groups with 25 or more students that are Full Academic Year Data that is NOT bubbled: Grade & Location RDA/cb/SBA Training 2010

All information on Pre ID label is cancelled What happens when I Bubble Demographics? All information on Pre ID label is cancelled Data does NOT get into STARS Data does NOT get used for AYP Don’t do it! There is no need to submit a test booklet for a student that is no longer enrolled. Destroy the label. RDA/cb/SBA Training 2010

FAY (Full Academic Year) “Present from 120 day to 120 day in a single school (or district).” 40D 80D Student does not have to be tested at the FAY school Note that student does not have to be 120D 120D RDA/cb/SBA Training 2010

FAY – Transition Grades x 120D In transition grades (6th grade in a middle school) count from 40 – 120 day, provided the student came from within district. 40D 80D 120D RDA/cb/SBA Training 2010

Attemptedness Rule Students must answer 15 items in a content area, with a minimum of one response per session. If a student does not complete one session of an assessment for a specific content area, the entire content area is considered invalid. One content area may be invalidated without invalidating the test for other content areas. The purpose of the Attemptedness Rule is to identify students who may not have completed enough of the assessment to have a valid score. RDA/cb/SBA Training 2010

Testing Disruptions Student Illness Emergency Evacuation Fire Drill, Bomb Scare, Drug-sniffing Dog, etc. - Students may be allowed to complete the session at a later time, but may not change response to any test items already answered. Have paper clips ready for students to clip on the page where they are working in the test booklet. Upon return and the testing session is resumed, walk around to ensure that students are working on the page with the paper clip. RDA/cb/SBA Training 2010

Student Starts on Next Session If the student has turned more than one page: TA must IMMEDIATELY stop student and take the test booklet from the student. Student is allowed to continue at a later time when everyone else is working on that session. RDA/cb/SBA Training 2010

When in Doubt If unsure of student’s ability to take the assessment, attempt the assessment. If assessment is discontinued & does not comply with the ‘Attemptedness Rule’, enter (6) — “Other Non-Completion” in Test Completion Status box of the Student Biogrid and turn in incomplete booklet. RDA/cb/SBA Training 2010

Student moves to another APS school prior to testing Before the test: If a student officially withdraws before the testing window and you have label; DO NOT AFFIX THE LABEL. If you affix the label and the child is not enrolled in your school it will count against participation and performance RDA/cb/SBA Training 2010

Student moves to another APS School during the test window If a child moves to a different school and has started but not finished the test The answer booklet needs to be transferred to the new location and If the child is in grade 3 the new school must have the test booklet Please identify the form number for the new school You can deliver it with a form that requires your signature and the receiving school’s signature (each school and RDA get a copy) OR RDA can deliver it for you RDA/cb/SBA Training 2010

Student moves to a non APS School Before the test Destroy label and do not send in a booklet for this student During the test Mark “Withdrew before test completion” for all not completed content areas RDA/cb/SBA Training 2010

Test Invalidation Student shares answers. Student makes no attempt to respond to test. Mis-administration of the test. DTC has authority and responsibility to invalidate test when standard assessment procedures and policies have been violated in any way. Invalidations outlined in Procedures Manual (parent refusal, non-allowed modifications, etc.). Invalid = not participated, no performance Again, contact RDA before you take action. RDA/cb/SBA Training 2010

Documentation for All Students There must be a test booklet returned FOR EACH ENROLLED STUDENT IN EVERY GRADE LEVEL, AND IN EVERY CONTENT AREA ASSESSED. Affix pre-coded label and/or complete the Student Biogrid on a blank booklet for students not tested (e.g., no shows, invalid tests). NOTE: If a student is no longer enrolled in your school, do not affix the pre-coded label to a blank test booklet. Ensure that you only return a test booklet (in every content area) for each registered student. If you find that a student has two test booklet for a different session and/or content area, you must scribe all of their responses into one test booklet and return the incomplete test booklet with the non-scorable materials. RDA/cb/SBA Training 2010

Documentation for All Students According to the PED, Foreign Exchange students DO NOT need to be tested. Only put their label on a bio-grid if your school has decided to test them. If a bio-grid is submitted the student will count for participation RDA/cb/SBA Training 2010

Documentation for All Students If a student has used large print: TA or STC must transfer all MC answers into a regular test booklet. The written responses do not have to be transcribed. Keep the Large Print book with the regular one If a student has used Braille as a response format: Appropriate school personnel must transcribe this information into regular print booklet. RDA/cb/SBA Training 2010

Final Check Name on cover of test booklet and Answer document. Pre-coded label and/or Student Bio-grid are complete/accurate. Stray marks are erased; erasures are complete. Return tests to STC: no tape, staples or rubber bands. RDA/cb/SBA Training 2010

Following Testing: STC Check test booklets: There must be a test booklet returned for each registered student in every grade level and every content area assessed. Verify student roster information and/or student data grids are complete and accurate. Ensure that the correct bubble is filled in if necessary. For example: Accommodations grid, the Form Number, and the Test Completion Status grid (if other than 0) RDA/cb/SBA Training 2010

Prepare Materials for Return Fill out the appropriate header sheets/group information sheets as directed by RDA. (See handouts) Package materials as directed by RDA Keep the original boxes Check to be sure that all materials are accounted for, and that test materials are separated as directed in manuals and/or by RDA Pay particular attention to which documents go in which envelope and/or box; scorable materials, non-scorable materials, and transcribed documents. The same precaution should be used for labels that go on the envelopes and/or boxes. . RDA/cb/SBA Training 2010

Duplicate Prevention Box voided answer sheets with “non scored” test materials (extra test booklets, etc.). Document any deviation from a single answer sheet (spills, transcriptions, lost) and attach to voided answer sheets at the time of boxing. RDA/cb/SBA Training 2010

Test pick-up Pick up will take place from 04-12 to 04-23 You must schedule pick up with Claudine at 872-6812 Please return as early as you can No more than 25 schools can be picked up in one day Hot Shots will pick up or you can deliver to Testing Services RDA/cb/SBA Training 2010

Participation of Students with Disabilities: Three Ways Participation in standard administration without accommodations. Participation with allowable accommodations. New Mexico Alternate Performance Assessment: for students with significant cognitive disabilities who are unable to participate in general assessment, even with accommodations. RDA/cb/SBA Training 2010

Participation of English Language Learners Variety of ways to participate Depends, in part, on how long the student has attended school in the U.S. Language of instruction is also an important consideration. NMELPA classifications Use most recent LAS or NMELPA scores available RDA/cb/SBA Training 2010

ELL Students: Less than one year in US Schools May receive language exemption from Reading test. Language proficiency assessment constitutes participation. Must take all other subtests. Option available first year in U.S. only Does not affect AYP performance results Does affect participation results All children who have been in a school less than one full academic year do not county for AYP purposes. [National Education Association (NEA)] RDA/cb/SBA Training 2010

ELL Students: Less than 3 Years in U.S. Schools Student may participate in: Standard administration of English language test. English language test with accommodations. Standard administration of Spanish language test Spanish language test with accommodations. Does affect AYP performance results. RDA/cb/SBA Training 2010

ELL Students: 3 or More Years in U.S. Schools Students must participate in English language assessment (with or without accommodations). However, waiver is available for up to two additional years to continue testing student in his or her home language. Kindergarten does not count as one of the 3 years. If, after 3 consecutive years, prior to the date of the test administration, the district determines (on a case-by-case basis) that state assessments in a language other than English would yield more accurate and reliable information, the student may continue to be tested in another language for a period not to exceed two years. RDA/cb/SBA Training 2010

Waiver Requests Must be submitted to RDA prior to testing Approved for a maximum of two years Approved for one year at a time Please refer to page 35 of the Procedures Manual for completing the student biogrid for a student with a waiver. RDA/cb/SBA Training 2010

Waiver Requests Must Include: Student Name State Student ID School Grade English language proficiency scores and date(s) of administration Indication of whether this is the first or second waiver request for this student Reason or justification for waiver request, and Names of Student Assistance Team members involved in the decision. RDA/cb/SBA Training 2010

Student Biographical Data Check (SBD) SBD will open June, 2010 Verify data are correct This is our last chance to make corrections that impact: School District Report Cards Adequate Yearly Progress Calculation (AYP) RDA/cb/SBA Training 2010

PED WEB SITE www.ped.state.nm.us Go to NMPED Web Directory Go to Assessment and Evaluation Find Procedure Manual, DFA, Sample Items etc. RDA/cb/SBA Training 2010

GOOD SUCCESS! RDA main: 872- 6870 Christoph Brunder: 872–6830 and 235-5843 Material questions and issues: 848-8751