2. Wisconsin Knowledge & Concepts Examination (WKCE) Test Security Training for Proctors Wisconsin Department of Public Instruction Office of Educational Accountability 06/19/2013

3. Purpose of this Training To emphasize the importance of test security To emphasize the importance of test security To ensure the standardized administration of the tests To ensure the standardized administration of the tests To make sure that there is not an unfair advantage to some students To make sure that there is not an unfair advantage to some students To improve the overall understanding of test security procedures To improve the overall understanding of test security procedures

4. Test Security The primary goal of WKCE test security is to protect the integrity of the examinations through: Securing the test materials at all times Securing the test materials at all times Ensuring appropriate administration of the test Ensuring appropriate administration of the test

5. Consequences of Test Security Violations When the security of an item is breached, this may result in making the item unusable in future tests. The state then incurs additional costs associated with item development, which is already a very expensive process. When the security of an item is breached, this may result in making the item unusable in future tests. The state then incurs additional costs associated with item development, which is already a very expensive process. An unfair advantage may be provided to some students, making it difficult to draw meaningful conclusions about their performance. An unfair advantage may be provided to some students, making it difficult to draw meaningful conclusions about their performance.

6. Consequences of Test Security Violations Invalidation of test results for individual students or groups of students. Invalidation of test results for individual students or groups of students. This will result in  Parents receive no scores on their child’s report if a test is invalidated  Public reporting will reflect all invalidated tests as “not tested”. This may reduce the percentage of students meeting proficiency.  Schools may have a more difficult time meeting accountability requirements as a result.

7. Stages of Test Administration During Which Test Security Must be Ensured Prior to testing Prior to testing During testing During testing After testing After testing During Item Analysis /data retreats During Item Analysis /data retreats

8. List of Responsibilities at Proctor Level Read the Test Security Manual, and the Accommodations Guidelines Read the Test Security Manual, and the Accommodations Guidelines Read and follow the directions as stated in the Test Administrator’s Manual Read and follow the directions as stated in the Test Administrator’s Manual Attend WKCE test administration training session prior to each test administration year Attend WKCE test administration training session prior to each test administration year Review the Accommodation Guidelines Review the Accommodation Guidelines Remain in the room throughout the entire test administration Remain in the room throughout the entire test administration Ensure that test materials are in a locked and secure location Ensure that test materials are in a locked and secure location

9. List of Responsibilities at Proctor Level Ensure that students do not view the WKCE test materials prior to testing. Ensure that students do not view the WKCE test materials prior to testing. Ensure that students do not receive improper assistance during testing. Ensure that students do not receive improper assistance during testing. Ensure that completed student answer books are not reviewed for completeness of answers. Ensure that completed student answer books are not reviewed for completeness of answers. Make sure that students are working in the correct place in their test books. Make sure that students are working in the correct place in their test books. Prevent students and others from talking about or sharing answers Prevent students and others from talking about or sharing answers

10. List of Responsibilities at Proctor Level Report all testing irregularities to the school assessment coordinator such as Report all testing irregularities to the school assessment coordinator such as –Student going back to the previous session –Student cheating –Unallowable accommodations Do not copy, alter, or modify of test materials, including photocopying student writing samples Do not copy, alter, or modify of test materials, including photocopying student writing samples

11. Calculator Policy The use of calculators varies by grade. There are clear directions for the use of calculators in the Test Administration Manual and the Policy Manual both of which can be accessed at http://oea.dpi.wi.gov/oea_publications. The use of calculators varies by grade. There are clear directions for the use of calculators in the Test Administration Manual and the Policy Manual both of which can be accessed at http://oea.dpi.wi.gov/oea_publications. http://oea.dpi.wi.gov/oea_publications It is important to review these policies carefully as inappropriate use of calculators during test administration may result in invalidation of test results. It is important to review these policies carefully as inappropriate use of calculators during test administration may result in invalidation of test results.

12. Appropriate Use of Test Accommodations For use of allowable accommodations, please refer to the assessment matrix available at For use of allowable accommodations, please refer to the assessment matrix available at http://oea.dpi.wi.gov/oea_accommtrx In the event that an accommodation is not on the matrix but necessary for a student to demonstrate their knowledge & skills in a content area, a non-standard accommodations request form should be submitted to DPI for consideration. This form is available at http://oea.dpi.wi.gov/oea_dacforms In the event that an accommodation is not on the matrix but necessary for a student to demonstrate their knowledge & skills in a content area, a non-standard accommodations request form should be submitted to DPI for consideration. This form is available at http://oea.dpi.wi.gov/oea_dacforms http://oea.dpi.wi.gov/oea_dacforms –If DPI agrees that the requested accommodation does not affect the validity of the test, it will be approved. –If it does impact test validity, the school may use the accommodation but the student will be counted as “not tested”.

13. After Testing After testing, all test books—those to be scored and those not to be scored— are to be returned to the school assessment coordinator After testing, all test books—those to be scored and those not to be scored— are to be returned to the school assessment coordinator –Follow the procedures established by the school assessment coordinator for returning all used and unused testing materials, blank paper, and supplemental materials

14. Test Security Violations to Avoid Use of a non-allowed accommodation e.g. Reading the reading test. Use of a non-allowed accommodation e.g. Reading the reading test. Use of live test items for test preparation activities Use of live test items for test preparation activities Allowing the use of a calculator for computation sections in Mathematics Allowing the use of a calculator for computation sections in Mathematics

15. Reporting Test Security Violations Test Security violations / irregularities should be reported to DPI at 608-267-1072 Test Security violations / irregularities should be reported to DPI at 608-267-1072 A completed Incident report form should be submitted to your SAC and DAC A completed Incident report form should be submitted to your SAC and DAC Districts may be contacted to conduct further investigation Districts may be contacted to conduct further investigation Districts might choose additional consequences as related to personnel contracts / issues Districts might choose additional consequences as related to personnel contracts / issues

16. Process for Handling Test Security Violations Initial Report Alleging Specific Violation A test security violation is reported and received by the Department of Public Instruction from any individual, school, or district alleging that a specific breach in test security has occurred in an individual district or testing site via telephone, email, or submission of the test security violation form. Initial Internal Review of Alleged Test Security Violation The Office of Student Assessment (OSA) reviews all reports brought to the team to determine how best to resolve the allegation by analyzing the severity of the alleged breach of test security and the scope of potential harm the breach may bring to the integrity of the assessment results. Telephone Assistance from OSA to the District Assessment Coordinator (DAC) Invalidation of Test Scores Letter from Director of OSANo Violation Determined/No Consequences Districts may choose additional consequences regarding personnel issues.

17. For additional information, please contact osamail@dpi.wi.govosamail@dpi.wi.gov