1. 2015–2016 DAC Test Administration Training Jennifer Burton and Tracy Cerda Altered by Albert Lea/Niebuhr Feb 18

2. What Were We Thinking??? Winter 2015: Pearson proposed PearsonAccess Next Spring 2015: DDOS attacks during testing Summer 2015: MDE decision for spring 2

3. Changes Still to Come Every Student Succeeds Act (ESSA) Writing test OLPA-will be offered again in 16-17 3

4. Standards-Based Accountability Assessments 4

5. Testing Windows Posting testing schedules required District and/or school websites Mathematics and Reading MCA Mathematics, Reading, and Science MTAS March 7 – May 6 Science MCA March 7 – May 13 One week longer than Reading and Mathematics MCA and Science MTAS 5

6. TestNav 8 Appearance and functionality similar to OLPA Supported tablets and Chromebooks can be used Access via browser or through installable application 6

7. Reading and Mathematics MCA Off-grade adaptive items will appear for students taking online grades 3–8 assessments Meets legislative requirements Not included in accountability scores Used in progress score calculations All grades and subjects are adaptive 7

8. MCA Test Monitor Resources Online Test Monitor Certification Course Required for all Test Monitors Even if course was completed for OLPA Student Directions Must be presented on test day Intended to be shown prior to each subject 8

9. MCA Student Resources Student tutorials are interactive Item samplers will be updated for TestNav 8.5 New item types will be added for Reading MCA in February 9

10. Supports and Accommodations Supports All students Accommodations Students with an IEP or 504 plan Linguistic Supports English learners 10

11. Exiting the MCA 11 AssessmentBefore Exiting Mathematics MCA Students must complete a section and go to next section Students must exit the test on the first item in the next section Reading MCA Students must complete a section, if possible, or minimally complete the first passage Students must exit the test on the Section page for the next section or the first item for the next passage Science MCA Students must complete the first section and go to the second section Students must exit the test on the Section page for the second section

12. Reporting Changes Re-designed Individual Student Report (ISR) New components only for Reading and Mathematics MCA : Progress score for grades 3–8 includes off- grade items Career and college readiness indicators for grades 3–8, 10, and 11 Student growth for grades 4–8 12

13. Test Security 13

14. Why Test Security Matters Ensure the validity of test score interpretation – Report accurate information – Provide resources and interventions where most needed – Provide recognition where merited Protect investment in test content 14

15. Why Now? 15 I am writing to urge you to do everything you can to ensure the integrity of the data used to measure student achievement and ensure meaningful educational accountability in your State. As I’m sure you know, even the hint of testing irregularities and misconduct in the test administration process could call into question school reform efforts and undermine the State accountability systems that you have painstakingly built over the past decade. I urge you to make assessment security a high priority by reviewing and, if necessary, strengthening your efforts to protect assessment and accountability data, ensure the quality of those data, and enforce test security.

16. Why Now? 16 Recommendations Prevent test administration irregularities. Detect and analyze test administration irregularities. Respond to and investigate possible test administration irregularities. Ensure the integrity of online tests.

17. Why Now? 17 Recommendations Monitor schools identified as high risk for having test administration irregularities and share the results of monitoring with LEAs. Strengthen prevention and handling of test administration irregularities, including formal processes for timely reporting and resolution and documentation of corrective action. Strengthen test security by training test administrators, safeguarding test materials and access to online systems, and requiring timely test administration reports from contractors. Ensure that LEAs and schools put in place procedures that will prevent irregularities from occurring.

18. Why Now? 18

19. 19 Critical Element 2.4 – Monitoring Test Administration The State adequately monitors the administration of its State assessments to ensure that standardized test administration procedures are implemented with fidelity across districts and schools. Critical Element 2.5 – Test Security The State has implemented and documented an appropriate set of policies and procedures to prevent test irregularities and ensure the integrity of test results… Critical Element 2.6 – Systems for Protecting Data Integrity and Privacy The State has policies and procedures in place to protect the integrity and confidentiality of its test materials, test-related data, and personally identifiable information…

20. Why Now? 20

21. Threats to Test Data Integrity Addressed by Test Security Policies & Procedures Student Misconduct Educator Misconduct 21

22. The Test Policies and Procedures Committee Noted: …the majority of Minnesota educators behave ethically and follow the rules for test administration… 22

23. The Test Policies and Procedures Committee Noted: …however, unethical or illegal conduct by a single educator has the potential to have a widespread negative impact on the integrity of test data. 23

24. The Test Policies and Procedures Committee (TPPC) Met October 2014 – June 2015 Reviewed MDE test security policies and procedures Recommended improvements to test security in Minnesota Issued a final report, posted to the MDE website Included in the 2015- 2016 Procedures Manual 24

25. Test Security Cycle PreventionDetectionInvestigationResolution 25

26. Prevention: Include Testing in Your Culture of Academic Integrity 26

27. Prevention: Training, Training, Training Train-the-trainerMini module for staff 27

28. Prevention: District Test Security Procedure Each district is required to have a District Test Security Procedure MDE will begin to request select districts’ procedures 28

29. Prevention: Assurance of Test Security and Non-Disclosure 29

30. Prevention: Active Monitoring 30

31. Prevention: Site Visits by MDE and District Staff 31

32. Prevention: Testing Location, Scheduling, and Secure Materials 32

33. Prevention: Student Role 33

34. Detection: Remember Erasure Analysis? Data forensics to detect cheating in online assessment – Changes to responses: W>R, R>W, W>W – Response latency – Response patterns Forensics generally conducted by testing contractor 34

35. Investigation: What Really Happened? Security breach is reported in the district Security breach is reported to MDE: Test Security Notification Tip Line MDE requires the district to investigate and document findings 35

36. Investigation: What Happens Next? ConsequencesMedia Requests 36

37. 37 Resolution: Completing the Cycle District investigation and documentation submitted to MDE MDE review of all security breach documentation and follow-up Resulting actions by MDE or District: Invalidations Personnel Action MDE and District work group to identify appropriate consequences Learning from the process and enhanced prevention

38. Test Administration in PearsonAccess Next 38

39. PearsonAccess Next vs. PearsonAccess PearsonAccess Next MCA and MTAS administrationAccess to resourcesOn-Demand ReportsFuture reporting PearsonAccess OLPA administration Longitudinal Reports (through spring 2016) 39

40. PearsonAccess Next User Accounts The majority of user roles were transitioned to PearsonAccess Next Same username and password are used for the Training Center and PearsonAccess Next 40 PearsonAccess District Assessment Coordinator District / School Administrator or School Assessment Coordinator District Tech Coordinator or Tech Configurations Test Monitor or Data Entry MTAS Score Entry PearsonAccess Next District Assessment Coordinator Assessment Administrator Technology Staff Test Monitor/Data Entry MTAS Score Entry

41. Precode Updates and Timelines Precode Files Loaded to: 41 PearsonAccessPearsonAccess Next Student updated in MARSS: 2 business days to appear Student added in Test WES: 1 business day to appear

42. What if students aren’t in PearsonAccess Next? Verify students are eligible in Test WES Check Precode Student Eligibility and Sent Precode Verify correct in Pretest Editing If students still don’t appear: May not have been sent yet May have completed testing May have started testing May be in a started test session 42 Mar 4 is Site Readiness Deadline—Test Samplers –Issues- -

43. Continue to Make Changes in Pretest Editing New students who enroll New decisions about accommodations and test assignments 43

44. Steps to Receive Test Materials After January 22: 1. Indicate in Pretest Editing 2. Order test materials through Additional Orders 44

45. Test Session Set Up Set up test sessions and add students before testing— Feb 22 M/R— Mar 1 Science Do NOT start test sessions until day of testing Set up separate sessions for different form group types 45

46. Form Group Types Main Data Entry Reading MCA Main (standard and accommodated text-to-speech) Data Entry Mathematics MCA Main (standard text-to-speech) Accommodated (accommodated text-to-speech and script) Data Entry Science MCA 46

47. Accommodations that Must Be Verified in PearsonAccess Next Mathematics MC accommodation indicated Test session with Main form Science MC or MS accommodation indicated Test session with Accommodated form 47

48. Resources 48

49. MCA and MTAS Training Resources Online Test Monitor Certification Course for MCAMTAS Training for Test Administrators Resources & Training > Training Management System (TMS): 49

50. MCA and MTAS Manual Resources MCA and MTAS Assessment Manual MTAS Task Administration Manual MTAS Learner Characteristics Inventory MTAS Data Collection Form Procedures Manual for Minnesota Assessments for 2015–2016 Resources & Training > Manuals: 50

51. MCA Test Monitor Resources MCA Test Monitor Directions MCA Student Directions MCA Test Monitor and Student Directions for Paper Accommodations Resources & Training > Test Monitor and Student Directions: 51

52. MCA Student Resources Math, Reading, and Science Item Samplers Accessing Online Item Samplers on PearsonAccess Next quick guide Accessing Online Item Samplers through the Training Center quick guide Student Resources > Item Samplers: MCA Tutorials (anticipated Feb 8) Student Resources > Student Tutorials: 52

53. PearsonAccess Next Resources Online Testing Quick Guide for MCA Data Entry Quick Guide for MCA (anticipated Jan 29) MTAS Score Entry Quick Guide for Test Administrators (anticipated mid-Feb) District Assessment Coordinator and Assessment Coordinator Quick Guide for MTAS Score Entry (anticipated mid-Feb) Resources & Training > User Guides: 53

54. Assessment Contact by Area Code Please contact Heidi or Kathy if possible first before contacting Lisa. All email contact with MDE testing need to include both Kathy and Heidi as cc’s 507, 320 Lisa Grasdalen lisa.grasdalen@state.mn.us lisa.grasdalen@state.mn.us 651-582- 8485 54