Presentation is loading. Please wait.

Presentation is loading. Please wait.

Ensuring Test Data Integrity Tracy Cerda Cheryl Alcaya Minnesota Assessment Conference August 5, 2015 “Leading for educational excellence and equity. Every.

Published byTracy Merritt Modified over 8 years ago

Similar presentations

Presentation on theme: "Ensuring Test Data Integrity Tracy Cerda Cheryl Alcaya Minnesota Assessment Conference August 5, 2015 “Leading for educational excellence and equity. Every."— Presentation transcript:

1 Ensuring Test Data Integrity Tracy Cerda Cheryl Alcaya Minnesota Assessment Conference August 5, 2015 “Leading for educational excellence and equity. Every day for every one.”

2 Ensure the validity of test score interpretation  Report accurate information  Provide resources and interventions where most needed  Provide recognition where merited Protect investment in test content Why Test Security Matters education.state.mn.us 2

3 Why Now? education.state.mn.us 3 I am writing to urge you to do everything you can to ensure the integrity of the data used to measure student achievement and ensure meaningful educational accountability in your State. As I’m sure you know, even the hint of testing irregularities and misconduct in the test administration process could call into question school reform efforts and undermine the State accountability systems that you have painstakingly built over the past decade. I urge you to make assessment security a high priority by reviewing and, if necessary, strengthening your efforts to protect assessment and accountability data, ensure the quality of those data, and enforce test security.

4 Why Now? (2) education.state.mn.us 4 Recommendations Prevent test administration irregularities. Detect and analyze test administration irregularities. Respond to and investigate possible test administration irregularities. Ensure the integrity of computer-delivered tests.

5 Why Now? (3) education.state.mn.us 5 Recommendations Monitor schools identified as high risk for having test administration irregularities and share the results of monitoring with LEAs. Strengthen prevention and handling of test administration irregularities, including formal processes for timely reporting and resolution and documentation of corrective action. Strengthen test security by training test administrators, safeguarding test materials and access to online systems, and requiring timely test administration reports from contractors. Ensure that LEAs and schools put in place procedures that will prevent irregularities from occurring.

6 Why Now? (4) education.state.mn.us 6

7 Student Misconduct Educator Misconduct Threats to Test Data Integrity Addressed by Test Security Policies & Procedures education.state.mn.us 7

8 The Test Policies and Procedures Committee Noted: education.state.mn.us 8 …the majority of Minnesota educators behave ethically and follow the rules for test administration…

9 The Test Policies and Procedures Committee Noted: education.state.mn.us 9 …however, unethical or illegal conduct by a single educator has the potential to have a widespread negative impact on the integrity of test data.

10 Included MDE staff and external advisors Met October 2014 – June 2015 Reviewed MDE test security policies and procedures Recommended improvements to test security in Minnesota Issued a final report, soon to be posted to the MDE website The Test Policies and Procedures Committee (TPPC) education.state.mn.us 10

11 PreventionDetectionInvestigationResolution Test Security Cycle education.state.mn.us 11

12 Prevention: Include Testing in Your Culture of Academic Integrity education.state.mn.us 12

13 Train-the-trainerMini module for staff Prevention: Training, Training, Training education.state.mn.us 13

14 Prevention: District Test Security Procedure Each district is required to have a District Test Security Procedure MDE will begin to conduct desk audits of select districts’ procedures education.state.mn.us 14

15 Prevention: Assurance of Non-Disclosure and Test Security education.state.mn.us 15

16 Prevention: Active Monitoring education.state.mn.us 16

17 Prevention: Site visits by MDE and District Staff education.state.mn.us 17

18 Prevention: Test site setup, assigned seating, link monitors to students education.state.mn.us 18

19 Prevention: Cell phone/device policies education.state.mn.us 19

20 Data forensics to detect cheating in online assessment  Changes to responses: W>R, R>W, W>W  Response latency  Response patterns  And many more in development Forensics generally conducted by testing contractor Detection: Remember Erasure Analysis? education.state.mn.us 20

21 Security breach is reported in the district Security breach is reported to MDE: Test Security Notification Tip Line MDE requires the district to investigate and document findings Investigation: What Really Happened? education.state.mn.us 21

22 ConsequencesMedia Requests Investigation: What Happens Next? education.state.mn.us 22

23 education.state.mn.us 23 Resolution: Completing the Cycle District investigation and documentation submitted to MDE MDE review of all security breach documentation and follow-up Resulting actions by MDE or District: Invalidations Personnel Action MDE and District work group to identify appropriate consequences Learning from the process and enhanced prevention

24 Key Policy Letters from the Education Secretary or Deputy Secretary, June 24, 2011. Available at http://www2.ed.gov/policy/elsec/guid/secletter/110624.html. http://www2.ed.gov/policy/elsec/guid/secletter/110624.html National Center for Education Statistics (2013). Testing integrity symposium: Issues and recommendations for best practice. Washington, DC: Author. Available at http://s3.documentcloud.org/documents/1109163/testing-integrity- symposium.pdf. http://s3.documentcloud.org/documents/1109163/testing-integrity- symposium.pdf U.S. Department of Education, Office of Inspector General (2014). The U.S. Department of Education’s and Five State Educational Agencies’ Systems of Internal Control over Statewide Test Results. Washington, DC: Author. Available at https://www2.ed.gov/about/offices/list/oig/auditreports/fy2014/a07m000 1.pdf. https://www2.ed.gov/about/offices/list/oig/auditreports/fy2014/a07m000 1.pdf http://www.fbi.gov/boston/press-releases/2015/former-charter-school- principal-sentenced-in-connection-with-mcas-cheating-scheme http://www.fbi.gov/boston/press-releases/2015/former-charter-school- principal-sentenced-in-connection-with-mcas-cheating-scheme http://www.ajc.com/news/news/education/sentencing-resumes-tuesday- convicted-aps-educators/nktD6/ http://www.ajc.com/news/news/education/sentencing-resumes-tuesday- convicted-aps-educators/nktD6/ References education.state.mn.us 24

Download ppt "Ensuring Test Data Integrity Tracy Cerda Cheryl Alcaya Minnesota Assessment Conference August 5, 2015 “Leading for educational excellence and equity. Every."

Similar presentations

Just Read Florida Leadership Conference, July 2006

Just Read Florida Leadership Conference, July 2006
Ways to Improve the Hazard Management Process

Ways to Improve the Hazard Management Process
Wisconsin Knowledge & Concepts Examination (WKCE) Test Security Training for Proctors Wisconsin Department of Public Instruction Office of Educational.

Wisconsin Knowledge & Concepts Examination (WKCE) Test Security Training for Proctors Wisconsin Department of Public Instruction Office of Educational.
…by your side. …working collaboratively. …to add value.

…by your side. …working collaboratively. …to add value.
Test Monitor Training Administering Minnesota Assessments “Leading for educational excellence and equity. Every day for every one.”

Test Monitor Training Administering Minnesota Assessments “Leading for educational excellence and equity. Every day for every one.”
Data Quality And Stewardship. PROVIDED BY THE IDAHO STATE DEPARTMENT OF EDUCATION.

Data Quality And Stewardship. PROVIDED BY THE IDAHO STATE DEPARTMENT OF EDUCATION.
Wisconsin Knowledge & Concepts Examination (WKCE) Test Security Training for Proctors Wisconsin Department of Public Instruction Office of Educational.

Wisconsin Knowledge & Concepts Examination (WKCE) Test Security Training for Proctors Wisconsin Department of Public Instruction Office of Educational.
Wisconsin Knowledge & Concepts Examination (WKCE) Test Security Training for Proctors Wisconsin Department of Public Instruction Office of Educational.

Wisconsin Knowledge & Concepts Examination (WKCE) Test Security Training for Proctors Wisconsin Department of Public Instruction Office of Educational.
TRAIN-THE-TRAINER FORMAT Minnesota Assessments Test Security Training for Districts and Schools.

TRAIN-THE-TRAINER FORMAT Minnesota Assessments Test Security Training for Districts and Schools.
Final Determinations. Secretary’s Determinations Secretary annually reviews the APR and, based on the information provided in the report, information.

Final Determinations. Secretary’s Determinations Secretary annually reviews the APR and, based on the information provided in the report, information.
FAEC Annual Conference - September 2013 Linda A. Halliday Assistant Inspector General for Audits and Evaluations Office of Inspector General U.S. Department.

FAEC Annual Conference - September 2013 Linda A. Halliday Assistant Inspector General for Audits and Evaluations Office of Inspector General U.S. Department.
1 INTERNAL CONTROLS A PRACTICAL GUIDE TO HELP ENSURE FINANCIAL INTEGRITY.

1 INTERNAL CONTROLS A PRACTICAL GUIDE TO HELP ENSURE FINANCIAL INTEGRITY.
K-12 EDUCATION: States’ Test Security Policies and Procedures Varied (GAO-13-495R) Council of Chief State School Officers National Conference on Student.

K-12 EDUCATION: States’ Test Security Policies and Procedures Varied (GAO R) Council of Chief State School Officers National Conference on Student.
Sandia is a multi-program laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy’s National Nuclear.

Sandia is a multi-program laboratory operated by Sandia Corporation, a Lockheed Martin Company, for the United States Department of Energy’s National Nuclear.
Environmental Management Systems An Overview With Practical Applications.

Environmental Management Systems An Overview With Practical Applications.
Response to the Blue Ribbon Commission’s Recommendations of the 2009 Criterion Referenced Competency Test (CRCT) Erasure Investigation Dr. Beverly L. Hall.

Response to the Blue Ribbon Commission’s Recommendations of the 2009 Criterion Referenced Competency Test (CRCT) Erasure Investigation Dr. Beverly L. Hall.
Introduction & Background Laurene Christensen National Center on Educational Outcomes National Center on Educational Outcomes (NCEO)

Introduction & Background Laurene Christensen National Center on Educational Outcomes National Center on Educational Outcomes (NCEO)
Office of Inspector General (OIG) Internal Audit

Office of Inspector General (OIG) Internal Audit
Computer Security: Principles and Practice

Computer Security: Principles and Practice
Performance Monitoring All All Contracts require basic monitoring once awarded. The Goal of contract monitoring is to ensure that the contract is satisfactorily.

Performance Monitoring All All Contracts require basic monitoring once awarded. The Goal of contract monitoring is to ensure that the contract is satisfactorily.

Similar presentations

Ads by Google