KDE:OAA:DSR: 2/6/20121

2 TEST SECURITY—addition of new checks and processes to monitor appropriate administration of state- required tests DATA QUALITY—collaborative process between OAA and school/district staff to ensure accurate reporting of test results KDE:OAA:DSR: 2/6/2012

 Recent loss of certification for Kentucky educators emphasizes a serious issue.  Senate Bill 64 (2012 Kentucky General Assembly) an ACT relating to assessment ethics has been filed.  authorize prosecution of violations (a prosecuting attorney and the Attorney General may investigate allegations of violations and prosecute violations);  require the Office of Education Accountability to periodically review assessment results and anomalies; and provide for fine upon conviction of not more than $1,000 and disciplinary action by the Education Professional Standards Board. KDE:OAA:DSR: 2/6/20123

Senate Bill 64 requirements  unlawful for any school district employee to allow examinees to view assessment questions in advance, copy test booklet contents, provide guidance to assist examinees to arrive at correct answers, change student responses, make answer keys available;  fail to follow test security protocol, fail to report violations, or follow any rules established by the Kentucky Board of Education (KBE);  require superintendent and principal to enforce policies;  require the KBE to adopt statistical guidelines for determining testing irregularities; 4KDE:OAA:DSR: 2/6/2012

 Appropriate training for Administration Code and Inclusion rules  Signatures on Appropriate Practices Form and Administration Code  Seating charts that reflect everyone in each testing room (adults and students)  Bubbling of testing room location codes by content area tests on student response booklets  DACs collect BAC certification and KDE collects DAC certification form (provided by KDE, not vendor) KDE:OAA:DSR: 2/6/20125

Certification Form DACs and BACs  from KDE/OAA and copy in DAC/BAC manual  Completed at end of year to reflect all testing  Certification form similar to prior years KDE:OAA:DSR: 2/6/20126

 Test window visits  Review of seating charts  Collection of DAC certification forms  Review/audit of randomly collected AAA Folders for alternate assessment students  Analysis of outlier test results by Office of Education Accountability  Analysis by vendors (i.e., erasure and others) KDE:OAA:DSR: 2/6/20127

Analysis by vendor can produce multiple types of information/reports at room, school or district levels.  Large score changes for a student  Large mean score increases  Probability of matched response analysis  Previous year’s distribution around scores  Pattern analysis  Comparison of individual student scores by item type KDE:OAA:DSR: 2/6/20128

Get the facts straight.  Record the date and time of the incident.  List all involved (i.e., staff, volunteers, students).  Identify content area and test parts impacted.  Identify specific content question(s), if applicable.  Record what you learn.  Report the incident. KDE:OAA:DSR: 2/6/20129

Support Documents  Testing Allegation Reporting Form  Notarized Statements written and signed by each individual involved (teacher, proctor, BAC, principal and/or others). One statement signed by multiple individuals is not acceptable.  Testing Schedule  Seating Chart KDE:OAA:DSR: 2/6/201210

Support Documents  Verification of Administration Code Training  Verify/Proctor Signature Sheet  Non-disclosure Agreement (classified/volunteers)  Student Name & SSID  For an allegation involving special education:  verification of student test accommodation(s).  verification of Inclusion of Special Populations training.  a signed copy of the Code of Ethics, record of testing room and test administrator for allegations regarding alternate assessment. KDE:OAA:DSR: 2/6/

 Correctness must happen first in Infinite Campus  KDE/OAA Student Data Review and Reporting (SDRR) Application will be used for two critical data accuracy functions:  Rosters  Required by regulation  Record of accountability for all grades 3-12  Testing information for some tests  Data Review (cleanup before reporting) KDE:OAA:DSR: 2/6/201212

Students enrolled a full academic year, any 100 instructional days, shall be included in calculations for Achievement, Gap, Growth and College/Career Readiness. Graduation Rate calculations shall include both students enrolled and students earning diplomas. 13KDE:OAA:DSR: 2/6/2012

14  INSERT TABLE KDE:OAA:DSR: 2/6/2012

 Every student enrolled on the first day of the test window must be tested. (Participation rate still reported.)  Every student in grades 3-12 must be placed in a grade for assessment purposes.  Students take the tests associated with the grade in which they are enrolled on the first day of the test window.  Grade 3 students are tested whether or not they are exiting primary or moving to grade 4.  If a grade 3 student is in grade 3 again next year, the student repeats the grade 3 test.  If a student skips a grade, the students takes only the tests associated with the current grade of enrollment. KDE:OAA:DSR: 2/6/201215

 “A1” means a school under administrative control of a principal and eligible to establish a school-based decision-making council.  “A1” school is not a alternative program operated by, or as a part of, another school.  “Alternative” program means all other education programs not classified as A1. KDE:OAA:DSR: 2/6/201216

START Has this student been enrolled in this school for 100 instructional days this school year? YES NO Student scores will count in this school’s accountability. Has this student not been in any one school but has been enrolled in this district for 100 instructional days this school year? Student scores will count in district’s accountability. YES NO Student scores will count in state’s accountability only. Has this student been enrolled in a school or district outside this district for 100 instructional days this school year? NO YES Student scores will count in another school’s or district’s accountability. Flowchart for Determining Accountability For Students in A1 Schools for the 2012 Kentucky Performance Rating for Educational Progress (K-PREP) Every student enrolled on the first day of the testing window will be tested for participation rate purposes. Accountability will be determined by full academic year. Has this student been enrolled in another school in this district for 100 instructional days this school year? NO Student scores will count in other school’s Accountability. YES KDE:OAA:DSR: 2/6/201217

Flowchart for Determining Accountability For Students in Alternative Programs for the 2012 Kentucky Performance Rating for Educational Progress (K-PREP) Accountable to A1 school and/or district where student was enrolled a full academic year or where the student would have attended if not enrolled in the alternative program. an A1 school’s or district’s policy ? YES a governmental agency or the court system? Was the student enrolled a full academic year in the A1 and alternative program combined or in the alternative program only ? NO Was the student enrolled in an A1 school or district for a full academic year before placement in an alternative program? YES Accountable to the state YES NO START: Was the student placed in the alternative program by: KDE:OAA:DSR: 2/6/201218

 The Kentucky Board of Education approved new accommodation rules with revisions to Inclusion regulation on February 1,  The new rules will impact the academic year and will impact state-required testing beginning in August KDE:OAA:DSR: 2/6/201219

 All grades (3-8 and HS writing) have separate test booklets and student answer booklets.  Test booklets are larger.  New printing process has increased the size of the test booklets (i.e., number of pages), the occurrence of blank pages and pages with one multiple-choice items.  Bigger books mean more boxes in shipment. KDE:OAA:DSR: 2/6/201220

 Tests are timed.  Timing chart has been revised and first-year transitional buffer has been added.  Timing charts display the expected time needed to complete each K- PREP test. KDE:OAA:DSR: 2/6/201221

KDE:OAA:DSR: 2/6/201222

KDE:OAA:DSR: 2/6/201223

 In spring 2012, any student that does not complete Parts B or C in the expected time may use up to an additional twenty minutes, for all content areas except writing.  During the first K-PREP administration, the Kentucky Department of Education will study completion times for Parts B and C. This additional time will be reviewed for its use in future. KDE:OAA:DSR: 2/6/201224

 Every English Learner (EL) student in grades k-12 must take an English Language Proficiency (ELP) assessment annually.  ACCESS—ELP test for ELs has an Alternate ACCESS available.  Districts determine the most appropriate ELP assessment to use (ACCESS—grades k-12 or Alternate ACCESS—grades1-12).  The Participation Guidelines for Alternate Assessment are an important reference. KDE:OAA:DSR: 2/6/201225