Kentucky Board of Education OAA 10/9/12 1 Assessment and Accountability Update

Kentucky Board of Education OAA 10/9/ Timeline for Assessment and Accountability Release 2. Standard Setting Update 3. School Report Card Update Topics for Discussion

Kentucky Board of Education OAA 10/9/12 3 Timeline May – June 2012 Test Administration for KPREP/EOC June – July 2012Tests scored by vendors August 2012Standard Setting Early SeptemberVendors apply standard setting cut scores and return final file with student data September-OctoberKDE compiles all data for School Report Card (SRC) OctoberSRC opens for local Quality Control End of OctoberPublic Release

Kentucky Board of Education OAA 10/9/12 4 Standard Setting Update K-PREP Grades 3 – 8 Standard Setting Committees: Dates of Meetings: August 28-31, 2012 GradeNumber of Educators per Committee ReadingMathematics 3 and and and 8109 GradeNumber of Educators Per Committee Writing On- Demand

Kentucky Board of Education OAA 10/9/12 5 Psychometric Goal – Create a method that will link K-PREP 3-8 assessments to the college-ready benchmarks. This link can be accomplished due to the unprecedented and remarkable work of CPE. The college definition is driven by our partners in higher education. The new testing system links to the CPE definition of college readiness from Grades 3 to 12. The new system: revises Kentucky’s Novice, Apprentice, Proficient, and Distinguished (NAPD) performance levels to align with college readiness. creates performance descriptors Grades 3-8 aligned with college readiness. Standard Setting Update K-PREP Grades 3 – 8 Reading and Mathematics

Kentucky Board of Education OAA 10/9/12 6 Performance Level Descriptors and Standards Adjustment Teacher panels for each subject met for two days. NAPD cut points were established using equipercentile linking of Grade 3-8 scores to the CPE college ready benchmarks of the ACT. The link defined Proficient. Committees worked to set cut scores for Apprentice and Distinguished. Performance level descriptors were written for every grade level. Descriptors outline the skills and knowledge needed to score within each performance level category (NAPD). Standard Setting Update K-PREP Grades 3 – 8 Reading and Mathematics

Standard Setting K-PREP Writing for Grades 5, 6, 8, 10, 11 No link exists for the Writing test to the CPE benchmarks for college readiness. Standard Setting used a Body of Work method to set cut scores. o Panels of teachers set the standards. o Teachers reviewed actual student work, writing rubrics, and impact data. o Teachers placed student work into Novice, Apprentice, Proficient, and Distinguished categories. Kentucky Board of Education OAA 10/9/12 7

8 Science and Social Studies standards on a national level are being developed; therefore, KDE continues to use Core Content 4.1. The K-PREP Science and Social Studies tests will be psychometrically equated to the 2011 tests given during the interim assessment and accountability system. Standard Setting Update K-PREP Grade 3-8 Science and Social Studies

Standard Setting High School End-of-Course (EOC) Tests Committee: o Expert panel of 13 Kentucky educators (teachers, principal, district leaders and college level) o Met August EOC tests are statistically linked to the PLAN and ACT. o Almost all EOC test takers have taken the PLAN test. o PLAN and ACT correlations are.7 to.9. o By using a linear link among PLAN, the ACT and Quality Core® EOC tests, a cut score can be determined for the EOC tests that link to the CPE ACT benchmarks. Kentucky Board of Education OAA 10/9/12 9

Standard Setting High School End-of-Course (EOC) Tests Panel used statistical analysis to set EOC cut scores for Novice, Apprentice, Proficient and Distinguished. The process used the superscore from all parts of the EOC tests (Multiple Choice/Multiple Choice/Constructed Response). The statistical link to the CPE benchmarks defined Proficient. The panel provided guidance on specific EOC cut scores for Apprentice and Distinguished. A label of Proficient means the student is very likely to meet the CPE benchmark. The link of EOC scale scores to classroom grades was updated for school use. There is a high probability that a student earning a B will be Proficient. Kentucky Board of Education OAA 10/9/12 10

Kentucky Board of Education OAA 10/9/12 11 Final Steps Vendors or KDE staff applies new cut scores from standard setting. Vendor or KDE staff produces a Novice, Apprentice, Proficient or Distinguished label for each test taker. Standard Setting Update

Kentucky Board of Education OAA 10/9/12 12

Kentucky Board of Education OAA 10/9/12 13

Kentucky Board of Education OAA 10/9/12 14 School Address, Phone and Fax

Kentucky Board of Education OAA 10/9/12 15

Kentucky Board of Education OAA 10/9/12 16

Kentucky Board of Education OAA 10/9/12 17

Kentucky Board of Education OAA 10/9/12 18

Kentucky Board of Education OAA 10/9/12 19

Kentucky Board of Education OAA 10/9/12 20