Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12 1 Assessment and Accountability Update

2 1.Assessment and Accountability Reporting Schedule 2.School Report Card Update Key Accountability Pages Clarifications and Issues 3.New for 2013 Testing Topics for Discussion Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

Assessment and Accountability Reporting Schedule  October 16 – Quality Control at district/school level ends.  Great Work, DACs and BACs!!  October – KDE makes changes, loads to School Report Card (SRC) and performs final quality control.  October 30 – Schools and media receive access to SRC and final data. (Date embargoed until public release.)  November 2 – Public release of data occurs.  November 2-14 – After public release, clean-up and appeal process required by state regulation is available. 3 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

4

5

6 School Address, Phone and Fax Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

7

8

9

10 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

11 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

12 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

SCHOOL CONFIGURATION AND REPORTING  92% of all schools in Kentucky follow standard configurations of K-5/K-6, 6-8 and  The new Unbridled Learning model calls for three levels of schools: Elementary, Middle, and High.  In order to make comparisons at the three levels, non-traditional configurations are placed into one of the three standard levels.  Non-traditional configurations are not penalized and do not have lower scores. Scores for these schools range from low to high. 13 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

REDISTRIBUTION OF WEIGHTS in REPORTING  If data cannot be calculated for any category of next- generation learners, the weights shall be redistributed using an equal proportion to categories that shall be reported for the school or district. 14 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12 High School Achievement (20% of Next Generation Learners) Example Tests Standard Weights Redistributed Weights Reading (English II) 20%25% Mathematics (Algebra II) 20%No test data Science (Biology) 20%25% Social Studies (U.S. Hist.) 20%25% Writing (ODW/ LangMech) 20%25%

Year 2 Reporting  Annual Measurable Objective is the gain or improvement expected on the Overall Score in  70 th percentile and above gain of.5  69 th percentile and below gain of 1  Relationship between Overall Score and Percentile Rank is locked annually until complete Unbridled Learning is implemented, then it is locked for five years. 15 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12 Overall Score=Percentile Rank Example of Lock (Simulation Data) Overall Score 58.7 =70 th Percentile Rank for Proficient Schools Overall Score 58.7 becomes the locked target. School reaches It is Proficient.

ACHIEVEMENT  Based on formula using student performance levels—Novice (0), Apprentice (.5), Proficient (1) and Distinguished (1) (NAPD)—with a bonus awarded if Distinguished is greater than Novice  The new testing system:  links to the CPE definition of college readiness from Grades 3 to 12.  revises Kentucky’s Novice, Apprentice, Proficient, and Distinguished (NAPD) performance levels to align with college readiness. 16 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

ACHIEVEMENT  The standard setting process for End-of-Course (EOC) tests used the superscore generated from all parts of the EOC tests combined. The Multiple Choice/Multiple Choice/Constructed Response results were reported on a new scale of to set cuts for NAPD.  Language mechanics is 4% of writing. At high school, the PLAN language usage score is used. NAPD cuts are aligned to the quartiles (1-24, , 50-74, 75-99) of the national percentile rank. 17 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

GAP  Gap data reports the percent of non- duplicated gap students scoring proficient or distinguished in each content area.  If a student is a member of one of the individual student groups (African American, Hispanic, Native American, students with disability (IEP), free/reduced price lunch and Limited English Proficient), then the student is included the non- duplicated gap group.  The student only counts once toward the non-duplicated gap group score in each content area.  Minimum for reporting is 10.  Non-duplicated gap students are identified in the student listing spreadsheets. 18 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

GROWTH  Data cleanup issue: Non-matched students.  Non-match students are eliminated from the calculation.  Approximately 90-95% of students matched from one year to the next.  Most schools had very small numbers of unmatched students. Some schools had a higher number.  KDE will work with schools with classification impacts to clean-up data after the public release. 19 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

COLLEGE/CAREER READINESS (CCR)  All G-Code students need opportunities to show readiness.  All G-Code students that have an 100 day enrollment (full academic year) are included in CCR accountability reporting.  College Ready: If student does not take the ACT in March or at a national administration, use COMPASS or KYOTE.  Career Ready: Students must be on a Career and Technical Education Preparatory track to take KOSSA and earn credit for Industry Certifications with CCR calculation.  ASVAB or WorkKeys results only add to CCR calculation for Career and Technical Education students. 20 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

GRADUATION RATE  Year 1 of Unbridled Learning reporting (2012), uses Averaged Freshman Graduation Rate (AFGR) for state reporting and information for federal reporting requirements.  In 2013, KDE will produce AFGR and Cohort Rate.  AFGR must be used one final time for federal reporting requirement to compare 2012 to  Cohort rate also reported for ; timing on use for accountability to be determined. 21 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

FEDERALLY-REQUIRED LABELS (PRIORITY AND FOCUS)  Priority schools are those previously identified as Persistently Low Achieving.  There are three ways to be a Focus school.  Non-duplicated gap is in the lowest 10 percent of the student group gap scores by level. The list will identify the lowest 10 percent of the Title I schools and the lowest 10 percent of all schools, regardless of Title I status; or  All schools with individual gap groups underperforming in the third standard deviation below the mean (called Third Standard Deviation Model); or  Any high school having a graduation rate below 60 percent for two years in a row will be a Focus school. 22 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

NEW FOR 2013 TESTING  Data quality and test security remain important themes in  As recommended by security audit, a Student Honor Code has been added to the Student Response Booklet on the back cover. Scripts will direct the Code be read aloud before testing begins. 23 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12 K-PREP Student Honor Code I understand the answers on this test must be my own work. Receiving test questions or answers from others is cheating. Giving test questions or answers to others is cheating. If I cheat, my school may discipline me and my test may not be scored. ­­­­­­­­­­­­­­­­­­­_________________________ Student Signature

NEW FOR 2013 TESTING  Buffer time allowed in 2012 will continue in  Includes Parts B and C of Reading, Mathematics, Science and Social Studies  Part A (NRT) in Reading, Mathematics, Science and Social Studies and Writing On-Demand will not have an increase in time.  Inclusion Regulation (703 KAR 5:070) has been withdrawn. No new accommodations changes will impact 2013 testing.  Reader/read aloud will be permitted on Reading test (grades 3-8) and EOC English II this academic year. 24 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12

Resources and Questions  Follow up questions may be addressed to rhonda.sims or or 502-  Resources for release of final data  DAC and Special DAC s  Training webcast (Friday, October 26) see DAC for links  SRC workbook to assist data analysis  Cut scores  Performance Level Descriptors for 3-8 and Writing high school  Data Goal Calculator 25 Kentucky Association for Assessment Coordinators (KAAC) Office of Assessment and Accountability 10/23/12