The New At-A-Glance Report Jonathan Wiens, Ph.D. Office of Accountability, Research, and Information Services Oregon Department of Education July 31, 2018

Accountability Timeline Date Event October 26, 2017 4-Year/5-Year Cohort Graduation Rates (Closed) April 5, 2018 Validations open for Staff FTE and Ethnicity (Closed) April 19, 2018 Validation open for Institutions for Accountability Reporting (Closed) June 7, 2018 Validations open for Student Enrollment and Not Chronically Absent June 14, 2018 Validations open for achievement (ELA, Math, and Science), growth (ELA and Math), and assessment participation (ELA, Math, and Science) July 12, 2018 Validations open for Freshman On-Track and Class Size July 26, 2018 Validation and preview opens for the school Accountability Details Report

Accountability Timeline (Cont’d) Date Event August 1-3, 2018 Summer Teaching, Learning, and Assessment Institute August 2, 2018 At-A-Glance Summer Teaching, Learning, and Assessment Institute August 9, 2018 RC Narrative Collection opens August 24, 2018 Student Centered Staging and Third Period Cumulative ADM closes September 28, 2018 RC Narrative Collection closes October 4, 2018 Final preview of RC At-A-Glance and Rating Details Report October 11, 2018 Public release of RC At-A-Glance and Rating Details Report

Questions?

Report Card Purposes State Law requires ODE to produce school performance reports to inform parents and to improve schools ESSA requires school and district report cards be “concise” and ‘‘presented in an understandable and uniform format that is developed in consultation with parents” … … then ESSA proceeds to describe several thousand data elements that must be presented for each school, expanding on the data requirements of NCLB …

Data Requirements Here are a few of ESSA’s requirements: Full description of the accountability system, including exit criteria Disaggregate data for FAY students for ALL accountability indicators Disaggregate data for all students for ALL accountability indicators Student groups beyond the accountability groups, including new groups Full reproductions of the CRDC reports and a number of brand new data elements This is important data, but turning this into an understandable report …

Redesign Goals Here is our approach to meet these requirements and to try to stay focused on equity: Design reports that are more engaging and informative for families, especially families from historically underserved communities Create a two-page “at-a-glance” report Supplement with a web-based “dashboard” that contains all required reporting elements (Fall 2020) In the interim we will publish all the required data on our “Accountability Measures” web page. Meet standards for web accessibility

Parent Focus Groups First Round: In October ODE went to 11 groups of parents and families of historically underserved students, to determine how we could make a report valuable to them. First Round Themes A desire to know more about how a school or district creates a welcoming, safe, and inclusive environment for all students and their families; A design that is simple, multi-colored, and easy to read and understand; and A report card that emphasizes progress through relevant and actionable, school-specific data.

Parent Focus Groups Second Round: Focus groups in January and February that reviewed prototypes for feedback. Eight sessions were held, including returns to the first round focus groups. We received feedback on content and design. For more complete information on the redesign process see http://www.oregon.gov/ode/schools-and- districts/reportcards/reportcards/Pages/Report-Card-Redesign- 1718.aspx

At-A-Glance Implementation Approved by the State Board in March 2018 English At-A-Glance in ADI on August 2 Spanish version available in late September Public Release on October 11, 2017

Questions?

Sample Reports The names in the following reports are real; the data has been changed to protect the innocent These designs were our attempt to meet stakeholder needs given the constraint of available data at the state. These may evolve over time as we receive feedback or as new data are available. We’ll do a broad overview as we go through the examples, then talk about specific data notes afterwards.

Sample Elementary/Middle School

Sample Elementary/Middle School

Sample High School

Sample High School

Sample District

Sample District

Data Notes All data is rounded to the nearest whole number or percentage Student progress is based on the levels received in growth for the all students group High is average level of 4 or more. Low is average level of 2 or less State averages shown for assessment results are for the grades served by the school, or the grades shown Regular attender state average is the K-12 average

Data Notes Staff data are based on FTE All fractional FTE values are rounded up A school with a ¼ time counselor will be reported as 1 We are still evaluating teacher experience metrics for next year Disaggregated data shown for only three indicators Postsecondary enrollment is now within 12 months of graduation (per ESSA), used to be 16

Draft State Goals WARNING: These are draft only. There may be some wordsmithing or even some data changes prior to final ODE approval. However, parents wanted something specific, and we need to address equity. I also want the State to clearly indicate our joint responsibility in this work. Elementary/Middle The state is working with schools and school districts to help Oregon reach a 90% on-time graduation rate, and to eliminate achievement and opportunity gaps for Oregon’s students. To help track progress toward this goal, the state has set targets of 93% regular attendance and 80% proficiency rates on state assessments.

Draft State Goals High School The state is working with schools and school districts to help Oregon reach a 90% on-time graduation rate, and to eliminate achievement and opportunity gaps for Oregon’s students. To help track progress toward this goal, the state has set targets of 93% of students being regular attenders and 95% of students being on track to graduate at the end of 9th grade. District The state is working with schools and school districts to help Oregon reach a 90% on-time graduation rate, and to eliminate achievement and opportunity gaps for Oregon’s students. To help track progress toward this goal, the state has set targets of 93% regular attendance, 80% proficiency rates on state assessments, and 95% of students being on track to graduate at the end of 9th grade.

Changing School Header Info To change the institution web address, phone number, or head of the organization, send an e-mail to ode.institutions-request@state.or.us with the institution name and ID. To change the institution address, complete an Institution Request Form and send it to ode.institutions-request@state.or.us along with the Official Board Minutes approving the address change. Address changes require internal ODE approval and can take up to two weeks to be implemented. If you have questions, contact ode.institutions-request@state.or.us or Amanda Hiaasen at amanda.hiaasen@state.or.us or 541-971-3540.

Questions?

Resources Assessment Inclusion Rules 2017-18 -- POSTED RC Policy and Technical Manual -- Still in progress How to Review Rating Details Report -- In progress Updated Measures of Interim Progress (MIP) Summary -- POSTED Create MIP for Regular Attenders and Freshman On-Track Add MIP for On Track to ELP and Five-Year Cohort Completer

Contacts Report Card At-A-Glance and Rating Details Report Jonathan Wiens: jon.wiens@state.or.us Student Centered Staging and Assessment Validation Cindy Barrick: cindy.barrick@state.or.us Elyse Bean: elyse.bean@state.or.us Growth Model, On Track to ELP, and Post-Secondary Enrollment W. Joshua Rew: josh.rew@state.or.us Regular Attenders, Freshman On-Track, and Report Card Narrative Collection Cumulative ADM Collections Amanda Hiaasen: amanda.hiaasen@ode.state.or.us Class Size and Student Enrollment Validations Robin Stalcup: robin.stalcup@state.or.us Class Roster, Fall Membership, and Staff Position Beth Blumenstein: beth.blumenstein@state.or.us ESD Partners: http://www.oregon.gov/ode/educator-resources/assessment/Documents/esdpartners.pdf

Thank You!