Cindy Kazanis, Director Jenny Singh, Administrator

Cindy Kazanis, Director Jenny Singh, Administrator
Association of California School Administrators What Administrators Need to Know about the California School Dashboard: Connecting Data to Performance Cindy Kazanis, Director Jenny Singh, Administrator Analysis, Measurement, and Accountability Reporting Division August 2, 2019

California Department of Education
Topics California School Dashboard (Dashboard) Mobile App Dashboard Purpose Overview and Update of State and Local Indicators Connections to California Longitudinal Pupil Achievement Data System (CALPADS): Data Used for State Indicators Demographic Data for Student Groups California Department of Education

Dashboard Mobile App is now Available!
Wherever you are, access to the Dashboard in English or Spanish is a simple swipe away! District and School Reports at your fingertips. Search for schools/districts on the go. View performance levels of each state indicator. Even drill-down to the performance details for student groups. Available for iOS and Android Devices Download today at iOS Devices requires iOS 12.0 or later. (Compatible with iPhone). Android Devices requires Android Version 5.0 (Lollipop) and up.

Dashboard Purpose California Department of Education

Purpose Supports local educational agencies (LEAs) and schools by providing information on specific indicators to identify strengths, weaknesses, and areas needing improvement In-depth analyses on specific areas can be conducted using local data Reports data for all student groups to ensure that each student group is provided the attention and services they need Promotes continuous improvement Standards established to help schools make significant progress California Department of Education

Use of the Indicator Data
LEAs are required to use the data to inform their local control and accountability plans (LCAPs) Schools are encouraged to use the data to inform their School Plan for Student Achievement The state uses both local and state indicators to identify LEAs that are eligible for support and uses state indicators to identify schools that are eligible for support. The goal is to focus on how to improve outcomes for students. California Department of Education

Goal of a Strong Accountability System
A strong accountability system should: Identify measures that impact student success during their K- 12 experience and impacts their success after graduating high school Encourage LEAs and schools to use the data to leverage change that improves student outcomes. California Department of Education

Overview and Update of State and Local Indicators
California Department of Education

Local Indicators Local Indicators Basics: Teachers, Instructional Materials, Facilities Implementation of Academic Standards Parent Engagement Local Climate Survey Access to a Broad Course of Study There are six state indicators And five local indicators LEAs are responsible for uploading information on local indicators in the Dashboard. California Department of Education

Local Indicators: How Do You Get a Rating?
LEAs determine whether they have: Met Not Met Not Met for More than Two Years Based on whether they completed the following requirements: Annually measure progress on local performance indicator based on locally available data Report results at a regularly scheduled public meeting of the local governing board Report results to the public through the Dashboard So, how are the ratings given for local indicators? California Department of Education

State Indicators by Grade Span
Chronic Absenteeism Indicator K–8 Suspension Rate Indicator K–12 Graduation Rate Indicator 9–12 College/Career Indicator (CCI) Academic Indicator 3–8 and 11 English Learner Progress Indicator Not reported in 2018 Dashboard Status only reported in 2019 Dashboard 1–12 California Department of Education

Core Rule Used Throughout the Dashboard
For all state indicators, the data are based on data generated at your LEA or school You don’t inherit another LEA’s or school’s data! When students transfer, the data that students generated at your LEA or school does not impact the data of the new LEA and/or school For example: Jason was suspended at your school three times and then transfers to Moonlight School. The three suspensions do not follow Jason to Moonlight. California Department of Education

N-Size Requirements for State Indicators
LEAs, schools, and student groups receive performance levels (or colors) for each state indicator with at least 30 students in the current and prior year “30 or more” determination differs for each state indicator Exception: LEAs receive a color for homeless and foster youth if they have at least 15 students in the current and prior year. Note: Charter schools are treated as schools (not LEAs) for reporting these two student groups (i.e., need at least 30 or more students in these two student groups to received a performance color). There is an N size requirement to get a color. California Department of Education

Small Student Populations
Small student populations are more susceptible to large swings in results from year to year Therefore, a three-by-five table (condensed from a five-by-five table) is applied used when N size is less than 150 at the LEA, schools and student group levels N size is based on different denominators, depending on the state indicator To prevent large swings in results on the Dashboard from year to year, the 3 x 5 table is used for small student populations.

N Size for Small Student Populations
Graduation Rate Indicator: N = number of students in the four- and five-year combined graduation rate or the DASS graduation rate Suspension Rate Indicator: N = number of students cumulatively enrolled Chronic Absenteeism Rate Indicator: N = number of students who meet the enrollment eligibility CCI: N = number of students in the four- and five-year combined graduation rate or the DASS graduation rate California Department of Education

Do Alternative Schools Get a Dashboard Too?
Yes. All alternative schools, or schools with Dashboard Alternative School Status (DASS), receive a Dashboard. DASS schools held accountable for all state indicators currently reported in the Dashboard. However, “modified methods” are used for select state indicators to fairly evaluate the success and progress of alternative schools that serve high-risk students. California Department of Education

Modified Methods for DASS Schools
Modified graduation rate was approved by the State Board of Education (SBE) New career measures for the CCI, specifically targeting DASS schools, are being collected in New Status level cut scores for the Academic Indicator will be proposed to the SBE in September 2019 California Department of Education

Chronic Absenteeism California Department of Education

Chronic Absenteeism Indicator: Grades K-8
No changes for 2019 Dashboard Students are removed from the calculation if they were: Enrolled less than 31 instructional days Enrolled at least 31 instructional days but did not attend at least one day (different from DataQuest reporting rules), and Flagged as exempt in the district attendance submission Enrolled in a Non-Public School (NPS) Received instruction through a home or hospital instructional setting, or Attended community college full-time. California Department of Education

LEA Concerns Indicator includes kindergarten students Research shows that chronic absenteeism in kindergarten impacts achievement in later years Indicator includes medically fragile students California Department of Education (CDE) will be convening a work group to develop a definition for medically fragile to be used for accountability purposes Students who meet this definition will be excluded from the chronic absenteeism indicator, when approved by the SBE California Department of Education

Automatic Assignment of Orange
LEAs and schools are automatically assigned an Orange performance level if they do not certify (or submit) their attendance data in CALPADS for the current or prior Dashboard cycles. California Department of Education

Status and Change for 2019 Dashboard
Status: Percent of students who were absent 10 percent or more of instructional days in Change: 2019 chronic absenteeism rates minus 2018 chronic absenteeism rates California Department of Education

Suspension Rate California Department of Education

Suspension Rate Indicator: Grades K–12
No changes for 2019 Dashboard Indicator is based on count of students who were suspended CALPADS cumulative enrollment data are used California Department of Education

Definition of Cumulative Enrollment
Total number of students who, at any time during the school year, enrolled in a school. Example: A student who enrolls in a school on March 7, is suspended on March 8, and transfers out on March 15 would be counted in the school’s cumulative enrollment and the school’s suspension rate. California Department of Education

Defining Suspension Multiple Suspensions for One Student: A student who is suspended multiple times is only counted as suspended once. Both “in-school” and “out-of-school” suspensions are counted in the numerator of the suspension rate calculation. “In-School” Suspensions: Defined as when principal or principal designee assigns a student to a supervised suspension classroom California Department of Education

Suspensions do not include….
Reassignment to another education program or class at the same school where the pupil will receive ongoing instruction, Referral to a certificated employee designated by the principal to advise pupils, or Removal from the class, but without reassignment to another class or program, for the remainder of the class period without sending the pupil to the principal or the principal’s designee California Department of Education

Discipline Data Business Rule Changes (See CALPADS Flash #145 – November 2018) Due to federal reporting requirements, beginning in , LEAs must report, in CALPADS, all increments of suspension for all students, including students with disabilities (SWDs): Before: Report suspensions in any increments of a day for SWDs and only full-day suspensions for all other students Now: Report all suspensions, regardless of the length of suspension Dashboard will only include students cumulatively suspended for a full day (i.e., students suspended for less than a day will be excluded) California Department of Education

Automatic Assignment of Orange for Suspension
LEAs and schools are automatically assigned an Orange performance level if they do not certify (or submit) their discipline data in CALPADS for the current or prior Dashboard cycles. California Department of Education

Suspension Rate: Status and Change for 2019 Dashboard
Status: 2019 Suspension Rates Change: 2019 Suspension Rates minus 2018 Suspension Rates California Department of Education

Separate Set of Cut Scores
Because suspension data vary widely by LEA and school type, cut scores were set separately. This resulted in six different sets of cut scores: Three sets based on LEA type Three sets based on school type To access cut scores for all state indicators, see: CDE Five-by-Five Colored Tables web page at: California Department of Education

Any Questions?

Graduation Rate California Department of Education

Graduation Rate Updates for 2019 Dashboard
Inclusion of a combined four-and five-year graduation rate for comprehensive high schools Potential changes to Very Low and Low Status cut scores: To be presented at September 2019 SBE meeting No revisions to Change cut scores California Department of Education

Combined Four- and Five-Year Graduation Rate
In July 2019, the SBE adopted a combined four- and five- year graduation rate for the Graduation Rate Indicator. Reflects students who graduate in a given year Example: All 2018 four- and five-year graduates: Based on Class of 2018 cohort with addition of fifth year graduates from Class of 2017 California Department of Education

Example of Combining Four-and-Five Year Graduates
For the Class of 2018, there were 95 graduates out of students in the four-year cohort for a rate of 95 percent. For the Class of 2017, five students graduated in their fifth year (i.e., five-year cohort). The combined graduation rate is: (95 + 5)/( )= 95.2 percent

DASS High Schools The combined rate applies only to non-alternative (non- DASS) high schools The DASS graduation rate, which is based on grade twelve students, already includes students who graduate in: Four-years, Five-years, Six years, or more California Department of Education

Student Transfers When students transfer—the last school where a student is enrolled is held accountable for the students graduation status. Rule applies to both non-DASS and DASS high schools California Department of Education

Who Counts as Graduates in the Combined Rate?
Only students who earn a standard diploma are counted as graduates. Graduates do not include students who earn: A certificate of completion High School Equivalency certificate (i.e., GED, HiSET, and TASC*) Adult education diploma California High School Proficiency Exam *GED: General Educational Development; HiSET: High School Equivalency Test; TASC: Test Assessing Secondary Completion California Department of Education

Status and Change for 2019 Dashboard for Comprehensive High Schools
Status: Total # of Students Who Graduated in 2019 (4 yr grads Class th yr grads Class 2018) 4 year cohort of Class # 5th year graduates of Class 2018 Change: Current Status minus 4 year graduates of Class th year graduates of Class year Cohort of Class th year graduates of Class 2017 California Department of Education

DASS Graduation Rate California Department of Education

DASS Graduation Rate: Based on Grade 12 Students
The four-year cohort graduation rate is used for non-DASS schools. This measurement is not appropriate to use to evaluate DASS schools who serve highly mobile and credit deficient students. The SBE approved using a grade 12 graduation rate for all DASS schools (e.g., continuation school, juvenile court schools, community day, etc.). California Department of Education

Four-Year vs. DASS Graduation Rate
Students who are counted as graduates differ: 4-Year Cohort Graduation Rate (Used for Graduation Rate Indicator) DASS Grade 12 (Modified Method) Standard diploma High School Equivalency certificate (i.e., GED, HiSET, and TASC*) Adult education diploma (issued by DASS schools) Early graduates (grade eleven students) California High School Proficiency Exam (CHSPE) Special Education Certificate of Completion (must be eligible to take the California Alternate Assessments) *GED: General Educational Development; HiSET: High School Equivalency Test; TASC: Test Assessing Secondary Completion California Department of Education

New Transition Status Field
Participation in a transition program are now collected in CALPADS: File: Student Enrollment (SENR) Field: Postsecondary/Transition Status Indicator To populate this field, a student must be 17 years or older, have a grade level of 12, and have a Special Education program record. This indicator should not be set to “Y” until AFTER the student’s initial cohort graduation year Student participating in a transition program will be removed from both the numerator and denominator of the DASS graduation rate. California Department of Education

Proposed Updates to Status Levels
Since combined rate increases graduation rates, SBE has determined that the State should raise the Very Low Status level threshold To date, Very Low level set at less than 67 percent Schools with graduation rates below 67 percent were eligible for comprehensive support and improvement (CSI) under ESSA Two new thresholds—68 percent and 70 percent—proposed for consideration Adopting new threshold will result in revised Status cut scores for Very Low and Low levels for all schools (i.e., DASS and non- DASS) California Department of Education

Questions Related to the Suspension Rate or Chronic Absenteeism Rate Indicators?

College/Career Indicator (CCI)

CCI: Grades 9-12 Based on graduation cohort: For non-DASS schools, the four-and five-year combined graduation rate is used For DASS schools, the students in the DASS graduation rate are included Includes all students, including those who take the CAAs Contains both college and career measures and allows for fair comparisons across all districts and schools that serve high school students. Multiple ways for students to be considered “Prepared” Students not required to meet all measures California Department of Education

CCI Levels Three performance levels for the CCI: Prepared Approaching Prepared Not Prepared See CCI flyer for the criteria for each level ( erready18.pdf) California Department of Education

Current CCI Measures International Baccalaureate (IB) Exams
Grade 11 Smarter Balanced Summative Assessments Advanced Placement (AP) Exams Career Technical Education (CTE) Pathway completion College Credit Course (Previously referenced as dual enrollment) a-g Completion State Seal of Biliteracy Leadership/Military Science California Department of Education

Years of Data Used For all schools (non-DASS and DASS): Students Graduating in Four Years Most recent four-years of coursework and exams are used to place students in Prepared or Approaching Prepared levels Students Graduating in Five Years Most recent five-years of coursework and exams are used to place students in Prepared or Approaching Prepared levels California Department of Education

LEA Concerns Articulated CTE capstone courses (articulated agreement between the high school and community college) are not counted for both college credit and completion of CTE pathway Analysis conducted by comparing student’s performance on the summative ELA assessment between those who took an articulate CTE course and those who did not Results showed that articulation makes little difference on assessment performance Students taking non-articulated CTE courses fared slightly better California Department of Education

CCI: Status and Change for 2019 Dashboard
Status: Percent of Prepared Students in the Class of 2019 Change: Difference in the Percent of Prepared Students Between Class of 2019 and Class of 2018 California Department of Education

Career Measures Collected in 2018–19
Completion of Pre- Apprenticeship* (both DASS and Non- DASS Schools) Completion of a State or Federal Job Program* (limited to DASS schools) Work Force Readiness Certificate* Completion of Workability Courses & Work-Based Learning** (limited to students with IEP) Food Handler Certification* (limited to DASS schools - potential use by Juvenile Court schools) Completion of DOR Work-Based Learning** (limited to students with IEP) IEP=Individualized Education Program; DOR=Department of Rehabilitation * Measures collected in CALPADS. ** Measures collected in CASEMIS for only. These measures will be collected in CALPADS in California Department of Education

Deadlines and Additional Information
Measures collected in CALPADS Collection deadline in CALPADS: August 30, 2019 While they will not be included until 2020 Dashboard, CDE will begin reviewing the data this year with stakeholders and LEAs to make initial decisions Measures collected in CASEMIS Collection deadline in CASEMIS: August 9, 2019 Could potentially be included in the 2019 Dashboard Definitions of each measure, including guidance: See CALPADS Flashes #137, #156, and #157 See 2018 Dashboard Technical Guide (Tables 11 and 12) California Department of Education

Career Measures Proposed for Collection in the 2020–21 School Year
Student Owned Business Hours Count (both DASS and Non- DASS schools) Internship Hours Count (both DASS and Non- DASS schools) The CDE will be working with the CCI Work Group and other stakeholders to develop guidance that will be distributed to LEAs.

Questions Related to the Graduation Rate or CCI Indicators?

Academic Indicator California Department of Education

Academic Updates for 2019 Dashboard
Inclusion of the California Alternate Assessments (CAAs) in calculations for Distance from Standard (DFS) New Status cut scores for DASS schools Expansion in “district of residence” rule for students with disabilities (SWDs) California Department of Education

Academic Indicator: Grades 3–8 and Grade 11
Content Areas: English Language Arts Mathematics NOTE: California Science Test (CAST) is not used! Assessments: Participation Rate Smarter Balanced Summative Assessments (SBAC) California Alternate Assessments (CAAs) DFS SBAC CAAs – proposed for September State Board meeting California Department of Education

Distance from Standard (DFS)
Calculates average distance between all student test scores and lowest possible scale score for the Standard Met Achievement Level (Level 3) for that grade level Average DFS is calculated for each LEA, school, and student group. Performance levels (colors) are based on DFS California Department of Education

DFS Example: Grade 5 Smarter Balanced Summative Assessments in Mathematics A Grade 5 student received a score of 2,505. Student scored 2,505. This is 23 points below the lowest possible score for Level 3. The student’s DFS for mathematics is -23 points. (2,505 – 2,528 = -23 points) California Department of Education

Proposal to Include the CAAs
To date, the DFS has been based on Smarter Balanced Summative Assessments only U.S. Department of Education requires the incorporation of the CAAs in DFS Three methodologies have been considered by the Technical Design Group (TDG) and other stakeholders Methodologies and recommendation will be proposed to the SBE in September 2019 California Department of Education

Participation Rate Is Also a Factor
ESSA requires schools to have at least 95 percent of its students participate on the standardized assessments. Therefore, if an LEA, school, or student group does not meet the 95 percent participation rate target, the percent of students needed to bring it to 95 percent will be factored into the DFS results. The participation count includes students who take the Smarter Balanced Assessment and those who take the CAAs. California Department of Education

Separate Cut Scores by Grade Spans
To date, the SBE has approved cut scores based on district and school type for ELA and mathematics. Grades 3-8 Cut Scores Grade 11 Cut Scores Elementary School High School (serving grades 7–12 ) Middle School High School District K–12 School (blank) Elementary School District Unified School District California Department of Education

Proposed Status Cut Scores for DASS Schools
Based on feedback from the California Alternative Schools Task Force, separate cut scores for DASS schools were reviewed. In September 2019, the CDE will propose to the SBE separate Status cut scores for Very Low and Low levels only. No revisions proposed for Change cut scores California Department of Education

Current District of Residence Rule
For Academic Indicator only, if a student receives services from a special education school (based on ownership code) at another district or a county office of education or from a Non-Public School (NPS), the assessment results are sent back to the District of Special Education Accountability (or the District of Residence) for inclusion in their Dashboard. Business rule was used in former accountability systems (i.e., API and AYP), including all Dashboard releases (i.e., 2017 and Dashboards) Assessment results are not included in the Dashboard of the LEA providing services California Department of Education

Proposed Changes for the 2019 Dashboard
Expand the rule For the Academic Indicator only, the District of Special Education Accountability will be held accountable for all SWDs, not just those who receive services from a special education school or NPS school This ensures that the LEA receiving federal IDEA funding for these students is held accountable for the outcomes of all SWDs. California Department of Education

Which Entity Is Accountable for SWDs for the Dashboard?
State Indicator School of Attendance District of Residence (District of Special Education Accountability) LEA of Attendance Academic Responsible Not Responsible Suspension Chronic Absenteeism Graduation Rate CCI ELPI California Department of Education

Changes Beyond the 2019 Dashboard: Expand Rule to All State Indicators
The CDE is proposing to apply the District of Special Education Accountability rule to all the state indicators for the 2020 Dashboard to align with the transition from CASEMIS to CALPADS. Provides sufficient notice CALPADS=California Longitudinal Pupil Achievement Data System CASEMIS=California Special Education Management Information System California Department of Education

Automatic Assignment of Orange for Academic Indicator
LEAs and schools are automatically assigned an Orange performance level if they fail to test at least ten percent of their testing population. California Department of Education

Academic: Status and Change for 2019 Dashboard
Status: Average DFS for All Students Who Took the 2019 Smarter Balanced Assessments or CAAs Change: 2019 Average DFS minus 2018 Average DFS To calculate Change, the 2018 Average DFS will be re-calculated for the Dashboard to incorporate the new revisions California Department of Education

Questions Related to the Academic Indicator?

English Learner Progress Indicator (ELPI): Grades 1–12
Due to transition to the English Language Proficiency Assessments for California (ELPAC), the Department—with stakeholder input—has been reviewing the methodology used to determine EL progress toward proficiency for state and federal accountability purposes. Current Timeline: Status only will be reported in the Dashboard Cut scores for Status will be proposed at November 2019 SBE meeting California Department of Education

Demographic Data for Student Groups

Data Used for State Indicators
Majority of state indicators use data derived from CALPADS, including demographic data for student group determinations. Therefore, it is important that LEAs meet the CALPADS certification timelines (August 30, 2019). Once the amendment windows close, there are no additional opportunities to correct the data for the Dashboard! California Department of Education

Program Participation Revisions
Beginning with the 2019 Dashboard state indicators based on annual data, students that participate in a program at any point during the academic year, at the school or LEA, will be included in the appropriate student group: Foster Youth Homeless English Learner Socioeconomically disadvantaged Students with disabilities For graduation rate and CCI, students are placed in one of the groups above if they participated in that program any time during their four or five years of high school. o California Department of Education

Dashboard Resources California School Dashboard and System of Support Parent Tab: Parent Guide and Flyers Resources Tab: Webinar PowerPoints Toolkit Tab: Dashboard: Key Points and Updates Flyers for Educators Data Files and Guide Tab: Data Files for each indicator Dashboard Technical Guide FAQs Tab Additional Reports and Data 5x5s for Each Indicator CCI Measures Report (new look!) Participation Rate Report Student Group Report District Performance by County DASS Current list, Background, and Eligibility Criteria Application Instructions Flyer: What is the DASS? DASS Graduation Rate PowerPoint California Department of Education

Thank You! Local Indicators State Indicators CALPADS
Local Agency Systems Support Office CALPADS State Indicators Academic Accountability Unit California Department of Education

Cindy Kazanis, Director Jenny Singh, Administrator

Similar presentations

Presentation on theme: "Cindy Kazanis, Director Jenny Singh, Administrator"— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

Cindy Kazanis, Director Jenny Singh, Administrator

Similar presentations

Presentation on theme: "Cindy Kazanis, Director Jenny Singh, Administrator"— Presentation transcript:

Similar presentations

About project

Feedback