Assessment and Accountability Update Chun-Wu Li, Ph.D. Assessment Accountability Continuous Improvement Division of Educational Services October 20, 2017

Assessment Update

English Language Proficiency Assessments for California (ELPAC)

ELPAC Practice Test Enhancements Practice tests will be posted on www.ELPAC.org by October 30. Provide examples of task types that are administered in each grade/grade span. Provide a sense of how the 2012 ELD Standards are assessed. Available to students, parents, teachers and other educators, and interested members of the public.

K–12 Reporting Hierarchy for the Summative Assessment Overall Scale Score Four Performance Levels Oral Language Scale Score Listening Three Performance Levels Speaking Written Language Scale Score Reading Writing

K–12 Reporting Hierarchy for the Initial Assessment Overall Scale Score Three Performance Levels Oral Language Listening Speaking Written Language Reading Writing

ELPAC SA Administration and Scoring Trainings California Department of Education- sponsored statewide trainings: October 24 through December 13 Optional half-day training to provide regional training hosts with additional support: October 25 To register, access the registration link on www.ELPAC.org at: https://ord.scoe.net/elpac/pg00.php.

Preparing for the ELPAC SA Test Operations Management System (TOMS) opens mid-October. SA test materials ordering window: Training Webcast mid-October October 17, 2017: ELPAC Test Operations Management System (TOMS) Overview Webcast Round 1, mid-October–November 17, 2017 Round 2, November 18–December 21, 2017 Supplemental, January 23–May 15, 2018

Preparing for the ELPAC SA (cont.) Pre-identification (Pre-ID) window: Training Webcast mid-October October 17, 2017: ELPAC Test Operations Management System (TOMS) Overview Webcast Round 1 Pre-ID Label order period (38¢ each) January 2–April 9, 2018 Round 2 Pre-ID label order period (52¢ each) April 10–May 14, 2018   Pre-ID highlights No set up fees are charged to LEAs. Pre-ID labels are ordered through TOMS. Purchase order required.

New ELPAC Resources “Do We Administer the California English Language Development Test (CELDT) or the ELPAC in 2017–18?” “A Parent Guide to Understanding the ELPAC” Translated into seven languages ELPAC Assessments Fact Sheet Domain Information Sheets Matrix 4: Universal Tools, Designated Supports, and Accommodations for the ELPAC These resources are located at http://www.cde.ca.gov/ta/tg/ep/

New Resources http://www.cde.ca.gov/ta/tg/ep/documents/howtotestel.pdf http://www.cde.ca.gov/ta/tg/ca/documents/elpacassessmenrfs.pdf

New Resources (cont.)

New Resources (cont.) http://www.cde.ca.gov/ta/tg/ep/elpacparentguide.asp

California Assessment of Student Performance and Progress (CAASPP)

CAASPP Summative Assessment

Back-to-School Toolkit http://www.cde.ca.gov/ta/tg/ca/backtoschoolkit.asp California Department of Education

Summative Assessment Fact Sheet Assessment Fact Sheet Web page available at http://www.cde.ca.gov/ta/tg/ca/assessmentfactsheets.asp We have recently developed several new resources to benefit teachers and families. One of those resources is the assessment fact sheets, which have been created for each state test. These reference sheets provide basic information about each of the statewide assessments, such as the why, who, and how for each assessment. A timeline is included on each fact sheet indicating the assessment window for the current school year. California Department of Education

A Parent Guide to Understanding A Parent Guide to Understanding for each assessment is available at http://www.cde.ca.gov/ta/tg/ca/parentguidetounderstand.asp California Department of Education

CAASPP Interim Assessment

Interim Assessment Fact Sheet http://www.cde.ca.gov/ta/tg/ca/documents/sbinterimfactsheet.pdf California Department of Education

California Department of Education 2017–18 Interim Assessments http://www.cde.ca.gov/ta/tg/sa/documents/iaboverview2017.pdf California Department of Education

Interim Assessment Hand Scoring Tables http://www.cde.ca.gov/ta/tg/sa/documents/iasbygrade2017.pdf California Department of Education

Interim Assessment Viewing System http://www.caaspp.org/ta-resources/interim.html California Department of Education

Manner of Administration— Set for Entire Test Session http://www.caaspp.org/rsc/pdfs/CAASPP.Manner-of-Administration-Tip-Sheet.pdf California Department of Education

The New Interim Assessment Reporting System! https://reporting.smarterbalanced.org/ California Department of Education

Interim Assessment Reporting System—Key User Roles Assigned through the Administration and Registration Tools (ART) interface: “PII” user role—Assign only to staff who need access to all students within the school/LEA. “PII_GROUP” user role (NEW!)—Assign to staff who need access to results for a subset of students. ____________________________________________________________________________________________________________________ “GROUP_ADMIN” user role (NEW!)—Assign to school and district administrators who will be responsible for creating and managing student groups. For further details, see the e-mail dated September 11 from CalTAC to LEA CAASPP coordinators, or contact CalTAC.

Key Features Create and manage student groups View aggregate student results Compare test results by student group Use advanced filtering options View student responses to test items View detailed item information View test-item results within a group Access links to related Digital Library resources

View Student Responses to Items and Item Information

Accountability Update

State Indicators in the Fall 2017 Dashboard   Chronic Absenteeism Suspension Rate English Learner Progress Graduation Rate College/Career Academic: English Language Arts and Mathematics California Department of Education

California Department of Education Chronic Absenteeism In November 2017, the State Board of Education (SBE) may determine: Calculation method for this indicator Data to be reported in the Fall 2017 Dashboard California Department of Education

English Learner Progress Indicator (ELPI) In September 2017, the SBE approved the following addition to the ELPI formula: “Extra credit” (an additional full weight) is provided for long-term English learners (LTELs) who advance at least one level on the California English Language Development Test (CELDT). California Department of Education

California Department of Education ELPI Formula Annual CELDT Test Takers Who Increased at least 1 CELDT Level Plus Annual CELDT Test Takers Who Maintained English Proficiency in the Early Advanced/Advanced CELDT Levels ELs Who Were Reclassified in the Prior Year LTEL CELDT Test Takers Who Increased at Least 1 CELDT Level (new criteria) Divided by Total Number of Annual CELDT Test Takers in the Current Year plus ELs Who Were Reclassified in the Prior Year California Department of Education

California Department of Education CCI Measures Career Technical Education (CTE) Pathway completion Grade 11 CAASPP in English language arts (ELA) and Mathematics Advanced Placement (AP) Exams International Baccalaureate (IB) Exams Dual Enrollment a-g Completion California Department of Education

CCI Status Reported for First Time Only Status will be reported this year: For 2015–16 four-year graduation cohort (Class of 2016) Change and performance levels (colors) will not be reported until the Fall 2018 Dashboard. California Department of Education

Revised CCI Cut Scores for Status Level Percent of Prepared Students Very High 70% or more High 55% to less than 70% Medium 35% to less than 55% Low 10% to less than 35% Very Low Less than 10% California Department of Education

CCI and the Dashboard: Timeline Fall 2017 Fall 2018 Data for Class of 2016 Status Only—no performance level (i.e., color) Breakdown by Number/Percent: Prepared by Student Group, Measures Met Approaching Prepared, by Student Group, Measures Met Not Prepared, by Student Group Status for Class of 2018 compared to the Class of 2017 for Change Status and Change— performance level (i.e., color) will be assigned California Department of Education

Calculation for Percent Prepared Students who take the California Alternate Assessment (CAA) are not included in the CCI and are removed from the calculations. Class of 2016 Graduates Who Meet the “Prepared” Benchmark divided by Class of 2016 Graduation Cohort minus Students Who Take the CAAs California Department of Education

Sample CCI Report for Fall 2107 Dashboard California Department of Education

Sample CCI Report for Fall 2017 Dashboard (Cont.) California Department of Education

Dashboard For those indicators that rely solely on CALPADS certified data, schools that do not certify (or submit) data in CALPADS are automatically assigned an Orange performance level Currently this only applies to the Suspension Indicator Eventually will apply to Chronic Absenteeism NOTE: The SBE will consider, beginning with the Fall 2018 Dashboard, automatically assigning a RED performance level if data are not certified October 17, 2017 CIM,

2017 Dashboard Data Source Year of Data Source Indicator Chronic Absenteeism CALPADS EOY 3 K-8 2016-17 (SBE to determine if Status or information only) Suspension Rate Suspension, Cumulative Enrollment 2015-16 and 2016-17 English Learner Progress Indicator (ELPI) CELDT end of year data file CALPADS ODS (cumulative count of ELs who became RFEP during school year, July 1 to June 30) CAASPP ELA Score 2015-16, 2016-17 CELDT 2015, 2016 RFEP Data 2014-15, 2015-16 CAASPP ELA Graduation Rate Indicator CALPADS ODS Class of 2016 rate Divided by average of rates for classes of 2013, 2014, 2015 Academic Indicator Smarter Balanced Results (3-8) CALPADS Demographics 2017 Smarter Balanced Assess. 2016 Smarter Balanced Assess. College/Career Indicator (CCI) CALPADS EOY 1 (Course, CTE) AP, IB Results Smarter Balanced Results (11) Class of 2016, Graduate Cohort (Status only) October 17, 2017 CIM,

Local Indicators and the Fall 2017 Dashboard   Basic (Teachers, Instructional Materials, Facilities) Implementation of Academic Standards Parent Engagement Local Climate Survey California Department of Education

Completion of Local Indicators Submission due December 1, 2017 Rating status will be locked after the submission window closes Default Rating will be “Not Met” Priority 7 Indicator-In progress for Fall 2018 Dashboard California Department of Education

Technical Assistance (TA) for LEAs and Schools Under LCFF California Department of Education

California Department of Education LEAs Eligible for TA LEAs will be identified for TA based on student group performance in each Local Control Funding Formula (LCFF) state priority area. LEAs will be identified for TA for the first time in fall 2017. California Department of Education

LEA Criteria for TA in Fall 2017 The same student group must meet two of the following criteria (e.g., priority areas 4 and 5, 4 and 6, or 5 and 6) for an LEA to be identified for Technical Assistance in the fall of 2017. Priority Area 4: Meet One of the Following: Both ELA and Math = or ELA/Math = ELPI = and Priority Area 5: Graduation Rate = Priority Area 6: Suspension Rate = California Department of Education

California Department of Education Example: Performance of EL Student Group In Springfield School District Priority Area 4: ELA = Math = ELPI = Priority Area 5: Graduation Rate = Priority Area 6: Suspension = Springfield Unified is Not Identified for Technical Assistance California Department of Education

Lowest Performing Five Percent of Title I Schools Under ESSA Identified for TA for the first time in 2018. The SBE will be making further decisions on the criteria for identifying these schools at its January 2018 meeting. California Department of Education

Tentative Release Schedule for the Fall 2017 Dashboard Early November 2017 LEA private preview begins Rolling weekly release of indicators November 8 and 9, 2017 SBE meeting – Potential action on Academic and Chronic Absenteeism Indicators Week of November 27, 2017 Tentative public launch of the Dashboard California Department of Education

Assessment and Accountability Related Items

2017-2018 RCAN Dates (Revised) 2017-2018 RCAN Dates (Regular Meeting: 9:00 a.m.-12:00 p.m.; Mini Workshop: 12:30 p.m.-2:30 p.m.) Friday, August 18, 2017 Friday, October 20, 2017 Friday, December 8, 2017 Friday, February 2, 2018 (cancelled due to the conflict with CAASPP Institute) Thursday, March 22, 2018 Friday, May 18, 2018

Data Analysis Tools RCOE will send out an email request to RCAN next week for sharing data analysis tools. General data analysis tools CAASPP data analysis tools Dashboard data analysis tools Attendance/Absenteeism data analysis tools Suspension/Expulsion and Climate data analysis tools CORE Data analysis tools Etc.

Training Materials May-June, 2017: Post-Test Workshop Part 1: Accessing Score, Reports, Resources and Tools Part 2: Analyzing Summative Assessment Results to Inform Teaching and Learning September 2017: Preparing Technology for Online Testing October 3, 2017: 2017 Assessment and Accountability Information Meeting October 13, 2017: Formative Assessment Training (Part 1) October 17, 2017: CALPADS Information Meeting October 17, 2017: ELPAC Test Operations Management System (TOMS) Overview Webcast October 23, 2017: New CAASPP Coordinator’s Workshop

Upcoming Conferences/Meetings/Trainings October 23, 2017: New CAASPP Coordinator’s Workshop, RCOE-Riverside. November 13, 2017: Formative Assessment Training (Part 2) Leading by Dr. Margaret Heritage, UCR Extension. November 14, 2017 or January 9, 2018: ELPAC Academy, RCOE-Riverside. November 29-December 1, 2017: The 2017 CERA Conference, Disneyland. December 12-13, 2017: COE CAASPP Institute TOT, RCOE-Riverside. December 14, 2017: ELPAC Administration and Scoring Training, RCOE-Indio. December 19, 2017 or January 23, 2018: ELPAC Administration and Scoring Training, RCOE-Riverside.

2017-2018 Upcoming Conferences/Meetings/Trainings (continued) February 1-2, 2018: District CAASPP Institute, Riverside Convention Center. February 6-7, 2018: Building Educator Assessment Literacy (BEAL) Science Training (for grades 6-12 only) Leading by SCALE, UCR Extension. April 9-10, 2018: Building Educator Assessment Literacy (BEAL) Mathematics Training Leading by SCALE, RCOE-Riverside. May 14-15, 2018: Building Educator Assessment Literacy (BEAL) English Language Arts Training Leading by SCALE, RCOE-Riverside.