1. Assessment and Accountability Update
Chun-Wu Li, Ph.D.
Assessment Accountability Continuous Improvement
Division of Educational Services
October 20, 2017

2. Assessment Update

3. English Language Proficiency Assessments for California (ELPAC)

4. ELPAC Practice Test Enhancements
Practice tests will be posted on by
October 30.
Provide examples of task types that are administered in each grade/grade span.
Provide a sense of how the 2012 ELD Standards are assessed.
Available to students, parents, teachers and other educators, and interested members of the public.

5. K–12 Reporting Hierarchy for the Summative Assessment
Overall Scale Score
Four Performance Levels
Oral Language
Scale Score
Listening
Three Performance Levels
Speaking
Written Language Scale Score
Reading
Writing

6. K–12 Reporting Hierarchy for the Initial Assessment
Overall Scale Score
Three Performance Levels
Oral Language
Listening
Speaking
Written Language
Reading
Writing

7. ELPAC SA Administration and Scoring Trainings
California Department of Education- sponsored statewide trainings: October 24 through December 13
Optional half-day training to provide regional training hosts with additional support: October 25
To register, access the registration link on at:

8. Preparing for the ELPAC SA
Test Operations Management System (TOMS) opens mid-October.
SA test materials ordering window:
Training Webcast mid-October
October 17, 2017: ELPAC Test Operations Management System (TOMS) Overview Webcast
Round 1, mid-October–November 17, 2017
Round 2, November 18–December 21, 2017
Supplemental, January 23–May 15, 2018

9. Preparing for the ELPAC SA (cont.)
Pre-identification (Pre-ID) window:
Training Webcast mid-October
October 17, 2017: ELPAC Test Operations Management System (TOMS) Overview Webcast
Round 1 Pre-ID Label order period (38¢ each)
January 2–April 9, 2018
Round 2 Pre-ID label order period (52¢ each)
April 10–May 14, 2018
Pre-ID highlights
No set up fees are charged to LEAs.
Pre-ID labels are ordered through TOMS.
Purchase order required.

10. New ELPAC Resources
“Do We Administer the California English Language Development Test (CELDT) or the ELPAC in 2017–18?”
“A Parent Guide to Understanding the ELPAC”
Translated into seven languages
ELPAC Assessments Fact Sheet
Domain Information Sheets
Matrix 4: Universal Tools, Designated Supports, and Accommodations for the ELPAC
These resources are located at

11. New Resources http://www.cde.ca.gov/ta/tg/ep/documents/howtotestel.pdf

12. New Resources (cont.)

13. New Resources (cont.)

14. California Assessment of Student Performance and Progress
(CAASPP)

15. CAASPP Summative Assessment

16. Back-to-School Toolkit
California Department of Education

17. Summative Assessment Fact Sheet
Assessment Fact Sheet Web page available at
We have recently developed several new resources to benefit teachers and families.
One of those resources is the assessment fact sheets, which have been created for each state test.
These reference sheets provide basic information about each of the statewide assessments, such as the why, who, and how for each assessment.
A timeline is included on each fact sheet indicating the assessment window for the current school year.
California Department of Education

18. A Parent Guide to Understanding
A Parent Guide to Understanding for each assessment is available at
California Department of Education

19. CAASPP Interim Assessment

20. Interim Assessment Fact Sheet
California Department of Education

21. California Department of Education
2017–18 Interim Assessments
California Department of Education

22. Interim Assessment Hand Scoring Tables
California Department of Education

23. Interim Assessment Viewing System
California Department of Education

24. Manner of Administration— Set for Entire Test Session
California Department of Education

25. The New Interim Assessment Reporting System!
California Department of Education

26. Interim Assessment Reporting System—Key User Roles
Assigned through the Administration and Registration Tools (ART) interface:
“PII” user role—Assign only to staff who need access to all students within the school/LEA.
“PII_GROUP” user role (NEW!)—Assign to staff who need access to results for a subset of students.
____________________________________________________________________________________________________________________
“GROUP_ADMIN” user role (NEW!)—Assign to school and district administrators who will be responsible for creating and managing student groups.
For further details, see the dated September 11 from CalTAC to LEA CAASPP coordinators, or contact CalTAC.

27. Key Features Create and manage student groups
View aggregate student results
Compare test results by student group
Use advanced filtering options
View student responses to test items
View detailed item information
View test-item results within a group
Access links to related Digital Library resources

28. View Student Responses to Items and Item Information

29. Accountability Update

30. State Indicators in the Fall 2017 Dashboard
Chronic Absenteeism
Suspension Rate
English Learner Progress
Graduation Rate
College/Career
Academic: English Language Arts and Mathematics
California Department of Education

31. California Department of Education
Chronic Absenteeism
In November 2017, the State Board of Education (SBE) may determine:
Calculation method for this indicator
Data to be reported in the Fall Dashboard
California Department of Education

32. English Learner Progress Indicator (ELPI)
In September 2017, the SBE approved the following addition to the ELPI formula:
“Extra credit” (an additional full weight) is provided for long-term English learners (LTELs) who advance at least one level on the California English Language Development Test (CELDT).
California Department of Education

33. California Department of Education
ELPI Formula
Annual CELDT Test Takers Who Increased at least 1 CELDT Level Plus Annual CELDT Test Takers Who Maintained English Proficiency in the Early Advanced/Advanced CELDT Levels ELs Who Were Reclassified in the Prior Year LTEL CELDT Test Takers Who Increased at Least 1 CELDT Level (new criteria) Divided by Total Number of Annual CELDT Test Takers in the Current Year plus ELs Who Were Reclassified in the Prior Year
California Department of Education

34. California Department of Education
CCI Measures
Career Technical Education (CTE) Pathway completion
Grade 11 CAASPP in English language arts (ELA) and Mathematics
Advanced Placement (AP) Exams
International Baccalaureate (IB) Exams
Dual Enrollment
a-g Completion
California Department of Education

35. CCI Status Reported for First Time
Only Status will be reported this year:
For 2015–16 four-year graduation cohort (Class of 2016)
Change and performance levels (colors) will not be reported until the Fall 2018 Dashboard.
California Department of Education

36. Revised CCI Cut Scores for Status
Level
Percent of Prepared Students
Very High
70% or more
High
55% to less than 70%
Medium
35% to less than 55%
Low
10% to less than 35%
Very Low
Less than 10%
California Department of Education

37. CCI and the Dashboard: Timeline
Fall 2017
Fall 2018
Data for Class of 2016
Status Only—no performance level (i.e., color)
Breakdown by Number/Percent:
Prepared by Student Group, Measures Met
Approaching Prepared, by Student Group, Measures Met
Not Prepared, by Student Group
Status for Class of compared to the Class of for Change
Status and Change— performance level (i.e., color) will be assigned
California Department of Education

38. Calculation for Percent Prepared
Students who take the California Alternate Assessment (CAA) are not included in the CCI and are removed from the calculations.
Class of 2016 Graduates Who Meet the “Prepared” Benchmark
divided by
Class of 2016 Graduation Cohort minus Students Who Take the CAAs
California Department of Education

39. Sample CCI Report for Fall 2107 Dashboard
California Department of Education

40. Sample CCI Report for Fall 2017 Dashboard (Cont.)
California Department of Education

41. Dashboard
For those indicators that rely solely on CALPADS certified data, schools that do not certify (or submit) data in CALPADS are automatically assigned an Orange performance level
Currently this only applies to the Suspension Indicator
Eventually will apply to Chronic Absenteeism
NOTE: The SBE will consider, beginning with the Fall 2018 Dashboard, automatically assigning a RED performance level if data are not certified
October 17, 2017 CIM,

42. 2017 Dashboard Data Source Year of Data Source Indicator
Chronic Absenteeism
CALPADS EOY 3
K-8
(SBE to determine if Status or information only)
Suspension Rate
Suspension, Cumulative Enrollment
and
English Learner Progress Indicator (ELPI)
CELDT end of year data file
CALPADS ODS (cumulative count of ELs who became RFEP during school year, July 1 to June 30)
CAASPP ELA Score
, CELDT
2015, 2016 RFEP Data
, CAASPP ELA
Graduation Rate Indicator
CALPADS ODS
Class of 2016 rate
Divided by average of rates for classes of 2013, 2014, 2015
Academic Indicator
Smarter Balanced Results (3-8)
CALPADS Demographics
2017 Smarter Balanced Assess.
2016 Smarter Balanced Assess.
College/Career Indicator (CCI)
CALPADS EOY 1 (Course, CTE)
AP, IB Results
Smarter Balanced Results (11)
Class of 2016, Graduate Cohort
(Status only)
October 17, 2017 CIM,

43. Local Indicators and the Fall 2017 Dashboard
Basic (Teachers, Instructional Materials, Facilities)
Implementation of Academic Standards
Parent Engagement
Local Climate Survey
California Department of Education

44. Completion of Local Indicators
Submission due December 1, 2017
Rating status will be locked after the submission window closes
Default Rating will be “Not Met”
Priority 7 Indicator-In progress for Fall 2018 Dashboard
California Department of Education

45. Technical Assistance (TA) for LEAs and Schools
Under LCFF
California Department of Education

46. California Department of Education
LEAs Eligible for TA
LEAs will be identified for TA based on student group performance in each Local Control Funding Formula (LCFF) state priority area.
LEAs will be identified for TA for the first time in fall 2017.
California Department of Education

47. LEA Criteria for TA in Fall 2017
The same student group must meet two of the following criteria (e.g., priority areas 4 and 5, 4 and 6, or 5 and 6) for an LEA to be identified for Technical Assistance in the fall of 2017.
Priority Area 4: Meet One of the Following:
Both ELA and Math = or
ELA/Math =
ELPI =
and
Priority Area 5:
Graduation Rate =
Priority Area 6: Suspension Rate =
California Department of Education

48. California Department of Education
Example: Performance of EL Student Group In Springfield School District
Priority Area 4: ELA = Math = ELPI = Priority Area 5: Graduation Rate = Priority Area 6: Suspension = Springfield Unified is Not Identified for Technical Assistance
California Department of Education

49. Lowest Performing Five Percent of Title I Schools Under ESSA
Identified for TA for the first time in 2018.
The SBE will be making further decisions on the criteria for identifying these schools at its January 2018 meeting.
California Department of Education

50. Tentative Release Schedule for the Fall 2017 Dashboard
Early November 2017
LEA private preview begins
Rolling weekly release of indicators
November 8 and 9, 2017
SBE meeting – Potential action on Academic and Chronic Absenteeism Indicators
Week of November 27, 2017
Tentative public launch of the Dashboard
California Department of Education

51. Assessment and Accountability Related Items

52. 2017-2018 RCAN Dates (Revised) 2017-2018 RCAN Dates
(Regular Meeting: 9:00 a.m.-12:00 p.m.; Mini Workshop: 12:30 p.m.-2:30 p.m.)
Friday, August 18, 2017
Friday, October 20, 2017
Friday, December 8, 2017
Friday, February 2, 2018 (cancelled due to the conflict with CAASPP Institute)
Thursday, March 22, 2018
Friday, May 18, 2018

53. Data Analysis Tools
RCOE will send out an request to RCAN next week for sharing data analysis tools.
General data analysis tools
CAASPP data analysis tools
Dashboard data analysis tools
Attendance/Absenteeism data analysis tools
Suspension/Expulsion and Climate data analysis tools
CORE Data analysis tools
Etc.

54. Training Materials May-June, 2017: Post-Test Workshop
Part 1: Accessing Score, Reports, Resources and Tools
Part 2: Analyzing Summative Assessment Results to Inform Teaching and Learning
September 2017: Preparing Technology for Online Testing
October 3, 2017: 2017 Assessment and Accountability Information Meeting
October 13, 2017: Formative Assessment Training (Part 1)
October 17, 2017: CALPADS Information Meeting
October 17, 2017: ELPAC Test Operations Management System (TOMS) Overview Webcast
October 23, 2017: New CAASPP Coordinator’s Workshop

55. Upcoming Conferences/Meetings/Trainings
October 23, 2017: New CAASPP Coordinator’s Workshop, RCOE-Riverside.
November 13, 2017: Formative Assessment Training
(Part 2) Leading by Dr. Margaret Heritage, UCR Extension.
November 14, 2017 or January 9, 2018: ELPAC Academy, RCOE-Riverside.
November 29-December 1, 2017: The 2017 CERA Conference, Disneyland.
December 12-13, 2017: COE CAASPP Institute TOT, RCOE-Riverside.
December 14, 2017: ELPAC Administration and Scoring Training, RCOE-Indio.
December 19, 2017 or January 23, 2018: ELPAC Administration and Scoring Training, RCOE-Riverside.

56. 2017-2018 Upcoming Conferences/Meetings/Trainings (continued)
February 1-2, 2018: District CAASPP Institute, Riverside Convention Center.
February 6-7, 2018: Building Educator Assessment Literacy (BEAL) Science Training (for grades 6-12 only) Leading by SCALE, UCR Extension.
April 9-10, 2018: Building Educator Assessment Literacy (BEAL) Mathematics Training Leading by SCALE, RCOE-Riverside.
May 14-15, 2018: Building Educator Assessment Literacy (BEAL) English Language Arts Training Leading by SCALE, RCOE-Riverside.