1. Science Assessment Development and Status
Regional Assessment Network Meeting
January 18, 2017
Michelle Center, Director
Assessment Development and Administration Division

2. California Science Test (CAST)
Overview of the CAST and the CAA for Science

3. California Science Test (CAST) Implementation Timeline
Spring 2017
Pilot test (census)
Spring 2018
Field test (census)
Spring 2019
Operational administration
The test design for the operational CAST is innovative and takes into consideration the complexity of the California Next Generation Science Standards.
With the pilot test in Spring 2017 and then the field test in Spring 2018,
we will lead up to the full operational design in Spring 2019.
Overview of the CAST and the CAA for Science

4. Overview of the CAST and the CAA for Science
2017 CAST Full Census Pilot
Participation required for all students in grades five and eight
High school sampling:
All high schools
Each high school assigned a single grade
All students enrolled in that grade are required to participate
Pilots, field tests, and operational administrations will be conducted as a full census, but
sampling plans will be used for high schools during the pilots and field tests.
The high school sample will be comprised of about 67% in grade 10 and the remaining 33% will be equally divided between grades 11 and 12.
The assigned grade will be the same for the CAST pilot test as well as the CAA for Science pilot test.
This is important information for you to communicate district wide, especially with the high schools.
Overview of the CAST and the CAA for Science

5. Overview of the CAST and the CAA for Science
2017 CAST Pilot Purpose
Collect participation status of students
Try out newly developed item types
Test system functionality
Components: items, student survey, training tests, and student surveys will be available online via the test delivery system (TDS)
Each form has the student survey at the end of the test
Overview of the CAST and the CAA for Science

6. CAST Pilot Test Components
Each form will have 12–15 discrete items, and one performance task.
Student survey:
- One survey per student
- Approximately three to five questions
No more than seven minutes to complete
Estimated testing time is one hour.
The CAST pilot administration will serve as a signal of transition from the old science standards to the NGSS.
With this pilot test, we will be primarily focused on testing the performance of the newly developed items and item types.
Depending on the test form, the pilot test will have anywhere from items and a performance task.
Each form also includes a Student Survey at the end of the test questions.
All students will take the survey, which has 3-5 questions that should take no more than 5-7 minutes to complete.
The pilot test should take about an hour from start to finish.
Overview of the CAST and the CAA for Science

7. Test Administrator Survey
Collect feedback on the pilot test administration
One survey per Test Administrator
Approximately 10–12 questions
No more than 15 minutes to complete
We are also developing a teacher survey to collect teachers’ feedback on their experience with the pilot administration.
While the survey is optional, learning about their experience will help guide the development and administration of the CAST.
This is where we will need your support.
In the spring, we will send all LEA CAASPP coordinators a letter that includes a survey link.
You will then need to send the information to each teacher who has students participating in the pilot test.
Approx. 10–12 questions, designed to be completed in no more than 15 minutes.
Overview of the CAST and the CAA for Science

8. CAST Item Writing Challenges
Align to the CA NGSS Performance Expectations
Multidimensional and broad focus of Performance Expectations
Accessibility
Appropriate rigor
Content coverage
Depth of knowledge
Overview of the CAST and the CAA for Science

9. Overview of the CAST and the CAA for Science
CAST Training Test: The Next Step in Developing California’s New Science Test
Educator, students, parents, and stakeholders are encouraged to try out a small number of sample tasks and questions in preparation for the statewide pilot test in the spring.
Training test is tentatively scheduled to be available in early February.
Scoring rubric will be provided.
Overview of the CAST and the CAA for Science

10. Sample Grade Five Performance Task: Segment B
Passage
Constructed Response Item
Overview of the CAST and the CAA for Science

11. Sample Grade Five Performance Task: Drag and Drop—Multiple Section
Overview of the CAST and the CAA for Science

12. Sample Grade Eight Discrete Item: Segment A
Overview of the CAST and the CAA for Science

13. Sample Grade Eight Discrete Item
Student selected “Increases” from drop-down menu for the perch population. The graphs autopopulate for the perch and sea otter populations
Student selected “Decreases” from drop-down menu for the perch population. The graphs autopopulate for the perch and sea otter populations
Overview of the CAST and the CAA for Science

14. Sample Grade Eight Discrete Item: Drag and Drop Multiple Select
Overview of the CAST and the CAA for Science

15. Sample High School Performance Task: Segment B
Constructed Response Question
Overview of the CAST and the CAA for Science

16. Overview of Accessibility Features
Purpose: Evaluate functionality of some accessibility features
American Sign Language
Text-to-speech
Braille (refreshable and embosser)
Print on demand
Student eligibility will be determined by the accommodations identified as required in the student’s IEP and/or Section 504 plan.
Most universal tools will be available on both forms
Some students with specific support needs will get routed to a special test form
Prioritized the six accessibility features based upon three criteria:
Students’ need based on volume of accessibility features required by students for the Smarter Balanced 2014–15 administration indicating the critical nature of the accommodation for some groups of students to show what they know and can do; and
The expected complexity of interaction and/or incompatibility between each of these accessibility features and the functionality of selected CAST item types.
Overview of the CAST and the CAA for Science

17. Plan for 2017 CAST Accessibility
Pilot test and field test will include limited accessibility features
Operational test will include a full suite of accessibility features
Operational accessibility features will be determined by CAASPP regulations
CDE will recommend changes to the permanent regulations for State Board of Education approval to begin the rulemaking process in March 2017.
Overview of the CAST and the CAA for Science

18. California Alternate Assessment (CAA) for Science
Overview of the CAST and the CAA for Science

19. CAA for Science Implementation Timeline
Pilot Test (census)
Spring 2017
Field Test (census)
Spring 2019
Operational Administration
Spring 2020
Spring 2018
Overview of the CAST and the CAA for Science

20. Benefits of Collecting Embedded PTs
Shows student progress over time when collecting student work samples throughout the school year
Provides an opportunity for students to demonstrate performance “in real time”
Conforms to the principles of universal design
Offers the least restrictive environment for teacher/students to select/produce evidence
Supports the improvement of teaching and learning
Provides a minimally stressful and burdensome process for students
Promotes the delivery of challenging, yet developmentally appropriate, academic content to students
Overview of the CAST and the CAA for Science

21. CAA Preliminary CA NGSS Content Core Connectors
Educational Testing Service, in collaboration with their subcontractor edCount (the developers of the National Center and State Collaborative Connectors for ELA and mathematics), developed the preliminary CA NGSS alternate summative assessment Content Core Connectors (Connectors)
Purpose of the connectors is to provide learning goals aligned appropriately with the needs of students with the most significant cognitive disabilities
Connectors are posted to the CDE CAASPP California Alternate Assessments Web page at
Overview of the CAST and the CAA for Science

22. CAA for Science Pilot Test Overview
The CAA for science will be a new type of alternate assessment for science.
The embedded Performance Task will provide the construct being measured and allow flexibility where appropriate.
Tasks are designed to be adjustable according to how each student is taught science concepts.
The embedded Performance Task explains which parts can and cannot be changed by the test examiner.
Remember, this year is a pilot, and we want feedback on…
How it works for your students.
How it works for test examiners.
Additional Talking Point: Embedded PT responses will be kept at a district level for one year. Should be kept until LEAs are informed otherwise. Need to be kept secure.
Overview of the CAST and the CAA for Science

23. Overview of the CAST and the CAA for Science
Grade 5 Example
Connector Term
Description
Performance Expectation:
5-PS1–3. Make observations and measurements to identify materials based on their properties.
Connector
Classify through observation materials (e.g., shape, texture, buoyancy, color, magnetism, solubility) by physical properties.
Focal Knowledge, Skill, and Abilities
FKSA: 1: Ability to classify materials by physical properties.
Essential Understanding
Match materials with similar physical properties (e.g., color, hardness, response to magnets).
Overview of the CAST and the CAA for Science

24. Example of CAA for Science
We’ve included this screenshot just as an example of the balance of flexibility and standardization on the test.
In this example, the test examiner is prompted to select two physical properties and four types of materials that should be used.
Note that the list of physical properties does not have an “other” option.
However, you do have the option to use materials alternate to the ones listed on this screen.
In this way, the CDE is making clear what to do and what not to do in this task.
The test examiner has some degree of freedom with this particular assessment.
If the test examiner does not want to choose which physical properties to test, the embedded Performance Task will offer an exemplar, as indicated by the asterisk, of which physical properties and materials to use.
Overview of the CAST and the CAA for Science

25. Example of CAA for Science
This is an observation data table specifically for the exemplar. Manipulatives (i.e. the physical object to interact with) do not have to be used, but they are an option.
Overview of the CAST and the CAA for Science

26. Challenges of Collecting Embedded PTs
Some educators may see the use of the embedded PTs as distinct from the instructional process.
Scoring and professional development activities can be costly.
Extra vigilance is required to ensure technical integrity.
Overview of the CAST and the CAA for Science

27. Overview of the CAST and the CAA for Science
How to Get Involved in the Development of the CAST and the CAA for Science
Opportunities for California educator involvement may include:
Item writing
Item review
Form review
Scoring
Data review
Rangefinding
To get involved, complete the content
reviewer application at
Overview of the CAST and the CAA for Science