Measuring the Power of Learning.™ Performance and Progress (CAASPP) 2015–16 Smarter Balanced Summative Assessments March 2016 California Assessment of Student

Measuring the Power of Learning.™ Agenda 2015–16 CAASPP Pretest Administration Workshop 2 Topic Welcome Overview Roles and Responsibilities Technology Practice Tests and Training Tests CAASPP User Account Accessibility Supports Test Administration Test Security Day of Testing Checklist & Questions

Measuring the Power of Learning.™ Overview

Who Takes What?

Measuring the Power of Learning.™ Student Participation: General 2015–16 CAASPP Pretest Administration Workshop 5 All students in grades 3–8 and grade 11 take the Smarter Balanced Summative Assessments with the following exceptions: – Students enrolled in or assigned to grades 3–8 and grade 11 whose IEP team designates the use of the California Alternate Assessments (CalAlts) for ELA and mathematics – English learners who have been enrolled in a school in the United States less than 12 months (ELA only)

Measuring the Power of Learning.™ Student Participation: Early Assessment Program 2015–16 CAASPP Pretest Administration Workshop 10 The Early Assessment Program (EAP) uses the high school Smarter Balanced Summative Assessments for ELA and mathematics. Students taking the Smarter Balanced Summative Assessments in high school may choose to release their test scores to the California State University (CSU) and participating California Community Colleges at the end of the computer adaptive tests. Students who do not authorize the release of their test scores to CSU and CCC at the time of testing may need to provide a copy of the CAASPP score report to the campus, upon request.

Measuring the Power of Learning.™ Pursuant to California Code of Regulations, Title 5, Section 852: Each year the local educational agencies (LEAs) are required to notify parents or guardians of their pupil's participation in the CAASPP tests. LEAs are required to inform parents of their right to exempt their child from taking the CAASPP tests. –Parents must annually submit a written request to the principal specifying the tests to be exempted. 2015–16 CAASPP Pretest Administration Workshop 7 Importance of Informing Parents and Guardians

Measuring the Power of Learning.™ Smarter Balanced Summative Assessments 2015–16 CAASPP Pretest Administration Workshop 8 Computer adaptive test (CAT): Students complete the CAT portion of the assessment for both ELA and mathematics. The CAT includes a wide variety of question types. As a student progresses, the difficulty of questions is adjusted on the basis of the student’s responses. –A student who answers a question correctly will receive a more challenging question –An incorrect answer will generate an easier question

Measuring the Power of Learning.™ Smarter Balanced Summative Assessments 2015–16 CAASPP Pretest Administration Workshop 9 Performance Task: Students complete a performance task for both ELA and mathematics. Classroom Activities are optional this year (available on MyConnect)

Measuring the Power of Learning.™ Scheduling Testing Time 2015–16 CAASPP Pretest Administration Workshop 10 Estimated testing times: Content AreaGradesComputer Adaptive Test (CAT) questions hrs : mins Performance Task (PT) hrs : mins Total hrs : mins Classroom Activity (administered prior to the PT)* hrs : mins English Language Arts/Literacy 3–5 6–8 11 1:30 2:00 3:30 4:00 :30 Mathematics3–5 6–8 11 1:30 2:00 1:00 1:30 2:30 3:00 3:30 :30 Both3–5 6–8 11 3:00 3:30 4:00 3:00 3:30 6:00 6:30 7:30 1:00

Measuring the Power of Learning.™ Scheduling Testing Time Recommended: Schedule the CAT first and the Performance Task (PT) second. –The optional classroom activity should be completed within 3 days prior to administering a Performance Task.  ELA PTs have 2 parts and can be completed over 2 days.  Mathematics PTs have 1 part and can be completed in 1 day. Recommended: PTs should not be administered on the same day as the CAT. CATCAT Optional Classroom Activity Performance Task 2015–16 CAASPP Pretest Administration Workshop 11

Measuring the Power of Learning.™ Roles and Responsibilities

Measuring the Power of Learning.™ Test Administrator Responsibilities 2015–16 CAASPP Pretest Administration Workshop 13 Read and sign the CAASPP Test Security Affidavit. Complete training and review all Smarter Balanced policy and administration documents prior to administering any Smarter Balanced assessments. Review student information prior to testing to ensure that the correct student receives the proper test with the appropriate supports and test settings. Administer the Smarter Balanced Summative Assessments. Report all potential test security incidents to the test site coordinator immediately.

Measuring the Power of Learning.™ Technology

Measuring the Power of Learning.™ Technology 2015–16 CAASPP Pretest Administration Workshop 15 NO streaming during testing Make sure headphones are available for all students Check volume setting on testing devices prior to logging into the secure browser

Measuring the Power of Learning.™ Practice Tests and Training Tests

Measuring the Power of Learning.™ 2015–16 CAASPP Pretest Administration Workshop 50 Smarter Balanced Practice Tests vs. Training Tests Practice Tests (Not for the CAA) Training Tests PurposeProvide students with a grade specific testing experience similar in structure and format to the summative assessments Provide students with an opportunity to quickly become familiar with the software and interface features Grade LevelsEach grade: 3–8, 11 Grade bands: 3–5 6–8 High school Number and Types of Questions Approximately 30 questions in ELA and 30 questions in mathematics per grade level; includes 1 ELA Performance Task and 1 mathematics Performance Task per grade level Approximately 15 questions per grade band (6 in ELA and 8–9 in mathematics); Performance Tasks are not available Universal Tools, Designated Supports, and Accommodations All ScoringTests are not scored, however answer keys and scoring rubrics are available Tests are not scored

Measuring the Power of Learning.™ Smarter Balanced Practice Tests 2015–16 CAASPP Pretest Administration Workshop 18 Practice Tests are available in each grade level for grades 3– 8 and grade 11 for ELA and mathematics. Each Practice Test contains approximately 30 questions. Performance tasks are available for both ELA and mathematics. Scoring rubrics and answers are available on the Test Administrators Resource Web page at All universal tools, designated supports, and accommodations are available. –Text-to-speech only available through secure browser. –Print-on-demand only available in proctored session.

Measuring the Power of Learning.™ Designed to try out the universal tools, designated supports, and accommodations to establish the most optimal test setting experience for the student Allow students and administrators to become familiar with the test delivery system and interface features Allow students to become familiar with: –Accessing the tests (log on process) –The testing software –The navigational tools –Embedded supports 2015–16 CAASPP Pretest Administration Workshop 19 Smarter Balanced and CAA Training Tests

Measuring the Power of Learning.™ Accessing the Practice and Training Tests 2015–16 CAASPP Pretest Administration Workshop 20 There are two means for accessing the Practice and Training Tests: 1.Through on a Web browserhttp:/ 2.Through the secure browser, which simulates operational online testing environment. Test administrators may create test sessions for the Practice Tests or Training Tests on the Test Administrator Practice and Training Site. –Students may return to a Practice Test and/or Training Test session.

Measuring the Power of Learning.™ CAASPP User Account

Measuring the Power of Learning.™ CAASPP User Accounts 2015–16 CAASPP Pretest Administration Workshop 22 You will NOT use the account log on information you used last year. You will receive an from with your temporary password which will Log in and set a new password Your username will be your full PUSD address

Measuring the Power of Learning.™ Accessibility Supports

Measuring the Power of Learning.™ Accessibility Supports 2015–16 CAASPP Pretest Administration Workshop 24 Universal Tools: –Available to all; based on student preference and selection (e.g., strikethrough, highlighter) Designated Supports: –Available to all; need to be indicated by an educator or guardian (e.g., color contrast, read aloud, glossary, magnification) Accommodations: –Based on IEPs or Section 504 plan (e.g., American Sign Language, scribe)

Measuring the Power of Learning.™ Accessibility Supports 2015–16 CAASPP Pretest Administration Workshop 25 Should be regularly used in the classroom The online assessments include embedded and non-embedded accessibility supports: –Embedded: part of the computer administration (e.g., digital notepad, calculator) –Non-embedded: provided outside the computer administration (e.g., scratch paper, multiplication table)

Accessibility Supports 2015–16 CAASPP Pretest Administration Workshop 90 *Must be activated in the test delivery system. **If you have students requiring Print On Demand-you will receive separate instructions and training from the Testing Office EmbeddedNon-Embedded Designated SupportAccommodationDesignated SupportAccommodation Color contrastAmerican Sign Language (ELA listening and math questions) Bilingual dictionary (ELA Performance Task full writes) Abacus MaskingBrailleColor contrastAlternate response options Text-to-speech (ELA and math questions) Closed captioning (ELA listening questions) Color overlay Calculator (math—allowed questions Grades 6–8, 11) Translations (glossaries) (math questions) Streamlined interfaceMagnification Multiplication table (math - Grades 4–8, 11) Translations (stacked) and Translated test directions ( for math - Spanish) Text-to-speech (ELA reading passages) Noise buffersPrint on demand** Print sizeRead aloud (ELA and math questions) Read aloud passages (ELA) Permissive mode Scribe (ELA non-writing and math questions) Scribe (ELA Performance Task full write) Turn off any universal tools*Separate settingSpeech-to-text Read aloud in SpanishUnlisted resources Translation (glossaries) (only paper pencil math tests) Additional alternate assessment instructional supports (CAAs only) Translated test directions (for online ELA and math questions)

Measuring the Power of Learning.™ Ordering Accessibility Supports 2015–16 CAASPP Pretest Administration Workshop 27 Special Education Students ELL Students504 Students General Education Students WhoCase ManagersELL Coordinator504 CoordinatorPrincipal WhereSEISCAASPP Test Settings Site WhenDeadline 4/1/16 HowComplete Statewide Assessment form (either during regularly scheduled IEP meeting or as an Amendment) Complete CAASPP Test Settings form in MyPLAN*

Measuring the Power of Learning.™ Test Administration

Measuring the Power of Learning.™ Establishing Appropriate Testing Conditions 2015–16 CAASPP Pretest Administration Workshop 29 Testing students in classroom-sized groups is preferable: –Reduces test fear and anxiety –Facilitates monitoring and control for test administrators Room should have good lighting and ventilation, and be free of noise and interruptions. Remove or cover displayed information (on bulletin boards, chalkboards, and dry-erase boards, etc.) that may be used by students to help answer questions: –Rubrics, vocabulary charts, student work, posters, graphs, charts, etc.

Measuring the Power of Learning.™ Establishing Appropriate Testing Conditions 2015–16 CAASPP Pretest Administration Workshop 30 Make appropriate seating arrangements prior to test administration: –Students should be seated so that they cannot view the answers of others. Establish procedures to maintain a quiet testing environment: –Remember that some students may finish more quickly than others.

Measuring the Power of Learning.™ Establishing Appropriate Testing Conditions 2015–16 CAASPP Pretest Administration Workshop 31 Cell phones or other electronic devices are not allowed to be used during testing (e.g., they must be turned off and put away). Smart watches* Post an “Unauthorized Electronic Devices May Not Be Used at Any Time During the Testing Session” sign inside the classroom so that it is clearly visible to all students while testing. Place a “TESTING—DO NOT DISTURB” sign on the outside of the door.

Measuring the Power of Learning.™ General Test Rules 2015–16 CAASPP Pretest Administration Workshop 32 Students must answer all test questions on a page (i.e., screen) before moving on to the next page. Students may not return to a test segment once it has been completed and submitted. Students must answer all test questions before the test can be submitted. Students may not return to a test once it has been completed and submitted. Test administrators must follow the “SAY” script in the DFA exactly each time a test session is administered.

Measuring the Power of Learning.™ Testing Tickets Test administrators need to distribute Student Logon Information to students with their SSID and official full first name immediately prior to testing. Class sets of these ‘Testing Tickets’ can be found in the SRC (under ‘Misc’ > Testing Tickets Report). Important: Student personal information is secure and must be collected and securely stored at the end of a test session, then securely destroyed at the end of the test administration. 2015–16 CAASPP Pretest Administration Workshop 33 “(4) (A) I will keep all assigned, generated, or created usernames, passwords, and logins secure and not divulge pupil personal information to anyone other than the pupil to whom the information pertains for the purpose of logging on to the test delivery system.” CAASPP TEST SECURITY AFFIDAVIT “(4) I will securely destroy all print-on-demand papers, scratch paper, and other documents as prescribed within the contractor’s(s’) or consortium’s administrative manuals and documentation.” CAASPP TEST SECURITY AGREEMENT

Measuring the Power of Learning.™ Print Out - Accessibility Supports Site Coordinators can print a list of all requested Accessibility Supports for each student at their site by logging into MyPLAN. 2015–16 CAASPP Pretest Administration Workshop 34 Test Administrators must have a print out of the Accessibility Supports for the students in their test session. Classroom teachers are able to print out a list of Supports for each student at the CAASPP Test Settings MyPLAN site.

Measuring the Power of Learning.™ Administering a Test Session 1.The test administrator logs on to the Test Administrator Interface from on a standard Web browser –16 CAASPP Pretest Administration Workshop 35 2.Or log on via the icon in Zenworks/Novell

Measuring the Power of Learning.™ Administering a Test Session 2.The test administrator selects the test category (click on the + sign, not the box). Choose purple 2015–16 CAASPP Pretest Administration Workshop 36

Measuring the Power of Learning.™ Administering a Test Session 3.The test administrator selects the tests to administer. –Additional tests can be added to a session; you will receive a confirmation message box. 4.The test administrator starts a test session. 2015–16 CAASPP Pretest Administration Workshop 37 Be sure not to check all tests, as students will have the option to choose these.

Measuring the Power of Learning.™ Administering a Test Session 5.The test administrator informs students of the test Session ID. –Write or display it clearly in a place all students can see. –Session IDs are automatically generated upon selecting the Start Session button. Additional tests can be added to a session; a confirmation message box confirms adding tests to a session. 2015–16 CAASPP Pretest Administration Workshop 38

Measuring the Power of Learning.™ Administering a Test Session 6.Students log on through the secure browser. –To log on, students need:  First Name: Student’s legal first name as spelled in CALPADS  State-SSID: “CA” followed by a hyphen “-” and the student’s SSID  Session ID: Test administrator-generated Session ID 2015–16 CAASPP Pretest Administration Workshop 110

Measuring the Power of Learning.™ Administering a Test Session 7.Students verify their identity. –After logging on, students will see the “Is This You?” screen. –Students should select Yes to continue if the information on the screen is correct. 2015–16 CAASPP Pretest Administration Workshop 40

Measuring the Power of Learning.™ Administering a Test Session 8.Student selects the test. –All grade-level tests that the student is eligible to take are displayed. –Only the tests that the test administrator has selected for the test session and those that have not been completed are selectable by students. Note: Only the tests that have been selected by the test administrator will appear active. Others will be grayed out. 2015–16 CAASPP Pretest Administration Workshop 41

Measuring the Power of Learning.™ Administering a Test Session 9.Upon selecting a test, students wait for test administrator approval. 10. As students select tests, the test administrator can see approvals populate in the Approvals queue of the Test Administrator Interface. 2015–16 CAASPP Pretest Administration Workshop 42

Measuring the Power of Learning.™ Administering a Test Session 11. The test administrator selects the Approvals (#) button to access the Approvals and Student Test Settings screen. 2015–16 CAASPP Pretest Administration Workshop 43

Measuring the Power of Learning.™ Administering a Test Session 12. The test administrator verifies that the students have selected the appropriate test and reviews the students’ test settings by selecting See Details button next to each student. 2015–16 CAASPP Pretest Administration Workshop 44

Measuring the Power of Learning.™ Administering a Test Session 2015–16 CAASPP Pretest Administration Workshop 45 Check that Accessibility Supports matches the printed list

Measuring the Power of Learning.™ Administering a Test Session 13.The test administrator selects Set to confirm the current test settings and return to the list of students awaiting approval. The test administrator still must approve the student for testing OR 14.The test administrator selects Set & Approve to establish the existing settings and approve the student for testing. Note: If a student’s test settings are incorrect, test administrators should deny the student, contact the test site coordinator, and test the student at a later time. 2015–16 CAASPP Pretest Administration Workshop 46

Measuring the Power of Learning.™ Administering a Test Session 15.Upon reviewing test settings for all students, the test administrator approves students to test on the Approvals and Student Test Settings screen. –Select Approve to approve a specific student for testing. –Select Approve All Students to approve all students. 2015–16 CAASPP Pretest Administration Workshop 47

Measuring the Power of Learning.™ Administering a Test Session 16.After the test administrator has approved a student for testing, the student verifies the test information and settings. The student will select Yes, Start My Test to begin testing or No if the settings are incorrect. 2015–16 CAASPP Pretest Administration Workshop 48

Measuring the Power of Learning.™ Administering a Test Session 17. If a student has a text-to-speech accommodation or is taking a test with ELA listening questions, he or she will verify the audio checks through headphones. Text-to-speech audio check 2015–16 CAASPP Pretest Administration Workshop 120 Test with listening questions audio check

Measuring the Power of Learning.™ Administering a Test Session 18.Finally, students will see the Test Instructions and Help page before they begin testing. Students will select Begin Test Now to begin testing. 2015–16 CAASPP Pretest Administration Workshop 50

Measuring the Power of Learning.™ Monitoring Student Progress Test administrators can monitor student testing through the Students in Your Test Session table on the Test Administrator Interface: –Displays students who have logged in and been approved for testing. 2015–16 CAASPP Pretest Administration Workshop 51

Measuring the Power of Learning.™ Pausing Tests Test administrators may pause an individual student’s test in the Students in Your Test Session table. –This will not affect other students’ tests. 2015–16 CAASPP Pretest Administration Workshop 52

Measuring the Power of Learning.™ General Pause Rules 2015–16 CAASPP Pretest Administration Workshop 53 If there is a technical issue (e.g., power outage or network failure), students will be logged out, and the tests will automatically be paused. If a test is paused, the student must log in again to resume testing. Highlighted text is preserved during test sessions. Student comments entered on a notepad are preserved.

Measuring the Power of Learning.™ Smarter Balanced Pause Rules: Computer Adaptive Test 2015–16 CAASPP Pretest Administration Workshop 54 If a CAT is paused for more than 20 minutes, the student is: –Presented with the test page (i.e., screen) containing the test question he or she was last working on (if the page contains at least 1 unanswered question) OR presented with the next test page (if all questions on the previous test page were answered) –Not permitted to review or change any test questions on previous test pages If a CAT is paused for less than 20 minutes, the student is: –Presented with the test question or passage he or she was working on when the test was paused –Permitted to answer previously shown questions within a segment

Measuring the Power of Learning.™ Pause Rules: Performance Task 2015–16 CAASPP Pretest Administration Workshop 55 There are no pause rules for Performance Tasks. –Even if a Performance Task is paused for more than 20 minutes, the student can return to the current section and continue. ELA Performance Tasks are divided into two parts. –After a student completes the first part, he or she cannot return to it. Global notes transfer.

Test Timeout Due to Inactivity As a security measure, students are automatically logged out of the test after 30 minutes of inactivity. Activity means: –Selecting an answer –Using a navigation option in the test (e.g., selecting Next or Back, using the Questions drop-down list) Note: Moving the mouse or selecting an empty space on the screen is not considered activity. Before the system logs out, a warning message is displayed. 2015–16 CAASPP Pretest Administration Workshop 56

Measuring the Power of Learning.™ Stopping an Entire Test Session Test administrators can stop a test session (and therefore, pause tests for all students in the session) –Select the Stop Session button in the upper-right corner of the Test Administrator Interface. –An “Important!” box will appear, requesting verification to end the session and log students out. –Select OK to continue or Cancel to keep the test session open. 2015–16 CAASPP Pretest Administration Workshop 57

Measuring the Power of Learning.™ Reaching the End of the Test 1.After students answer the last question on the test, the End Test button will appear in the upper-left corner of the screen. 2015–16 CAASPP Pretest Administration Workshop 58

Measuring the Power of Learning.™ Reaching the End of the Test 2.Upon selecting the End Test button, an “Attention” message will appear. –Students will select [Yes] to proceed with reviewing answers and submitting the test. 2015–16 CAASPP Pretest Administration Workshop 130

Measuring the Power of Learning.™ Reaching the End of the Test 3.Students may review answers before submitting a test. 2015–16 CAASPP Pretest Administration Workshop 60

Measuring the Power of Learning.™ Reaching the End of the Test 4.When a student is ready to submit the test, he or she will receive a confirmation screen. Be sure students see this screen. If the student does not click submit test, their test will be paused and it will expire if they do not finish and submit. 2015–16 CAASPP Pretest Administration Workshop 61

Measuring the Power of Learning.™ Test Expiration Rules 2015–16 CAASPP Pretest Administration Workshop 62 A student’s CAT remains active until the student completes and submits the test, or 45 calendar days after the student has begun the CAT. A student’s Performance Task remains active for 10 calendar days after the student has begun it.

Measuring the Power of Learning.™ Test Security

Measuring the Power of Learning.™ Test Security and Appeals 2015–16 CAASPP Pretest Administration Workshop 64 There are three different types of test security incidents: 1.Impropriety 2.Irregularity 3.Breach Social media and other Web sites will be monitored daily for postings of secure materials.

Measuring the Power of Learning.™ Test Security Incidents Type and Examples 2015–16 CAASPP Pretest Administration Workshop 65 Type of Security IncidentExampleExample Test ImproprietyStudents talking during testing; A student is unable to complete the test before it expires due to an unanticipated excused absence or unanticipated school closure. Test IrregularityStudent cheating or providing answers to one another Test IrregularityStudent accessing or using electronic equipment (e.g., cell phone) Test BreachAdministrator or coordinator modifying student responses or record at any time Test BreachAdministrator allowing students to take home test questions, passages, prompts, or scratch paper

Measuring the Power of Learning.™ Test Impropriety 2015–16 CAASPP Pretest Administration Workshop 140 Unusual circumstance that has a low impact on the testing individual or group of students Low risk of affecting student performance, test security, or test validity Correctable and containable at local level Must be reported to your Site Coordinator immediately

Measuring the Power of Learning.™ Test Irregularity 2015–16 CAASPP Pretest Administration Workshop 67 Unusual circumstance that impacts the testing individual or group of students May affect student performance, test security, or test validity Correctable and containable at local level Must be reported to your Site Coordinator immediately

Measuring the Power of Learning.™ Test Breach 2015–16 CAASPP Pretest Administration Workshop 68 Event that threatens test validity (e.g., release of secure materials) Example: Student or administrator takes a photograph and posts to social media External implications for the Consortium Must be reported to your Site Coordinator immediately

Measuring the Power of Learning.™ Day Of Testing Checklist DFA “No Unauthorized Electronic Devices” sign Testing Tickets Accessibility Supports print out

Measuring the Power of Learning.™ Linda Meloney Testing Help Desk NEW DIRECT LINE: (858) My Connect Questions NEW