1. California Assessment of Student Performance and Progress (CAASPP) IUSD SBAC Spring 2014 Field Test Workshop for Test Adminstrators Spring, 2014

2. Before we start Security Affidavit – please sign and leave for me PowerPoint presentation CAASPP is new STAR; California Assessment of Student Performance and Progress SBAC – Smarter Balanced Assessment Consortium

4. Purpose of the Smarter Balanced Field Test “Test the test” Evaluate testing software Ensure quality of test questions Evaluate the effectiveness of the test administration and training materials Establish scoring and reporting levels “Dress rehearsal” for operational assessments in 2015 − “Stress test” LEA technology − Familiarize educators, administrators, and students with online testing

5. Field Test Participation in California Who will take the Field Test? − Grades 3–8: All students − Grades 9 and 10: Only students selected for the scientific sample − Grade 11: Students selected for the scientific sample; all others encouraged to participate The only students exempt from participating in the Field Test are: − Students participating in the California Alternate Performance Assessment (CAPA) − For the English language arts/literacy (ELA) test only, English learners (ELs) who have been attending school in the United States for less than 12 months

6. 5% of students will take Field Test items from one content area (ELA or mathematics). 95% of students will take Field Test items from both content areas. All students will receive one Performance Task (PT) in either ELA or mathematics. There is roughly same amount of testing time for all students. Content areas will be assigned by grade and school level. Content area assignments will be available in March (projected availability, 3/10). There are four scenarios: Field Test Participation in California ELA+Math, with ELA PTELA+Math, with Math PT ELA, with ELA PTMath, with Math PT

7. Examples of Field Test Participation in California Example 1: Elementary School X − Grade 3 was assigned a single content area (ELA), which includes an ELA performance task (PT). − Grade 4 was assigned both ELA and math, with a mathematics PT. − Grade 5 was assigned both ELA and math, with an ELA PT. Example 2: High School Y − Grade 11 is not in the sample, but they are volunteering to test. They were assigned ELA and math with an ELA PT.

8. Field Test Format Note: The Field Test is computer-based, not computer adaptive. Need to try out the test questions during the Field Test before tests can be made adaptive for the first operational administration in 2015. Two components: Performance task (PT) A set of complex questions that is centered on a common theme or problem; requires classroom activity Non–performance task (non-PT) E.g., Selected Response, Drag and Drop, Matching Tables

10. Test Administrator (TA) Carefully and completely read and sign new security affidavit. Complete test administration training. View student information prior to testing, to ensure it is correct. Ensure that appropriate designated supports and accommodations have been set prior to testing. Set up and proctor testing. Report all potential test security incidents to the School Coordinator Increase comfort levels and reduce anxiety of students. − Encourage students to do their best.

11. Additional Resources California Online Field Test Administration Manual − Available at http://californiatac.orghttp://californiatac.org Use only California specific information from this site. SBAC only info may not pertain to California. − Please take advantage of the role-specific checklists in the appendixes. Test Administrator Series of video training modules produced by Smarter Balanced: − Available at http://sbac.portal.airast.org/ca/field-test- ca/resources/http://sbac.portal.airast.org/ca/field-test- ca/resources/

13. Secure Browser Specifically designed by Smarter Balanced to provide secure access to the Field Test. Prevents students from accessing other hardware and software functions. A secure browser will be installed on all student computers/devices. ‘ Test Administrator computers will use a standard Web browser.

14. Secure Browser (cont.) Students must use the secure browser to log in to the Student Interface and access the Field Test. Prohibits access to external applications or navigation away from the test Prior to testing, TAs should verify that: External user applications are closed The secure browser will not work if the computer detects that a forbidden application is running.

16. Field Test Item Types Selected response one correct response multiple correct responses two-part Matching tables yes/no true/false Fill-in tables Select or order text or graphics Drag and drop Graphing Equation or numeric response Short text Long essay

17. Training Tests Released on January 30. Available by grade band (3–5, 6–8, and high school) There are 6–8 items per content area per grade band Allow students to experience updated interface features and functionality. Do not include PTs or scoring guides. Teachers are encouraged to conduct a group walk-through with students. Two ways to access Training Tests: Web TA interface

18. Practice Tests Released in May 2013. Available for grades 3–8 and grade 11 in ELA and mathematics. Approximately 30 items per test, including one PT and scoring guide. Archived Practice Test Webcast is available on http://californiatac.org. http://californiatac.org

19. Accessing the Training Tests and Practice Tests California Smarter Balanced Portal: http://sbac.portal.airast.org/ca/practice-test-ca/ http://sbac.portal.airast.org/ca/practice-test-ca/

20. Screenshot of Practice Tests and Training Tests

22. Field Test Student Registration LEA 1 CDE CALPADS System 2 TIDE 3 Student demographic data Student registration Designated supports and accommodations

23. Importance of CALPADS CALPADS is the sole source for student demographic and program participation data for TIDE. Student accommodations and supports will not be uploaded in CALPADS. LEAs cannot update student demographic or program participation data in TIDE; must be updated in CALPADS.

24. Student Registration The student’s grade level must be correct in TIDE before testing. (Only correctable in CALPADS.) Eligible students must appear in TIDE. If a student’s designated supports and accommodations information is incorrect, it must be updated in TIDE before he or she can test. (This can be done at the school level)

25. More on TIDE TIDE Training Video is available: http://sbac.portal.airast.org/wp- content/uploads/presentations/TIDE/ http://sbac.portal.airast.org/wp- content/uploads/presentations/TIDE/

27. Scheduling Testing Time: Things to Note Non-PT items and PTs will be presented in up to three separate tests. − For 95%, 3 tests total: 2 condensed non-PT tests (ELA and math) and 1 PT − For 5%, 2 tests total: 1 non-PT test (ELA OR Math) and 1 PT in same content area − ELA PTs have 2 parts; math PTs have 1 part − Reminder: Overall testing time will be the same, regardless of content assignment (approximately 3.5–4 hours).

28. Scheduling Testing Time: Things to Note Estimated testing times are available in the California Online Field Test Administration Manual. http://sbac.portal.airast.org/wp- content/uploads/2014/02/CAASPP-Field-Test- Administration-Manual.pdf http://sbac.portal.airast.org/wp- content/uploads/2014/02/CAASPP-Field-Test- Administration-Manual.pdf Note: The estimates do not account for any time needed to start computers, load secure browsers, and log in students. Scheduling is a collaborative effort. Each school is assigned a 6-week window.

29. Scheduling Testing Time: Things to Note Recommended: Non-PT first, PT second. Classroom activity should be completed within 3 days prior to starting the PT. ELA PTs have 2 parts and can be completed over 2 days. Math PTs have 1 part and can be completed in 1 day. Recommended: PT should not be administered on the same day as non-PT.

30. Scheduling Considerations for Special Populations Students taking CAPA will appear in TIDE but should not be tested. English Learners in US schools for 12 months or less should not be given any ELA items. SCs must ensure that TAs know which students are not to take the Field Test. Schedule activities for students not taking exam (or that finish early).

31. Example Testing Schedules Example 1: For a grade taking both content areas and an ELA PT. Example 2: For a grade taking one content area and assigned mathematics MondayTuesdayWednesdayThursdayFriday All Math non-PTAll ELA non-PTClassroom activity ELA PT Part 1ELA PT Part 2 MondayTuesdayWednesdayThursdayFriday Non-PT Math Session 1 Non-PT Math Session 2 Non-PT Session 3 Math PT Classroom activity

32. Establishing Appropriate Testing Conditions Testing students in classroom-sized groups is preferable. Reduces test fear and anxiety Facilitates monitoring and control for TAs Administer in a room that does not crowd students. Room should have good lighting, ventilation, and freedom from noise and interruptions. Displayed information (on bulletin boards, chalkboards, or dry-erase boards, etc.) that might be used by students to help answer questions must be removed or covered, including: Rubrics, vocabulary charts, student work, posters, graphs, charts, etc.

33. Establishing Appropriate Testing Conditions (cont.) Cell phones or other electronic devices are not allowed to be used during testing (i.e., turned off and put away). Place a “TESTING—DO NOT DISTURB” sign on the door. Post an “Unauthorized Electronic Devices May Not Be Used at Any Time During the Testing Session” sign so that it is clearly visible to all students. May also be helpful to post signs in halls and entrances rerouting hallway traffic.

34. Establishing Appropriate Testing Conditions (cont.) Make appropriate seating arrangements prior to test administration. Students should be seated so that they cannot view the answers of others. Establish procedures to maintain a quiet testing environment throughout the test session. Remember that some students will finish more quickly than others.

35. Test Administrator Interface TAs need to use the interface to administer a test session. Or you can view the training video at this link: http://sbac.portal.airast.org/wp- content/uploads/presentations/tainterface/

36. General Rules During the Field Test Students must answer all test items on a page before moving on to the next page. Students may not return to a test segment once it has been completed and submitted. Students must answer all test items before the test can be submitted. Students may not return to a test once it has been completed and submitted. There is a difference between “segment” and “session.” Expiration and pause rules vary between PT and non-PT.

37. Classroom Activity Administration Guidelines Classroom Activity Purpose: To provide students with important context, concepts, and key terms prior to taking the PT. All students will have a classroom activity before they complete a PT in the assigned content area. May be administered in a classroom or any other appropriate space. May take place on a separate day from the PT. Recommended: No more than a 3-day lapse between the classroom activity and the PT administration. TA may need a chalkboard or dry-erase board.

38. Classroom Activity Administration Guidelines (cont.) Computers, projectors, and other technology are allowed but not required for the classroom activity. Involves the participation of all students in an instructional task. PT will be completed by individual students in the computer-based test delivery system. Students may take notes during the classroom activity, but the notes must be collected before proceeding to the PT.

39. Classroom Activity Administration Guidelines (cont.) Designed to fit into a 30-minute window. Will vary due to complexity of topic and individual student needs. After receiving the activity from the School Coordinator, the TA or classroom teacher should administer the classroom activity. Provide the appropriate accommodations for students who normally use them during instruction.

41. Universal Tools: Available to all; based on student preference and selection (e.g., breaks, strikethrough, highlighter). Designated Supports: Need to be indicated by an educator or group of educators (e.g., color contrast, read aloud, glossary, magnification). Accommodation: Based on individualized education programs (IEPs) or Section 504 plans (e.g., American Sign Language, scribe). What are Universal Tools, Designated Supports, and Accommodations?

42. The FT includes embedded and non-embedded universal tools, designated supports, and accommodations to maximize accessibility. Embedded: part of the computer administration (i.e., digital notepad, calculator) Non-embedded: provided outside the computer administration (i.e., scratch paper, multiplication table) Universal Tools, Designated Supports, and Accommodations on the Field Test

43. Universal Tools, Designated Supports, and Accommodations

44. Both School Coordinators are authorized to set supports and accommodations for students. Two ways: one-by-one or upload file Must be set prior to the test session Accommodations can be set immediately prior to the student test. Set in system by content area. Designating Supports and Accommodations

45. More on student supports Training video available at this link: http://smarterbalanced.articulate- online.com/p/7753269018/DocumentViewRouter.ashx?C ust=77532&DocumentID=3d28a842-e6df-4267-8449- bc1afb4cba72&Popped=True&InitialPage=presentation. html

47. Accessing TIDE Users may access a link to the California Smarter Balanced Portal http://sbac.portal.airast.org/ca/field-test-ca/ http://sbac.portal.airast.org/ca/field-test-ca/ Selecting the portal link will bring you to the page below.

48. Accessing TIDE Select the Online TIDE System for California Users card. When logging into TIDE for the first time, users will be prompted to change their password. Same password is used for TIDE and the TA Interface – single sign-on.

49. TIDE: Logging In To log in, the user should enter his or her username and password.

50. Navigating TIDE The TIDE interface uses tabs as the principal means of navigating between tasks. Some tasks in the TIDE interface contain multiple sub-tasks. TIDE shows only the features that are available to the user based on his or her role.

51. TIDE: Student Information Tab The Student Information tab may be used to: Search for existing student records Export a list of existing student records View an existing student record View and update student test settings

52. TIDE: View Student Information To search for existing student records, select the sub-tab [View Students]. Select a district and school from the drop-down menu. Note: Users only have access to students in districts and schools with which they are associated in TIDE.

53. TIDE: View Student Information To help narrow results, search by First Name, Last Name, SSID, Confirmation Code (first name) and/or grade. You can select Add Additional Search Criteria to include Test Settings in your search.

54. TIDE: Export a List of Students The search will result in a table similar to the one shown below. Results may be sorted by selecting the column header above the data. It may be helpful to export a list of students in order to verify the correctness of their information and assist them in logging in to the test. It will also be useful to verify student supports. −Users may export the full results table or a subset of those results in Excel or CSV format.

55. TIDE: View a Student Record To view a student’s record, select the [View] button for that record.

56. TIDE: View Student Information Student demographic data is read-only. Changes must be submitted to CALPADS and will be reflected within 48 hours.

58. Test Administrator Interface TAs need to use the interface to administer a test session. The Test Administrator User Guide will be available on the California Smarter Balanced portal under Field Test > Resources and Documentation. – This document will contain complete instructions on how to complete tasks in the Test Administrator Interface. Reminder: The easiest way to reach the California Smarter Balanced Portal is by visiting http://sbac.portal.airast.org/ca/field-test-ca/ http://sbac.portal.airast.org/ca/field-test-ca/

59. Accessing the Test Administrator Interface The TA Interface button will be available to select. The TA Interface isn’t available yet so it’s still grayed out. Should be available soon.

60. Starting a Test Using the TA Interface (not TIDE), TAs must start a test session before students can log in to a test. A test can be selected by selecting the checkbox next to the test’s name.

61. Student Login To log in to the Field Test, each student will need: − Confirmation Code: Student’s legal first name as spelled in CALPADS − State-SSID: State abbreviation (CA) followed by a hyphen and the student’s Statewide Student Identifier − Session ID Note: TAs must follow the “DFA SAY” script exactly each time a test is administered. Refer to the DFA section of the Test Administration Manual.

62. Confirmation Code: Irene State-SSID: CA-xxxxxxxxxx Session ID: Demo1234 10/23/2015

63. Distributing Student Login Information We are prohibited from providing the student’s name and SSID (statewide student identifier) number in written or electronic format. The district will find a solution and let us know how we can provide this information to students. − TAs may also write the Test Session ID on the board or where students can see it. − Make sure students know that the Test Session ID must be entered exactly as it is written, without extra spaces or characters.

64. Student Lookup Feature

65. Viewing Student Test Settings and Approvals [Approvals] button is not selectable. [Approvals] button says “[Approvals (0)].” Preview table says “No students awaiting approval.” [Approvals] button is selectable. [Approvals] button says “[Approvals (#)].” Preview table lists each student and his or her selected test.

66. Approving Students for Testing TAs can either select [Approve] for each individual student (recommended) or select [Approve All Students]. Reminder: If any student’s test settings are incorrect, do NOT approve that student. To refresh the list of students awaiting approval at any time, select the [Refresh] button at the top of the pop-up window.

67. Test Settings and Accommodations Confirm or select settings. Select [Set] to confirm the current test settings and return to the list of students awaiting approval. You will still have to approve the student for testing. Select [Set & Approve] to establish the updated settings and approve the student for testing. Select [Cancel] if you want to return to the Approvals and Student Test Settings screen.

68. Monitoring Student Progress The “Students in Your Test Session” table displays students who have logged in and been approved for testing.

69. Pausing Tests Through the TA Interface, TAs may: – Stop an entire session; or – Pause individual student tests. Users should exit or log out of the Test Administrator Interface only after stopping the test session. Note: If a test is paused for any reason or length of time, the student must log in again to resume testing. Highlighted text and item notes will not be preserved.

70. Pausing Tests If there is a technical issue (i.e. power outage or network failure), students will be logged out and the test will automatically be paused. Regardless of when or how users log out or navigate away from the Test Administrator Interface, student data will NOT be lost. If you have difficulty with the computer you’re using as a TA you can transfer to another computer without stopping the session.

71. Pause Rules During the Field Test: Non–Performance Task During the non-PT test, if testing is paused for more than 20 minutes, the student is: − Presented with the test page containing the test item he or she was last working on (if page contains at least 1 unanswered item) OR − Presented with the next test page (if all items on the previous test page were answered); − NOT permitted to review or change any test items on previous test pages.

72. Pause Rules During the Field Test: Performance Task There is no pause rule for the performance task. − Even if a test is paused for 20 minutes or more, the student can return to the current section and continue. ELA PTs are divided into 2 parts. After a student completes Part 1, he or she cannot return to it.

73. Test Timeout Due to Inactivity As a security measure, students are automatically logged out of the test after 20 minutes of inactivity. Activity means: − Selecting an answer − Using a navigation option in the test (i.e. selecting [Next] or [Back], using the Past/Marked Questions drop-down list) − NOTE: Moving the mouse or selecting an empty space on the screen is NOT considered activity.

74. Test Timeout Due to Inactivity (cont.) Before the system logs out, a warning message will be displayed. − If a student does NOT select [Ok] within 30 seconds, the student will be logged out. − Selecting [Ok] will restart the 20 minute inactivity timer.

75. Stopping Tests: Entire Session To stop the session (and pause tests for all students in the session): –Select the [Stop Session] button in the upper-left corner of the screen. An “Important!” box will appear, requesting verification to end the session and log students out. –Select [OK] to continue or [Cancel] to keep the test session open.

76. Pausing Tests: Individual Students TAs may pause an individual student’s test in the Students in Your Test Session table. −This will not affect other students’ tests.

77. Student View of Testing When the secure browser is launched, it opens to this page.

78. Student View of Testing: Verifying Information

79. Student View of Testing: Test Selection

80. Student View of Testing: Test Administrator Approval The student will see the display above while waiting for the Test Administrator to approve the request for entry into the session.

81. Student View of Testing: Is This Your Test?

82. Student View of Testing: Sound Check

83. Student View of Testing: Test Instructions

84. Proceeding Through the Test To answer multiple-choice items, students must select the desired answer option or select the circle with A, B, C, or D. To answer machine-scored constructed-response items, students need to carefully follow the instructions given for each question.

85. Reviewing Items

86. Ending the Test

87. Questions 10/23/2015

88. TIDE video: http://sbac.portal.airast.org/wp- content/uploads/presentations/TIDE/http://sbac.portal.airast.org/wp- content/uploads/presentations/TIDE/ Student Interface video: http://sbac.portal.airast.org/wp- content/uploads/presentations/StInterface/ http://sbac.portal.airast.org/wp- content/uploads/presentations/StInterface/ TA Interface video: http://sbac.portal.airast.org/wp- content/uploads/presentations/tainterface/http://sbac.portal.airast.org/wp- content/uploads/presentations/tainterface/ 10/23/2015