1. Measuring the Power of Learning.™ California Assessment of Student Performance and Progress (CAASPP) Configuring Online Student Test Settings in TOMS October 28, 2015 1–2 p.m. Presented by Kristen Moore, ETS

2. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 2 Purpose The purpose of this Webcast is to go over how to set embedded and non-embedded designated supports and accommodations for students in the Test Operations Management System (TOMS).

3. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 3 Agenda Overview One by One Process in the User Interface File Upload Process –Using the Online Student Test Settings template –Using the 2015–16 CAASPP Individual Student Assessment Accessibility Profile (ISAAP) Tool Live Demonstration Questions

4. Measuring the Power of Learning.™ Overview

5. Configuring Online Student Test Settings in TOMS 5 Overview Entering student test settings in TOMS ensures students receive the assigned accessibility supports for the online Smarter Balanced assessments. CAASPP Coordinator and Test Site Coordinator are the ONLY roles with access to configure online student test settings in TOMS.

6. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 6 Overview Access to Configure Student Test Settings by Role Role System Access TOMS Test Administrator Interface Interim Assessments Summative Assessments CAASPP CoordinatorFull Access View Only Test Site CoordinatorFull Access View Only Test AdministratorView OnlyFull AccessView Only Test ExaminerView OnlyFull AccessView Only Test Administrator & Test Examiner View OnlyFull AccessView Only Interim Assessment Only View OnlyFull AccessView Only

7. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 7 Overview Embedded and non-embedded accommodations are available only to students that have a Section 504 plan or an “IDEA” indicator with a valid primary disability type in the California Longitudinal Pupil Achievement Data System (CALPADS). All embedded and non-embedded designated supports and accommodations may be assigned and activated through TOMS, except Turning off a universal tool, which must be activated through the test administrator interface.

8. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 8 Overview *Must be activated in the test delivery system. **Print on demand for cannot be activated in TOMS. If a student(s) need print on demand for items and/or items and stimuli, contact the CalTAC. EmbeddedNon-Embedded Designated SupportAccommodationDesignated SupportAccommodation Color Contrast American Sign Language (ELA listening and Math items) Bilingual Dictionary (ELA PT full writes) Abacus MaskingBrailleColor Contrast Alternate Response Options Text-to-Speech (ELA items and Math) Closed Captioning (ELA listening items) Color Overlay Calculator (Math - Allowed items Grades 6-8, 11) Translations (glossaries) (Math items) Streamlined InterfaceMagnification Multiplication Table (Math - Grades 4-8, 11) Translations (stacked) and Translated Test Directions ( for Math - Spanish) Text-to-speech (ELA reading passages) Noise BuffersPrint on Demand** Print Size Read Aloud (Math and ELA items) Read Aloud Passages (ELA) Permissive Mode Scribe (ELA non-writing and math items) Scribe (ELA PT Full Write) Turn off any universal tools* Separate SettingSpeech-to-Text Read Aloud in SpanishUnlisted Resources Translation (glossaries) (only paper pencil math tests) Additional Alternate Assessment Instructional Supports(CAA Only) Translated Test Directions ( for online ELA and math items)

9. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 9 Overview There are three options to set designated supports and accommodations in TOMS: –One-by-one manual configuration in the user interface –File upload using the Online Student Test Settings template –File upload using the 2015–16 CAASPP ISAAP Tool to create an upload file

10. Measuring the Power of Learning.™ One by One Process

11. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 11 One by One 1.Select the [Test Operations Management System (TOMS)] button on the CAASPP portal at http://caaspp.org. http://caaspp.org 2.Log onto TOMS using your sign in credentials.

12. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 12 One by One 3.On the left navigation bar, select the [Students] button.

13. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 13 One by One 4.Upon selecting [Students], a dropdown menu will open. The [Search] button will be preselected.

14. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 14 One by One 5.Enter details about the student in the search fields or select the LEA the student is associated with by selecting the [Select Organization] link.

15. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 15 One by One 6.Select the [Search] button.

16. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 16 One by One 7.Upon selecting [Search], search results will populate in a table.

17. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 17 One by One 8.To view and/or edit a student’s profile, select the magnifying glass [View] icon.

18. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 18 One by One 9.The selected student’s profile will open and the student’s demographic information will be displayed.

19. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 19 One by One 10.To configure the student’s online test settings, select the [Test Settings] tab.

20. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 20 One by One 11.Set embedded and non-embedded designated supports and accommodations for the student by selecting the appropriate option(s) in the checkboxes and dropdown menus.

21. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 21 One by One 12.Select the [Update] button at the bottom of the page.

22. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 22 One by One 13.Upon selecting [Update], a confirmation message will display.

23. Measuring the Power of Learning.™ File Upload Process

24. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 24 Online Student Test Settings Template 1.Select the [Test Operations Management System (TOMS)] button on the CAASPP portal at http://caaspp.org.http://caaspp.org 2.Log onto TOMS using your sign in credentials.

25. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 25 Online Student Test Settings Template 3.On the left navigation bar, select the [Students] button.

26. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 26 Online Student Test Settings Template 4.Upon selecting [Students], a dropdown menu will open. Select the [Online Test Settings] button.

27. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 27 Online Student Test Settings Template 5.Select the [Download Spreadsheet Template] link to download the online student test settings template.

28. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 28 Online Student Test Settings Template Do not move or change the order of the columns –Column widths can be expanded for easier viewing Accepted file format: –.csv only Maintain the column headers in rows 1 and 2 Do not use formulas Save your file frequently!

29. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 29 Online Student Test Settings Template

30. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 30 Online Student Test Settings Template 6.Fill in the necessary fields of the template. −Column A: Student’s Statewide Student Identifier (SSID)  Must be 10 numeric characters  Required field  Acceptable values: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9 −Column B: Abacus  Mathematics  Acceptable values: NEA_Abacus (abacus), leave field blank to deselect abacus −Column C: Alternate Response Options  Mathematics, ELA, performance task (PT)  Acceptable values: NEA_AR (alternate response options), leave field blank to deselect alternate response options

31. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 31 Online Student Test Settings Template 6.Fill in the necessary fields of the template. −Column D: American Sign Language (ASL) for ELA Listening and Math Items  Mathematics, ELA, PT  Acceptable values: TDS_ASL1 (show ASL videos), leave field blank to deselect ASL −Column E: Bilingual Dictionary for ELA Full Writes  ELA, PT  Acceptable values: NEDS_BD (bilingual dictionary), leave field blank to deselect bilingual dictionary

32. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 32 Online Student Test Settings Template 6.Fill in the necessary fields of the template. −Column F: Braille  Mathematics, ELA, PT  Acceptable values: ENU-Braille (Braille), leave field blank to deselect Braille −Column G: Calculator  Mathematics – allowed items for grades 6-8 and 11  Acceptable values: NEA_Calc (calculator), leave field blank to deselect calculator

33. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 33 6.Fill in the necessary fields of the template. −Column H: Closed Captioning for ELA Listening Items  ELA  Acceptable values: TDS_ClosedCap1 (available), leave field blank to deselect closed captioning −Column I: Color Contrast (EMBEDDED)  Mathematics, ELA, PT  Accepted values: TDS_CCInvert (reverse contrast), TDS_CCMagenta (black on rose), TDS_CCMedGrayLtGray (medium gray on light gray), TDS_CCYellowB (yellow on blue), leave field blank to deselect color contrast Online Student Test Settings Template

34. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 34 6.Fill in the necessary fields of the template. −Column J: Color Contrast (NON-EMBEDDED)  Mathematics, ELA, PT  Acceptable values: NEDS_CC (color contrast), leave field blank to deselect color contrast −Column K: Color Overlays  Mathematics, ELA, PT  Acceptable values: NEDS_CO (color overlays), leave field blank to deselect color overlays −Column L: Magnification  Mathematics, ELA, PT  Acceptable values: NEDS_Mag (magnification), leave field blank to deselect magnification Online Student Test Settings Template

35. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 35 6.Fill in the necessary fields of the template. −Column M: Masking  Mathematics, ELA, PT  Acceptable values: TDS_Masking1 (available), leave field blank to deselect masking −Column N: Multiplication Table  Mathematics for grades 4-8 and 11  Acceptable values: NEA_MT (multiplication table), leave field blank to deselect multiplication table Online Student Test Settings Template

36. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 36 6.Fill in the necessary fields of the template. −Column O: Noise Buffers  Mathematics, ELA, PT  Acceptable values: NEA_NoiseBuf (noise buffers), leave field blank to deselect noise buffers −Column P: Print On Demand  Mathematics, ELA, PT  Note: If your student needs print on demand for items, you must contact the California Technical Assistance Center (CalTAC) Online Student Test Settings Template

37. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 37 6.Fill in the necessary fields of the template. −Column Q: Read Aloud for ELA  ELA, PT  Acceptable values: NEDS_RA_Stimuli (read aloud), leave field blank to deselect read aloud for ELA −Column R: Read Aloud for Math and ELA Items (NON- EMBEDDED)  Mathematics, ELA  Acceptable values: NEDS_RA_Items (read aloud for math and ELA items), leave field blank to deselect read aloud for math and ELA items Online Student Test Settings Template

38. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 38 6.Fill in the necessary fields of the template. −Column S: Scribe  ELA, PT  Acceptable values: NEA_SC_WritItems (scribe), leave field blank to deselect scribe −Column T: Scribe (for ELA non-writing items and Math items)  Mathematics, ELA, PT  Acceptable values: NEDS_SC_Items (scribe), leave field blank to deselect scribe Online Student Test Settings Template

39. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 39 6.Fill in the necessary fields of the template. −Column U: Separate Setting  Mathematics, ELA, PT  Acceptable values: NEDS_SS (separate setting), leave field blank to deselect separate setting −Column V: Speech-to-text  Mathematics, ELA, PT  Acceptable values: NEA_STT (speech-to-text), leave field blank to deselect speech-to-text Online Student Test Settings Template

40. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 40 6.Fill in the necessary fields of the template. −Column W: Text-to-speech for ELA Reading Passages  ELA, PT  Acceptable values: TDS_TTS_Stim (passages), leave field blank to deselect text-to-speech for ELA reading passages Online Student Test Settings Template

41. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 41 Online Student Test Settings Template 6.Fill in the necessary fields of the template. −Column X: Text-to-speech for Math and ELA Items  Mathematics, ELA, PT  Acceptable values: TDS_TTS_Item (ELA items), TDS_TTS_Stim&TDS_TTS_Item (Math stimuli and items), TDS_TTS_All (ELA items and Math stimuli and items), leave field blank to deselect text-to-speech −Column Y: Translated Test Directions (NON- EMBEDDED)  ELA, PT  Acceptable values: NEDS_TransDirs (translated test directions), leave field blank to deselect translated test directions

42. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 42 Online Student Test Settings Template 6.Fill in the necessary fields of the template. −Column Z: Translation Glossaries for Math Items  Mathematics, PT  Accepted values: TDS_WL_Glossary (English), TDS_WL_ArabicGloss (Arabic), TDS_WL_CantoneseGloss (Cantonese), TDS_WL_ESNGlossary (Spanish), TDS_WL_KoreanGloss (Korean), TDS_WL_MandarinGloss (Mandarin), TDS_WL_PunjabiGloss (Punjabi), TDS_WL_RussianGloss (Russian), TDS_WL_TagalGloss (Filipino), TDS_WL_UkrainianGloss (Ukrainian), TDS_WL_VietnameseGloss (Vietnamese), TDS_WL_ArabicGloss&TDS_WL_Glossary (Arabic & English), TDS_WL_CantoneseGloss&TDS_WL_Glossary (Cantonese & English), TDS_WL_ESNGlossary&TDS_WL_Glossary (Spanish & English), TDS_WL_KoreanGloss&TDS_WL_Glossary (Korean & English), TDS_WL_MandarinGloss&TDS_WL_Glossary (Mandarin & English), TDS_WL_PunjabiGloss&TDS_WL_Glossary (Punjabi & English), TDS_WL_RussianGloss&TDS_WL_Glossary (Russian & English), TDS_WL_TagalGloss&TDS_WL_Glossary (Filipino & English), TDS_WL_UkrainianGloss&TDS_WL_Glossary (Ukrainian & English), TDS_WL_VietnameseGloss&TDS_WL_Glossary (Vietnamese & English

43. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 43 Online Student Test Settings Template 6.Fill in the necessary fields of the template. −Column AA: Translation Glossaries for Math Items (NON-EMBEDDED)  Mathematics  Acceptable values: NEDS_TRussian (Russian), NEDS_TArabic (Arabic), NEDS_TCantonese (Cantonese), NEDS_TSpanish (Spanish), NEDS_TKorean (Korean), NEDS_TMandarin (Mandarin), NEDS_TPunjabi (Punjabi), NEDS_TFilipino (Filipino), NEDS_TUkrainian (Ukrainian), NEDS_TVietnamese (Vietnamese), leave field blank to deselect translation glossaries for math items

44. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 44 6.Fill in the necessary fields of the template. −Column AB: Permissive Mode  Mathematics, ELA, PT  Acceptable values: TDS_PM1 (enabled), leave field blank to deselect permissive mode −Column AC: Print Size  Mathematics, ELA, PT  Acceptable values: TDS_PS_L1 (1.5X), TDS_PS_L1 (1.75X), TDS_PS_L3 (2.5X), TDS_PS_L4 (3X), leave field blank to deselect print size −Column AD: Streamlined Interface  Mathematics, ELA, PT  Acceptable values: TDS_SLM1 (streamlined), leave field blank to deselect streamlined interface Online Student Test Settings Template

45. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 45 Online Student Test Settings Template 6.Fill in the necessary fields of the template. −Column AE: Stacked Translations and Translated Test Directions for Math (Embedded) Designated Supports  Mathematics  Acceptable values: ESN (Spanish), leave field blank to deselect stacked translations and translated test directions for math −Column AF: Reminder to Turn Off Any Universal Tools  Mathematics, ELA, PT  Acceptable values: TDS_REM (reminder), leave field blank to leave universal tools on

46. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 46 Online Student Test Settings Template 6.Fill in the necessary fields of the template. −Column AG: Read Aloud in Spanish (Math) (N/A for CAA)  Mathematics  Acceptable values: NEDS_RA_Items_ESN (items), NEDS_RA_Stimuli_ESN (stimuli), NEDS_RA_Items_Stimuli_ESN (stimuli and items), leave blank to deselect read aloud in Spanish for math −Column AH: Manipulatives for Alternate Assessment  Mathematics  Acceptable values: NEA_AddAltRSC (manipulatives for CAA), leave blank to deselect manipulatives for alternate assessment

47. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 47 7.Save the file in.csv format and upload it on the Upload Online Student Test Settings page in the TOMS interface. Online Student Test Settings Template

48. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 48 Online Student Test Settings Template 8.Check on the status of your uploaded file(s) on the Upload Online Student Test Settings page in the TOMS interface. : Processing : Complete : Delete file: Download errors

49. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 49 The 2015–16 CAASPP ISAAP Tool is an Excel workbook with specially designed formulas; the tool facilitates selection of embedded and non- embedded designated supports and accommodations that match students’ access needs for the Smarter Balanced assessments as well as the California Alternate Assessments. The 2015–16 CAASPP ISAAP Tool can be used to produce the online student test settings file that can be uploaded to TOMS. 2015–16 CAASPP ISAAP Tool

50. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 50 2015–16 CAASPP ISAAP Tool

51. Measuring the Power of Learning.™ Live Demonstration

52. Measuring the Power of Learning.™ Tips and Reminders

53. Measuring the Power of Learning.™ Configuring Online Student Test Settings in TOMS 53 Resources For more information about the use of designated supports and accommodations on CAASPP assessments, visit the CDE CAASPP Accessibility Supports Web Page at http://www.cde.ca.gov/ta/tg/ca/accesssupport.asp

54. Measuring the Power of Learning.™ Questions

55. Configuring Online Student Test Settings in TOMS 55 Help Desk Support The California Technical Assistance Center (CalTAC) is there to support all LEA CAASPP coordinators! Available Monday – Friday from 7 a.m.– 5 p.m. PT E-mail: caltac@ets.orgcaltac@ets.org Phone: 800-955-2954 Web site: http://www.caaspp.org/http://www.caaspp.org/