1. Assessments & Accountability v 1.0 ASSESSMENTS & ACCOUNTABILITY Suspense Resolution and Reports

2. Assessments & Accountability v 1.0 22 – Mute phones while listening (*6 to mute and un-mute) – Do not place your phone on HOLD – Silence cell phones – Hold questions until Q&A periods – Submit all questions via the Chat function GROUND RULES

3. Assessments & Accountability v 1.0 3 Assessment and Accountability (A/A)

4. Assessments & Accountability v 1.0 4 A/A Expectations Assessment and Accountability functionality in CALPADS is being implemented to support: −Building a complete individual student assessment history for STAR, CAHSEE, and CELDT −Improving the accuracy and consistency of data used to evaluate performance of individual students and educational entities

5. Assessments & Accountability v 1.0 5 A/A Expectations Achieving these objectives will require several iterations of CALPADS functionality −Current phase of functionality is focused on identifying issues for both LEAs and CDE related to the loading of data −Future functionality will address these issues as well as enhance the accessibility and usability of the data for LEAs and CDE

6. Assessments & Accountability v 1.0 6 A/A Expectations The initial CALPADS A/A functionality requires no changes in the way LEAs currently work with assessment vendors or with CDE −Student Demographic changes will continue to be made through the testing vendor −Testing Vendors will provide test results & reports as usual −Pre-ID, where applicable, will continue as usual −Testing processes will continue as directed by assessment program offices −AYP/API results will continue to use the student data you supply to test vendors

7. Assessments & Accountability v 1.0 7 A/A Expectations LEAs will: −Match student records for your LEA to the correct SSID when CALPADS cannot make the match automatically −Verify the reports −Provide feedback to improve functionality

8. Assessments & Accountability v 1.0 8 A/A Expectations CDE will: −Match student records to the correct SSID in CALPADS, when a LEA flags a record as “Not Mine” −Negotiate contracts with assessment vendors that ensure the data needed for a student’s complete assessment history in CALPADS is available and timely −Coordinate with each assessment program area to enable CALPADS to… −Provide a consistent approach to managing and reporting assessment data −Report assessment results that reflect the testing procedures communicated to LEAs

9. Assessments & Accountability v 1.0 9 A/A Expectations CDE will: −Evaluate the outcome to determine the impact on LEAs and Accountability reports of using CALPADS data instead of vendor test data −Work with LEAs to provide functionality focused on data accessibility and usability −Communicate When and How:  Results data left in suspense will impact Accountability reporting  Current vendor relationships will be impacted

10. Assessments & Accountability v 1.0 10 A/A Expectations Logistics A schedule for data loads is included in the report sections for each Program Assessment and Accountability Coordinators receive an email when vendor data is loaded Report content is frozen when CDE performs the last snapshot for a Program Administration after all data received from the assessment vendor has been loaded

11. Assessments & Accountability v 1.0 11 Suspense Management

12. Assessments & Accountability v 1.0 12 Suspense Management Suspense - (i.e. unsuccessful matches) Matched – (i.e. successful matches) CALPADS Assessment Results:

13. Assessments & Accountability v 1.0 13 Suspense Management Reason for Suspense Record: Miss-match in student demographic data (gender, date of birth year) between the assessment results file and CALPADS Missing CALPADS enrollment at time of testing Missing SSID Administration Date As soon as one of these conditions is not met, CALPADS places the record in suspense.

14. Assessments & Accountability v 1.0 14 Suspense Management Importance of Suspense Resolution: A record in suspense will not be matched to a CALPADS SSID, which leaves the CALPADS assessment longitudinal record incomplete for this SSID As students enroll at other districts their assessment data will be missing if not matched Records in suspense do not appear in reports; therefore, your CALPADS assessment and AYP/API reports will not be complete

15. Assessments & Accountability v 1.0 15 Suspense Management Suspense data can be resolved both Online & in Batch Both methods are accessed from the Assessment menu CALPADS Functionality

16. Assessments & Accountability v 1.0 16 MANAGING SUSPENSE DATA - ONLINE

17. Assessments & Accountability v 1.0 17 Manage Suspense Data - Online LEA SUSPENSE Workflow Review Suspense Records Determine best resolution Apply resolution Wait for refresh and verify suspense resolved

18. Assessments & Accountability v 1.0 18 Manage Suspense Data - Online Suspense Resolution Workflow CDE loads assessment results Data compared to ODS Two buckets created Suspense and Matched Review Suspense Records Determine best resolution Apply Wait for refresh Verify suspense resolved

19. Assessments & Accountability v 1.0 19 Manage Suspense Data - Online LEA SUSPENSE REASONS Date of Birth Mismatch: If Student Date of Birth Year for SSID in results record <> Student Date of Birth Year in ODS SINF data that was valid at the time of testing Gender Mismatch: If Student Gender Code for SSID in results record <> Student Gender Code in ODSR SINF data that was valid at the time of testing SSID Mismatch: If SSID in results record does not exist in ODSR Admin Date Empty: If the Administration Date in the results record is blank LEA Mismatch: If enrollment in LEA at the time of testing could not be validated

20. Assessments & Accountability v 1.0 20 Manage Suspense Data - Online LEA SUSPENSE RESOLUTIONS − the LEA correcting CALPADS data − the vendor correcting results data − the LEA and/or CDE manually assigning the suspense record to the correct SSID

21. Assessments & Accountability v 1.0 21 Manage Suspense Data - Online Filter : Program, Administration, Academic Year, and Matched Result (LEA Suspense) Note: Filter Options are subject to user’s access rights Resolution STEP 1: Review LEA Suspense LEA Matched LEA Suspense CDE Suspense ADMIN Date & Suspense Reason

22. Assessments & Accountability v 1.0 22 Manage Suspense Data - Online If the resolution for the Suspense Reason requires … – Data addition/changes in CALPADS, make the additions/changes and either 1) match immediately to the corrected record using STEP 3, since the changes to ODS are available real-time, or 2) wait for the nightly suspense process to recognize that the CALPADS demo has changed and now matches the results record demo, eliminating the suspense automatically – Contacting the vendor to make changes, the suspense process that runs during a load will eliminate the suspense when CDE receives and loads the corrected data from the vendor. – Manual Matching the record with incorrect demographic data to a CALPADS record with the correct demographic data. Resolution STEP 2a: Determine Resolution

23. Assessments & Accountability v 1.0 23 Manage Suspense Data - Online 1. If the student record in suspense does not belong to your LEA, select “Not Mine” 2. The record is placed in CDE’s queue for resolution. CDE can match the record to a student in another LEA. Resolution STEP 2b: Determine Resolution 1 2 1 2

24. Manage Suspense Data - Online Mismatch Condition SourceActionComment SSID MismatchResults record SSID does not exist in ODSR Update CALPADS first & match after Nightly Suspense Process will provide correct CALPADS data as report data the next day after CALPADS corrected Results record SSID incorrectCorrect vendor results data Subsequent load of vendor data will cause a re-evaluation of the suspense record, clearing the suspense automatically Demo Mismatch (Birth Date/Gender) Results record demo correctCorrect CALPADS Nightly Suspense Process will provide correct CALPADS data as report data the next day after CALPADS corrected Results record demo incorrectCorrect Vendor Results Subsequent load of vendor data will cause a re-evaluation of the suspense record, clearing the suspense automatically LEA Mismatch (Enrollment Not Validated) CALPADS enrollment incorrectCorrect CALPADS Nightly Suspense Process will provide correct CALPADS data as report data the next day after CALPADS corrected SSID in result record incorrectUse SELECT MATCH to match results to correct SSID Must also update Vendor data CALPADS enrollment correct but no match made Submit Service Ticket SSID Administration Data Missing Assessment Date in result record blank Contact Vendor Assessments & Accountability v 1.0 24

25. Assessments & Accountability v 1.0 25 Manage Suspense Data - Online When match is successful, return to Student List to resolve another record Resolution STEP 3: Return to Student List The newly matched record is available for reporting immediately

26. Assessments & Accountability v 1.0 26 Manage Suspense Data - Online When you make changes to data in the ODS, they are replicated to the ODSR in real time. However, the change will not resolve a suspense until one of the following: – You match the suspense data to the corrected CALPADS record – Suspense processing clears the suspense (in nightly process, load, or CDE snapshot) Resolution STEP 4: Wait for Refresh

27. Assessments & Accountability v 1.0 27 Manage Suspense Data - Online Resolution STEP 5: Verify Resolved

28. Assessments & Accountability v 1.0 28 Manage Suspense Data - Online Select Match initiates the user-defined search for a CALPADS SSID to which the result record belongs Resolution – SELECT MATCH

29. Assessments & Accountability v 1.0 29 Manage Suspense Data - Online Resolution – SELECT MATCH, step 1 Select Match John Doe

30. Assessments & Accountability v 1.0 30 Manage Suspense Data - Online Enter SSID and/or demographics, using * wildcard if needed Resolution – SELECT MATCH, step 2 Enter Search Criteria

31. Assessments & Accountability v 1.0 31 Manage Suspense Data - Online Review matching results displayed by SSID and/or Demographics, depending on the criteria entered Resolution – SELECT MATCH, step 3 Suggested Correction Record Note the incorrect Birth Year

32. Assessments & Accountability v 1.0 32 Manage Suspense Data - Online Make selection and answer “OK” to initiate the match Resolution – SELECT MATCH, step 4 Select the record to which suspense record will be matched

33. Assessments & Accountability v 1.0 33 Manage Suspense Data - Online Both the suspense record and the selected match record are displayed Select Match Record to resolve Resolution – SELECT MATCH, step 5 Select “Match Records”

34. Assessments & Accountability v 1.0 34 Manage Suspense Data - Online The Matched Student List displays the Assessment Results record and the CALPADS record to which it has been matched Matched Records LEA Matched LEA Suspense CDE Suspense

35. Assessments & Accountability v 1.0 35 Manage Suspense Data - Online The source of the match is identified in the field “Match Source”. The source could be Batch, LEA, or State. MATCHED STEP 1: Confirm Matches

36. Assessments & Accountability v 1.0 36 LEA Matched LEA Suspense CDE Suspense Manage Suspense Data - Online Matched records can be …. MATCHED STEP 2: Resolve Incorrect Match − unmatched if incorrectly matched (UNMATCH) and re-matching will occur later − unmatched if incorrectly matched and re-matching will occur now (SELECT NEW MATCH) − unmatched and sent to CDE for matching to another LEA (NOT MINE)

37. Assessments & Accountability v 1.0 37 Understanding Suspense Data NameTriggerResolution Date Of Birth Mismatch If Student Date of Birth Year for SSID in results record <> Student Date of Birth Year in ODS SINF data that was valid at the time of testing If SSID in results record is incorrect, use CALPADS “Select Match” to match the results record to a CALPADS student record with the correct SSID If SSID is correct but Date of Birth Year in results record is incorrect, use “Select Match” to match the results record to a CALPADS student record with the same SSID which has the correct DOB Year If no record is found, use SSID Enrollment Validation rules to identify the Assessment Date for the SSID and locate the SINF data for that date. If missing, add a SINF record or correct existing SINF data. Repeat “Select Match”. If the SSID Assessment Date identified does not accurately represent the time of testing for the student, contact the vendor to correct the SSID Administration Date (after contacting Service Desk). If SSID and Date of Birth Year in results record are correct, correct CALPADS data before making a match. Use SSID Enrollment Validation rules to identify the Assessment Date for the SSID and locate the SINF data for that date. Add a SINF record if missing or correct existing SINF data. Then use “Select Match” to match the results record to the CALPADS student record with the same SSID which now has the correct DOB Year LEA SUSPENSE REASONS & RESOLUTIONS

38. Assessments & Accountability v 1.0 38 Understanding Suspense Data NameTriggerResolution Gender Mismatch If Student Gender Code for SSID in results record <> Student Gender Code in ODSR SINF data that was valid at the time of testing Same as Date of Birth Mismatch, using Gender SSID Mismatch If SSID in results record does not exist in ODSR Enroll student in CALPADS Use “Select Match” to match the results record to new CALPADS student record for the SSID Admin Date Empty If the Administration Date in the results record is blank Contact vendor to correct the SSID Administration Date in the results record (after contacting Service Desk) LEA SUSPENSE REASONS & RESOLUTIONS

39. Assessments & Accountability v 1.0 39 Understanding Suspense Data NameTriggerResolution LEA Mismatch If enrollment in LEA at the time of testing could not be validated If SSID in results record is incorrect, use CALPADS “Select Match” to match the results record to a CALPADS student record with the correct SSID If SSID is correct in results record, use SSID Enrollment Validation rules to identify the SSID Assessment Date that CALPADS is using to identify the enrollment record at the time of testing If the student was enrolled in the LEA on the Assessment Date, either enroll the student in CALPADS or correct existing CALPADS enrollment. Then use “Select Match” to match the results record to the CALPADS student record with the same SSID which now has an enrollment that includes the Assessment Date. If the student was enrolled in the LEA at the time of testing, but not on the Assessment Date, contact vendor to correct the SSID Administration Date in the results record for the SSID (after contacting Service Desk). LEA SUSPENSE REASONS & RESOLUTIONS (Cont.)

40. Assessments & Accountability v 1.0 40 Assessment Reports

41. Assessments & Accountability v 1.0 41 ASSESSMENT REPORTS Operational STATUS REPORTS CDE Only 50.1 Assessment Upload – Detail 52.1 Assessment Snapshots - Detail

42. Assessments & Accountability v 1.0 42 ASSESSMENT REPORTS 51.1 Assessment Suspense – Summary Summary of LEA and School Assessment Suspense by Administration STATUS REPORTS - SUSPENSE

43. Assessments & Accountability v 1.0 43 ASSESSMENT REPORTS 51.2 Assessment Suspense – Student Detail Detail of LEA and School Assessment Suspense for one or more Programs and/or Administrations STATUS REPORTS - SUSPENSE (Cont) Grey, Jordan Abdul, Jordan Ferrell, J 3224589451, 2274589451, 5288589451,

44. Assessments & Accountability v 1.0 44 ASSESSMENT REPORTS The following types of Assessment reports are available – Summary LEA results for STAR, CAHSEE and CELDT, including county & state comparisons – Individual student result detail supporting the summary results for STAR, CAHSEE, and CELDT – Currently enrolled students missing CAHSEE – Currently enrolled students needing CELDT The following types of AYP/API reports will be available – Students included in the AYP/API results The following types of individual student reports are available – Individual student assessment history REPORTS AVAILABLE

45. Assessments & Accountability v 1.0 45 ASSESSMENT REPORTS Assessment reports use vendor assessment results data The Student Profile data display as follows: – For reports that present results data by ADMIN, data valid at the time of testing is used for filters and report content – For reports that present results data for Current Students, current data is used for filters and data valid at the time of testing is used for report content

46. Assessments & Accountability v 1.0 46 ASSESSMENT REPORTS Report content for a Program Administration can continue to change as long as suspense processing is occurring for that Program Administration – Students can be added when a new match is made through the Suspense Resolution Process, either online or batch, which updates the AADS immediately – Student demographic data on the report can change when the Suspense Process, either nightly or in a data load, refreshes student data in AADS for students whose data have changed in the ODS (Note: Non-Participant only in Load) – Students can be removed when the Suspense Process, either nightly or in a data load, is not able to re-validate the student’s enrollment due to changes made in ODS enrollment data that were valid at the time of testing

47. Assessments & Accountability v 1.0 47 ASSESSMENT REPORTS ASSESSMENT MENU Two entry points from Assessment Menu

48. Assessments & Accountability v 1.0 48 ASSESSMENT REPORTS xxxxxxxxx REPORTS

49. Assessments & Accountability v 1.0 49 ASSESSMENT REPORTS xxxxxxxxx REPORTS (Cont) CDE Only 50.1 Assessment Upload – Detail 52.1 Assessment Snapshots - Detail Coming

50. Assessments & Accountability v 1.0 50 UNDERSTANDING STAR REPORTS

51. Assessments & Accountability v 1.0 51 Understanding STAR Reports The STAR Program has one Administration, called ANNUAL The ANNUAL Administration includes multiple Assessments: California Standards Tests (CST) California Modified Assessment (CMA) California Alternate Performance Assessment (CAPA) Standards-based Tests in Spanish (STS) INTRODUCTION

52. Assessments & Accountability v 1.0 52 Understanding STAR Reports INTRODUCTION (Cont) STAR vendor results for the ANNUAL Administration are loaded multiple times –The loads are named P1, P2, P3, and Post P-3 –Loads P2 and P3 overwrite the previous load –The Post-P3 load does not overwrite P3

53. Assessments & Accountability v 1.0 53 Understanding STAR Reports GENERAL CALENDAR - STAR ScheduleEventDescription August (Week 1) P1 LOADIncludes approximately 99.9% of LEA participants Received about 8/1. Required to meet statutory reporting deadline of 8/15. August (Week 2/3) AYP/ API (P1) LOAD Concurrent with posting on DataQuest STAR aggregate downloadable files from assessment vendor AYP/API reports and data files pre-release for LEAs AYP/API reports and data files release to the public (August 15) September (Week 1) P2 LOADIncludes 100% of results, including LEA’s remaining results not included in the P1 (e.g. Year-round schools). Received about 9/1. September (Week 2-4) LEA Data Review LEAs examine STAR and CAHSEE data to identify needed student data changes. LEAs make changes in CALPADS and through vendor. Assumption: Results data is loaded to CALPADS within x days of its receipt by CDE

54. Assessments & Accountability v 1.0 54 Understanding STAR Reports GENERAL CALENDAR – STAR (Cont) ScheduleEventDescription OctoberAYP/ API (P2) LOAD Concurrent with posting on DataQuest AYP/API reports and data files that incorporate P2 STAR late testing LEAs, CAHSEE data corrections, appeal and exception decisions, and CAPA reallocations related to 1% cap for LEAs (October 1) October - December LEA Data Review LEAs examine AYP/API (P2) results to identify needed student data changes. LEAs make changes in CALPADS and through vendor. December/ January P3 LOADIncludes 100% of results, including LEA student data changes made since P2. December/ January AYP/ API (P3) LOAD Concurrent with posting on DataQuest AYP/API reports and data files that incorporate P3 student data changes Assumption: Results data is loaded to CALPADS within x days of its receipt by CDE

55. Assessments & Accountability v 1.0 55 Understanding STAR Reports GENERAL CALENDAR - STAR (Cont) ScheduleEventDescription January - February LEA Data Review LEAs examine AYP/API (P3) results to identify needed student data changes. LEAs initiate appeal process through CDE for approval to submit changes to vendor. January - February Post-P3 LOAD(s) Includes only LEA specific results submitted to the vendor that have been approved by CDE through the appeals process. The number of loads and the timing will vary. FebruaryAYP/ API (Post-P3) LOAD Concurrent with posting on DataQuest Final AYP and Growth API that incorporate all Post- P3 changes (February) and Final Base API (March) Assumption: Results data is loaded to CALPADS within x days of its receipt by CDE

56. Assessments & Accountability v 1.0 56 Understanding STAR Reports REPORT 20.1 LEA Summary Summary of the most current STAR results for a school by grade Test Type should be Assessment

57. Assessments & Accountability v 1.0 57 Understanding STAR Reports REPORT 20.1 LEA Summary (Cont) Test Type should be Assessment

58. Assessments & Accountability v 1.0 58 Understanding STAR Reports REPORT 20.2 Student List Detail of the most current STAR results by student for Test Participants for all or selected assessments. If multiple scores exist for a student at the same school for the same test, the best result is reported. Test Type should be Assessment

59. Assessments & Accountability v 1.0 59 Understanding STAR Reports REPORT 20.3 LEA and State Summary Summary of the most current results for an LEA and the state Test Type should be Assessment

60. Assessments & Accountability v 1.0 60 UNDERSTANDING CAHSEE REPORTS

61. Assessments & Accountability v 1.0 61 Understanding CAHSEE Reports The CAHSEE Testing Program has multiple monthly Administrations (ADMINs): – JUL, OCT, NOV, DEC, FEB, MAR, & MAY A CAHSEE vendor results file is loaded and stored for each monthly Administration Cumulative results files are also received quarterly and at the end of the year INTRODUCTION

62. Assessments & Accountability v 1.0 62 Understanding CAHSEE Reports All result files may include records for a previous ADMIN during the year (e.g. The monthly file for a DEC ADMIN may include corrected data for a student from the previous OCT ADMIN) – If a record in a load for an SSID was in a previous load for the same Test & same ADMIN, the most current record is reported for the ADMIN different ADMIN, each record is reported for its ADMIN INTRODUCTION (Cont)

63. Assessments & Accountability v 1.0 63 Understanding CAHSEE Reports GENERAL CALENDAR - CAHSEE ScheduleEventDescription September (Middle) MONTHLY-JULIncludes: JUL. Received 6-7 weeks after ADMIN September (End) QUARTERLY-1Includes: JUL December (Middle) MONTHLY-OCTIncludes: OCT. Received 6-7 weeks after ADMIN January (Middle) MONTHLY-NOVIncludes: NOV. Received 6-7 weeks after ADMIN February (Middle) MONTHLY-DECIncludes: DEC. Received 6-7 weeks after ADMIN February (End) QUARTERLY- 2Includes: OCT, NOV, DEC + Q1 (JUL) April (Middle) MONTLY-FEBIncludes: FEB. Received 6-7 weeks after ADMIN Assumption: Results data is loaded to CALPADS within 2 days of its receipt by CDE

64. Assessments & Accountability v 1.0 64 Understanding CAHSEE Reports GENERAL CALENDAR – CAHSEE (Cont) ScheduleEventDescription June (First) MONTHLY-MARIncludes: MAR (largest ADMIN). Received 7-8 weeks after ADMIN June (End) QUARTERLY-3Includes: FEB, MAR + Q2 (JUL, OCT, NOV, DEC) Pre-EOY - Used for LEA Preview Reports July (Middle) MONTHLY-MAYIncludes MAY (Make-up ADMIN). Received 6-7 weeks after ADMIN July - SepLEA Data Review After last ADMIN, LEAs can do corrections for all ADMINS during the year. Corrections must be complete by Oct 8. July/August (Begin) QUARTERLY-4Includes: MAY + Q3 (JUL, OCT, NOV, DEC, FEB, MAR) Preliminary Final for DataQuest & AYP/API for AYP Participation Rate Assumption: Results data is loaded to CALPADS within 2 days of its receipt by CDE

65. Assessments & Accountability v 1.0 65 Understanding CAHSEE Reports GENERAL CALENDAR – CAHSEE (Cont) ScheduleEventDescription August (Week 2/3) AYP/ API (P1) LOAD Concurrently with posting on Data Quest … STAR aggregate downloadable files from assessment vendor AYP/API reports and data files pre-release for LEAs AYP/API reports and data files release to the public (August 15) October (Middle) EOYIncludes: JUL, OCT, NOV, DEC, FEB, MAR, MAY Final - Cumulative for DataQuest & AYP/API OctoberAYP/ API (P2) LOAD Concurrently with posting on DataQuest … AYP/API reports and data files that incorporate P2 STAR late testing LEAs, CAHSEE data corrections, appeal and exception decisions, and CAPA reallocations related to 1% cap for LEAs (October 1) Assumption: Results data is loaded to CALPADS within 2 days of its receipt by CDE

66. Assessments & Accountability v 1.0 66 Understanding CAHSEE Reports Three types of CAHSEE reporting are available in CALPADS Census – Provides an unduplicated count of enrolled 10th grade students who took either part or all parts of the test at the enrolled school during the administration(s) being reported. Administration - Provides overall results of CAHSEE administrations for all currently students enrolled in a school who took either part or all parts of the test at the enrolled school by grade level during the administration(s) being reported. Enrollment - Provides overall results of CAHSEE administrations for all currently students enrolled in a school, both students who did not take the test and students who took the test, regardless of where the test was administered. REPORTING TYPES

67. Assessments & Accountability v 1.0 67 Understanding CAHSEE Reports REPORT 21.1 Census – LEA Summary

68. Assessments & Accountability v 1.0 68 Understanding CAHSEE Reports REPORT 21.1 Census – LEA Summary Summary of the CENSUS Reporting Type results for Student Tested on each part of the assessment. The number and percentage of students who met the high school graduation requirement are also included.

69. Assessments & Accountability v 1.0 69 Understanding CAHSEE Reports REPORT 21.2 Census – Student List Student detail of the CENSUS Reporting Type results for Students Tested in Grade 10.

70. Assessments & Accountability v 1.0 70 Understanding CAHSEE Reports REPORT 21.2 Census – Student List Student detail of the CENSUS Reporting Type results for Students Tested in Grade 10

71. Assessments & Accountability v 1.0 71 Understanding CAHSEE Reports REPORT 21.3 Administration – LEA Summary Summary of the ADMINISTRATION results for Students Tested (grades 10-12 and AD) and the number and percentage of students who met the high school graduation requirement.

72. Assessments & Accountability v 1.0 72 Understanding CAHSEE Reports REPORT 21.4 Administration – Student List Detail of ADMINISTRATION results for enrolled Students in grades 10-12 and AD that were tested at the reporting school. Although Requirement Met recognizes scores received from other schools, they are not displayed. Report Operation: The individual student data can be displayed using all of an LEA’s schools or using only selected schools. Report can be filtered to display the results for selected Administrations, and for subgroups of students. The following legend appears at the bottom of the report to explain the Result column.

73. Assessments & Accountability v 1.0 73 Understanding CAHSEE Reports REPORT 21.4 Administration – Student List Detail of ADMINISTRATION results for enrolled Students in grades 10-12 and AD that were tested at the reporting school. Although Requirement Met recognizes scores received from other schools, they are not displayed.

74. Assessments & Accountability v 1.0 74 Understanding CAHSEE Reports REPORT 21.5 Enrollment – LEA Summary (Cont) Report Operation: This report displays results for all/selected schools within an LEA, which can be filtered to display the results for subgroups of students. It also includes a County summary for comparison.

75. Assessments & Accountability v 1.0 75 Understanding CAHSEE Reports REPORT 21.5 Enrollment – LEA Summary Summary of testing results for current enrollment in grades 10-12 and AD Not Tested should be No Test

76. Assessments & Accountability v 1.0 76 Understanding CAHSEE Reports REPORT 21.6 Enrollment – Student List Detailed CAHSEE results for individual students for current enrollment in grades 10-12 and AD. If multiple scores exist for an enrolled student, all scores received are displayed regardless of the school in which the score was received.

77. Assessments & Accountability v 1.0 77 Understanding CAHSEE Reports REPORT 21.7 Administration-LEA Disaggregated Summary of CAHSEE results for Students Tested in grades 10-12 and AD with the number and percentage of students who met the high school graduation requirement.

78. Assessments & Accountability v 1.0 78 UNDERSTANDING CELDT REPORTS

79. Assessments & Accountability v 1.0 79 Understanding CELDT Reports The CELDT Testing Program has an Administration (ADMIN) every month: – JUL, AUG, SEP, OCT, NOV, DEC, JAN, FEB, MAR, APR, MAY, & JUN The Annual assessments occur from July 1 – October 31. CDE receives the data in January/early February. If an initial assessment occurred during this timeframe, it will be included in the data received. Initial assessments occur each month as students enroll. CDE receives the data at the end of the year. CDE is negotiating with the vendor to receive results monthly INTRODUCTION

80. Assessments & Accountability v 1.0 80 Understanding CELDT Reports GENERAL CALENDAR - CELDT ScheduleEventDescription January/ February PRE-DRM LOAD Includes (Annuals & Initials): JUL, AUG, SEP, OCT LEAs get results to vendor by Mid-November. When CDE receives, it is checked before it goes into LEA DRM (Data Review Module) February - March LEA Data Review LEAs make corrections in DRM April (Early) POST-DRM LOAD Includes: JUL, AUG, SEP, OCT Concurrent with posting on DataQuest & calculation of Title III AMAO FINALIncludes (Initials): NOV, DEC, JAN, FEB, MAR, APR, MAY, JUN Assumption: Results data is loaded to CALPADS within x days of its receipt by CDE

81. Assessments & Accountability v 1.0 81 Understanding CELDT Reports REPORT 22.1 CELDT – LEA SUMMARY

82. Assessments & Accountability v 1.0 82 Understanding CELDT Reports REPORT 22.1 CELDT – LEA SUMMARY Summary of selected administration(s) by Grade

83. Assessments & Accountability v 1.0 83 Understanding CELDT Reports REPORT 22.2 CELDT – Student List Detail for currently enrolled Students Tested during the selected administration(s). If multiple scores exist for an enrolled student, all scores received at the school for the reported administration(s) are displayed.

84. Assessments & Accountability v 1.0 84 Understanding CELDT Reports REPORT 22.3 CELDT – English Learner Status Detail of the current year status of the CELDT for currently enrolled English Learners. If there is no current year data, it reports if it is Due or Overdue.

85. Assessments & Accountability v 1.0 85 Understanding CELDT Reports REPORT 22.4 CELDT – County Trend by LEA Summary of results for selected administration(s) and academic years by LEA

86. Assessments & Accountability v 1.0 86 UNDERSTANDING INDIVIDUAL STUDENT ASSESSMENT REPORTS

87. Assessments & Accountability v 1.0 87 Understanding Student Reports GENERAL CALENDAR Report is available at any time to the school in which the student is primarily enrolled The data included is subject to the loads and suspense processing of each Program.

88. Assessments & Accountability v 1.0 88 Understanding Student Reports REPORT 40.1 Individual Student Profile Description: Displays the entire Assessment history for individual students currently enrolled in the selected LEA. It displays scores for all administrations, regardless of the LEA administering the Assessment. If multiple scores exist for an administration, all scores are displayed. Assessment modifications and accommodations are included in the report as Testing Conditions. Enrollment Status Code of students included = 10 (Primary). Data as of: Last Load date +/- subsequent suspense processing Data Included: Test Purpose (e.g. Initial, Annual), Administration, Administration Date, Test Condition that makes the result an Invalid Result (see Legend), Result (CELDT = Criterion Met, CAHSEE = Requirement Met, STAR = N/A) Totals: None Links: None Glossary References: SSID Administration Date, Criterion Met, Requirement Met

89. Assessments & Accountability v 1.0 89 Understanding Student Reports REPORT 40.1 Individual Student Profile (Cont) Report Operation: This individual student report can be printed for currently enrolled students for all of an LEA’s schools or only selected schools. It can also print for an individual student. When printing for a school/LEA, the report displays results regardless of where the assessment was administered. It can be filtered to display the results for selected Academic Years, Programs, Assessments, Tests, etc. It can be requested for subgroups of students. The legend on the following page appears at the bottom of the report. A user selection allows it to print per student.

90. Assessments & Accountability v 1.0 90 Understanding Student Reports REPORT 40.1 Individual Student Profile (Cont) Entries appear only if used in report

91. Assessments & Accountability v 1.0 91 Understanding Student Reports VIEW STUDENT RESULTS - Online STAR=All CAHSEE=10-12, AD CELDT=EL+ TBD Results available online for all Programs by … Administration(s) Result SSID Click Individual student for details

92. Assessments & Accountability v 1.0 92 Understanding Student Reports (Cont) VIEW STUDENT RESULTS – Online (Cont) Complete history of STAR, CAHSEE, and CELDT

93. Assessments & Accountability v 1.0 93 Wrap-UP Please Complete Our Survey 93 Questions http://www.csis.k12.ca.us/survey/calpads-training/

94. Assessments & Accountability v 1.0 94 WRAP-UP

95. Assessments & Accountability v 1.0 95 Wrap-Up QUESTIONS When should I begin resolving suspense data? If suspense conditions exist in your data, the suspense records are available to you for resolution after each suspense evaluation. Data is evaluated … when vendor results data is received and loaded for a Program Administration nightly after the first vendor data is loaded for a Program Administration when CDE initiates a manual snapshot The schedule for receiving results data differs for each Program Administration. Therefore, the data is received and loaded at different times during the Academic Year. See General Calendar in the Reports Training for information about each Program’s data load schedule. Because reports are available for viewing immediately after the completion of the load process, this load schedule also indicates the schedule for the availability of suspense data.

96. Assessments & Accountability v 1.0 96 Wrap-Up QUESTIONS (Cont) How will I know when I have suspense data to resolve? When Assessment results have been loaded (which means that the suspense and snapshot processes have also completed), notification that suspense items are available for resolution and that reports are available for viewing will be: Displayed in CALPADS Notifications on the Home page Emailed to the following roles: – LEA STAR Coordinator for STAR data load – LEA CAHSEE Coordinator for CAHSEE data load – LEA CELDT Coordinator for CELDT data load – CDE Assessment Coordinator NOTE: Notification occurs only after data is loaded. There is no notification after the nightly process or after a CDE initiated snapshot.

97. Assessments & Accountability v 1.0 97 Wrap-Up QUESTIONS (Cont) Should I monitor the status of my records through the operational reports? The operational reports are available for your convenience. Monitoring can be accomplished solely through the “Student List”. How frequently should I monitor the status of my suspense records? Once you begin resolving your suspense records, you will want to monitor your list of records to verify that data changes you made have removed the record from your list of suspense records as expected. Since records in suspense do not appear in reports, your schedule for monitoring them should be based on the schedule that accurate reports need to be available for your LEA and the CDE. See General Calendar in the Reports Training for information about each Program’s data availability for reports.

98. Assessments & Accountability v 1.0 98 Wrap-Up When you make changes to data in the ODS, they are replicated to the ODSR in real time. However, the change will not resolve a suspense until one of the following: – You match the suspense data to the corrected CALPADS record – Suspense processing clears the suspense (in nightly process, load, or CDE snapshot) KEY POINTS A suspense record can be resolved in CALPADS by one of the following … − the LEA correcting CALPADS data − the vendor correcting results data − the LEA and/or CDE manually assigning the suspense record to the correct SSID

99. Assessments & Accountability v 1.0 99 Wrap-Up The rules for identifying an SSID Assessment Date (i.e. date CALPADS used to locate the enrollment at the time of testing) may not accurately identify a student’s enrollment at the time of testing, since an actual day of testing is not available in the results data for STAR and CELDT. Consult the Service Desk if you suspect this has occurred. CDE will be working with assessment vendors to get the actual date of testing in the results file, which will eliminate the need to calculate this date. KEY POINTS (Cont)

100. Assessments & Accountability v 1.0 100 Wrap-Up QUESTIONS Will I need to resolve CALPADS suspense records and work with my vendor to correct vendor results data that caused the suspense? Yes, until CDE announces that it will use CALPADS data for Data Quest reports. When CALPADS provides data to the CDE accountability process (AYP/API), it will provide both CALPADS and vendor data for evaluation. CDE will compare the data to determine whether/when CALPADS data can be used.

101. Assessments & Accountability v 1.0 101 DOCUMENTATION Key Terminology Loading Assessment Results Data Validation & Reporting Data Managing Suspense – Batch Files Glossary of Terms and Business Rules – Assessments (separate document) Wrap-Up

102. Assessments & Accountability v 1.0 102 KEY TERMINOLOGY

103. Assessments & Accountability v 1.0 103 Key Terminology KEY TERMS & RELATIONSHIPS Reporting and Data Storage utilize standard definitions ADMINISTRATION DATE (SSID) ASSESSMENT DATE (SSID) ADMINISTRATION DATE (SSID) ASSESSMENT DATE (SSID)

104. Assessments & Accountability v 1.0 104 Key Terminology Program (Testing Program) – STAR Testing Program – CAHSEE Testing Program – CELDT Testing Program Administration - ADMIN (Program Administration) Indicator for a Program’s testing DATA DEFINITIONS cycle: – STAR = ANNUAL – CAHSEE = JUL, OCT, NOV, DEC, FEB, MAR, & MAY – CELDT = JUL, AUG, SEP, OCT, NOV, DEC, JAN, FEB, MAR, APR, MAY, & JUN

105. Assessments & Accountability v 1.0 105 Key Terminology DATA DEFINITIONS (Cont) Calendar (Program Testing Calendar) The schedule for each Program Administration used to indicate the valid testing days for a Program Administration Assessment – STAR = California Standards Tests (CST) California Modified Assessment (CMA) California Alternate Performance Assessment (CAPA) Standards-based Tests in Spanish (STS) – CAHSEE = CAHSEE – CELDT = CELDT

106. Assessments & Accountability v 1.0 106 Key Terminology DATA DEFINITIONS (Cont) Test Content Area (Test Content Area) Subject content area to which the Test belongs (See Documentation) Name of testing instrument (See Documentation)

107. Assessments & Accountability v 1.0 107 LOADING ASSESSMENT RESULTS

108. Assessments & Accountability v 1.0 108 Loading Assessment Results AADS Requires … – Vendor Results Data – Student Profile Data Enrollment (SENR) Student Information (SINF) Student Program (SPRG) LOAD PROCESS A B C D Reporting

109. Assessments & Accountability v 1.0 109 Loading Assessment Results STUDENT PROFILE DATA LOAD What data does CALPADS replicate into ODSR from ODS and when? Student Profile data is replicated from the ODS into the ODSR in real-time as transactions in the ODS occur. The data in the ODSR is a subset of ODS data from all enrollments for currently and previously enrolled students.

110. Assessments & Accountability v 1.0 110 Loading Assessment Results STUDENT PROFILE DATA LOAD (Cont) When does ODSR data get replicated into AADS for reporting? ODSR Student Profile data for a Program Administration gets replicated into AADS as a part of the Suspense Resolution Process by LEAs and CDE, as part of the Suspense Process evaluation of data (nightly and when a Snapshot is taken during a load or manually initiated by CDE i.e. update & freeze of reporting data for a Program Administration). The data include: − For Test Participants without data in suspense: Data that were valid at the time of testing (i.e. SSID Assessment Data Records) − For Non-Test Participants: Data that were valid during the time of testing (i.e. LEA Testing Window) Note: occurs only during Snapshot Process − For currently enrolled students without data in suspense: Current data SSID Assessment Data Records are the ODSR Student Profile Records (SENR, SINF, SPRG) valid at the time of testing that are used in the Suspense Process to validate a Testing Participant’s enrollment. Test Participants are students with results records for a Program Administration (both valid and invalid results)

111. Assessments & Accountability v 1.0 111 Loading Assessment Results STUDENT PROFILE DATA LOAD (Cont) What data does CALPADS snapshot in AADS? data replicated into AADS from ODSR for the Program Administration. This is the data used to report results for Program Administrations, as well as to report results/lack of results for currently enrolled students. The Snapshot process updates and freezes both the vendor results data for the Program Administration and all of the Student Profile

112. Assessments & Accountability v 1.0 112 Loading Assessment Results LOADING RULES SUMMARY ProgramLoad NameInitial Load Rules STAR P1 P2 P3 Overwrite previous load for academic year. Evaluate for Suspense If previous record exists for UIN (student Unique Identification Number), reevaluate for suspense, except for – LEA or CDE Resolved. Do not re-match demo Post P3-LEA(s) No overwrite of P3. Load & evaluate for Suspense If previous record exists for UIN, reevaluate for suspense, except for – LEA or CDE Resolved. Do not re-match demo. Note: Multiple loads are possible for different sets of LEA(s). Load Name is used for Snapshot Name and Extract Name When new data are loaded, suspense records that have been resolved stay resolved, unless enrollment can no longer be validated

113. Assessments & Accountability v 1.0 113 Loading Assessment Results LOADING RULES SUMMARY (Cont) ProgramLoad NameInitial Load Rules CAHSEE MONTHLY-ADMIN NAME QUARTERLY 1-4 EOY No overwrite of previous load for academic year. Load & evaluate for suspense If SSID is in a subsequent load for the same Test & – Same ADMIN, replace previous record & reevaluate for suspense, except for LEA or CDE Resolved. Do not re-match demo. – Different ADMIN, save each record & evaluate new for suspense CELDT MONTHLY-ADMIN NAME PRE-DRM POST-DRM No overwrite of previous load for academic year. Load & evaluate for suspense If SSID is in a subsequent load for the same Test & – Same ADMIN, replace previous record & reevaluate for suspense, except for LEA or CDE Resolved. Do not re-match demo. – Different ADMIN, save each record & evaluate new for suspense Multiple ADMINS are stored for same test (CAHSEE & CELDT)