© 2014, Florida Department of Education. All Rights Reserved. K-12 Student Assessment Scoring and Reporting Dr. Qian Liu Gabriel Colorado Annual District Assessment and Accountability Coordinators Meeting 1

© 2014, Florida Department of Education. All Rights Reserved. NGSSS FCAT 2.0/End-of-Course (EOC) Assessments FCAT 2.0 Reading Retake  Last two test administrations: Fall 2015 and Spring 2016  Alternate Passing Score (APS) indicator in PreID file o Students may ONLY be flagged for APS status via PreID upload for each test administration. o A student should only be marked eligible for APS status if he/she entered the 9 th in the school year or before. o The default value for this field should be ‘No’. 2

© 2014, Florida Department of Education. All Rights Reserved. NGSSS FCAT 2.0/End-of-Course (EOC) Assessments Florida Statewide Science Assessment  Grade 5 and Grade 8 NGSSS EOCs  Fall, Winter, Spring and Summer test administrations  Algebra 1 Retake, Biology 1, Civics and U.S. History FCAT 2.0 Reading Retake, Science and EOCs results will be reported using the following three measures: Scale Scores, Content Area Scores and Achievement Levels. 3

© 2014, Florida Department of Education. All Rights Reserved. Florida Standards Assessments (FSA) ELA/Mathematics/EOC English Language Arts (ELA) (Grades 3-10) o Writing component (Grades 4-10) Mathematics (Grades 3-8) EOC (Algebra 1, Algebra II and Geometry) 4

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  In the data file, each student has a Score Status Flag for each subject. If a student took the test but score is not reported, the Score Status Flag defines the reason the scores wasn’t reported. Only records with flag of 1 are aggregated for regular reporting.  Each flag of 0 to 9 is assigned to a record and then the flag hierarchy is used to determine one flag for each subject for the record. The flags are set prior to merging the Writing and Reading records since some flags prohibit records merging and ELA scoring. 5

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  Score flag 4: Insufficient Match to TIDE (PBT only) o The flag is 4 if the test record is an insufficient match to student record in TIDE after the matching criteria has been applied. o It is important to enter student record to TIDE. o Discrepancy Resolution System will be available after the regular score release to resolve the scoreflag 4 so that a valid score could be reported during the late reporting. 6

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  Score flag 5: Below-Grade Tester o The flag is 5 if the tested grade is lower than the enrolled grade that is in the PreID file/TIDE. o The enrolled grade changed from the time student record was entered to TIDE through the end of the test administration window. 7

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  Score flag 5: Below-Grade tester 8 Tested Grade 4 Enrolled Grade 4 Enrolled Grade 5 Enrolled Grade 4 When Taking the Test At the end of the testing window Student A Student B

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  Score flag 5: Below-Grade Tester o Depending on when the enrolled grade is updated or changed, the score flag might be set differently for a student. o The enrolled grade information that is recorded at the time that the student completes his/her first test will be used to determine the below-grade tester score flag. 9

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  Score flag 5: Below-Grade tester 10 Tested Grade 4 Enrolled Grade 4 Enrolled Grade 5 Enrolled Grade 4 when taking the test At the end of the testing window Student A Student B Scoreflag of 1 Scoreflag of 4

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  Score flag 6: Duplicate Record within/across grade o The score flag is 6 if the SID is the same for more than one test records for the same subject test (e.g. Grade 5 mathematics and Grade 6 mathematics or Grade 6 reading PBT and Grade 6 reading CBT). o The scores will be held until one can be released (score flag of 9) and the other(s) can be invalidated (score flag of 3) during the late reporting. 11

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  ELA Score Flag/Report Status o 0 – Not Reported/Not Tested o 1 – Score Reported o 9 – Score Report for late reporting The Writing and Reading score status flags determine the ELA score flag and ELA report status. 12

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag – ELA Score Flag * All pending ELA records (i.e., Writing or Reading records that cannot be merged with the other component test) will get a score flag of Writing Score Flag Reading Score Flag ELA Score Flag ELA Report Status 111 RS Report Score , 1, 3, 4, 5, 6, 7, 8, 9 2, 3, 4, 5, 6, 7, 80 NR Not Reported 3, 4, 5, 6, 7, 8 0, 1, 2, 3, 4, 5, 6, 7, 8, NT Not Tested

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Scoring  Spring/Summer/Fall 2015 o District Student Results (DSR) file contains Raw Score, Content Area Scores, T-score, Percentile Rank, Theta score, Linked score with the Passing Information (Grade 10 ELA and Algebra 1 EOC). o The student-level result will be reported using the Percentile Rank, Content Area Scores with the Maximum Point Possible, Passing Information (Grade 10 ELA and Algebra 1 EOC). 14

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Scoring  Spring/Summer/Fall 2015 o The State-, District-, School-level results will be reported using the Mean T-score, Mean linked score with Percentage Passing (Grade 10 ELA and Algebra 1 EOC). o Suppression Rules: To provide meaningful results and to protect the privacy of individual students, no data are reported if the number of students is less than 10 or if all students would be reported in the same category (e.g. all students pass the Grade 10 ELA). An asterisk(*) appears when data are suppressed. 15

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/End-of-Course Assessments Scoring  Winter 2015/Spring 2016 o DSR file contains Raw Score, Content Area Scores, Theta score, Scale Score, Achievement Level (2016). o The student-level result will be reported using the Scale Score, Content Area Scores with Maximum Points Possible, Achievement level (2016) with Passing Information when it is applicable. o The State-, District-, School-level results will be reported using the Mean Scale Score, Percentage at each achievement level (2016) with Percentage Passing when it is applicable. 16

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/End-of-Course Assessments Reporting  Score Release via Online Reporting System (ORS) o Data Files (DSR/DAR/SAR) o PDF of the aggregation results o Interactive report o Hard copy of Individual Student Report 17

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/End-of-Course Assessments Reporting  Score Release via Online Reporting System (ORS) o Data Files (DSR/DAR/SAR) Fixed – width pipe-delimited text file The start and end numbers for each field in the file layouts are not at sequence as the position values account for the pipe delimiters. The files are by grade and by subject. The excel/CSV format files are also available to download with student identification information and basic score information. 18

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/End-of-Course Assessments Reporting  Score Release via Online Reporting System (ORS) o PDF of the aggregation results State Summary District Summary State Report of Districts State Report of Schools District Report of Schools o Excel format of the aggregation results 19

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/End-of-Course Assessments Reporting  Score Release via Online Reporting System (ORS) o Interactive Report Aggregated scores for districts and schools School Report of students Individual Student Report 20

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/End-of-Course Assessments PreID Upload via Test Information Distribution Engine (TIDE)  Unique SID for each student is required.  Please DO NOT delete student record from TIDE if there is a test record tied to that student.  Enter student record(s) to TIDE before the test administration ends and print the ‘on-demand’ PreID label. 21

© 2014, Florida Department of Education. All Rights Reserved. Two Systems Score Invalidation Appeal Invalidations based on similar answer patterns Score Inquiry System Everything except Score Invalidation Appeals such as missing scores, undo DNS etc. 22

© 2014, Florida Department of Education. All Rights Reserved. 23 TIDE Test Information Distribution Engine

© 2014, Florida Department of Education. All Rights Reserved. Topics Matching Pre-Existing Students Name Changes Solutions Rosters Across Administrations Show History How to Access Features/Functionality

© 2014, Florida Department of Education. All Rights Reserved. Matching Pre-Existing Students 25 Example: Summer Record: Fall Record: Step One: Check to see if SID has been used before. Summer Record: Fall Record: = Note: If Step One clears (the SID has been used before), TIDE will proceed to Step Two. Otherwise, your student should be added successfully (as long as there are no errors) ?

© 2014, Florida Department of Education. All Rights Reserved. Matching Pre-Existing Students 26 Example: Summer Record: Fall Record: Step Two: Check to make sure names match. Summer Record: Fall Record: Adam =Smith-Williams = Note: This name match is not an EXACT match. For example, Catherine and Katherine would be considered a match by TIDE. Adam?Smith?

© 2014, Florida Department of Education. All Rights Reserved. Matching Pre-Existing Students 27 Example: Summer Record: Fall Record: How to Fix: Option 1: If you know what the student’s name was last administration, update the current name to the old name. o You can then edit the student’s name through the individual Add Students interface on TIDE. Option 2: If you do not know what the student’s name was last administration, contact FDOE or the AIR Help Desk. Summer Record: Fall Record:

© 2014, Florida Department of Education. All Rights Reserved. Rosters Across Administrations 28 TIDE views each administration as belonging to a school year. For example, Fall 2015 – Summer 2016 is considered the school year. This can cause districts to have issues with rosters. Example: AdminRoster NameStudents Displayed Summer 15 ROOM1Summer 15 Fall 15 ROOM1Fall 15 Winter 15 ROOM1Fall 15 and Winter 15 Spring 15 ROOM1Fall 15, Winter 15 and Spring 15

© 2014, Florida Department of Education. All Rights Reserved. Rosters Across Administrations 29 Solution: The best way to fix this problem is to have admin- specific roster names. Ex: SUM15SMITH Fixed Example: AdminRoster NameStudents Displayed Summer 15 SUM15ROOM1Summer 15 Fall 15 FAL15ROOM1Fall 15 Winter 15 WIN15ROOM1Winter 15 Spring 16 SPR16ROOM1Spring 16

© 2014, Florida Department of Education. All Rights Reserved. Show History 30 Added during PreID window last spring. Helpful in getting status updates / information about your PreID uploads.

© 2014, Florida Department of Education. All Rights Reserved. Show History – FileName and Date Uploaded 31 One entry for each attempted upload. Clicking on the FileName will let you re-download any PreID files successfully received by AIR. Each entry will show the date it was uploaded to TIDE.

© 2014, Florida Department of Education. All Rights Reserved. Show History – Status 32 Shows current status of your file upload. Most Common: Offline Validated – Passed initial validation, in queue. Processed – Processed successfully. Error – There was an issue, either resubmit or call FDOE.

© 2014, Florida Department of Education. All Rights Reserved. Show History – Records Processed/Rejected 33 Download will be available if your upload had records either processed successfully or rejected. Number in parentheses reflects number of records. Clicking on Download will save a file to your local drive with just the processed/rejected record data.

© 2014, Florida Department of Education. All Rights Reserved. Show History – Validation Log 34 Download will be available if your upload had records rejected due to errors. Clicking on Download will save a file to your local drive with a log for each error encountered

© 2014, Florida Department of Education. All Rights Reserved. Show History – Validation Log Example 35 Date and Time Record Number Error Description Field with Error Value of Field with Error

© 2014, Florida Department of Education. All Rights Reserved. Contact Information K-12 Scoring and Reporting Team Qian Liu: Brian Lane: Gabriel Colorado Justin Tarin Esra Kocyigit Seung-Yeon Ha Marilyn Dwyer Ying Zhang

© 2014, Florida Department of Education. All Rights Reserved. 37