Www.FLDOE.org © 2014, Florida Department of Education. All Rights Reserved. K-12 Student Assessment Scoring and Reporting Dr. Qian Liu Gabriel Colorado.

Slides:



Advertisements
Similar presentations
TIDE Presentation Florida Standards Assessments 1 FSA Regional Trainings Updated 02/09/15.
Advertisements

Components of the 2015 Texas Assessment Program State of Texas Assessments of Academic Readiness (STAAR) –STAAR Spanish –STAAR A –STAAR L –STAAR Alternate.
Computer-Based Testing (CBT) Certification Tool (FSA, FCAT/FCAT 2.0, and EOC) Maria C. Bruguera, Director 1 Mara C. Ugando, Staff Specialist Assessment,
© 2014, Florida Department of Education. All Rights Reserved. Department of Education Update Florida Charter School Conference November 20,
Test Setup & Managing the Test Information Distribution Engine (TIDE) 1 FSA Live Training February 19, 20 & 23.
Classroom Diagnostic Tools and Keystone Exams PAIUCC Meeting, September 17, 2010 PAIUCC Meeting Classroom Diagnostic Tools and.
COMPUTER-BASED TESTING (CBT) CERTIFICATION TOOL (FSA, FCAT/FCAT 2.0, AND EOC) Maria C. Bruguera, Director 1 Mara C. Ugando, Staff Specialist Assessment,
Data Cleanup Tools 1. Close Out 2015 SAGE Testing Overview of Special Codes Management of Special Codes Working with Special Codes – TIDE – ORS Use Cases.
1 Student Registration Import Must be imported into PBA by 2/18.
FY2015 Assessment Update CAO July 2014 Dr. Frank Rodriguez, Assistant Superintendent Mark Howard, Director.
THE NEW FSA Florida Standards Assessment Dr. Karen Schafer Brevard Public Schools July, 2014.
Test Information Distribution Engine (TIDE) Copyright © 2014 American Institutes for Research. All rights reserved. Training Module.
Test Administration Training 2 Test Management Functionality for TestNav 8.
September 2008Demographic Data Corrections STAR Demographic Data Corrections Webcast September 25, 2008 Start time 9:00 a.m.
FSA Writing Component Spring 2015.
Florida Standards Assessments Paper-Based Materials SCHOOL COORDINATOR RETURN INSTUCTIONS.
Online HSAP Reporting System for HSA, HSA-Alt, and EOC Exams September 19, :30 PM - 3:30 PM HST For audio, please call
Nancy Severe-Barnett Program Coordinator, SCIS
1 Welcome to HSPA Online. 2 Measurement Incorporated Partnering with NJDOE & New Jersey School Districts.
© 2014, Florida Department of Education. All Rights Reserved Annual District Assessment Coordinator Meeting VAM Update.
Online Reporting System Florida Standards Assessments (ELA/Mathematics, EOC) This presentation will help you understand the key features and tools of.
Understanding Your Child’s FSA Score
March 2009 Supplemental Order/Late Labels and Extended Data Corrections STAR Supplemental Order/Late Labels and Extended Data Corrections Webcast.
STAR Extended Pre-ID Data Corrections March 27, 2013 START TIME 9 a.m. Presenters: Michael McDaniel and Nicole Goward Extended Pre-ID Data Corrections.
PearsonAccess April 14, PearsonAccess – Agenda Order Tracking Additional Orders Student Data Upload (SDU) files New Student Wizard Online Testing.
Test Information Distribution Engine (TIDE) Copyright © 2014 American Institutes for Research. All rights reserved. South Dakota Smarter Balanced Assessment.
2011 STAR Extended Pre-ID Data Corrections March 30, 2011 START TIME 9:00 a.m. Presenters: Michael McDaniel and Nicole Goward Extended Pre-ID Data Corrections.
STAR Extended Pre-ID Data Corrections March 28, 2012 START TIME 9 a.m. Presenters: Michael McDaniel and Mark Hansen Extended Pre-ID Data Corrections.
COMPUTER-BASED TESTING (CBT) CERTIFICATION TOOL (FSA, FCAT 2.0, AND NGSSS) MARIA C. BRUGUERA, DIRECTOR 1 MARA C. UGANDO, STAFF SPECIALIST ASSESSMENT, RESEARCH,
Measuring the Power of Learning.™ California Assessment of Student Performance and Progress (CAASPP) TOMS Test Administration TOMS Test Administration.
Session 5 Achievement Testing Pre-Test Training Spring 2016 AzMERIT Testing Part 1 – Tasks
FSA Spring 2016 Updates & Reminders January 19th and 20th,
Fall/Winter 2015 End-of-Course and Retake Assessments Training Materials FCAT 2.0 Reading Retake Algebra 1 Retake EOC Biology 1, Civics, U.S. History EOC.
Test Setup & Managing the Test Information Distribution Engine (TIDE) 1 FSA Live Training February 12, 18 & 19.
Top-performing urban school district in Florida Introduction to TIDE 1.
Texas Assessment Management System STAAR Alternate Manage Teacher Assignments.
American Diploma Project Administrative Site Training.
SAGE Spring Summative Training Assessment and Accountability Utah State Office of Education.
American Diploma Project Administrative Site Training.
© 2014, Florida Department of Education. All Rights Reserved. Accountability Update School Grades Technical Assistance Meeting.
FLORIDA TEST SCORES. TEST BUILDER RECORDS Adding New Test Records Test Name Codes Display and Update Options Link to State Code Use for ELL Exclude from.
Accountability Corrections Prior Year Assessment Matching.
Test Information Distribution Engine (TIDE) Copyright © 2014 American Institutes for Research. All rights reserved. Training Module.
American Diploma Project Administrative Site Training New Jersey.
American Diploma Project Administrative Site Training.
© 2014, Florida Department of Education. All Rights Reserved. K-12 Student Assessment Scoring and Reporting Dr. Qian Liu Gabriel Colorado.
K-12 Student Assessment Scoring and Reporting
2016–17 FSA TIDE Webinar.
PearsonAccess EOC Training
Computer-Based Testing
The end is in sight!!! Accountability Corrections
Texas Assessment Management System Student Directory and Send Files
Winter 2017 PearsonAccess Next District Training Webinar
Accountability Applications 2017
2017 State Assessment Highlights
Adding and editing students and student test settings
March 12, 2008 START TIME 9:00 AM Presenter: Jonathan Halling
Test Information Distribution Engine (TIDE)
Adding and editing users
Activating your account and navigating through TIDE
Adding and Editing Users
Managing Rosters Screener Training Module Module 5
Test Information Distribution Engine (TIDE) Training
Test Information Distribution Engine (TIDE) Training
A Parents’ Guide to the FL Standards Assessment
Webinar: Test Accommodations in SIS January 2018
Computer-Based Testing (CBT) Certification Tool
School Improvement Ratings Rule 6A , F.A.C.
CMAS and CoAlt SBD Training
Presentation transcript:

© 2014, Florida Department of Education. All Rights Reserved. K-12 Student Assessment Scoring and Reporting Dr. Qian Liu Gabriel Colorado Annual District Assessment and Accountability Coordinators Meeting 1

© 2014, Florida Department of Education. All Rights Reserved. NGSSS FCAT 2.0/End-of-Course (EOC) Assessments FCAT 2.0 Reading Retake  Last two test administrations: Fall 2015 and Spring 2016  Alternate Passing Score (APS) indicator in PreID file o Students may ONLY be flagged for APS status via PreID upload for each test administration. o A student should only be marked eligible for APS status if he/she entered the 9 th in the school year or before. o The default value for this field should be ‘No’. 2

© 2014, Florida Department of Education. All Rights Reserved. NGSSS FCAT 2.0/End-of-Course (EOC) Assessments Florida Statewide Science Assessment  Grade 5 and Grade 8 NGSSS EOCs  Fall, Winter, Spring and Summer test administrations  Algebra 1 Retake, Biology 1, Civics and U.S. History FCAT 2.0 Reading Retake, Science and EOCs results will be reported using the following three measures: Scale Scores, Content Area Scores and Achievement Levels. 3

© 2014, Florida Department of Education. All Rights Reserved. Florida Standards Assessments (FSA) ELA/Mathematics/EOC English Language Arts (ELA) (Grades 3-10) o Writing component (Grades 4-10) Mathematics (Grades 3-8) EOC (Algebra 1, Algebra II and Geometry) 4

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  In the data file, each student has a Score Status Flag for each subject. If a student took the test but score is not reported, the Score Status Flag defines the reason the scores wasn’t reported. Only records with flag of 1 are aggregated for regular reporting.  Each flag of 0 to 9 is assigned to a record and then the flag hierarchy is used to determine one flag for each subject for the record. The flags are set prior to merging the Writing and Reading records since some flags prohibit records merging and ELA scoring. 5

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  Score flag 4: Insufficient Match to TIDE (PBT only) o The flag is 4 if the test record is an insufficient match to student record in TIDE after the matching criteria has been applied. o It is important to enter student record to TIDE. o Discrepancy Resolution System will be available after the regular score release to resolve the scoreflag 4 so that a valid score could be reported during the late reporting. 6

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  Score flag 5: Below-Grade Tester o The flag is 5 if the tested grade is lower than the enrolled grade that is in the PreID file/TIDE. o The enrolled grade changed from the time student record was entered to TIDE through the end of the test administration window. 7

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  Score flag 5: Below-Grade tester 8 Tested Grade 4 Enrolled Grade 4 Enrolled Grade 5 Enrolled Grade 4 When Taking the Test At the end of the testing window Student A Student B

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  Score flag 5: Below-Grade Tester o Depending on when the enrolled grade is updated or changed, the score flag might be set differently for a student. o The enrolled grade information that is recorded at the time that the student completes his/her first test will be used to determine the below-grade tester score flag. 9

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  Score flag 5: Below-Grade tester 10 Tested Grade 4 Enrolled Grade 4 Enrolled Grade 5 Enrolled Grade 4 when taking the test At the end of the testing window Student A Student B Scoreflag of 1 Scoreflag of 4

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  Score flag 6: Duplicate Record within/across grade o The score flag is 6 if the SID is the same for more than one test records for the same subject test (e.g. Grade 5 mathematics and Grade 6 mathematics or Grade 6 reading PBT and Grade 6 reading CBT). o The scores will be held until one can be released (score flag of 9) and the other(s) can be invalidated (score flag of 3) during the late reporting. 11

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag  ELA Score Flag/Report Status o 0 – Not Reported/Not Tested o 1 – Score Reported o 9 – Score Report for late reporting The Writing and Reading score status flags determine the ELA score flag and ELA report status. 12

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Score Status Flag – ELA Score Flag * All pending ELA records (i.e., Writing or Reading records that cannot be merged with the other component test) will get a score flag of Writing Score Flag Reading Score Flag ELA Score Flag ELA Report Status 111 RS Report Score , 1, 3, 4, 5, 6, 7, 8, 9 2, 3, 4, 5, 6, 7, 80 NR Not Reported 3, 4, 5, 6, 7, 8 0, 1, 2, 3, 4, 5, 6, 7, 8, NT Not Tested

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Scoring  Spring/Summer/Fall 2015 o District Student Results (DSR) file contains Raw Score, Content Area Scores, T-score, Percentile Rank, Theta score, Linked score with the Passing Information (Grade 10 ELA and Algebra 1 EOC). o The student-level result will be reported using the Percentile Rank, Content Area Scores with the Maximum Point Possible, Passing Information (Grade 10 ELA and Algebra 1 EOC). 14

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/EOC Scoring  Spring/Summer/Fall 2015 o The State-, District-, School-level results will be reported using the Mean T-score, Mean linked score with Percentage Passing (Grade 10 ELA and Algebra 1 EOC). o Suppression Rules: To provide meaningful results and to protect the privacy of individual students, no data are reported if the number of students is less than 10 or if all students would be reported in the same category (e.g. all students pass the Grade 10 ELA). An asterisk(*) appears when data are suppressed. 15

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/End-of-Course Assessments Scoring  Winter 2015/Spring 2016 o DSR file contains Raw Score, Content Area Scores, Theta score, Scale Score, Achievement Level (2016). o The student-level result will be reported using the Scale Score, Content Area Scores with Maximum Points Possible, Achievement level (2016) with Passing Information when it is applicable. o The State-, District-, School-level results will be reported using the Mean Scale Score, Percentage at each achievement level (2016) with Percentage Passing when it is applicable. 16

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/End-of-Course Assessments Reporting  Score Release via Online Reporting System (ORS) o Data Files (DSR/DAR/SAR) o PDF of the aggregation results o Interactive report o Hard copy of Individual Student Report 17

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/End-of-Course Assessments Reporting  Score Release via Online Reporting System (ORS) o Data Files (DSR/DAR/SAR) Fixed – width pipe-delimited text file The start and end numbers for each field in the file layouts are not at sequence as the position values account for the pipe delimiters. The files are by grade and by subject. The excel/CSV format files are also available to download with student identification information and basic score information. 18

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/End-of-Course Assessments Reporting  Score Release via Online Reporting System (ORS) o PDF of the aggregation results State Summary District Summary State Report of Districts State Report of Schools District Report of Schools o Excel format of the aggregation results 19

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/End-of-Course Assessments Reporting  Score Release via Online Reporting System (ORS) o Interactive Report Aggregated scores for districts and schools School Report of students Individual Student Report 20

© 2014, Florida Department of Education. All Rights Reserved. FSA ELA/Mathematics/End-of-Course Assessments PreID Upload via Test Information Distribution Engine (TIDE)  Unique SID for each student is required.  Please DO NOT delete student record from TIDE if there is a test record tied to that student.  Enter student record(s) to TIDE before the test administration ends and print the ‘on-demand’ PreID label. 21

© 2014, Florida Department of Education. All Rights Reserved. Two Systems Score Invalidation Appeal Invalidations based on similar answer patterns Score Inquiry System Everything except Score Invalidation Appeals such as missing scores, undo DNS etc. 22

© 2014, Florida Department of Education. All Rights Reserved. 23 TIDE Test Information Distribution Engine

© 2014, Florida Department of Education. All Rights Reserved. Topics Matching Pre-Existing Students Name Changes Solutions Rosters Across Administrations Show History How to Access Features/Functionality

© 2014, Florida Department of Education. All Rights Reserved. Matching Pre-Existing Students 25 Example: Summer Record: Fall Record: Step One: Check to see if SID has been used before. Summer Record: Fall Record: = Note: If Step One clears (the SID has been used before), TIDE will proceed to Step Two. Otherwise, your student should be added successfully (as long as there are no errors) ?

© 2014, Florida Department of Education. All Rights Reserved. Matching Pre-Existing Students 26 Example: Summer Record: Fall Record: Step Two: Check to make sure names match. Summer Record: Fall Record: Adam =Smith-Williams = Note: This name match is not an EXACT match. For example, Catherine and Katherine would be considered a match by TIDE. Adam?Smith?

© 2014, Florida Department of Education. All Rights Reserved. Matching Pre-Existing Students 27 Example: Summer Record: Fall Record: How to Fix: Option 1: If you know what the student’s name was last administration, update the current name to the old name. o You can then edit the student’s name through the individual Add Students interface on TIDE. Option 2: If you do not know what the student’s name was last administration, contact FDOE or the AIR Help Desk. Summer Record: Fall Record:

© 2014, Florida Department of Education. All Rights Reserved. Rosters Across Administrations 28 TIDE views each administration as belonging to a school year. For example, Fall 2015 – Summer 2016 is considered the school year. This can cause districts to have issues with rosters. Example: AdminRoster NameStudents Displayed Summer 15 ROOM1Summer 15 Fall 15 ROOM1Fall 15 Winter 15 ROOM1Fall 15 and Winter 15 Spring 15 ROOM1Fall 15, Winter 15 and Spring 15

© 2014, Florida Department of Education. All Rights Reserved. Rosters Across Administrations 29 Solution: The best way to fix this problem is to have admin- specific roster names. Ex: SUM15SMITH Fixed Example: AdminRoster NameStudents Displayed Summer 15 SUM15ROOM1Summer 15 Fall 15 FAL15ROOM1Fall 15 Winter 15 WIN15ROOM1Winter 15 Spring 16 SPR16ROOM1Spring 16

© 2014, Florida Department of Education. All Rights Reserved. Show History 30 Added during PreID window last spring. Helpful in getting status updates / information about your PreID uploads.

© 2014, Florida Department of Education. All Rights Reserved. Show History – FileName and Date Uploaded 31 One entry for each attempted upload. Clicking on the FileName will let you re-download any PreID files successfully received by AIR. Each entry will show the date it was uploaded to TIDE.

© 2014, Florida Department of Education. All Rights Reserved. Show History – Status 32 Shows current status of your file upload. Most Common: Offline Validated – Passed initial validation, in queue. Processed – Processed successfully. Error – There was an issue, either resubmit or call FDOE.

© 2014, Florida Department of Education. All Rights Reserved. Show History – Records Processed/Rejected 33 Download will be available if your upload had records either processed successfully or rejected. Number in parentheses reflects number of records. Clicking on Download will save a file to your local drive with just the processed/rejected record data.

© 2014, Florida Department of Education. All Rights Reserved. Show History – Validation Log 34 Download will be available if your upload had records rejected due to errors. Clicking on Download will save a file to your local drive with a log for each error encountered

© 2014, Florida Department of Education. All Rights Reserved. Show History – Validation Log Example 35 Date and Time Record Number Error Description Field with Error Value of Field with Error

© 2014, Florida Department of Education. All Rights Reserved. Contact Information K-12 Scoring and Reporting Team Qian Liu: Brian Lane: Gabriel Colorado Justin Tarin Esra Kocyigit Seung-Yeon Ha Marilyn Dwyer Ying Zhang

© 2014, Florida Department of Education. All Rights Reserved. 37