1. Online Reporting System Florida Standards Assessments
FSA Regional Trainings
This presentation will help you understand the key features and tools of Online Reporting System; the types of data you can access; and how this can be used in the district and school. To accomplish this, we will give an overview of some key components of the system and then provide a guided walk-through of the system itself.
Please note that the screenshots displayed in this presentation are mockups. They do not reflect the final look and feel of ORS, which may be slightly different based on the final development work.
Updated 02/06/15

2. What is the Online Reporting System?
Online Reporting System (ORS) is the gateway to viewing student results from computer- and paper-based testing.
ORS also includes a tool to view participation data for computer-based tests.
Online Reporting System, also known as ORS, is the gateway to viewing student results from computer- and paper-based testing. ORS is a system that enables teachers and administrators to view student results and performance data for each test administration.
ORS also includes a tool to view participation data for computer-based tests. The Reports & Files section of ORS allows users to generate participation reports to determine which students have completed or need to complete computer-based testing.

3. Objectives of This Presentation
Understanding the organization of ORS
Learning to navigate the system and access data
Using Interactive Reports and Reports & Files features
Accessing help and support
We will first provide a brief introduction to the system and then walk you through each of the system’s features. After this presentation, you should be able to navigate ORS and access various types of reports, use Interactive Reports and Reports & Files features, and know how to access help if you have questions or need support.

4. User Roles and Report Access
All ORS users must be assigned a user role in TIDE.
Each user has drill-down access when viewing score results.
School Administrators see the students in their school.
District Assessment Coordinators see the district, schools in that district, and the students in each school in that district.
ORS provides access to testing information based on user roles. There are two basic levels of user roles: district level and school level. Each user is granted drill-down access based on his or her assigned user role. This means that schools will be able to see data for the students in their school while districts will be able to see data for each school and student in the district.

5. Interactive Reports Interactive Reports Subject Detail Page
Reporting Category Detail Page
ORS contains two major features. The first major feature is called Interactive Reports, which provides score data for each of the FSA assessments. Users can compare score data between individual students and the school, district, or overall state average scores.
Student Listing Page
Individual Student Report Page

6. Reports & Files Reports & Files Participation Report
Test Completion Rates
The second major feature is called Reports & Files, which allows users to generate customized participation reports to determine which students have completed or need to complete computer-based testing, view participation summary statistics (count and percentages) of students who tested, and download data files and static reports.
Retrieve Student Results
Retrieve Aggregate Results

7. Navigating Online Reports
Users can navigate throughout ORS by using the Navigation Tool.
The Navigation Tool is present wherever you see a magnifying glass.
The tool provides access to two dimensions of data:
Who: Which entities do you want to access (e.g., students, schools)?
What: What level of the content area is being investigated (e.g., Mathematics, reporting categories)?
You can move up and down any one of these dimensions with the Navigation Tool.
Users navigate throughout ORS using the Navigation Tool, which is present wherever you see a magnifying glass. The Navigation Tool gives you access to two dimensions of data: Who and What. Who includes which entities you want to access such as students and schools, and What includes the level of the content area being investigated such as Math and reporting categories. You can move up or down through these dimensions using the Navigation Tool.

8. Who What Navigation Tool
Click to move to a higher level of a dimension
Click to drill down to details of a dimension
Here is an example of the Navigation Tool, showing two dimensions of data. Clicking the left side of the Navigation Tool will allow you to move to a higher level of a dimension while clicking the right side of the Navigation Tool will allow you to drill down to details of a dimension. A cell that has been grayed out on the Navigation Tool and displays the text N/A means that you cannot navigate any further up or down in that dimension.
NOTE: Clicking the Back button on a web browser returns you to the Home page. Backward navigation should be done with the Navigation Tool.

9. Navigation Tool State District School Student Subject
Reporting Categories
For the “Who” dimension, users can navigate along the levels shown here in the blue chain. For example, District Assessment Coordinators can view information from the district level all the way down to the student level.
For the “What” dimension, users can choose which level of content detail to view for the given subject. For example, for the FSA Mathematics, you can choose to view test result information for the test at the subject level or the reporting category level.

10. Key Features
ORS shares its password with other secure sites that require a login (TIDE, Test Administrator Interface, etc.).
Score reports available after testing:
Student-level data
Aggregate data (state, district, school)
ORS allows users to download data files (e.g., DSR, SAR/DAR files) and static reports (e.g., State Report of Districts, District Report of Schools).

11. Logging in to ORS Access the FSA portal at www.FSAssessments.org.
Select the appropriate role.
Click the Online Reporting System (ORS) icon to be directed to the System Login page.
Enter your username ( address) and password.
Click Log In.
To log in to ORS, go to the FSA Portal. Select a role, which will take you to a user page. Click the ORS icon. Then log in on the login screen using your username ( address) and password.

12. Welcome Page
When you first log in to ORS, the Welcome page is displayed that allows you to select the type of reports that you want to view. To view interactive reports, click the [Interactive Report] button. To view participation data, click the [Participation Report] button. You will be taken to the appropriate report based on your selection. Selecting one or the other does not limit your access to navigate between the two once inside ORS.

13. Home Page
Click any data element for a particular grade and subject to view more data.
If you select Interactive Report from the Welcome page, you will be directed to the Home page, which will automatically display the information that is applicable to your user role. The page shown here displays the Home page for a District Assessment Coordinator. At the top of the screen, you will see a banner that provides links to all ORS reports and features.
- The [Interactive Reports] button links to the Home Page Dashboard screen.
- The [Reports & Files] drop-down menu displays the following options: (1) Participation Report; (2) Test Completion Rates; (3) Retrieve Student Results; and (4) Retrieve Aggregate Results.
- The [Inbox] button links to the Retrieve Student Results screen where you can access data files and static reports.
- The [Search Students] button opens a pop-up window that allows you to search for a student by SID or by first or last name and access his or her test results.
The banner also consists of several tools. The tools that are available may vary from screen to screen.
- The [Help] button links to the ORS User Guide. When you click the [Help] button, the ORS User Guide is displayed in a new tab. This is a useful resource for learning more about system capabilities or for answering questions about where to find certain data.
- The [Print] button enables you to print the current screen. When you click the [Print] button, a dialog box is displayed that enables you to specify your print options. The dialog box may vary slightly depending on the browser that you are using.
- The [Export] button enables you to export the data displayed on the current screen. The data is exported in a Microsoft Excel (.xls) file.
- The [Definitions] button provides definitions for terms specific to the report you are viewing. This button may not appear on every screen. When you click the [Definitions] button, a pop-up window appears. This window contains definitions of the different terms used in the report. To close the pop-up window, click the [X] button in the upper right corner.
To navigate to data for a specific assessment, select a test, administration, and a school for which you would like to see results. On the bottom of the screen, a dashboard will appear with the results based on your selections. The number of students and the mean t score will appear for each subject and grade. To further explore the data, select the grade and subject you wish to explore from either table. As an example, we will select the Grade 3 FSA ELA.

14. Subject Detail Page The titles describe the page and table in detail.
The table shows data for the user’s access level (in this case, Demo District).
The user will be directed to the subject-level data for the selected grade and subject, in this case, Grade 3 FSA ELA. This report provides information about groups of students and aggregate scores.
The page will be accompanied by a detailed title describing the data being viewed as well as the name of the test and administration window.
The table displays comparison data for all the higher levels of the data, such as the state, and data for all the entities at the current level of the “Who” dimension. For example, we may see a list of schools (if the user is a district-level user).
In each column, the headers will tell you the exact data being displayed. The first column displays the number of students who have completed the test at each level of aggregation. The second column displays the mean T scores. For Grades 3 & 10 ELA and Algebra 1, the third and fourth columns will display the mean linked scores to FCAT 2.0 and the percentage in achievement levels 2-5 or 3-5. The last column will display what percentage of students in the group are at each achievement level.

15. Exploring Subject-Level Data
The data can be disaggregated by Enrolled Grade.
The data in this and other tables in ORS can be sorted in a number of ways. On most table columns, the data can be sorted in ascending or descending order simply by clicking the column header.
For any aggregated data, the data can also be disaggregated by Enrolled Grade using the Breakdown By drop-down menu.

16. Exploring the Data: Using the Navigation Tool
Click the magnifying glass to explore the data.
From this subject detail page, users can begin to use the Navigation Tool by clicking the magnifying glass icons next to the district or school names. The Navigation Tool is the main method for moving between reports and deciding which type of data you would like to view. It is designed to help emphasize the hierarchy of the data while allowing the user to navigate with a click of the mouse.
Simply click the magnifying glass to access the Navigation Tool. It will appear as a pop-up box on the webpage, as shown here at the bottom center of the page.
The next sections will show how to explore the data on two different dimensions: Who and What.

17. Navigating the “Who” Dimension
Click [View STUDENT] to go to the Student Listing page.
Click the magnifying glass.
This page shows the information a district user would see on the Subject Detail Report. The example here lists Demo School 1 and Demo School 2 as schools. To view students for Demo School 1, the user would navigate from the subject detail page by clicking the Navigation Tool next to the school’s name and selecting [View STUDENT].

18. Student Listing Page
We can now see a listing of all the students for this particular school (Demo School 1). The Student Listing page, which is the School Report of Students, lists individual data for each student in the selected school. Instead of only aggregate data and mean scores, this page also contains testing data on individual student performance.

19. Batch Printing Individual Student Reports (ISRs)
The [Print] tool on the Student Listing page allows you to print the current screen and also allows you to generate a PDF file of individual student reports for all the students in the school. When you click the [Print] button on the Student Listing page, a pop-up window is displayed that enables you to specify the report you wish to print. To print the data displayed on the screen, click the [Print this page] button. To generate a PDF report of all the listed students, click the [Print Individual Student Reports] button. The PDF reports can be accessed from the Inbox section of the Retrieve Student Results screen.

20. Navigating the “Who” Dimension
Click [View STUDENT] to go to the ISR page.
Click the magnifying glass.
From the Student Listing page, the user can navigate all the way down along the “Who” dimension to access the individual student report page. To view a particular student’s report, the user would navigate from the Student Listing page by clicking the Navigation Tool next to the individual student’s name and selecting [View STUDENT].

21. Individual Student Report (ISR)
This table shows the student’s test performance.
This table shows the comparison scores.
The Individual Student Report page provides a summary of all reporting data for an individual student. The student’s T score and percentile rank are shown in the table at the top of the page. For Grades 3 and 10 ELA and Algebra 1, the student’s linked score to FCAT 2.0 and linked achievement level are also shown. The table in the middle of the page shows the comparison scores and the table at the bottom of the page displays information on the student’s performance in each reporting category for the subject.
This table shows the student’s performance in each reporting category.

22. Navigating the “What” Dimension
Click the magnifying glass.
Click [View Reporting Categories] to go to the Reporting Category Detail page.
We will now explore how to navigate the “What” dimension. Along the “What” dimension, users can choose which level of content detail to view for the given subject. For example, you can choose to view test result information for the test at the subject level or the reporting category level. The left side of the pane appears grayed out because the user in this example is already at the highest “What” dimension - the subject level. In this example, we will click the Navigation Tool to navigate down to a more specific level on the “What” dimension - the reporting category level.

23. Reporting Category Detail Page
Data are presented for each reporting category.
The user is taken to a Reporting Category Detail page. This page provides data on how students performed on specific reporting categories within a subject. Such data can help schools and districts further diagnose possible areas of strengths and weaknesses within a subject.

24. Use the drop-down menu to choose the function you would like to use.
Reports & Files
Use the drop-down menu to choose the function you would like to use.
In addition to the Interactive Reports, Reports & Files is an important feature of ORS. Reports & Files will help users manage and monitor computer-based testing in ORS and download data files and static reports.   
To access the [Reports & Files], click the link visible at the top of all pages in ORS.
The Reports & Files displays four tabs: Participation Report, Test Completion Rates, Retrieve Student Results, and Retrieve Aggregate Results.

25. Reports & Files: Participation Report
Choose What and Who to include in report, then filter with specific information about student’s participation.
Selecting the [Participation Report] tab will take the user to a page from which detailed participation reports can be accessed for all computer-based tests. As shown on this slide, the user can build a custom report by choosing among a list of options for the type of data he or she wants to view.
As with the other reports, users will need to first choose what test to include in the report output as well as whom to include in the report.
Display onscreen or export to Excel.

26. Using the Participation Report
Common examples of Participation Report cases:
Which students have not yet tested?
Which students have started but not yet completed their test?
Which students have paused tests?
Did all students in a test session complete their tests?

27. Reports & Files: Participation Report
Once the user has made the appropriate selections and clicked the [Generate Report] button, the output table will display results. This Participation Report output example shows the list of students who have completed the Grade 8 FSA ELA Writing Field Test. Note that the user will search for the “reported” status to determine if students have completed testing. “Reported” only means that the student’s test was completed in TDS.
With these results, District Assessment Coordinators and school personnel can track participation and student results across the district or school.
Note that participation reports are available only for computer-based tests.

28. Reports & Files: Test Completion Rates
Test Completion Rates provide a high-level view of how many students have started and completed all possible computer-based tests by school, district, or state (limited to the user’s level of access). This is a quick way for district assessment coordinators to track schools’ participation for all computer-based tests. To see which individual students have or have not completed a given computer-based test in a school, the user can view the reports in Participation Report.
Select reports by schools or district to see the number of tests started/completed.

29. Reports & Files: Retrieve Student Results
Choose What and Who to include in data file.
Choose a file format.
Download completed data file.
Click Download File.
Selecting the [Retrieve Student Results] tab will direct users to a page from which they can build custom downloadable data files for groups of students.
Once on this page, the user will need to complete Steps 1 and 2 displayed at the top of the page to choose what they would like to view (test, administration and grade) and whose results they would like to view. After the parameters have been selected, clicking Download File will prompt the system to begin creating the file.
When the file has been generated, it will appear in the user’s inbox (My Inbox), shown here at the bottom of the slide. The user can then download the file and view it in either fixed width or Excel format. Remember, users can access their inbox from any page in ORS by clicking the Inbox icon. This inbox is only for ORS and is used to retrieve these student data files, as well as any static reports (e.g., State Report of Districts, District Report of Schools).
My Inbox will also be used to access DSR, SAR, DAR, and similarity results files in the summer, as these data files will be posted in the user’s inbox (based on the user’s role and level of access). Unlike custom-generated files that will be available for 30 days, these files will be available for the duration specified by FDOE.
Data file has score report data across subject. File is available for 30 days. User is alerted by when the file is ready.

30. Reports & Files: Retrieve Aggregate Results
Choose the specific report you would like to download and what you would like to view (test, administration, and grade).
Selecting the [Retrieve Aggregate Results] tab will direct users to a page from which they can download the following static reports: (1) State Summary; (2) State Report of Districts; (3) State Report of Schools; (4) District Summary; and (5) District Report of Schools.
Once on this page, the user will need to choose the specific report he or she would like to download and what they would like to view (test, administration, and grade). After the parameters have been selected, clicking [Download Report] will prompt the system to begin creating the report.
When the report has been generated, it will appear in the user’s inbox (My Inbox) shown in the previous slide. The user can then download the report and view it.

31. Things to Remember
The magnifying glass icon indicates what data can be further explored.
All tables can be printed and exported.
The Help (User Guide) button is available for every page.
Inbox is used to download DSR, SAR/DAR, and similarity results files, as well as any static reports.

32. Paper Score Reports
Students who participate in a computer- or paper-based assessment will receive a paper Score Report.
Paper Reports will be sent to districts.
Schools will distribute the reports to students.
Students who participate in a computer- or paper-based assessment will receive a paper Score Report. These student scores will also appear in ORS. Paper Reports will be sent to districts. District will then distribute them to schools who will then send/distribute them to students.

33. Online Reporting System Resources
ORS User Guide
ORS Webinar (February)
Other resources to help with the administration of FSAs will be available soon on the FSA Portal. Please check the FSA portal frequently for up-to-date information.

34. Contact Us FSA Portal: www.FSAssessments.org Email:
Toll-Free Phone:
Hours:
7:00 a.m.–8:30 p.m. (ET)
Monday–Friday (except holidays)
This concludes the ORS Webinar. More detailed information on TIDE, the Test Delivery System, and ORS can be found in the User and Quick Guides posted to the FSA portal. If you need additional assistance, please contact the AIR Help Desk.
Hours: 7:00 a.m.–8:30 p.m. (ET) Monday–Friday (except holidays)