1. Online Reporting System (Required for DTCs)

2. Objectives
Understand the role and purpose of Score Reports in supporting student success and achievement.
Understand changes to the Online Reporting System and how to use the interface.

3. Overview Available through the OAKS Portal
Definition: Online Reporting System
Available through the OAKS Portal
Purpose:
To allow districts and school staff and teachers to identify strengths and weaknesses and improve teaching and learning by providing:
Aggregate performance data for districts, schools, teachers, and classes
Scores for individual students
The ability to print student reports to distribute to families
The ability to view performance trends
The ability to create and view reports for custom rosters
Aggregate and student level performance strand data
Aggregate level performance data on content standards

4. New Features for 2012-2013 New features in ORS on November 6, 2012:
Eligibility-Based Reporting: ORS now bases participation reports on students who are eligible to take the test (as defined by student’s attributes in TIDE).
Summary Participation Counts: In Plan and Manage Testing, users can get frequency data for the number of students who have completed each test in their school or district.
Test Administrator (TA) Participation Reports: In Plan and Manage Testing, users can see the test statuses for students based on their most recent test session.

5. Other Changes to Reports
Batch printing of Individual Student Reports is now available from the Student Listing page.
Pagination is removed from the Export feature—all records will now export in a single file, even if displayed on multiple pages.
The values on the Summary Statistics report and the % Completed By Opportunity values are based on all students who tested, even if the students go on to take another opportunity.
Users can create data files for all available grades in Retrieve Student Results.
OAKS High School reports are now based on four years of score data instead of three.
Regarding Student Transfers (this is also detailed in later slides)
Beginning this year, data access will transfer with a student. If a student transfers to your school or district, you will be able to see all of his or her scores in the reports, even if the scores were earned elsewhere. Conversely, if a student transfers out of your school or district, you will no longer be able to access the scores he or she earned at your school. These students will also be included or excluded from aggregate calculations using the same rule. This reporting rule is designed to give educators the most accurate information about their current students and has no impact on how AYP is calculated.

6. Score Reports: Subject Performance
District users can see performance data for the district and its schools; school users see data for a school and each teacher; etc.
The distribution of students across performance levels is displayed graphically to allow easier comparison
between groups
Users can view the data for subgroups by choosing
an option from the “Breakdown By” dropdown
- The look and feel of the final system might be slightly different than presented here
- Labels will be appropriately updated

7. Score Reports: Navigation
- The look and feel of the final system might be slightly different than presented here
- Labels will be appropriately updated
Users can explore the data in various ways to answer questions they have of the performance reports and identify strengths and weaknesses.
The icon indicates that data can be further explored.
When users click the icon, they see a control panel that will let them select whether they want to see more or less group detail, more or less content detail, or if they want to see a trend for a particular piece of data.

8. Score Reports: Navigation, cont’d
By choosing more or less group detail, users can see data for schools, individual personnel, classes, or individual students.
The buttons on the control panel will update to identify the data the user is accessing.
This will help users answer “who” questions.
For example: Who is struggling in algebra?

9. Score Reports: Navigation, cont’d
By choosing “Trend” or “Current” users can choose whether they want information on the current year performance of a student, group of students, school, or district or if they want a historical trend of that performance.
This will help users answer “When” questions. For example,
Has this group of students struggled in
mathematics in the past?

10. Score Reports: Data and Tools
Users can access these data and tools:
Longitudinal Reports
Rosters of students with scores
Ability to create custom rosters
Ability to view all aggregated data for custom rosters
Printable family-friendly student reports
Ability to print and export pages
Ability to print and export student responses to Writing Performance Assessment (for individual students or groups of students)

11. Student Listing Report
- The look and feel of the final system might be slightly different than presented here
- Grades and subjects are mocked up; final system will have actual grades and corresponding subjects
Users can see a list of all of the students belonging to a roster, teacher, or school.
As with aggregated reports, users can filter the list by the students’ demographic characteristics using the “Breakdown By” feature.

12. Score Reports: Student Report
Score Reports provide family-friendly student reports and other data and tools.

13. Test Management Center Features
Plan and Manage Testing
Participation report—filters can be used to see the test statuses for individual students
Results can be viewed onscreen or exported to Excel

14. Test Management Center Features
Plan and Manage Testing Filters in Step 3: Get Specific
Find students who have or have not completed a specific test opportunity based on their proficiency. Helpful for prioritizing which students may or may not need to test again.
Find students whose opportunity will expire within a certain number of days. Helpful for identifying students who need to complete their opportunity soon before it expires.
Find students who are on their first, second, or third opportunity who have a given test status. Helpful for finding students who have paused tests or have reported results.
Find students’ test status based on their most recent test session. Search by TA name, session ID, or within a specific date range. Helpful for checking the status of students who tested together.

15. Test Management Center Features
Summary Statistics
View statistics on how many students have tested at each opportunity

16. Test Management Center Features,
cont’d
My Testing Windows (via Summary Statistics)
Set a schedule of testing windows to organize when students will test
Available to TT, TA, STC, and DTSA Users through the Summary Statistics page
Planning tool only. Does not limit actual test administration dates.

17. Retrieve Student Results
Download student results for a selected group (by School, District, Teacher, or Roster)
The system creates a data file of all students’ scores from the selected administration
This file appears in your Online Reporting “Inbox”
Data file is designed to be read in spreadsheet programs (Excel) and statistical software packages
Download Roster tool can also be activated by clicking on the arrow icon next to a roster in the performance reports

18. Student Search
Allows users to look up information for any student that exists in the Online Reporting System (based on your user role access)
Enter either the student’s SSID OR the first or last name of a student
The student results will show a list of students that matched your search (for name based searches)
- The look and feel of the final system might be slightly different than presented here
- Grades and subjects are mocked up; final system will have actual grades and corresponding subjects

19. Test Management Center Updates
Summary Participation Counts
Test completion frequencies by district, school, and opportunity all in one CSV file
Displays the number of students associated with the school or district, the number who started an opportunity, and the number who completed an opportunity
Plan and Manage Testing – New Search Filter
Search for student test participation information by TA name, session ID, or a particular date range. The student will appear only in their most recent test session for a given test.

20. OAKS High School Scores
Reporting OAKS High School Scores
High school students can have scores from grades 9, 10, 11, or 12.
Aggregated scores for High School students are based on grade 11 students’ highest OAKS High School score from the past four years.
Ex: If a grade 11 student demonstrated proficiency while in 9th grade, that is reflected in the current aggregated reports
Aggregated data corresponds to that administration’s grade 11 students only
Grade 9, 10, or 12 students who take the High School tests will appear in individual student rosters. However, aggregated comparison scores incorporate only grade 11 students.
- The look and feel of the final system might be slightly different than presented here
- Grades and subjects are mocked up; final system will have actual grades and corresponding subjects

21. Rules for Transfer Students
Data for students moving schools midyear:
Scores travel with students transferring between Oregon schools midyear
If a student transfers to a school midyear, his or her scores are now associated with the new school in the Online Reporting System
If a student leaves a school midyear, his or her scores are no longer associated with the originating/previous school in the Online Reporting System
Scores do not travel with students who transfer or move to a non-Oregon school
If a student transfers from an Oregon public or charter school to a private or parochial school that does not conduct OAKS testing, the student’s scores remain with your school.
If the student moves to another state, his or her scores remain with your school.
Scores do not travel with students who drop out or otherwise leave Oregon public/charter schools entirely
This does not change how AYP is calculated for schools

22. Rules for Transfer Students
Data for students moving schools between years:
If users wish to see their current students’ scores from previous years and previous schools, they can choose the “Scores for my current students” view on the home page of Score Reports.

23. Do’s and Don’ts
Do’s
Use the enhanced help features to learn about the new online reporting system and how to make best use of it
Use data from Score Reports along with other information on student ability to identify areas of need and provided targeted instruction
Create custom rosters to track the progress of particular groups of students
Students in an intervention program
Use the data after checking your assumptions

24. Do’s and Don’ts, cont’d Don’ts
Online Reporting users must not share their log-in information and passwords, even with other authorized Online Reporting users – Student Score Data is Confidential

25. Promising Practices
Create custom rosters to track the progress of a group of students in a particular program
Use trend reports to examine student data over time
Use participation reports to track which students have tested and which tests are nearing expiration

26. In a Nutshell
The Online Reporting System is available through the OAKS Portal
Score Reports provide the score data from previous years and include aggregate and student level reports
Test Management Center has students’ test participation data, including reports by TA or session ID, and summary reports for schools and districts

27. Additional Training Opportunities
AIR will present two live training sessions via WebEx once the Reporting System goes live on November 6:
Thursday, November 15
3:00 p.m. PT
Tuesday, November 20
9:00 a.m. PT

28. Online Resources OAKS Online User Guides
OAKS Portal (includes Training Site and Practice Tests)

29. Acorns for Storage
What are the main new features of the Online Reporting System?
How can I use Score Reports and Test Management Center to manage testing for my students?