Download presentation
Presentation is loading. Please wait.
Published byΊσις Γεννάδιος Modified over 5 years ago
1
AIRWays Reporting Training Module Posted October 31, 2018
Welcome to the online training module for the AIRWays Reporting system. This training module discusses the information and features of the system. For more in depth information you can review the AIRWays Reporting User Guide on the WCAP portal. Posted October 31, 2018 This presentation contains a script in the notes section. If you are accessing this information with a screen reader, be sure you are reading the notes section as well as the text contained in the slides. Copyright © 2016 American Institutes for Research. All rights reserved.
2
Objectives After viewing this presentation, you should understand how to: Navigate AIRWays Reporting View student test results and performance on items Search for specific students Enter and Modify scores Download and print report information Change display settings Customize the appearance of report tables After viewing this presentation, you should understand how to: Navigate AIRWays Reporting View student test results and performance on items Search for reports on specific students Enter and modify scores Download and print report information Change display settings Customize the appearance of report tables
3
Purpose of AIRWays Reporting
Displays student and roster test performance tailored to the needs of classroom teachers: Includes item-level reports for interim assessments Also provides school and district reports for authorized users Allows teachers to: View students’ actual work and responses to each test item Score items and modify scores Compare individual students’ performance with overall class performance on a test or item Pinpoint areas for improvement throughout the school year AIRWays Reporting provides access to performance on assessments and individual test items for students and rosters. School- and district-level users can additionally view reports for their school and/or district. AIRWays Reporting provides insight into how students performed on specific items of interim assessments. Teachers can use the system to: view students’ actual work, presenting a clear picture of the topics that students have mastered and where they need to improve, score items and modify scores, compare individual students’ performance with overall class performance on a test or item, and pinpoint areas for improvement throughout the school year.
4
What is AIRWays Reporting
AIRWays Reporting is a reporting system that provides teachers with detailed information on student performance on Interim Assessments. AIRWays Reporting is a reporting system that provides teachers (in the role of Test Administrators) with detailed information about their students performance on Smarter Balanced Interim Assessments. The reports show student responses to items, and information on which items students in a class performed the best or worst. School and District level users can also use AIRWays Reporting to see the data at the school and district level. AIRWays Reporting provides insight into how students performed on specific items of interim assessments. Teachers can use the system to view students’ actual work, presenting a clear picture of the topics that students have mastered and where they need to improve.
5
How Data Gets to AIRWays Reporting
Use AVA, the teacher hand-scoring materials in TIDE, and the interim blueprints to decide which interim to administer. Administer the interim to students using the TA site and the secure browser. Use the AIRWays Reporting to score constructed response items using the materials located in TIDE. View high-level reports in ORS. View more detailed, item level reports in AIRWays Reporting. AIRWays Reporting is at the end of a set of assessment events. Educators should use the Assessment Viewing Application (AVA), the teacher hand-scoring materials located in TIDE, and the interim blueprints posted in the General Information folder on the WCAP Portal to help them determine which Interim assessment to give to students. Then the Test Administration interface and the Washington Secure browser are used to administer an Interim Comprehensive Assessment (ICA) or an Interim Assessment Block (IAB) to students. The student responses to any constructed response items are then scored by educators at the local level using AIRWays Reporting. After hand-scoring is completed, data will be available in both the Online Reporting System (ORS) and in the AIRWays Reporting system. AIRWays Reporting only displays interim data for the current school year. To view high-level summaries of interim results from previous years, use the Online Reporting System (ORS). If no hand-scoring is needed, which is true for many of the IABs, scores will be available in ORS and AIRWays Reporting soon after the completion of testing. Each of these systems has their own User Guide and Training Module available on the WCAP Portal. Please refer to those materials for questions about those steps of the process.
6
Assessments and Data in AIRWays Reporting
District Assessment Reports School Assessment Reports The Assessment Reports in AIRWays Reporting provide detailed information about how the students associated with a user or institution performed on an individual assessment. Assessment Reports display a column of student performance data for the assessment as a whole, for each claim (reporting category), and on individual items in the interim assessment. The reports are available for each assessment at various levels within the district: The data available in AIRWays Reporting depends on the user’s level of access and the report you are viewing: The Teacher Reports include data for all the assessments associated with a given teacher. This includes the following: All data for any student who participated in a test session proctored by that teacher during the current school year (including data for assessments completed in other teachers’ test sessions). All data for any student who are members of that teacher’s rosters as of Fall of the current school year (including data for assessments they completed in other teachers’ test sessions). School Reports include data for all current-school-year assessments associated with teachers who belong to a given school. District Reports include data for all current-school-year assessments associated with the schools that belong to that district. All of these reports (excluding the District Assessment Report) also provide information about how students responded to the individual items in each Interim Comprehensive Assessment or Interim Assessment Block and allow you to view those items. Authorized users can navigate from a higher-level Assessment Report to a lower level Assessment Report for institutions and users who are members of their institution. For example, district-level users can access the School Assessment Report for each school listed in their District Assessment Report, but teachers can only view their teacher level reports. Teacher Assessment Reports
7
Logging in to AIRWays Reporting
To log in to AIRWays Reporting, you must have an authorized address and password, which is the same as the one you use for TIDE and the TA Interface. Contact your School Administrator if you do not have a TIDE account. AIRWays Reporting is a secure, role-based system. Your access to reports and data in the system depends upon your user role and your district and school associations. To log in to AIRWays, go to your portal. Click the appropriate user role or assessment card. On the next page, click the AIRWays Reporting system card. Enter your username and password, and then click Secure Login.
8
Logging in to AIRWays (cont.)
The system has an authentication process that will be triggered when you log in from a different device or browser, or after clearing your browser’s cache. If you see this screen, an containing the code will have automatically been sent to your address. Enter the code and click Submit. If you need the code resent, click Resend Code. When logging in to the system using a new device or browser, or after clearing the cache on a previously-used browser, you will see an Enter Code page. If you see this screen, an containing the code will have automatically been sent to your address. You will need to enter the code on this page within fifteen minutes of receiving the . If you do not receive a code or do not enter the code within the fifteen-minute time limit, click Resend Code. Click Submit after entering the authentication code to access the system.
9
Resetting Your Password
You will need to reset your password in the following situations: It is a new school year. You forget your password. Your activation link expired. Your account is locked because you exceeded the account login attempt limit. To reset your password, click the Forgot Your Password Link. You will be taken to the Reset Your Password page. Enter and confirm a new password and click Submit.
10
Teacher Dashboard Specific Assessments Specific Students
The Teacher Dashboard is the landing page for Test Administrators in AIR Ways. From this page, you can see how your students performed on a specific assessment or you can see how a specific student has performed across assessments. When you log in you’ll see two tables. The top table is the My Assessments table. It displays all assessments your students have taken as well as the average score and performance distribution of all assessments for all your students. The bottom table is the My Students table, it displays a list of your students (rostered and proctored) who’ve taken any test as well as when they last took a test. Specific Students
11
My Assessments Table y
The My Assessments table provides information about how your students did, organized by assessment. Each row in the table displays the assessment’s name, test reason, the number of students who have completed the assessment, the average score earned by those students, a graph showing the percentage of students in each performance level, and the date the assessment was last taken. Assessment name shows the name of the assessment. The Test Reason column will show the test reason selected by the proctor in the Test Administration Interface when the test was given. If no reason was selected, this column will show Unassigned. The Student Count column shows you how many of your students took the specific test. The Average Score and Performance Distribution columns will show how your students did on the specific interim assessment. ICAs and IABs will have slightly different information in these columns. ICAs will have a numerical score on the same scale as the summative assessment, and IABs will have an "n/a" in the average score column. ICAs will have 4 performance levels, and IABs will have 3 categories in the Performance Distribution column. The Last Date Taken column lists the last time one of your students took the assessment. Each column can be sorted using the up and down arrows at the top of the column. If you want to see how each of your students did on a specific assessment, click on the assessment name, or the magnifying glass to the left. Click on the assessment name to view students who took that assessment.
12
My Students’ Performance on Assessment
Click on the item number to see a “blank” version of the item. Click on the points earned to view the item and student’s response Once you’ve selected the assessment you want to see, it will take you to a page of all of your students who took this assessment. This report can be used to compare how individual students have performed compared to the rest of the students as well as to show you how your class did as a whole. There is a row which shows performance data for all of the students shown (1), as well as a row for each student who took the test (2). The ‘Everyone’ row has the average score and performance level for students listed. In the further columns it lists the points possible for each item. If you want to see the item you can click on the item number in the top row (3). This will show the blank item as the student saw it. If you want to see a specific student’s response to an item, click on the point value in the student’s row (4). A pop-up will appear showing the item and student's response. For some items, this pop-up also provides information about the item's difficulty, alignment, and scoring. Score and performance information for the class as a whole Item numbers Individual student’s results Student points earned
13
AIRWays Reports Reports Available in AIRWays Reporting: Report Type
Used to… My Students’ Performance on Test View how students and rosters in your classes performed on a test. School Performance on Test View how students and rosters in your school performed on a test. District Performance on Test View how schools in your district performed on a test. Student Performance on Test View how a single student performed on a test. Student Portfolio View how a single student performed on all tests. AIRWays Reporting organizes performance data into different types of reports. Here, you can see a summary of the reports that are available in the system. Note that not all reports are accessible to all users. For example, both school- and district-level users can view school performance on a test, but only district-level users can view district performance on a test. For detailed information about report types and user roles, see your AIRWays User Guide.
14
Reports for Teachers, Schools, and Districts
To view a report showing how your rosters and students performed on an individual assessment, click the magnifying glass next to an assessment on the Dashboard. The sample report shown here is for a teacher. School-level users will see a report for all rosters and students associated with their school, and district-level users will see a report for all schools in their district. In other words, reports for teachers, schools, and districts all contain similar information, but for different populations. Note that AIRWays Reporting only includes data for scorable test opportunities. A student’s test opportunity cannot be scored when it has a test status of “Expired” or “Invalidated.” For more information on non-scorable test opportunities, consult the AIRWays Reporting User Guide.
15
Performance by Roster Some reports can be viewed by roster or by student. This sample report shows performance by roster. You can move between performance by roster and performance by student by using the tabs above the report. The report’s first row shows the maximum obtainable points on the test. The second row shows average performance for all students in the report. The other rows show how your rosters performed on the test. To view the performance of individual students within a roster, click the magnifying glass next to the roster’s name.
16
School (and District) Reports
Assessment label: Name of the assessment Student count: Number of students who took the specific assessment in your district/school Student performance: Performance average for all students in your district or school who took the specific assessment. The Dashboard landing page is very similar for both school and district users. In both cases the dashboard will show a summary of the assessments students in your jurisdiction have taken. Unlike the Teacher Dashboard only one table will appear, the Average Score and Performance Distribution by Assessment for the school or district. For a district user, clicking on an assessment will take you to the school level, as the school user sees when they log in.
17
Informational Pop-ups
On some pages in AIRWays Reporting, you can learn more about the data in a table by clicking the blue information icon next to it. A pop-up will describe the data in more detail.
18
Informational Pop-ups, Cont’d
When looking at the Performance Distribution column, remember that the ICAs and IABs will have different information. As shown on the left, the IABs will have 3 categories: Below Standard, At/Near Standard, and Above Standard, which are like the claim scores in the Summative assessments. As shown on the right, ICAs will have 4 performance levels, which are the same as the performance levels on the Summative assessment. Click the “i" icon next to the graph for a key to explain the various colors in the column.
19
Expanding and Collapsing Columns
Reports contain columns that can be expanded or collapsed. For example, in the report shown here, the Total column is expanded to show the student count, test completion rate, average score, and performance distribution for each roster. You can see additional columns on the right side of the report. These columns are collapsed. Note that column names will vary depending on the test you are viewing. To collapse a column, click the minus sign above its name. Additional data will appear, and the minus will change to a plus. To expand a collapsed column, click the plus sign above its name. As you expand columns, the report may become too large to fit all columns on the screen at once. To view any columns that extend off the edge of the page, click the blue arrow that appears to the side of the report.
20
Performance by Student
To view performance by student, click the Performance by Student tab near the top of the report. When viewing performance by student, each test opportunity for each student is displayed on a separate row. Therefore, students may appear more than once in the table if they have taken the same test multiple times. To view more information about an individual test opportunity, click the magnifying glass next to a student’s name.
21
Student Portfolio The My Students table allows you to view student portfolios. The Student Portfolio shows a list of all tests that the student has completed, including the student’s score and performance level, as well as the average score and performance distribution of all your students who took the test. You can access this report from the Dashboard by clicking a magnifying glass next to a student in the My Students table. You can also jump to a Student Portfolio for any of your students by entering his or her student ID into the search box on the right side of the gray bar above the report. From the Student Portfolio, you can view the student’s performance on a particular test by clicking the magnifying glass next to the name of the test.
22
Student Performance on Test
After clicking the magnifying glass next to a student’s name, a report will appear that shows the student’s performance on each item of the test for the selected opportunity. You can return to a previous report by selecting an item in the page navigation trail that appears in the gray bar above the report. Item-level data on this page appear as clickable links. Clicking one of these links will pull up an item view window that shows the student’s actual response.
23
Item View Window For example, you can click the score that a student received on an item to open the Item View Window for that item. The window consists of an Item & Score tab and a Rubric & Resources tab. A banner at the top of the window displays the item’s number and score.
24
Item Preview Windows: Item & Score
Viewing item-level information is what makes AIRWays Reporting so useful for classroom instruction. For example, teachers can see a student’s wrong answer and then start a conversation with the student about how they approached the problem and where they went off track. The Item & Score tab displays the item as it appeared on the assessment in the Student Testing Site, the student’s actual response, scoring criteria, and the item’s score. When an item has multiple scoring dimensions, the Scoring Criteria table appears, listing the name, maximum points, points earned, and any selected condition codes for each scoring dimension. This table also allows you to modify scores for items with editable scores. For items associated with a passage, the passage also appears. You can change the roster or student displayed in the pop-up using the Roster or Student dropdown menu located at the top of the pop-up. To view performance for the previous item on the test, click the item button in the upper-left corner of the screen. To view performance for the next item on the test, click the item button in the upper-right corner. You can also show or hide student test settings in the item by clicking the toggle switch on the right side of the window.
25
Entering or Modifying Scores
Any user with scoring permissions may enter or modify scores for unscored items and certain machine-scored items. Use the teacher hand scoring materials to understand the scoring expectations before assigning any scores. You can modify the scores for certain items directly from the Item View window on available Assessment Reports. A test’s Assessment Report will display a pencil icon in the column headers for each item with editable scores. To review a student’s entered response, click the pencil icon in the Scoring Criteria Table at the top of the window. To enter a score for the response, select a numerical score from the Score drop-down list. If the item consists of multiple scoring criteria, select a numerical score from the Score drop-down list for all scoring criteria. To save the score, click Save. When you close the Item View window, any average scores or performance distributions on the Assessment Report update automatically.
26
Item Preview Window: Rubric and Resources
The Rubric and Resources tab of the Items Preview Window displays the following sections when available for a test item: Item Details, which include the item’s topic, difficulty, and content alignment Resources, which provides links to any exemplars, scoring guides, or answer keys available for an item Rubric, which displays the criteria used to score an item Frequency Distribution of Student Responses, which provides a breakdown of how many students earned each possible point value available for the item. This information does not populate when viewing results at the individual student level. To expand a section, click the up arrow. To collapse a section, click the down arrow. Please note that all sections in the Rubric and Resources tab may not be available for a test item.
27
Entering Scores for Unscored Items
If a test contains unscored items, its performance data is excluded from your Dashboard and Assessment Reports until you or another user with scoring permissions enters scores for all the unscored items in at least one opportunity of that test. When you have tests awaiting item scoring, a Tests to Score notification appears in the banner. To enter scores for unscored items, click the Tests to Score notification. The Scoring Mode window will open and display a list of tests with unscored items. Click the magnifying glass icon next to the name of the test you wish to score.
28
Entering Scores for Unscored Items, continued
The Test Scoring page will appear in the Scoring Mode window. The Scoring Mode window displays a list of students and items awaiting scoring for the selected test. To enter scores for an item, click the Score link for the item in the student’s row. The Item View window will open. Review the items rubric and available resources on the Rubric & Resources tab. On the Item & Score tab, review the student’s entered response for scoring. To enter a score for the response, select or type a numerical score in the Points Earned drop-down menu and click Save. If you need to assign a condition code to the response, select the appropriate option from the Condition Code drop-down list. You can continue scoring unscored items in the Item Preview Window. To view another unscored item for the same student, use the arrow buttons at the top of the Item View window. To view the same unscored item for another student, select the student from the Student field at the top of the Item View window To exit the Item Preview window and Scoring Mode window, click the X icon in the upper-right corner.
29
Header Bar and other features.
y Navigation links: Current page and links to navigate to previous pages Inbox: location of saved reports My Settings: where to manage rosters and create or manage assessment or Class preferences Print button: Print the current page or data associated with the page y SSID search: Search for an individual student by SSID AIR Ways navigation is based on the text at the top. (1)The bolded section shows the current page. The links can be used to navigate to previous pages. AIR Ways has other features to assist teachers and school and district users. You may print or download the page you are viewing by clicking the printer in the upper right. (4). If you want to be able to manipulate the data you can save the file as a csv through the print link rather than as a pdf. You will also be able to choose if you want to print or download a summary of the data or the data including student scores. Reports that you have printed or downloaded are saved in the Inbox indicated in (2) above in the screenshot. You can also choose which test you want to see in your reports in the My Settings feature (3). Please see the next slide for more details. If you want to go directly to a student’s portfolio page, listing all of the tests taken by that student you can search using the student’s SSID indicated in (5) above in the screenshot. If you would like more information on anything discussed in this presentation please see the AIR Ways Reporting User Guide located on the WCAP Portal.
30
Printing and Downloading
AIRWays Reporting allows users to print or download data on any page in AIRWays Reporting. To print or download a page in AIRWays Reporting, click the Print button in the upper-right corner of the report. If you are printing a report that contains multiple tables, you will also need to select which table you wish to print.
31
Printing and Downloading, continued
When you click Print, a print preview screen will appear. Next, examine the options on the left side of the screen. If the report you wish to print provides data about individual test items, you can choose to include or exclude this information from the printed report by selecting Summary Only or Summary and Item Scores. Finally, select whether you wish to print the report, download the report as a PDF file, or download the report as a spreadsheet in CSV format. Files in CSV format can be opened using Excel. Note that your available print options will depend on the format you select. When you are ready to download or print, click Confirm.
32
Using the Inbox All downloaded reports will appear in your Inbox, located in the banner. The Inbox stores any PDF or CSV versions of reports you print from a report page, any file exports you create in TIDE or ORS, as well as secure files uploaded by administrative users. These files automatically expire after a designated period unless you archive them. To view a downloaded report, click Inbox. The Inbox window appears, listing the available files. The Inbox dashboard displays all the files except those that you have archived. Archived displays files that you archived. To filter the files by keyword, enter a search term in the text box above the list of files. The table allows users to download, archive, and delete downloaded files. To download a file, click the file name in the Name column. To archive a file, click the file box icon in the Actions column. To delete a file, click the trashcan icon in the Actions column. A check icon will appear in the Viewed column if you have previously downloaded a report. The Days Available column displays how many days the report will be available for download before expiration.
33
My Settings Users wishing to manage test reasons, change display settings, manage rosters, or change their user role can perform these tasks using the My Settings feature. This options in this list will vary, depending on your user role. In the next section of the training module, we will discuss these features in detail.
34
Manage Test Reasons: Search Test Sessions
If you wish to classify one or more test opportunities using test reasons, you can assign test reasons after the fact using the Manage Test Reasons feature. To assign a test reason to a set of test opportunities, select Manage Test Reasons from the My Settings feature. In the pop-up window that appears, search for test opportunities by session ID or by an existing test reason and date. Click Search to display test opportunities.
35
Manage Test Reasons: Select Test Opportunities
Your results will appear in the bottom of the window. Test opportunities are organized hierarchically. Click the plus sign next to a session ID to see all the tests that were in that session ID. Click the plus sign next to a test name to see all the students who took that test during the session. Select one or more checkboxes for test opportunities. You can select students individually or select all students who took a test or all students in a test session. When finished, scroll to the bottom of the popup window and click Assign Test Reasons to confirm your selections.
36
Manage Test Reasons: Assign Opportunities
Finally, you will be asked to select a test reason to assign to the selected opportunities. Choose a test reason from the drop-down list, and then click Confirm to assign the test reason.
37
Select Tests to Display
Teachers can change which tests are displayed in AIRWays Reporting. For example, an ELA teacher can choose to hide all Mathematics tests. By default, all tests are displayed for all teachers. To change displayed tests, click Select Tests to Display in the My Settings menu. A pop-up window will appear that lists all available tests that can be displayed in AIRWays Reporting. You may uncheck a box to hide a single test, or uncheck a box for a subject or grade to hide all tests for that subject or grade. When you have finished selecting tests to be displayed, click Save & Close to save your selections and close the window. AIRWays Reporting will remember your test display preferences even when you log out. If you cannot see information for a specific test, you can check here to make sure the test is not hidden.
38
Select Roster Preferences
School- and district-level users can choose which rosters display for teachers by selecting Select Roster Preferences in the My Settings menu. In the pop-up window that appears, choose whether to view all rosters, or view rosters according to teacher preferences. If you select Teacher Preferences, you will not see data for teachers who have excluded a given test. To continue the example on the previous slide: If an ELA teacher chooses to hide Mathematics tests, then school- and district-level users will not see that teacher’s rosters when viewing Mathematics tests.
39
Set Student Settings Display
To change whether student test settings are shown by default in item view, click Set Student Settings Display in the My Students menu. A pop-up window will appear that allows you to choose whether to show or hide test settings by default when you view a test item. You can always toggle this setting on and off for individual items using the switch in the Item Preview Window. If you choose Yes, you will view all test items with the student’s test settings applied. If you choose No, you will see all test items without the student’s test settings. When finished, click Save to close the pop-up window.
40
Manage Rosters School- and district-level users can also add, edit, or upload rosters from the My Settings menu. These functions all work exactly the same way they do in TIDE. We will describe these functions if the following slides.
41
Manage Rosters: Add Roster
Rosters are groups of students associated with a teacher in a particular school. Some reports in AIR Ways provide performance data for the students within a roster or for the roster as a whole. A roster created or modified in any AIR system that allows roster creation will be carried over to other systems that access rosters. You can create new rosters from students associated with your school or district by selecting Add Rosters from the My Settings drop-down list. The Roster Manage page will appear as a popup window. To add a new roster, select the district and school to which the roster belongs. Enter a roster name and select the name of the teacher who should be associated with the roster. In the Test Settings and Tools panel and Additional Filters panel, refine the list of available students by selecting additional criteria from the drop-down lists and checkboxes. Then click Search Students.
42
Manage Rosters: Add Roster, continued
In the Add/Remove Students to the Roster section, the students in the left column are available to be added to the roster, and students in the right column are currently in the roster. To add a single student to the roster, click the green plus sign next to a student in the left column. You can add multiple students to the roster by marking checkboxes next to the students you want to add, and then clicking Add Selected. Add all available students to the roster by clicking Add All. To remove a single student from the roster, click the orange X next to a student in the right column. You can remove multiple students from the roster by marking checkboxes next to the students you want to remove, and then clicking Remove Selected. Remove all students from the roster by clicking Remove All. When you are finished adding students, click Save to save the roster.
43
Manage Rosters: View/Edit Rosters
The View/Edit Rosters page includes a form for setting selection criteria to retrieve rosters. In this example, the district and school criteria are required. Click Search to display a list of rosters matching your criteria. Print or delete rosters from TIDE by selecting the desired rosters and clicking the Print or Delete button above the search results. Click the pencil icon next to a roster to view or edit its details. The Edit Roster form will appear. This form is similar to the form used to add rosters, and you may edit the roster name, teacher name, and students in the roster in the same way that you would for a new roster.
44
Manage Rosters: Upload Rosters
A second way to add new rosters is to use the Upload Rosters page to compose an upload file in Excel or CSV format and then upload that file. This task is performed by following the same steps used to upload new users and students: download a template file, enter information into the template, save, and click the Browse button to locate the file and upload it in to AIR Ways.
45
Change User Role If your account is associated with multiple user roles, you may change the role you are using by selecting Change Role in the My Settings menu.
46
American Institutes for Research
Thank You! Further Information Washington Help Desk American Institutes for Research Tel For questions regarding state policy decisions and protocol, please contact OSPI at Thank you for taking the time to view this training module. For additional information, refer to your AIR Ways User Guide located on the WCAP Portal or contact the Washington Help Desk.
47
Revision Log Updates to the Module after October 31, 2018 are noted below. Section Slide Description of Change Revision Date Blank If updates are needed throughout the school year, they will be outlined on this revision log and communicated in the WAW newsletter.
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.