Schoolnet II Welcome Instructor:

Learning Goals At the end of this workshop, you will understand how to: Explain how user roles impacts item access Create and Administer Benchmark Assessments Explain how test categories and test dates impact test content and results access Understand best practices for creating assessment items 2

3 Where can I find helpful resources ? DPI and Pearson have loaded a variety of helpful materials into Schoolnet. Search Home Base in Instructional Materials to locate: Quick reference cards End user PowerPoint presentations Training scripts Schoolnet contains screen specific help on every screen ( to access click the ) For hardware and software questions click System Requirements in the footer of any screen

4 Pearson K12 Technology Customer Education Self-Paced Distance Learning: When are we training? Self-Paced Distance Learning, accessed via PowerSource, Web-based “Mastery in Minutes” training includes short tutorials that are topic-specific for easy answers to simple tasks Online distance learning consists of interactive courses approximately one hour in duration. Designed for adult learners, this type of training includes authentic assessment, interactive storylines, and hand-drawn graphics to engage learners. Unlimited access! LEAs determine who can access the materials Authentic Assessment to evaluate understanding of concepts Practice throughout the course

5 What Assessment Items are available? DPI has loaded a total of 35,919 assessment items (as of Sept 19 th 2014) ELA – 6,352 Math – 13,536 Science – 12,834 Social Studies – 2,432 Additionally, there are 869 passages More items/ Passages can be created and submitted for approval to the state. Once approved they will be available for every educator in North Carolina.

6 What Instructional Materials are available? DPI has loaded a total of 38,026 instructional materials (as of sept 19 th 2014) Curricular Units Instructional Units– 1,545 Lesson Plans – 12,212 Assessments Resources – 11,454 External Resources – 11,977 More instructional materials can be created and submitted for approval to the state. Once approved they will be available for every education in North Carolina.

Item Types TYPEPaperOnlineClickersNotes Multiple choiceYYY T/FYYSome GriddedYYSome Open ResponseYYSomeCan be associated with a rubric Inline ResponseYYN MatchingYYN Hot spot - Single NYN Hot Spot – Multiple NYN Drag and DropNYN Click Stick DropNYN TasksSomeYNA collection of items 7

Building the Item Bank Grouping multi-step items into reusable tasks Snip it tool for adding Items Paste from Word Using the html editor Use of express test to create placeholders Answer Key Only tests Bulk uploading Scores 8

Tasks A task is a collection of items that you can reuse Each item can have a different standard and point value Group items that are part of a project and can’t stand alone 9

10 Activity: Create a Task item with at least 2 activities. Note the difference when saving in Leadership vs Teacher role.

Item Visibility Options Determine who should have access to each item Enable co-authoring to create items collaboratively Reserve some items for district benchmarking 11

Process for Submitting and Approving Any user can submit an item, passage, or rubric to be shared Users who are permissioned to do so can approve content at their default institution Once the content is approved, the submitter can no longer edit the content 12

N aming conventions for assessments For example: Preparing for testing Discuss who will do what Including item creation, test creation, scheduling and assigning tests, and monitoring the collection of results 13 Math 6 CDB Math 6 CDB 1 M Subject Grade Test title School year Modified Rolling Out an Assessment Program 13

Restrict Teacher Access 14

Restrict Teacher Access 15

16 Review Activity: (Creating a test) Create a District Benchmark containing 4-6 items (title it with your initials). Choose 8 th Grade Math. Edit one item to be an Open Response item. Find the task item and add it to the test (hint – Advanced Search).

Benchmark vs. Classroom Tests Benchmark Results appear in School & District Data and Classrooms Tests created at the district or school level for the purpose of institution-wide data collection Only the highest level category used for KPI calculations Classroom Results appear in only Classrooms Tests created for the purpose of classroom use Can be teacher-created or selected from a pool of pre- made tests My Classroom or Common Classroom categories available 17

Test Category What Type of Assessment am I creating Test Category Use forWhere to Find Results My Classroom Check for Understandings, classroom tests with scores for teacher use only In Student Profile and Classrooms Shared Classroom Assessment Assessment shared by Teachers Tests that can be used by multiple teachers of a course that don’t need review at aggregate level In Student Profile and Classrooms School Assessment End of Unit Assessments Tests taken by students in multiple teachers’ classes that should be viewed at the school level either by teacher or aggregated Same as above plus throughout School & District Data with the exception of KPIs District Benchmark Baseline/Benchmark Assessments Tests taken by all students in a course that should be available for all reports Same as above plus in KPI if this is the most recent test 18

Understanding Test Stages Private Draft Visible only to the creator Public Draft Visible and available for editing to all users with permission to create and edit tests Does not apply to teacher-created classroom tests Ready To Schedule Test content is complete and cannot be edited Be sure to add any new items to Item Central before scheduling Scheduled The test is assigned, but has not reached the start date A test switches from Scheduled to In Progress automatically when the start date is reached In Progress Current time is between the start date and the end date Automatically switches to Complete when the number of results exceeds a certain percent of eligible test takers (default is 85%) Complete The test is Complete when the current time is past the end date or percentage hit 19

Scheduling at the School & District OptionAvailable toDescription Assign to students AllAssign the test to a specific set of courses Recommend to teachers District and school test administrators Suggest this test to teachers based on course taught. Teachers have option to assign the test to students. Recommend to schools District test administrators Turn over the assignment task to school test administrators who can then assign the test. Use this option when you do not have sufficient knowledge of the courses at each school to assign the tests. School test administrators will see an additional section titled Recommend Tests on the Assessment Admin page. These users must click Not Assigned to assign these tests locally. 20

21 Resume Activity Return to test. Go through test stages, Private, Public, Ready to Schedule. What do you need to do at Ready to Schedule stage? Copy test and replace the words (COPY) with ‘Recommend’. Schedule the ‘Recommend’ test to start immediately and recommend to schools/courses. Schedule the original test to start the next day and assign directly to courses (or Quick Assignment)

Assigning District Benchmarks 22

Assigning District Benchmarks Con’t 23

Teacher Assigns Recommended Test Click ‘No’ in the Assigned column of a recommended test to assign it to sections 24

Preparing for Online Testing Students - Understand available features, how to view results, how results will be used Teacher or other proctors - Access to Proctor Dashboard, online passcode, usernames and passwords Computers - Hardware and software 25

Printing Printing options available on Test Detail page If testing online, will some students with accommodations test on paper? Discuss who will print: Test booklet Answer sheets Answer key Scoring instructions or rubrics 26

Scanning Use ScanIt to scan and upload results

Scoring Score by student or section 28

29 Resume Activity Return to original test (in progress and assigned to courses). Score open response items by sections

Track Completion Rates Test administrators monitor the progress of scanning by school and by section with Track Completion Rates. 30

Discussion: Implementing Assessments Building the item banks - Submission/approval process Who will do what? - Creating school assessments / district benchmarks? - Assigning / recommending? - Scanning / printing - Tracking data completion

Don’t Forget! Navigate to the survey and tell us what you think!

Welcome back 33

CURRICULUM MANAGER DAY 1 PM USE CM PPT Use Curriculum Manager PPT 34

Welcome back 35

CUSTOM REPORTING DAY 2 36

Learning Goals School and District Data Overview Distinguish between the “who” and the “what” for reporting Define student sets Build custom reports Publish reports Tag key reports Run course or section reports

DISTRICT/SCHOOL LEVEL REPORTING OVERVIEW 38

View Key Performance Indicators Explore the KPI Dashboard.

How did students perform on benchmark tests?

Drilling Down: Item Analysis Report Find a section that has district and local assessment data - Which skill and standard are you most concerned about for your students? - Which items were the most challenging for students and what can you learn about their misunderstandings by looking at the distractors? - What evidence of strengths/weaknesses in curriculum, instruction, or assessment are apparent in the data? - What other data (student work, individual demographic data) do you have that informs your knowledge about student performance? - What instructional actions will you take to differentiate instruction based on the data?

Reports Available to Investigate Further Access published reports in the Report Bank. Districts may choose to published reports in the Report Bank. Learn more about this in the Schoolnet II series

Reports Available to Investigate Further

Save and Access Your Own Reports So that the data is always current, save the report parameters, rather than the results.

Analysis Spreadsheet How are my students performing across multiple data points?

Functionality Review Are you familiar with the following? Running reports from the Report Bank and Benchmark Dashboard Creating a pre-formatted report Creating an analysis spreadsheet Saving a report and viewing a saved report

Creating a Report First ask yourself: What is my goal for this report? Who do I want to know about? What do I want to know about these students? What do I want to compare?

Compare Reports Report 1Report 2 Who: Students who missed multiple days of school last year Who: Students who performed poorly on a standardized test What: Standardized Test reportWhat: Attendance report How do these reports differ? Is it likely that the same students are in both reports? What questions do these reports help answer?

Making a Complete Report Who: Student Set + What: (Report Parameters + Data Constraints) Pre-formatted reports: Choose from a limited selection of student sets, report parameters, and data selections, all available in one place Custom reports: Define student sets, report parameters, and data constraints separately Analysis spreadsheet: Begin with a student set and define columns of data

The “Who” The “who” is your student set: a group of students who meet pre-defined criteria. Example student sets include students who: - Are enrolled in a particular class - Are currently enrolled at your school - Are enrolled in a special education program - Were enrolled in 4th grade last year - Performed poorly on a specific test

The “Who” Defining a Student Set Create a student set: - Manually, using a student filtering process - Automatically, by clicking a graph or table The student set “box” appears in the following locations: - Analysis Spreadsheet - Student Filter - Custom Reports

The “Who” Define the Student Set by Applying Filters Filters are “and” criteria; students must meet all filters.

Current Enrollment – Students enrolled as of today Total Enrollment – Students enrolled over time Choose Total Enrollment to include all students at some point during the school year—to evaluate how the institution performed over time. Also, use this option during summer. The “Who” Enrollment Filter

Middle School No Year Specified Enrolled Female A DC B Try It Out Use Boolean Logic

Try It Out The “Who” – Define a Student Set Create a set of current students at a school Create a set of low-scoring students Save a student set Discuss enrollment selection (current vs. total)

The “What” Analysis Spreadsheet The “what” is your data selection, the data points on which you would like to report. Use your data selection to: - Measure students across multiple assessments (such as standardized vs. benchmark tests for same subject) - View scores across multiple subjects and sort results to identify students who perform better in some subjects than others - Compare assessment data to attendance - View demographic information (such as gender and ethnicity) Analysis spreadsheet — The “what” is displayed in the columns and the “who” in the rows. The student selection (“who”) is the same regardless of the column selection (“what”).

The “What” Custom Reports For custom reports, the “what” is defined by report parameters and data selections. Report parameters: Formatting (such as a table, graph, or pie chart) and data elements (rows and columns, such as test section or score group) Data constraints: Point in time (last year’s test), school, and grade level in which the students tested

The “What” Report Parameters: Grouping Data Use report parameters to group data using sub-rows and paging Use paging for both custom and pre-formatted reports For pre-formatted reports, page by subgroup category Rows and sub-rows grouped by subject Paging by student subgroup

The “What” Custom Report Builder Use custom reports to define parameters: Formatting Rows Columns Totals

Use of Row and Sub Row The row and sub-row selection alters the report for the same data

Demonstration: Building a Custom Report

Try It Out: Generate a Custom Report Generate custom reports - Standardized test - Independent practice Try some of the options in the Benchmark Item Analysis report Save a few reports for other activities

Analysis SpreadsheetCustom Report For ~<200 students For specific students, such as those who did well in reading but not math To see student names on the report If a pre-formatted report does not meet your needs For a large selection of students To find patterns To identify instructional areas of concern for a group of students Choose a Report Type

Publishing Reports for Others Report Manager – Users with the report manager role can publish reports and manage published reports: Save the report Publish the report - School-level report managers publish to the school bank - District-level report managers publish to a single school, a district, or multiple schools Edit and retract reports No approval workflow

Saving to the Report Bank What can you save to the Report Bank? Pre-formatted reports Student sets Analysis spreadsheets with students Analysis spreadsheets without students* Custom report with students (focus for today) Custom report without students* * When using these items, you are prompted to select the missing component

Key Reports Display on Schoolnet home page Highlight the especially important reports for your institution Display reports from your institution’s Report Bank only Tag reports as “Key Reports” at the school level or across all schools as part of the publishing and contextualizing process

Places to Find Reports Public Report Bank: Repository for published reports (published reports are custom reports approved by an administrator for district-wide or school-wide distribution) My Reports Bank: Repository for saved reports that you created and published reports from the Report Bank that you bookmarked (Note: Only you can see the reports that you save.) Key Reports: Quick reference for published reports on the Schoolnet home page that are tagged as “key” reports Related Reports: Quick reference for published reports on the KPI detail page that are related to a specific KPI Benchmark Dashboard: Quick reference for published reports that include a single test administration

Try It Out: Publishing Reports Publish reports you want to make available to other users Select a few reports to tag as Key Reports Retract any reports you don’t want to remain published

Don’t Forget!! Navigate to the survey and tell us what you think! Event Number:

Don’t Forget! Navigate to the survey and tell us what you think!

Understanding Roles/ Operations within Home Base Day 2 PM 71

Understanding Roles and operations within Home Base Roles for Schoolnet access Tools and support documentation available How to access user management in Powerschool Cautions and scenarios Bulk export and import role assignments 72

Deployment of Schoolnet – Wrap up Discussions Group Discussion for next steps for deployment/ turn around training Home Base planning questions (utilizes worksheet) 73

ADDITIONAL RESOURCES 74

75 Where can I find helpful resources ? DPI and Pearson have loaded a variety of helpful materials into Schoolnet including (search Home Base in Instructional Materials) Quick Reference cards End user PowerPoint's Training Scripts Schoolnet contains screen specific help on every screen ( to access click the ) For Hardware and Software questions click System Requirements at the bottom of My Schoolnet (main start screen)

Where do I find more information IIS webpage for further information: 76

77 Pearson K12 Technology Customer Education Self-Paced Distance Learning: When are we Training? Self-Paced Distance Learning, accessed via PowerSource, 365/24/7 Web-based “Mastery in Minutes” training includes short tutorials that are topic-specific for easy answers to simple tasks. Online distance learning consists of interactive courses approximately one hour in duration. Designed for adult learners, this type of training includes authentic assessment, interactive storylines, and hand-drawn graphics to engage learners. Unlimited access! LEAs determine who can access the materials Authentic Assessment to evaluate understanding of concepts Practice throughout the course

78 Distance Learning and Mastery in Minutes

Enhancement Requests and Forums 79

Next Steps Wrap up Questions and answers Evaluation Explore on your own site