NC State University Center for Urban Affairs and Community Services

What is ClassScape ™ ? Similar to other university-supported initiatives that support educators Online formative assessment system Allows teachers to build classroom tests with system tools Allows teachers to monitor student performance on the Standard Course of Study academic indicators Facilitates learning by focusing on curricular objectives Collaborative effort NC State University Center for Urban Affairs and Community Services North Carolina Department of Public Instruction— Accountability Division

O bjectives To help teachers Focus instruction with Standard Course of Study academic indicators Identify class strengths and weaknesses Identify individual student strengths and weaknesses

Objectives, cont’d To assist teachers in Achieving curriculum/instructional alignment Maintaining curriculum/instructional alignment by providing assessment items approved by content experts and based on all curricular objectives

Objectives, cont’d To allow teachers To self-assess instructional strategies To monitor student progress on an ongoing basis To select objectives to assess throughout the school year To access real-time feedback reports

Schedule Grade Three Grade Four Grade Five Grade Six Grade Seven Grade Eight Math (Pilot) Math (Pilot) Math Math Reading Math Reading Math Reading Math Reading Math Reading Math Reading Math Reading Math Reading Math Reading Math Reading Math Reading Math Reading Science Math Reading Math Reading Math Reading Science

First-Year Development Establish and register name and logo Construct and register website Build item database Assemble focus group of teachers, curriculum specialists, and instructional administrators Design online item writing and reviewing system Design online test delivery system Beta test system with volunteers

Second-Year Development Evaluate online test delivery system Refine test delivery system Identify and visit pilot schools Test online system with pilot schools Develop training tools and tech support

Annual Development Determine weight of curricular objectives Populate database with existing items Reclassify and review existing items Identify gaps and contract items where necessary Review and revise items Refine online testing system Recruit school participants

Why Grades 5 & 8 Math? Why math first? Time crunch for pilot Fewer copyright issues Pilot to coincide with new curricula Why grades 5 & 8 first? Benchmark grades Grade 8 current competency grade

Item Collection “Secure for Local Use” items Revised items not used in testing system Items reviewed by off-duty North Carolina teachers (w/stipend) New items by vendor contracts

Online Testing System Acceptable Use policy Teachers assemble small or medium assessments on one or more objectives Students can attempt to demonstrate mastery of objective up to three times Large item pool to avoid overexposure Requesting demographic information to ensure quality as part of research and development

Student View Anticipated tools and other features Clock Formulas provided within question stem Full screen—web options disabled Ability to jump forward/backward during testing Accommodations Project Development Team visited Governor Morehead School and Assistive Technology Center Items reviewed for EC/ESL considerations Tests and items use Universal Design

Teacher View Pulling up assessment items By goal (20-30 items) By objective (10-20 items) By keyword (10 items) Reporting format Item Objective Thinking skill Difficulty level Accuracy of response Classroom percentage Overall population’s percentage

Sample Teacher Feedback Report Answers By Student for Objective 1.01a Percent  Total  Total  Total – Brendan  –  80%811 Brian–  70%721 Dan  –  80%811 Davida  90%910 Elizabeth  80%820 Faye  –  –  50%532 Jeff  80%820 Jennifer  –  80%811 Jerrie  –  80%811 Phyllis  –  80%811 Qing–  –  ––30%334 Sean  –  –  80%802 Shakir  90%910 Shirley  90%910 Sloane  90%910 Susie  –  90%901 Tiha  100%1000 Test Total  Test Total  Test Total – Class  85% 90%80%30%85% 90% District  87%83%94%70%50%88%35%92%82%83% ClassScape  82%80%87%67%48%81%42%84%78%85%

Sample Teacher Feedback Report

ClassScape Percent Correct for Obj 1.01a

Sample Teacher Feedback Report Percent Correct By Student for All Goals (Last Administration Taken by Student) Goal 1Goal 2Goal 3Goal 4Goal 5 AverageMaxMin Brendan80%70%80% 90%80%90%70% Brian90% 100%80%90% 100%80% Dan80% 70%90%100%84%100%70% Davida90%100% 90%96%100%90% Elizabeth80% 90% 80%84%90%80% Faye100%80% 90% 88%100%80% Jeff80% 100% 88%100%80% Jennifer80%100% 90%94%100%80% Jerrie80%90% 80%90%86%90%80% Phyllis80%70%90% 84%90%70% Qing80%70% 80%90%78%90%70% Sean80% 90% 84%90%80% Shakir90%80%100% 90%92%100%80% Shirley90% 80%90% 88%90%80% Sloane90%80%90%100%90% 100%80% Susie90% 100% 90%94%100%90% Tiha100%90%100% 90%96%100%90% Average 87%84%90%93%92% Average 89% Goal Max 100% Goal Min 70% ClassScape Average73%80%87%90%48%

Sample Teacher Feedback Report

Website Site map Purpose and objectives Portal to item writing, item reviewing, and testing system Screen shots of student view and teacher view Calendar of events Online form to request participating in future review sessions FAQs, contact info, and tech support Enter by state Flash video Statements by previous users

Pilot School Recommendations? Need to select pilot schools for Grades 5 and 8 math for Program free of charge for pilot schools Seeking pilot schools throughout state Need 6 elementary and 4 middle school recommendations per region Schools should challenge system with all ranges of technical capacity, but minimum capacity must meet NCCATS requirements Schools must be willing to work with us on technical issues.

Additional Information Sloane Thrasher (919) Phyllis Jernigan (919) Website: