1 New Hampshire Statewide Assessment Using the 2009 NECAP Reports January, 2010

2 Welcome and Introductions Tim Kurtz Director of Assessment Gaye Fedorchak Alternate Assessment Coordinator

3 Welcome and Introductions Tim Kurtz Director of Curriculum and Assessment Phone: (603) Gaye Fedorchak Supervisor of NH Alternate & ACCESS Phone: (603) Susan Morgan ACCESS for ELLs ® & NH-Alt Program Specialist Phone: (603) David Gebhardt NAEP Coordinator Phone: (603) E Mail: NH DOE Assessment Staff Visit us on the Web:

4 Welcome and Introductions ELA – position vacant (hiring freeze) Mathematics – position vacant (hiring freeze) Science – Jan McLaughlin (on leave) Ken Relihan, Social Studies Supervisor Phone: (603) Deb Fleurant, Bias & Sensitivity & Title I Phone: (603) Jiffi Rainie, Math/Science Partnership Program Specialist Phone: (603) Gail Taylor, Math/Science Program Asst. Phone: (603) NH DOE Curriculum Staff

5 Welcome and Introductions Tim Crockett Vice President x2106 Harold Stephens NECAP Program Director x2235 Shannan Douglas NH Program Manager x2139 Amanda Smith NECAP Program Manager x2259 Carole Soule NECAP Program Manager x2450 Amanda Breitmaier NH-Alt Program Manager x2251 Elliot Dunn NECAP Program Manager – Science x2126 Tina Haley NECAP Program Assistant x2427 Kellie Beaulieu NECAP Program Assistant x2115 Mellicent Friddell NECAP Program Assistant x2355 NECAP Service Center:

6 Purpose of the Workshop Review the different types of NECAP reports Conduct a demonstration of the new NECAP Analysis & Reporting System Review the four interactive reports available from the new reporting system Provide an Introduction to Performance Plus

7 Involvement of Local Educators Development of Grade Level and Grade Span Expectations Test Item Review Committees Bias and Sensitivity Review Committees Classroom Teacher Judgment Data Standard Setting Panelists Technical Advisory Committee

8 The Family Educational Rights and Privacy Act (FERPA) Access to individual student results is restricted to:  the student  the student’s parents/guardians  authorized school personnel Superintendents and principals are responsible for maintaining the privacy and security of all student records. Authorized school personnel shall have access to the records of students to whom they are providing services when such access is required in the performance of their official duties. FERPA website:

9 Guides to Using the 2009 NECAP

10 Types of NECAP Reports Student Report (Confidential) Information for Parents Item Analysis Report (Confidential) School level by student Results Report (Public) School and District level Summary Report (Public) School/District/State level Student Level Data Files (Confidential) Excel/csv files by grade on district and school confidential site

11 Student Report

12 Looking at the Student Report This part of the report provides the individual student’s achievement level and scaled score

13 Looking at the Student Report

14 Looking at the Student Report This part of the report provides a comparison between the performance of this student and his/her school, district, and state

15 Looking at the Student Report

16 Looking at the Student Report This part of the report gives specific information about the student’s performance in content area subcategories

17 Looking at the Student Report

18 Item Analysis Report

19 Looking at the Item Analysis Report This part of the report gives specific information about the released items

20 Looking at the Item Analysis Report

21 Looking at the Item Analysis Report This part of the report represents all of the items used to compute student scores

22 Looking at the Item Analysis Report

23 Looking at the Item Analysis Report This part of the report does not represent all of the items used to compute student scores

24 Looking at the Item Analysis Report

25 Released Items Documents

26 District and School Results Report

27 Looking at a School Results Report Schools can view reports for Testing Year ( )

28 Looking at a School Results Report Or for Teaching Year ( )

School Results Report – Grade Level Summary 29

School Results Report – Grade Level Summary 30

School Results Report – Grade Level Summary 31

32 School Results Report – Grade Level Summary

33 School Results Report – Content Area Results

34 School Results Report – Content Area Results

35 School Results Report – Content Area Results Cumulative Totals… provide information on multiple cohorts of students exposed to the program of instruction at a specific grade. Caution should be used if the program of instruction has changed significantly.

36 School Results Report – Content Area Results

37 School Results Report – Content Area Results Total Possible Points includes both common and matrix items (not field-test). Total Possible Points also represents the test’s balance of representation.

38 School Results Report – Content Area Results Please note: The Total Possible Points column is organized differently on the Reading Results Report 106 possible points are represented here – they are sorted by “Type of Text” The same 106 possible points are represented here – they are sorted by “Level of Comprehension”

School Results Report – Content Area Results Total Possible Points includes both common and matrix prompts (not field-test).

40 School Results Report – Disaggregated Results

41 School Results Report – Disaggregated Results Important Note: Disaggregated results are not reported for sub- groups of less than 10

42 School Results Report – Disaggregated Results Because this is a small school, and so many of the sub-groups are smaller than 10, this part of the report is not as useful. But we can still look at district and state disaggregated results. Does this data match what we know about the district’s program?

43 Looking at a Summary Report

44 NECAP District and School Student Level Data Files Contain: All demographic information for each student that was provided by the districts to the state The scaled score (or raw score for NH-Alt), achievement level, and subscores earned by each student in all content areas tested NECAP files also contain: Performance on released items Student questionnaire responses Optional reports data

45 Go to… How Do I Find Public Assessment Reports?

46 Click Here

47 Choose Test Year & Reporting level….. Then take a look

48 Reminder: Select to view NH-Alt reports.

49

NECAP Results will appear here

51 Guides to Using the 2009 NECAP Reports NECAP Analysis and Reporting System User and Training Manual Companion PowerPoint presentation Grade Level and Grade Span Expectations (within NH Curriculum Frameworks documents) NECAP Accommodations Guide Released Items documents Preparing Students for NECAP: Tips for Teachers to Share with Students Practice Tests for each subject at every grade level Supporting Materials and Resources

52 Accessing Your Confidential Reports

53 Accessing Your Confidential Reports Select “Reports” to view non-interactive reports. Select “Interactive” to view interactive reports.

54 Accessing Your Confidential Reports Apply filter to view by teaching or testing group Select and filter criteria to view desired NECAP reports. Outcome from applied filters will be displayed here.

55 Now that we have collected valuable data, we have partnered with Performance Pathways to help districts and schools access the data – access is via the i4see Workbench. Performance Tracker --- Assessment Builder – Tech Paths (curriculum)

56 So how do I get access… Visit 1.PD centers are providing hands-on training. 2.TIP 16 on the i4see home page will describe how to request a user id. 3.Under Recent Highlights you will find a link to a timeline identifying monthly i4see training sessions.

57 Performance Pathways Provides Access to Assessment Information…

58 So how should we be using Performance Tracker… Yes You Should… Use Performance Tracker to learn more about your student performance in relation to the GLEs & GSEs Look for trends over time rather than one time snap-shots. Look at item level results and specific test items to better understand test terminology and student thinking Define student groups to understand the success of specific programs Compare across student groups and subgroups within your schools and within your district to understand curriculum and instructional strengths, weaknesses & needs Please Be Cautious… Performance Tracker is not meant to recreate AYP results Not all correlations are statistically significant Watch out for percentages -- keep an eye on the number of students represented by the reporting results– don’t jump to conclusions if 75% represents only three students Remember NECAP is only one indicator