1. 1 New Hampshire Statewide Assessment Using the 2009 NECAP Reports January, 2010

2. 2 Welcome and Introductions Tim Kurtz Director of Assessment Gaye Fedorchak Alternate Assessment Coordinator

3. 3 Welcome and Introductions Tim Kurtz Director of Curriculum and Assessment Phone: (603) 271-3846 E-Mail: TKurtz@ed.state.nh.us Gaye Fedorchak Supervisor of NH Alternate & ACCESS Phone: (603) 271-7383 E-Mail: GFedorchak@ed.state.nh.us Susan Morgan ACCESS for ELLs ® & NH-Alt Program Specialist Phone: (603) 271-3719 E-Mail: SMorgan@ed.state.nh.us David Gebhardt NAEP Coordinator Phone: (603) 271-2298 E Mail: DGebhardt@ed.state.nh.us NH DOE Assessment Staff Visit us on the Web: www.ed.state.nh.us/assessment

4. 4 Welcome and Introductions ELA – position vacant (hiring freeze) Mathematics – position vacant (hiring freeze) Science – Jan McLaughlin (on leave) Ken Relihan, Social Studies Supervisor Phone: (603) 271- 6151 E-mail: KRelihan@ed.state.nh.us Deb Fleurant, Bias & Sensitivity & Title I Phone: (603) 271- 3838 E-mail: DFleurant@ed.state.nh.us Jiffi Rainie, Math/Science Partnership Program Specialist Phone: (603) 271-7450 Email: j.rainie@ed.state.nh.us Gail Taylor, Math/Science Program Asst. Phone: (603) 271- 8266 Email: gail.j.taylor@ed.state.nh.us NH DOE Curriculum Staff

5. 5 Welcome and Introductions Tim Crockett Vice President 1-800-431-8901 x2106 Crockett.tim@measuredprogress.org Harold Stephens NECAP Program Director 1-800-431-8901 x2235 Stephens.harold@measuredprogress.org Shannan Douglas NH Program Manager 1-800-431-8901 x2139 Douglas.shannan@measuredprogress.org Amanda Smith NECAP Program Manager 1-800-431-8901 x2259 Smith.amanda@measuredprogress.org Carole Soule NECAP Program Manager 1-800-431-8901 x2450 Soule.carole@measuredprogress.org Amanda Breitmaier NH-Alt Program Manager 1-800-431-8901 x2251 Breitmaier.amanda@measuredprogress.org Elliot Dunn NECAP Program Manager – Science 1-800-431-8901 x2126 Scharff.elliot@measuredprogress.org Tina Haley NECAP Program Assistant 1-800-431-8901 x2427 Haley.cristina@measuredprogress.org Kellie Beaulieu NECAP Program Assistant 1-800-431-8901 x2115 Beaulieu.kellie@measuredprogress.org Mellicent Friddell NECAP Program Assistant 1-800-431-8901 x2355 Friddell.mellicent@measuredprogress.org NECAP Service Center: 1-877-632-7774

6. 6 Purpose of the Workshop Review the different types of NECAP reports Conduct a demonstration of the new NECAP Analysis & Reporting System Review the four interactive reports available from the new reporting system Provide an Introduction to Performance Plus

7. 7 Involvement of Local Educators Development of Grade Level and Grade Span Expectations Test Item Review Committees Bias and Sensitivity Review Committees Classroom Teacher Judgment Data Standard Setting Panelists Technical Advisory Committee

8. 8 The Family Educational Rights and Privacy Act (FERPA) Access to individual student results is restricted to:  the student  the student’s parents/guardians  authorized school personnel Superintendents and principals are responsible for maintaining the privacy and security of all student records. Authorized school personnel shall have access to the records of students to whom they are providing services when such access is required in the performance of their official duties. FERPA website: http://www.ed.gov/policy/gen/guid/fpco/ferpa/index.html

9. 9 Guides to Using the 2009 NECAP

10. 10 Types of NECAP Reports Student Report (Confidential) Information for Parents Item Analysis Report (Confidential) School level by student Results Report (Public) School and District level Summary Report (Public) School/District/State level Student Level Data Files (Confidential) Excel/csv files by grade on district and school confidential site

11. 11 Student Report

12. 12 Looking at the Student Report This part of the report provides the individual student’s achievement level and scaled score

13. 13 Looking at the Student Report

14. 14 Looking at the Student Report This part of the report provides a comparison between the performance of this student and his/her school, district, and state

15. 15 Looking at the Student Report

16. 16 Looking at the Student Report This part of the report gives specific information about the student’s performance in content area subcategories

17. 17 Looking at the Student Report

18. 18 Item Analysis Report

19. 19 Looking at the Item Analysis Report This part of the report gives specific information about the released items

20. 20 Looking at the Item Analysis Report

21. 21 Looking at the Item Analysis Report This part of the report represents all of the items used to compute student scores

22. 22 Looking at the Item Analysis Report

23. 23 Looking at the Item Analysis Report This part of the report does not represent all of the items used to compute student scores

24. 24 Looking at the Item Analysis Report

25. 25 Released Items Documents

26. 26 District and School Results Report

27. 27 Looking at a School Results Report Schools can view reports for Testing Year (2009-10)

28. 28 Looking at a School Results Report Or for Teaching Year (2008-09)

29. School Results Report – Grade Level Summary 29

30. School Results Report – Grade Level Summary 30

31. School Results Report – Grade Level Summary 31

32. 32 School Results Report – Grade Level Summary

33. 33 School Results Report – Content Area Results

34. 34 School Results Report – Content Area Results

35. 35 School Results Report – Content Area Results Cumulative Totals… provide information on multiple cohorts of students exposed to the program of instruction at a specific grade. Caution should be used if the program of instruction has changed significantly.

36. 36 School Results Report – Content Area Results

37. 37 School Results Report – Content Area Results Total Possible Points includes both common and matrix items (not field-test). Total Possible Points also represents the test’s balance of representation.

38. 38 School Results Report – Content Area Results Please note: The Total Possible Points column is organized differently on the Reading Results Report 106 possible points are represented here – they are sorted by “Type of Text” The same 106 possible points are represented here – they are sorted by “Level of Comprehension”

39. School Results Report – Content Area Results Total Possible Points includes both common and matrix prompts (not field-test).

40. 40 School Results Report – Disaggregated Results

41. 41 School Results Report – Disaggregated Results Important Note: Disaggregated results are not reported for sub- groups of less than 10

42. 42 School Results Report – Disaggregated Results Because this is a small school, and so many of the sub-groups are smaller than 10, this part of the report is not as useful. But we can still look at district and state disaggregated results. Does this data match what we know about the district’s program?

43. 43 Looking at a Summary Report

44. 44 NECAP District and School Student Level Data Files Contain: All demographic information for each student that was provided by the districts to the state The scaled score (or raw score for NH-Alt), achievement level, and subscores earned by each student in all content areas tested NECAP files also contain: Performance on released items Student questionnaire responses Optional reports data

45. 45 Go to… How Do I Find Public Assessment Reports?

46. 46 Click Here

47. 47 Choose Test Year & Reporting level….. Then take a look

48. 48 Reminder: Select 2008-2009 to view NH-Alt reports.

49. 49

50. 50 2009 NECAP Results will appear here

51. 51 Guides to Using the 2009 NECAP Reports NECAP Analysis and Reporting System User and Training Manual Companion PowerPoint presentation Grade Level and Grade Span Expectations (within NH Curriculum Frameworks documents) NECAP Accommodations Guide Released Items documents Preparing Students for NECAP: Tips for Teachers to Share with Students Practice Tests for each subject at every grade level www.ed.state.nh.us/assessment Supporting Materials and Resources

52. 52 Accessing Your Confidential Reports http://iservices.measuredprogress.org

53. 53 Accessing Your Confidential Reports Select “Reports” to view non-interactive reports. Select “Interactive” to view interactive reports.

54. 54 Accessing Your Confidential Reports Apply filter to view by teaching or testing group Select 2009-2010 and filter criteria to view desired NECAP reports. Outcome from applied filters will be displayed here.

55. 55 Now that we have collected valuable data, we have partnered with Performance Pathways to help districts and schools access the data – access is via the i4see Workbench. Performance Tracker --- Assessment Builder – Tech Paths (curriculum)

56. 56 So how do I get access… Visit www.ed.state.nh.us/i4see 1.PD centers are providing hands-on training. 2.TIP 16 on the i4see home page will describe how to request a user id. 3.Under Recent Highlights you will find a link to a timeline identifying monthly i4see training sessions.

57. 57 Performance Pathways Provides Access to Assessment Information…

58. 58 So how should we be using Performance Tracker… Yes You Should… Use Performance Tracker to learn more about your student performance in relation to the GLEs & GSEs Look for trends over time rather than one time snap-shots. Look at item level results and specific test items to better understand test terminology and student thinking Define student groups to understand the success of specific programs Compare across student groups and subgroups within your schools and within your district to understand curriculum and instructional strengths, weaknesses & needs Please Be Cautious… Performance Tracker is not meant to recreate AYP results Not all correlations are statistically significant Watch out for percentages -- keep an eye on the number of students represented by the reporting results– don’t jump to conclusions if 75% represents only three students Remember NECAP is only one indicator