1. Using the 2009 NECAP Reports February 2010 New England Common Assessment Program

2. 2 Dr. Kevon Tucker-Seeley Assessment Specialist Office of Instruction, Assessment & Accountability RI Department of Education 1-401-222-8494 Welcome and Introductions Ana Karantonis Assessment Specialist Office of Instruction, Assessment & Accountability RI Department of Education 1-401-222-8940

3. 3 Welcome and Introductions NECAP Service Center 1-877-632-7774 Harold Stephens NECAP Program Director 1-603-749-9102 ext. 2235 Stephens.Harold@measuredprogress.org Amanda Smith NECAP Program Manager 1-603-749-9102 ext. 2259 Smith.Amanda@measuredprogress.org Carole Soule NECAP Program Manager 1-603-749-9102 ext. 2450 Soule.Carole@measuredprogress.org Sarah Halaby-Weston NECAP Program Manager 1-603-749-9102 ext. 2485 Halaby-Weston.Sarah@ measuredprogress.org Elliot Dunn NECAP Program Manager 1-603-749-9102 ext. 2126 Dunn.Elliot@measuredprogress.org

4. 4 NECAP Service Center: 1-877-632-7774 Welcome and Introductions Tina Haley: NECAP Program Assistant Phone - 1-603-749-9102 ext. 2427 E-mail – haley.cristina@measuredprogress.org Mellicent Friddell: NECAP Program Assistant Phone - 1-603-749-9102 ext. 2355 E-mail – friddell.mellicent@measuredprogress.org Kellie Beaulieu: NECAP Program Assistant Phone - 1-603-749-9102 ext. 2156 E-mail – beaulieu.kellie@measuredprogress.org

5. 5 Purpose of the Workshop Review the different types of NECAP reports Demonstrate the new NECAP Analysis & Reporting System Review the four interactive reports available from the new system

6. 6 Involvement of Local Educators in NECAP Development of Grade Level Expectations Participation in annual test item review committees & bias and sensitivity review committees Use of classroom teacher judgment data Participation in standard setting panels Technical Advisory Committee work

7. 7 FERPA The Family Educational Rights and Privacy Act (FERPA) Access to individual student results is restricted to:  the student  the student’s parents/guardians  authorized school personnel Superintendents and principals are responsible for maintaining the privacy and security of all student records. Authorized school personnel shall have access to the records of students to whom they are providing services when such access is required in the performance of their official duties. FERPA website: http://www.ed.gov/policy/gen/guid/fpco/ferpa/index.html

8. 8 Workshop Materials

9. 9 Types of NECAP Reports Student Report (Confidential) Information for Parents Item Analysis Report (Confidential) School level by student Results Report (Public) School and District level Summary Report (Public) School/District/State level Student Level Data Files (Confidential) Excel/csv files by grade on district and school confidential site

10. 10 Student Report

11. 11 This part of the report provides the individual student’s achievement level and scaled score Looking at the Student Report

12. 12 Looking at the Student Report

13. 13 This part of the report provides a comparison between the performance of this student and her or his school, district, and state Looking at the Student Report

14. 14 Looking at the Student Report

15. 15 This part of the report gives specific information about the student’s performance in content area subcategories Looking at the Student Report

16. 16 Looking at the Student Report

17. 17 Item Analysis Report

18. 18 Item Analysis Report - Legend

19. 19 Looking at the Item Analysis Report

20. 20 This part of the report gives specific information about the released items and student performance on individual items Looking at the Item Analysis Report

21. 21 Looking at the Item Analysis Report

22. 22 This part of the report represents all of the items used to compute student scores - points are displayed by subcategory. Each student’s Scaled Score and Achievement Level are shown. Looking at the Item Analysis Report

23. 23 Looking at the Item Analysis Report

24. 24 Looking at the Item Analysis Report This part of the report is where group, school, district and state summary results are located for the Released Items only.

25. 25 District and School Results Report

26. 26 Looking at a School-Level Results Report

27. 27 Schools can view reports for Testing Year (2009-10) Looking at School Results Report – Testing Year

28. 28 or for Teaching Year (2008-09) Looking at School Results Report – Teaching Year

29. 29 School-Level Results Report – Grade Level Summary

30. 30 School-Level Results Report – Grade Level Summary

31. 31 School-Level Results Report – Grade Level Summary

32. 32 School-Level Results Report – Grade Level Summary

33. 33 School-Level Results Report – Content Area Results

34. 34 Looking at the Results Report – Content Area Results Cumulative Totals… provide information on multiple cohorts of students exposed to the program of instruction at a specific grade. Caution should be used if the program of instruction has changed significantly.

35. 35 Looking at the Results Report – Content Area Results

36. 36 Total Possible Points includes both common and matrix items (not field-test). Total Possible Points also represents the test’s balance of representation. Mathematics Looking at the Results Report – Content Area Results

37. 37 Please note: The Total Possible Points column is organized differently on the Reading Results Report 106 possible points are represented here – they are sorted by “Type of Text” The same 106 possible points are represented here – they are sorted by “Level of Comprehension” Looking at the Results Report – Content Area Results

38. 38 Total Possible Points includes both common and matrix items (not field-test). Reading Looking at the Results Report – Content Area Results

39. 39 Writing Looking at the Results Report – Content Area Results Total Possible Points includes both common and matrix prompts (not field-test).

40. 40 Looking at the Results Report – Disaggregated Results

41. 41 Important Note: Disaggregated results are not reported for sub- groups of less than 10 Looking at the Results Report – Disaggregated Results

42. 42 Because this is a small school, and so many of the sub-groups are smaller than 10, this part of the report is not as useful. But we can still look at district and state disaggregated results. Does this data match what we know about the district’s program? Looking at the Results Report – Disaggregated Results

43. 43 School Summary Report

44. 44 Contain: All demographic information for each student that was provided by RIDE. The scaled score, achievement level, and subcategory scores earned by each student in all content areas tested NECAP files also contain: Performance on released items Student questionnaire responses Optional reports data NECAP District and School Student-Level Data Files

45. 45 Released Item Documents

46. 46 http://iservices.measuredprogress.org Accessing Your Confidential Reports

47. 47 Select “Interactive” to view Interactive Reports Select “Reports” to view Static Reports 47 Accessing Your Confidential Reports

48. 48 Guides to Using the 2009 NECAP Reports NECAP Analysis and Reporting System User and Training Manual Companion PowerPoint presentation Grade Level Expectations NECAP Accommodations Guide Released Items documents Preparing Students for NECAP: Tips for Teachers to Share with Students Supporting Materials and Resources