1. A professional development seminar presented by: Michele Mailhot and Susan Smith March 21, 2012 michele.mailhot@maine.gov susan.smith@maine.gov

2. NECAP Mathematics Assessment Goals of the presentation: 1. communicate NECAP mathematics test design, structure and scoring procedures; 2. demonstrate how to access NECAP mathematics data; 3. provide strategies for using NECAP data to inform instruction and program analysis, and; 4. describe the influence that the Common Core State Standards will have on future mathematics assessment.

3. Purpose and Design of the NECAP Mathematics Assessment Measures the mathematics content of the NECAP Grade Level Expectations (GLEs) Reports across four subtopics Provides a consistent measure of mathematics programs across all schools in the state

4. Purpose and Design of the NECAP Mathematics Assessment 3 separate sections requiring a minimum of 45 minutes of testing time each; 1 session does not permit the use of calculator or other tools 48 questions worth 66 common score points – 32 multiple choice questions, 12 short answer questions (worth 1 or 2 points), and 4 constructed response questions (worth 4 points)

5. Purpose and Design of the NECAP Mathematics Assessment The raw score is calculated in the following manner: 1 point for each correct answer to MC items 1 point for each correct answer to 1-pt SA items 0-2 points for each answer to 2-pt SA items, with a score of 2 indicating that the response is complete. 0 – 4 points for each answer to constructed response items, with a score of 4 indicating that the response is complete.

6. Purpose and Design of the NECAP Mathematics Assessment Distribution of Emphasis for Mathematics Mathematics Content Standards (GLEs) Grade 2(3)* Grade 3(4) Grade 4(5) Grade 5(6) Grade 6(7) Grade 7(8) Numbers and Operations 55%50%45%40%30%20% Geometry and Measurement 15%20% 25% Functions and Algebra15% 20% 30%40% Data, Statistics and Probability 15% * 2(3) indicates end-of-grade 2 GLEs are tested at the beginning of grade 3

7. NECAP Mathematics Assessment Overview of the data analysis tool (a product of Measured Progress) Using this tool, school designated personnel can view student’s responses to MC answers and earned points for SAs and CRs for every released NECAP mathematics item.

8. iServices – “Interactive” Tab Released Items Summary Data Multiple Choice Item Short Answer and Constructed Response – including scoring guide, sample student response and annotation Item Analysis Reports Longitudinal Data School Reports

9. NECAP Mathematics Assessment - Data Mathematics Student-Level Item Analysis 1. NECAP results and new access codes were mailed to school principals in January 2012 2. Go to link below. 3. Select “Maine,” and then “Maine Reports” OR select “New England Common Assessment Program”, click on map of Maine, then “Maine Reports”. http://iservices.measuredprogress.org

10. NECAP Mathematics Assessment - Data Mathematics Student-Level Item Analysis If your principal needs a reminder of these codes s(he) should call Measured Progress at 1-877-632-7774 http://iservices.measuredprogress.org

11. Maine’s Mathematics Progress Over 3 Years NECAP % ProficientNECAP Scaled Scores Grade200920102011% Change 200920102011Point Change 3626164+2342343 +1 4626066+4443 444+1 56460640543 0 663 65+2643 644+1 7605861+1742 743+1 859 60+1842 0

12. Maine’s Mathematics Progress Cohorts NECAP % ProficientNECAP Scaled Scores Grade200920102011% Change 200920102011Point Change 3626164--342343 -- 4626066+5443 444+1 5646064+2543 +1 663 65+3643 644+1 7605861-3742 7430 859 60-3842

13. iServices – “Interactive” Tab Released Items Summary Data Multiple Choice Item “Open Response” – including scoring guide and sample student responses to short answer and constructed response items Item Analysis Report Longitudinal Data School Reports

14. NECAP Mathematics Instructional Strategies Ideas for consideration: Begin classes with a question of the day… Use a released NECAP question… multiple choice or short answer.

15. NECAP Mathematics Instructional Strategies Ideas for consideration: Have students create their own multiple-choice items aligned to the mathematics unit of instruction and learning goals. Challenge them to create four choices, including a correct answer and three good distractors. Have students explain what makes the distractors good choices.

16. NECAP Mathematics Instructional Strategies Ideas for consideration: Have students create their own short answer and constructed response items and corresponding scoring guides aligned to the mathematics unit and learning goals.

17. NECAP Mathematics Instructional Strategies Ideas for consideration: Embed a released NECAP question (or two) into a homework assignment.

18. NECAP Mathematics Instructional Strategies Ideas for consideration: Ask students to answer selected released items (constructed response, short answer and/or multiple choice items) at the end of a unit. Score and compare the results from year to year.

19. NECAP Mathematics – Uses for the Data Ideas for consideration: Reflect on your school programming What are your strengths/weakness across areas? Which students are served well/not served well?

20. NECAP Mathematics – Uses for the Data Ideas for consideration: Reflect on student misconceptions/thinking Can your mathematics staff predict your student response patterns? Can your staff predict student response patterns for disaggregated groups in your community?

21. NECAP Mathematics – Uses for the Data Important ideas: NECAP data is one tier (small but comparable) of a pyramid of student data intended to inform understanding of school program. NECAP data must be supported and informed by classroom and school level formative assessment data for individual students.

22. NECAP Mathematics – Support Resources Resources for consideration: NCTM Principles and Standards of School Mathematics NCTM Curriculum Focal Points Helping Children Learn Mathematics Adding It Up

23. NECAP Mathematics – Support Resources Resources for consideration: Curriculum Topic Study Formative Assessment Probes The Illustrative Mathematics Project http://illustrativemathematics.org/ http://illustrativemathematics.org/

24. CCSSM Implementation Timeline 2010-2011 : Year of Study – become familiar with the documents and terminology 2011-2012 : Begin implementing the 8 Standards for Mathematical Practice in your instruction and take an informal look at your current curriculum 2012-2013 : Begin aligning/implementing your curriculum to the CCSS content standards (including the practices) 2013-2014 : Continue aligning/implementing your curriculum to the CCSS content standards (including the practices) 2014-2015 : Full alignment/implementation of the CCSS practice and content standards

25. New Assessments Aligned to CCSS Current plans are for the last NECAP assessment to be administered in October 2013. Maine is a member of the SMARTER Balanced Assessment Consortium with 26 other states, which is building an assessment system aligned to the CCSS to be implemented in 2014-15. The system will consist of optional interim assessments and a summative assessment consisting of computerized performance tasks and a computer-adaptive assessment administered in the Spring of 2015. FMI - http://www.smarterbalanced.org/ http://www.smarterbalanced.org/

26. Changes to NECAP During the Transition There will be no changes to the NECAP Reading, Mathematics, and Writing tests in the fall of 2012. There will be no changes to the NECAP Reading and Writing tests in the fall of 2013. The fall 2013 NECAP Mathematics tests will have a limited number of changes due to differences with the CCSS

27. Changes to NECAP During the Transition TestGradeGLEs NOT Assessed in Fall 2013* NECAP Mathematics3 DSP 2-4 NECAP Mathematics4DSP 3-5 NECAP Mathematics5DSP 4-4, DSP 4-5, and GM 4-5 NECAP Mathematics6 DSP 5-5 NECAP Mathematics7DSP 6-4, DSP 6-5, FA 6-2, and GM 6-5 NECAP Mathematics8FA 7-2 *The GLEs that will be eliminated from testing—primarily because they have moved to a higher grade level in the CCSS—include concepts such as probability, combinations, similarity, and rate of change.

28. Maine’s NECAP Mathematics MDOE Website Overview of the MDOE website and resources. http://maine.gov/education/lsalt/index.htm http://www.maine.gov/education/necap/index.html

29. Stay informed MDOE Mathematics website http://www.maine.gov/education/lres/math/index.html Mathematics Listserv https://list.terc.edu/mailman/listinfo/maine-math

30. The NECAP Mathematics Test This presentation is recorded and posted at: http://www.maine.gov/education/lres/math/index.html and http://www.maine.gov/education/necap/presentations.html