The New England Common Assessment Program (NECAP) An Introduction and Overview of the (now) 4-State Assessment Collaborative Presented by Susan Smith – April 13, 2009 Updated on April 14, 2009

This complete presentation, including audio, will be available as soon as possible at: /necap/presentations.html The PowerPoint portion of this presentation is currently posted. Presentation

The information contained in this presentation is based on current NECAP policies and may be subject to change. Presentation

Maine’s partnership with NECAP NECAP Standards and Maine Learning Results Brief history of NECAP Maine’s testing program Overview of content area test designs, administration, reporting Presentation Overview

No Child Left Behind Requirements Each State Shall… Develop and implement a statewide accountability system that will be effective in ensuring that all local educational agencies, public elementary schools and public secondary schools make adequate yearly progress.

NECAP is the assessment used by four New England states to meet the testing and accountability requirements of the No Child Left Behind Act. What exactly is NECAP?

1.School Accountability 2.Public Reporting 3.Program Evaluation and Improvement 4.Student Proficiency and Progress Multiple Uses of NECAP Testing

Why is Maine Joining NECAP? All Maine state departments were directed by the governor to achieve major cuts in future spending. The Commissioner was directed to identify significant cost reductions across all MDOE programs.

The state assessment program had only two realistic options: 1) Adopt an all multiple-choice test format; 2) Find a less costly way to deliver a test that also includes student constructed responses. Why is Maine Joining NECAP?

In the fall of 2008, the MDOE conducted content comparisons and cost analyses associated with joining NECAP. Comparison studies between NECAP and Maine standards showed adequate correlation (in reading and mathematics) to move forward with adoption of NECAP in Maine. Why is Maine Joining NECAP?

Savings were estimated at 1 million dollars per year. The Maine Department of Education petitioned the 3-state collaborative for acceptance into the assessment group. Acceptance was unanimously offered. Why is Maine Joining NECAP?

To achieve the cost savings, Maine is adopting the following for the content areas of reading, writing, and mathematics for assessment purposes: NECAP standards (GLEs) at all grades 2-high school, NECAP tests at grades 3-8, NECAP cut scores at grades 3-8 to determine achievement levels, and NECAP reports at grades 3-8. Why is Maine Joining NECAP?

The 2007 Maine Learning Results (MLRs) are still very much in effect and describe the breadth and depth of knowledge and skills expected to be taught and learned at all grades and in all content areas MLRs and NECAP Standards

The MLRs will be modified to include the NECAP assessment standards (GLEs) in mathematics, reading and writing at grades 2-7 and high school, providing a consistent progression along the learning continuum MLRs and NECAP Standards

Until the MLRs are modified, instruction should be informed by the current Parameters for Essential Instruction unless there is a discrepancy between them and the NECAP GLEs. In those instances, instruction should reflect the NECAP GLEs MLRs and NECAP Standards

The Department is providing content-specific presentations that discuss the major differences between the NECAP GLEs and the MLRs, which will be posted at: salt/necap/presentations.html 2007 MLRs and NECAP Standards

Can you supply a brief history of NECAP? What are the major differences between the NECAP and the MEAs? What are the major differences in reporting? How will AYP be affected? Some Questions We’ll Try to Answer

Which States Participate in NECAP?

Developed through a collaborative effort by Vermont, New Hampshire and Rhode Island Tests were administered for the first time in October 2005, assessing Reading and Math in grades 3 through 8 and Writing in grades 5 and 8 Grade 11 Reading, Math and Writing was added in Fall 2007 NECAP – A Brief History

Participating states share the same NECAP standards, tests accommodations, cut scores, and reports (for the most part). Each state maintains its own alternate assessment program Each state maintains its own accountability system. NECAP – A Brief History

Maine will continue with the SAT Initiative including the Mathematics Augment and Science Tests as in previous years and not join the NECAP high school assessments. The Maine High School Assessment (MHSA) tests will continue to be administered during the spring of grade 11. Maine’s Participation in NECAP - HS

While Maine has not adopted the NECAP high school testing series, the MDOE has adopted the NECAP high school assessment standards (GLEs) from which the NECAP tests are developed. Maine’s Participation in NECAP - HS

The reasons for adopting the NECAP high school GLEs are twofold: 1) It completes the articulated continuum of NECAP assessment expectations from grades 2 through high school. This is also important for the alternate assessment system that is required to develop assessment tasks “backed down” from the high school level standards. Maine’s Participation in NECAP - HS

2) Adopting the common NECAP high school standards allows for the sharing of future learning experiences and assessment development across the New England Secondary Schools Consortium partners. Maine’s Participation in NECAP - HS

In the past, Maine has conducted an independent alignment study on the SAT, Mathematics Augment and Science test to the Ch. 131 accountability standards. In the future, these alignment studies on the reading and mathematics tests will be to the NECAP GLEs and provide information on the need for any augmentation. Maine’s Participation in NECAP - HS

Maine will NOT adopt the NECAP GLEs or tests in science. Maine will continue with the current MEA science testing program at this time in grades 5, 8 and 11, assessing the existing science accountability standards of the 2007 MLRs. Maine’s Science Testing Program

The decision to stay with MEA science testing was based on the discrepancy between Maine and NECAP science standards. In addition, no savings were projected for joining the NECAP science test due to the format of the test. The MEA testing window for science at grades 5 and 8 will be moved to May 10-21, Maine’s Science Testing Program

Maine will participate fully in the NECAP for reading, mathematics, and writing in grades 3-8. The NECAP test will assess the NECAP GLEs in: reading and mathematics in grades 3-8 (testing the grades 2-7 GLEs). writing in grades 5 and 8 (testing the grades 4 and 7 GLEs). Maine’s Participation in NECAP: Gr. 3-8

As in past years, Maine’s Personalized Alternate Assessment Portfolio (PAAP) will parallel the blueprint of the standard state assessment plan. PAAP alternate standards and tasks in reading, writing, and mathematics are currently being revised. Maine’s Alternate Assessment

PAAPs will now be administered in Grade 2 for the first time. The Department is providing a presentation on PAAP that addresses revisions to Maine’s Alternate Assessment Standards due to the adoption of NECAP standards that will be posted at: alt/necap/presentations.html alt/necap/presentations.html Maine’s Alternate Assessment

NECAP and the MEA use the same testing contractor, Measured Progress, and NECAP has acknowledged “borrowing” from the MEA when they were forming their program. Consequently (fortunately), there are many similarities in policies, formats of test and answer booklets, administration manuals, reports, etc. NECAP Overview

Maine educators will still be involved in reviewing and giving input on all test items by serving on NECAP Item Review and Bias/Sensitivity Committees. Maine educators, working with colleagues from New Hampshire, Rhode Island and Vermont, have recently completed this work for the October 2009 test. NECAP Overview - Committees

NECAP assesses the learning of one year (teaching year) at the beginning of the following year (testing year), so grades 2-7 are assessed at the beginning of grades 3-8 in reading and mathematics. Fourth and seventh grade writing is assessed at the beginning of grades 5 and 8. Alternate assessments are provided for students in grades 2-7. NECAP Overview – Teaching/Testing Years

Reading, Mathematics, and Writing tests consist of multiple-choice (1 point) and constructed-response (4 points) items. The mathematics sessions also include short-answer questions (1 or 2 points). One writing session includes an extended response item ( prompt - 12 points). NECAP Overview - Test Design

There are 3 testing sessions in both reading and mathematics of 45 minutes each, with up to an additional 45 minutes allowed (100% extra time). There are 9 test forms at each grade. The forms contain common, field test and matrix items. There are integrated test/answer booklets at grades 3 and 4. NECAP Overview Test Design

There are 52 common score points at all grades in reading, distributed between the following item types: 28 1-point Multiple Choice (MC) 6 4-point Constructed Response (CR) 54% MC and 46% Student Generated NECAP Test Design -Reading

Reading Passages are similar to the MEA since there are: purpose setting statements, the same formatting, paragraphs numbered in the margin when referenced in the item. Poems are numbered every 5 th line. 25% to 50% of the reading test is released each year. NECAP Test Design -Reading

Reading passages are divided evenly between literary and informational text. The common reading test contains 2 long passages (4 MC, 1CR, 4MC, 1CR) and 2 short passages (4 MC, 1 CR), plus 4 stand alone MCs. Questions are arranged primarily in text order. NECAP Test Design -Reading

Maine and the other NECAP states all value writing highly so have chosen to include it in their tests although it is not required under NCLB. The writing portion of the NECAP test is the most different from the MEA of the content areas. NECAP Test Design - Writing

This October, the NECAP writing test will consist of a previously scheduled writing field test only. No student scores will be reported, but data from the field test, including that of Maine students, will be used to inform the writing test for the next five years. 100% of writing items are released each year. No items from this year’s field test will be released. NECAP Test Design - Writing

There are 34 common score points at all grades distributed among the following item types: 10 1-point Multiple Choice (MC) 3 4-point Constructed Response (CR) 1 12-point Prompt 27% MC and 73% Student Generated There are 2 sessions of writing. NECAP Test Design - Writing

Multiple choice items at grade 5 assess aspects of writing such as accurate spelling, combining sentences in a correct and efficient way, correct end punctuation of sentences, accurate capitalization of words, and correct usage of commas in a series and in dates. NECAP Test Design - Writing

Multiple choice items at grade 8 assess aspects of writing such as accurate spelling, combining sentences in a correct and efficient way, identifying sentence fragments and run-on sentences, use of apostrophes, correct subject-verb agreement, capitalization, quotation marks, etc. NECAP Test Design - Writing

Constructed response items require students to respond in a paragraph after first reading stimulus materials. Stimulus materials require students to read text appropriate for the range of students at the particular grade or occasionally respond to a photograph. The stimulus may be a few lines or a whole page. NECAP Test Design - Writing

Constructed response items require students to respond to 3 of the following 5 types of writing: response to literature (after reading a story, part of a story, or a poem response to informational texts (after reading a short article) NECAP Test Design - Writing

report (after reading a graphic organizer containing relevant or possibly irrelevant facts about a topic), narrative (may or may not utilize stimulus materials) persuasive at grade 8(7) – a response to a situation with no stimulus material. NECAP Test Design - Writing

There is one extended response item (prompt) that will assess a type of writing not included in the constructed response items, although there will never be a narrative prompt at grade 8. All stimulus material for the prompt is read by the teacher. NECAP Test Design - Writing

The Department is providing more in- depth presentations on the reading and writing NECAP GLEs and tests that will be posted at: /necap/presentations.html /necap/presentations.html NECAP Test Design - Writing

Mathematics Test Design – Gr. 3 & 4 There are 65 common score points at grades 3-4 distributed among the following item types : 35-1 point Multiple Choice (MC), 10-1 point Short Answer (SA), 10-2 point Short Answer (SA), 54% MC and 46% Student Generated NECAP Test Design -Mathematics

Mathematics Test Design – Gr. 5-8 There are 66 common score points at grades 5-8: 32-1 point MC 6-1 point SA 6-2 point SA 4-4 point Constructed Response (CR) 48% MC and 52% Student Generated NECAP Test Design - Mathematics

Scratch paper is allowed on all math sessions. (ALL answers must appear in the student answer booklet.) For every grade, calculators are not permitted for the 1 st session, but are permitted for the last 2 sessions. NECAP Test Design - Mathematics

For calculator sessions, the following resources are allowed: calculators that meet NECAP specifications, NECAP Multiplication Tables, NECAP Hundreds Charts, NECAP mathematics tool kits, and rulers % of mathematics items are released. NECAP Mathematics

The Department is providing a more in-depth presentation on the mathematics NECAP GLEs and tests that will be posted at: /necap/presentations.html /necap/presentations.html NECAP Mathematics

NECAP accommodations and related policies are currently being reviewed by educators in all four states. (Refer to: me.shtml for more information.) me.shtml The protocol for approving accommodations for any student is basically the same as that used for the MEA currently. A team must meet to discuss, approve and document allowable accommodations for students who receive them on an everyday basis. NECAP Overview - Accommodations

There are several differences in current NECAP accommodations. For instance, in the reading sessions, the questions and answers accompanying the reading passage can not be read to students who have the approved “read aloud” accommodations. NECAP Overview - Accommodations

The MEA has not allowed modifications, but NECAP currently allows the following modifications to the test: F-1Using calculator and/or manipulatives on Session 1 of the Mathematics test F-2Reading the reading test HOWEVER, all affected sessions using these modifications are counted as incorrect. NECAP Overview - Accommodations

Also, the responses for students who have been approved to use a word processor, typewriter, or computer must be transcribed by school personnel exactly as written into the student’s answer booklet prior to returning materials. NECAP can not allow computer- generated responses to be returned in the special handling envelope for hand scoring due to the volume of returned materials. NECAP Overview - Accommodations

Following the current review, updated accommodation policies and a crosswalk to MEA accommodations will be available prior to the start of testing. IEP teams should use the current MEA accommodation policies and codes for Spring 2009 meetings. These policies are located at: 809materials/policiesprocedures.pdf 809materials/policiesprocedures.pdf Approved accommodations from the MEA list will be allowed for the 2009 NECAP. NECAP Overview - Accommodations

Another difference to note is that NECAP testing policies require that schools ensure that no students are advantaged or disadvantaged by their testing environment. Reference materials, including those on classroom walls or desks, should not be used by students. All reference materials that interfere with proper test administration must be covered or removed during testing, or students’ desks must be positioned so that the materials cannot be viewed. NECAP Overview – Policies

The NECAP testing window will always begin on October 1 st, or the first school day following October 1 st, each year and is 3 weeks long. Maine’s first administration of the NECAP tests will begin on October 1, 2009 and continue through October 22 nd. NECAP Overview – Administration Dates

Testing materials will be shipped from MP the week of September , They should arrive in schools during the latter part of that week or more likely the beginning of the following week. Following test administration, the materials will be picked up on October 23 rd. NECAP Overview – Administration Dates

MEDMS/Infinite Campus student data used for printing labels will be provided to Measured Progress on August 14,2009. The Department will use the best information available to determine interim enrollment for students who are promoted from one school to another over the summer. NECAP Overview – Administration Info.

The Department will provide an updated enrollment file to Measured Progress based on October 2 nd MEDMS/IC student data. Additional labels will then be printed and mailed to schools during the testing window. NECAP Overview – Administration Info.

NECAP test administration presentations (possibly in this electronic format) containing more specific information will occur in September NECAP Overview – Administration Info.

NECAP is very similar to Maine’s current reporting system in that it: Utilizes an 80-point scale, with an initial digit representing the grade being tested. Classifies student achievement across 4 achievement levels with definitions similar with Maine’s present language. The NECAP Reporting System

NECAP Achievement Levels Proficient with Distinction (Level 4) Students performing at this level demonstrate the prerequisite knowledge and skills needed to participate and excel in instructional activities aligned with the GLE at the current grade level. Errors made by these students are few and minor and do not reflect gaps in prerequisite knowledge and skills. (MEA - Exceeds the Standards)

NECAP Achievement Levels Proficient (Level 3) Students performing at this level demonstrate minor gaps in the prerequisite knowledge and skills needed to participate and perform successfully in instructional activities aligned with the GLE at the current grade level. It is likely that any gaps in prerequisite knowledge and skills demonstrated by these students can be addressed during the course of typical classroom instruction. (MEA – Meets the Standards)

NECAP Achievement Levels Partially Proficient (Level 2) Students performing at this level demonstrate gaps in prerequisite knowledge and skills needed to participate and perform successfully in instructional activities aligned with the GLE at the current grade level. Additional instructional support may be necessary for these students to meet grade level expectations. (MEA – Partially Meets the Standards)

NECAP Achievement Levels Substantially Below Proficient (Level 1) Students performing at this level demonstrate extensive and significant gaps in prerequisite knowledge and skills needed to participate and perform successfully in instructional activities aligned with the GLE at the current grade level. Additional instructional support is necessary for these students to meet grade level expectations. (MEA – Does Not Meet the Standards)

NECAP assessment reports are very similar to MEA reports, will be available in late January 2010, and will consist of: Individual student reports Item analysis reports School and SAU reports The NECAP Reporting System

The reports will be delivered on the same secure online reporting tool as the MEA reports have been. Data will be supplied to both teaching and testing schools. The NECAP Reporting System

Student Report

73 Item Analysis Report

74 The Item Analysis Report

School/SAU Report

The NECAP Reporting System

NECAP reporting presentations containing more specific information will occur in late January and/or February The NECAP Reporting System

At this time, pending federal approval, the plan is that the Adequate Yearly Progress (AYP) determinations will be based on the following assessments of learning during the teaching year: October 2009 NECAP reports PAAP data (except at grade 3) first year LEP participation based on ACCESS administration Maine Accountability Reporting

Full Academic Year (FAY) will be based on student enrollment prior to October 1, AYP targets for grades 3-8 for are: Reading: 66% Mathematics: 60% Average Daily Attendance: 92% AYP reports will be posted online about a month after the NECAP reports. Please see the contact list at the end for information on directing AYP–related questions. Maine Accountability Reporting

NECAP information, such as GLEs, released items, other content- related information, and administration information is or will be posted and regularly updated on links from the NECAP page on the DOE website at: /necap/index.htmlhttp:// /necap/index.html. Maine Accountability Reporting

Wanda Monthey Team Leader Daniel Hupp Director of Student Assessment Susan Smith MEA/NECAP Coordinator Kim Schroeter PAAP and Accommodations Coordinator Diana Dorion ELA Content Specialist Patsy Dunton ELA Content Specialist Sandra McKechnie Program Assistant Rachelle Tome Title 1A School Improvement - AYP Maine DOE Contact Information