NECAP Science Pilot Test Administration Workshop Grades 4, 8 & 11 NH Department of Education and Measured Progress April 30; May 1, 3, 4

NH DOE Contact Information Tim Kurtz, Director of Assessment TKurtz@ed.state.nh.us 603.271.3846 Jan McLaughlin, Science Curriculum & Assessment jmclaughlin@ed.state.nh.us 603.271.3856 Gaye Fedorchak, Alternative Assessment gfedorchak@ed.state.nh.us 603.271.7383 Lisa Kaim, Assistant for Math and Science lkaim@ed.state.nh.us 603.271.7450 NH Department of Education, 101 Pleasant Street, Concord, NH 03301-3860

Measured Progress NECAP Science Team NECAP Service Center 1-877-632-7774 Elliot Scharff: NECAP Science Program Manager Phone - 1-603-749-9102 ext. 2126 E-mail - escharff@measuredprogress.org Jennifer Varney: NECAP Science Program Assistant Phone - 1-603-749-9102 ext. 2115 E-mail - jvarney@measuredprogress.org

Measured Progress NECAP Team Harold Stephens: NECAP Program Director Phone - 1-603-749-9102 ext. 2235 E-mail - hstephens@measuredprogress.org Amanda Smith: NECAP Program Manager Phone - 1-603-749-9102 ext. 2259 E-mail - asmith@measuredprogress.org Joshua Evans: NECAP Program Manager Phone - 1-603-749-9102 ext. 2244 E-mail - jmevans@measuredprogress.org Mellicent Friddell: NECAP Program Assistant Phone - 1-603-749-9102 ext. 2355 E-mail - mfriddell@measuredprogress.org Tina Haley: NECAP Program Assistant Phone - 1-603-749-9102 ext. 2427 E-mail - chaley@measuredprogress.org NECAP Service Center 1-877-632-7774

The purpose of this workshop is to ensure that everyone understands the administration procedures for the tests and knows where to find support materials and information. the NECAP tests are administered in a comparable way in all locations across the three states. quality control procedures are followed for returning materials.

Important Dates (page i) April 30 - May 4: Test Materials and Student ID Labels shipped to schools May 14 - 24: Test Administration Window May 25: UPS pickup of test materials for return to Measured Progress. (Materials need to be ready at 8 a.m.)

The New England Common Assessment Program (NECAP) (page 1) Background Collaboration among New Hampshire, Rhode Island, and Vermont to create a common program Allows states to combine experience, increase capacity, and share costs Allows development of a customized science assessment program, which includes an inquiry task component

The New England Common Assessment Program (NECAP) (page 1) Purpose of the Pilot Test Field testing of all items Try out testing procedures Opportunity for all schools to become familiar with science testing, including the inquiry task, prior to the May 2008 operational assessment.

The New England Common Assessment Program (NECAP) (page 1) Structure of the Science Pilot Test Students in every school in all three states will take the test. Each student completes one session of multiple-choice and constructed-response questions and one session of questions tied to an Inquiry Task. Differences between Pilot Test and Operational Test: Total testing time Number of sessions Make-up tests Testing window Reporting

Where do NECAP Science Assessment Targets come from?

New Hampshire NECAP Information The NECAP Science Assessment is based on the Science Assessment Targets as designated in the NH Frameworks for Science Literacy K-12. The designated state (NECAP) assessment targets are the expectations in BOLD boxes in the Science Grade Span Expectations (GSEs). We use the same “statements of enduring knowledge” to organize our frameworks as the NECAP documents.

New Hampshire NECAP Information NECAP Resources on the NH Science Page www.ed.state.nh.us Programs and Services  S  Science in NH Schools NH Science Framework New Hampshire Framework for Science Literacy K-12 (includes all Science Grade Span Expectations) NH Science Grade Span Expectations (includes NECAP targets) K-12 Science Process Skills (includes inquiry targets) K-12 Earth Space Science  K-12 Life Science  K-12 Physical Science 

New Hampshire NECAP Information More NECAP Resources on the NH Science Page: www.ed.state.nh.us Programs and Services  S  Science in NH Schools NH NECAP Inquiry Task Information Planning Guide for Investigations  Planning Guide for Non-Investigations  Sample Investigation Inquiry Task at Grade 4  Sample Non-Investigation Inquiry Task at Grade 8     Sample Non-Investigation Inquiry Task at Grade 11  Released Inquiry Performance Tasks      NH NECAP Science Information NH NECAP Science Assessment Information  (includes all assessment targets) Number of Targets by Domain and Grade Span 

Content Framework for NECAP Science Assessment Science Domains by Enduring Knowledge Statements Assessment Targets Grade 4 Grade 8 Grade 11 LS 1 - Survival of organisms 1-4 1-2 LS 2 - Matter & energy of ecosystems 5-6 5-7 3-5 LS 3 - Organisms change over time 7 8-9 6-9 LS 4 - Humans are similar and different 10-12 9-10 PS 1 - Properties and structure of matter 1-3 1-5 PS 2 - Energy 4-6 6-7 PS 3 - Forces and motion 7-8 8 8-10 ESS 1 - Earth and earth materials 1-6 ESS 2 - Solar System 6-8 ESS 3 - Universe and galaxies 5-8

New Hampshire NECAP Information Eligible NECAP Targets for the Inquiry Task at each grade tested can be found in the Science Process Skills (SPS) GSE in the last row in SPS1 labeled: NECAP Science Assessment Targets for Inquiry (INQ) May be subject of performance component Resources and Information about the Science Frameworks and NH Information about the NECAP Science Assessment can be found at www.ed.state.nh.us Programs and Services  S  Science in NH Schools Science Reference Sheets can be found at the link below www.ed.state.nh.us Programs and Services  N  NECAP

Item Types Multiple Choice (MC) 1 Point Answer Key Constructed Response (4-CR) 4 points Rubric: 0-4 points Inquiry Task 16-18 points assessed with a mix of 2- and 3-point SA

Grade 4 Science Pilot Test Design: Session 1: 50 Minutes* Session 2: 95 Minutes** 29 Multiple Choice (1 pt each) 8 short-answer questions Making Your Predictions 2 Constructed Response (4 pts each) Setting Up and Conducting Your Investigation *For Session 1, students are allowed an additional 45 minutes without an accommodation. Organizing and Presenting Your Data Analyzing and Using Your Results A New Investigation **For Session 2, students should complete the Inquiry Task and all questions within 95 minutes.

Grade 8 Science Pilot Test Design: Session 1: 50 Minutes* Session 2: 95 Minutes** 29 Multiple Choice (1 pt each) 8 short-answer questions Making Your Predictions 2 Constructed Response (4 pts each) Setting Up and Conducting the Investigation and Collecting Data *For Session 1, students are allowed an additional 45 minutes without an accommodation. Organizing and Presenting Your Data Analyzing and Using Your Results **For Session 2, students should complete the Inquiry Task and all questions within 95 minutes.

Grade 11 Science Pilot Test Design: Session 1: 50 Minutes* Session 2: 80 Minutes** 29 Multiple Choice (1 pt each) 8 short-answer questions Prediction 2 Constructed Response (4 pts each) Analyzing and Using Data Organizing and Presenting Data *For Session 1, students are allowed an additional 45 minutes without an accommodation. Using Evidence and Applying What You Learned **For Session 2, students should complete the Inquiry Task and all questions within 80 minutes.

Inquiry Task Design: Pilot Test Grade 4 & 8 INVESTIGATION Introduction Prompt with Content Question Make a predictions (gr. 4) or hypothesis (gr. 8) and explain. Conduct Investigation with a partner ~ Collect and display data Summarize results Develop and evaluate explanations with content Propose new question (gr. 4) that could be investigated or investigation (gr. 8)

Inquiry Task Design: Pilot Test Grade 11 NON–INVESTIGATION Introduction prompt with content question Review results from an investigation Develop and evaluate explanations Formulate questions and hypothesize Plan/Critique Investigation Construct or analyze alternative explanation Link to Enduring Knowledge concept

The New England Common Assessment Program (NECAP) Science Assessment Changes of Note: For the pilot ONLY, session 1 will be 1 domain per student. Every school will have all domains present. Student Test Booklet and Student Answer Booklet are separate documents for Grades 4, 8, and 11. Districts/schools may decide if students can use a calculator on the assessment (not recommended at grade 4.) A science reference sheet will be provided for each student in grades 8 and 11. (There are different sheets at grade 8 and 11.) The reference sheets are available now on the NH Science web page.

Setting up the Inquiry Task Questions

School Test Coordinator’s Responsibilities (page 2) Primary responsibilities: serve as the school’s contact person with Measured Progress coordinate all test-related activities prepare test administrators to administer NECAP according to directions in the Test Administrator Manual oversee the inventory, distribution, collection, and return of ALL test materials ensure test security and compliance with test administration procedures

Test Security (page 3) Test Security relies on the professional integrity of everyone in our schools across all three states. No student should be advantaged or disadvantaged based on how or where the test is administered. All test items and responses to those items in the NECAP are secure and may not be copied or duplicated in any way or kept by the school after testing is completed. Using secure test material to prepare students in any way for this test administration is a violation of test security and testing procedure.

Breaches in Test Security (page 3) Any concern about breaches in test security must be reported immediately to the test coordinator and/or principal. The test coordinator/principal is then responsible for reporting breaches to the district superintendent and the state department of education.

Getting Ready Select each school’s Test Coordinator Communicate test plan to staff Ensure test security is in place Schedule testing Plan logistics around testing—especially for the Inquiry Task

Preparation for Test Administration BEFORE TESTING (page 4) Preparation for Test Administration Manuals Read the Principal/Test Coordinator and Test Administrator Manuals Student Participation and Accommodations The Accommodations and Procedures: Administrators Training Guide covers these topics: Who should be tested Determining how students will participate using accommodations Documenting and bubbling in accommodation codes

Who should be tested for the pilot? (page 4) As many students as possible, including: Students with disabilities English language learners Students attending career and technical centers EXCEPTIONS for the pilot test ONLY: Students who would normally participate in alternate assessment ELL students enrolled in U.S. schools less than one year Students absent for entire testing window Students experiencing extraordinary personal circumstances

Classroom Environment Preparing for the Inquiry Task ~ Grades 4 and 8 Only Check to ensure there are enough materials for the Inquiry Task. Materials are packed by “type”, not by kit. Ensure that students have enough room to place materials on the 11” x 17” Placemat. Identify plan for setting up materials for the Inquiry Task. Identify process for grouping students (see Appendix 6 of the Principal/Test Coordinator Manual).

Appendix 6: Guidelines for Grouping Students in Session 2 ~ Grades 4 & 8 only Part 1 – Making your prediction Students will make predictions and record them on their own Prediction Sheet. Part 2 – Setting up and conducting your investigation and collecting data Students will work in collaborative groups. All students must record data on their Data Sheets for use in Parts 3 and 4 ( and Part 5 for grade 4). Parts 3 and 4 (and Part 5 for grade 4) – Organizing and presenting your data, and analyzing and using your results Students will work alone with data collected from Parts 1 and 2 and record all their answers in their own Student Answer Booklet.

Accommodations for the Pilot Who is eligible for testing accommodations? ALL students Accommodations do not change what we expect students to know and be able to do. Test accommodations are based on individual student needs and classroom assessment practice; they are not for the use of an entire classroom or category of students. They should not give students unfair advantages; rather they are meant to remove barriers that may exist due to a student’s learning style or disability.

Appendix 5: Table of Standard Test Accommodations (Page A-6)

Accommodations for the Pilot Accommodations, Guidelines, and Procedures: Administrator Training Guide – Still available on state DOE website under NECAP, but not yet updated for Science. Everything listed there is still available. For the Science Pilot, Use the Table of Standard Test Accommodations found in Appendix 5 of the Test Coordinator and the Test Administrator Manuals. Only these manuals have the most recent updates. School teams may use, without state approval, only standard accommodations listed in categories A, B, C, or D. Please note: Categories E and F work differently, as follows:

Accommodations for the Pilot Use of Category E “Other” Accommodations - Contact NHDoE, Gaye Fedorchak, in advance of testing to discuss any other (non-listed) accommodations you want to use during the pilot. Accommodation(s) must be consistent with those used in student’s regular classroom instruction. If the DOE finds the Category E-Other accommodation to be comparable to a standard accommodation, we will note this and consider for future updates to Accommodations Manual. DOE is seeking & collecting teacher ideas for the Inquiry Task During full test implementation (May 2008), student work done using category A, B, C, D, or state approved E accommodations will be fully credited & scored.

Accommodations for the Pilot Use of Category F Modifications - If the state determines that your request for a (non-listed) E-Other Accommodation will change what the test measures, then the state will respond in writing that use of this procedure will produce a test “modification” and must therefore be documented as an F-Modification. After the pilot, during full test administration, use of an F-Modification will result in no credit given for student work during test sessions in which this F-Modification was used. When full assessment starts, any E –Other Accommodation not registered as “approved” by your state DOE will be treated as an F- Modification.

Accommodations for Pilot After Testing, Document all accommodations and modifications actually used on page 2 of the Student Answer Booklet. (If not used, don’t bubble.) Accommodation Updates for the Science Pilot: C-4 ……. Now includes Science C-12 ….. Now includes Science C-13 ….. Does not appear in Test Manuals but is still in effect for NECAP and will return in future manuals. An abacus is not likely to be needed for the Science Pilot. D-5 ……. Now includes Science D-6 ……. Now includes Science D-7 ……. Reserved for Future Standard Accommodation (after pilot data is gathered)

Accommodations - Thinking long term Support teachers through the accommodations decision- making process. Include all of a student’s classroom teachers, parents, and, whenever possible, the student in the decision-making process. Consult with parents regarding use of accommodations through phone or similar kinds of contacts. A face-to-face meeting is not required. Standardize the accommodation administration process and plan the resources necessary for large-scale implementation. Ensure that the students’ records include the decisions made to inform both current and future educational planning.

Scheduling Test Sessions (page 5) Session 1 of the NECAP Science pilot test in grades 4, 8, and 11 is designed to be completed in approximately 50 minutes. Students are allowed an additional 45 minutes for Session 1 without an accommodation. Plan accommodations for those students who typically take more than 50% additional time for regular classroom assessment. Only those students with an extended time accommodation may be permitted more than 95 minutes to complete Session 1. Session 2 of the NECAP Science pilot test in grades 4 & 8 is designed to be completed in approximately 95 minutes. Session 2 in grade 11 is designed to be completed in approximately 80 minutes. The student questionnaire for grades 4, 8, and 11 is designed to be completed in 20 minutes.

Scheduling Test Sessions (page 5) All testing, including accommodated sessions, must occur within the testing window. Test sessions must be scheduled and given in the order presented in the Student Test Booklet. All classrooms of students in a school should take the same test session simultaneously.

Student ID Labels (page 7) Labels created for students based on beginning of school year 2006-07 enrollment files 2 identical labels printed for each student (one for Student Answer Booklet, one for Student Test Booklet) Student labels are sorted by group field prior to printing (if requested)

Student ID Labels (page 7) Students enrolled in your school WITH Student ID Labels 3 fields MUST be correct in order to use label: student name, state-assigned Student ID number, and school name If any of the 3 fields are incorrect or missing, DO NOT USE the label. Call your state DOE to report incorrect information. Follow procedure for students without Student ID Labels.

Student ID Labels (page 7) Student ID Labels for students NOT in your school Labels are NOT transferable between schools. Throw away any labels provided for students not enrolled in your school. DO NOT forward these labels on to other schools. DO NOT affix these labels to Student Answer Booklets.

Student ID Labels (page 7) Students WITHOUT ID labels Complete the student information on pages 1 and 2 of the Student Answer Booklet.

Preparing Student Test Booklets and Answer Booklets for Testing (page 7) Booklets will be shrink-wrapped in packs of 15, 10, 5, and singles. Count the booklets to verify that the quantity received matches the quantity sent. Call Measured Progress if your count does not match the quantity indicated on the Material Summary form sent by Measured Progress. Do not re-sequence test booklets or answer documents. Student Answer Booklets come inserted in the Student Test Booklet, paired by form.

Preparing Student Test and Answer Booklets for Testing (page 7) DO NOT separate the Student Answer Booklets from the Student Test Booklets. If the booklets do become separated, you will need to match the form number on the front cover of the Student Test Booklet with the bracketed portion of the number printed on the bottom right corner of the Student Answer Booklet. The unique serial numbers on Student Test Booklets and Student Answer Booklets are not designed to match.

Preparing Student Test Booklets and Answer Booklets for Testing (page 7) For students WITH Student ID labels For students enrolled with a label, affix the label to the front cover of the Student Answer Booklet. Affix second label on the front cover of the Student Test Booklet For students WITHOUT Student ID labels For students enrolled without a label, fill in all required information. Write student name and school name on cover of the Student Test Booklet

New Hampshire

Prior to Test Administration (page 8) Designating Test Administrators Administer content area test sessions simultaneously within each grade level at the school and district. Test students in surroundings that will provide them the opportunity to do their best work. (Grades 4 and 8 will need a level workspace for session 2). Students who require accommodations must be supervised by trained test administrators (refer to Accommodations, Guidelines, and Procedures: Administrator Training Guide)

Preparing Test Administrators (page 8) Assign each Test Administrator to a specific group of students. Notify Test Administrators of the testing schedule. Explain security procedures. Plan for grouping students into pairs in grades 4 & 8 prior to Session 2. Plan for inventorying, distributing, collecting, and storing materials. Create a plan for applying Student ID Labels or code student identification info on covers of Student Test Booklets and Answer Booklets. For students without a label, plan for completing student info on page 2 of Student Answer Booklet.

Preparing Test Administrators (cont.) Discuss additional materials needed: calculators, scratch paper and/or Post-Its, Science reference sheets Explain guidelines for classroom environment. Encourage completion of Test Administrator Questionnaire. Answer questions regarding test administration and security.

Test Materials (pages 10-14) Inventory Test Materials Packing Order of NECAP Science Materials Quantities of Student Test Booklets and Answer Booklets Quantities of Other Materials Ordering Additional Materials Storing and Access to Test Materials Equipment and Materials Permitted During Test Administration Equipment and Materials Prohibited During Test Administration Ancillary Test Materials

DURING TESTING (page 14) Test Administration Distributing Test Materials Make sure materials are kept in a locked storage area prior to testing and between sessions. Include an additional set of test materials for the test administrator to use while giving directions. Monitoring Test Administration Test administrators may not comment on students’ work. Test administrators may not help students in any way except during the General Instructions, Student Questionnaire, or as specified in the Test Administrator Manual.

Preparation of Test Materials for Return AFTER TESTING (page 15) Preparation of Test Materials for Return Collecting Materials After Testing List on page 15 of Principal/Test Coordinator Manual Special Materials Make sure that all non-standard, student-generated work (computer-generated, large-print, and Braille responses) have been transcribed into a regular Student Answer Booklet. Examples of materials for the Special Handling envelope: torn booklets, responses written with anything other than a #2 pencil, damaged test booklets

Verifying Completion of Student Information on Student Answer Booklets (page 16) Ensure that a label is affixed properly for all students with a Student ID Label. Ensure that all applicable student information has been competed for students without a Student ID Label. Ensure that accommodation information has been coded on page 2 of the Student Answer Booklet for students who used an accommodation(s).

Completing Principal’s Certification of Proper Test Administration (page 16) Complete 1 form online for each grade tested. Must be done prior to return of materials Numbers you need: total # of booklets sent to your school # of used booklets being returned total # of booklets being returned Detailed instructions will be shipped with test materials. Print, sign, and return a copy of the form with test materials.

Return of Materials (page 17) Packaging test materials for return to Measured Progress UPS One-Day Pickup on May 25th at 8:00 a.m. Use original shipping cartons. Pack materials for one grade only per carton. Follow packing instructions on the bottom on page 17 of your Principal/Test Coordinator Manual.

DO NOT return the following (page 18): Manipulatives from the Inquiry Task Kits Inquiry Task Placemats Materials Summary Form & Packing Slips *Secured Material* Science reference sheets Principal/Test Coordinator Manual and Test Administrator Manuals Principal/Test Coordinator Questionnaire (Return completed answer sheets only.) Test Administrator Questionnaire (Return completed answer sheets only.) Student Questionnaires (Students answered the questions in their Student Answer Booklets.)

NH Science NECAP Resources NECAP Page on NH Dept. of Ed Website. www.ed.state.nh.us Programs and Services N  NECAP2007 Science pilot Student Support and Testing Materials Science Reference Sheets Policy Material Accommodations, Guidelines, and Procedures: Administrator Training Guide Calculator Policy 2007 NECAP Science Principal/Test Coordinator & Test Administrator Manuals Reference Materials 2007 Test Administration Workshop Presentation

Questions and Answers