1. NECAP Science Pilot Test Administration Workshop Grades 4, 8 & 11
NH Department of Education
and
Measured Progress
April 30; May 1, 3, 4

2. NH DOE Contact Information
Tim Kurtz, Director of Assessment
Jan McLaughlin, Science Curriculum & Assessment
Gaye Fedorchak, Alternative Assessment
Lisa Kaim, Assistant for Math and Science
NH Department of Education, 101 Pleasant Street, Concord, NH

3. Measured Progress NECAP Science Team
NECAP Service Center
Elliot Scharff: NECAP Science Program Manager
Phone ext. 2126 -
Jennifer Varney: NECAP Science Program Assistant
Phone ext. 2115 -

4. Measured Progress NECAP Team
Harold Stephens: NECAP Program Director
Phone ext. 2235 -
Amanda Smith: NECAP Program Manager
Phone ext. 2259 -
Joshua Evans: NECAP Program Manager
Phone ext. 2244 -
Mellicent Friddell: NECAP Program Assistant
Phone ext. 2355 -
Tina Haley: NECAP Program Assistant
Phone ext. 2427 -
NECAP Service Center

5. The purpose of this workshop is to ensure that
everyone understands the administration procedures for the tests and knows where to find support materials and information.
the NECAP tests are administered in a comparable way in all locations across the three states.
quality control procedures are followed for returning materials.

6. Important Dates (page i)
April 30 - May 4:
Test Materials and Student ID Labels shipped to schools
May :
Test Administration Window
May 25:
UPS pickup of test materials for return to Measured Progress. (Materials need to be ready at 8 a.m.)

7. The New England Common Assessment Program (NECAP) (page 1)
Background
Collaboration among New Hampshire, Rhode Island, and Vermont to create a common program
Allows states to combine experience, increase capacity, and share costs
Allows development of a customized science assessment program, which includes an inquiry task component

8. The New England Common Assessment Program (NECAP) (page 1)
Purpose of the Pilot Test
Field testing of all items
Try out testing procedures
Opportunity for all schools to become familiar with science testing, including the inquiry task, prior to the May 2008 operational assessment.

9. The New England Common Assessment Program (NECAP) (page 1)
Structure of the Science Pilot Test
Students in every school in all three states will take the test.
Each student completes one session of multiple-choice and constructed-response questions and one session of questions tied to an Inquiry Task.
Differences between Pilot Test and Operational Test:
Total testing time
Number of sessions
Make-up tests
Testing window
Reporting

10. Where do NECAP Science Assessment Targets come from?

11. New Hampshire NECAP Information
The NECAP Science Assessment is based on the Science Assessment Targets as designated in the NH Frameworks for Science Literacy K-12.
The designated state (NECAP) assessment targets are the expectations in BOLD boxes in the Science Grade Span Expectations (GSEs).
We use the same “statements of enduring knowledge” to organize our frameworks as the NECAP documents.

12. New Hampshire NECAP Information
NECAP Resources on the NH Science Page
Programs and Services  S  Science in NH Schools
NH Science Framework
New Hampshire Framework for Science Literacy K-12 (includes all Science Grade Span Expectations)
NH Science Grade Span Expectations (includes NECAP targets)
K-12 Science Process Skills (includes inquiry targets)
K-12 Earth Space Science 
K-12 Life Science 
K-12 Physical Science 

13. New Hampshire NECAP Information
More NECAP Resources on the NH Science Page:
Programs and Services  S  Science in NH Schools
NH NECAP Inquiry Task Information
Planning Guide for Investigations 
Planning Guide for Non-Investigations 
Sample Investigation Inquiry Task at Grade 4 
Sample Non-Investigation Inquiry Task at Grade 8    
Sample Non-Investigation Inquiry Task at Grade 11 
Released Inquiry Performance Tasks   
NH NECAP Science Information
NH NECAP Science Assessment Information  (includes all assessment targets)
Number of Targets by Domain and Grade Span 

14. Content Framework for NECAP Science Assessment
Science Domains by Enduring Knowledge Statements
Assessment Targets
Grade 4
Grade 8
Grade 11
LS 1 - Survival of organisms
1-4
1-2
LS 2 - Matter & energy of ecosystems
5-6
5-7
3-5
LS 3 - Organisms change over time 7
8-9
6-9
LS 4 - Humans are similar and different
10-12
9-10
PS 1 - Properties and structure of matter
1-3
1-5
PS 2 - Energy
4-6
6-7
PS 3 - Forces and motion
7-8 8
8-10
ESS 1 - Earth and earth materials
1-6
ESS 2 - Solar System
6-8
ESS 3 - Universe and galaxies
5-8

15. New Hampshire NECAP Information
Eligible NECAP Targets for the Inquiry Task at each grade tested can be found in the Science Process Skills (SPS) GSE in the last row in SPS1 labeled: NECAP Science Assessment Targets for Inquiry (INQ) May be subject of performance component
Resources and Information about the Science Frameworks and NH Information about the NECAP Science Assessment can be found at
Programs and Services  S  Science in NH Schools
Science Reference Sheets can be found at the link below
Programs and Services  N  NECAP

16. Item Types Multiple Choice (MC) 1 Point Answer Key
Constructed Response (4-CR)
4 points
Rubric: 0-4 points
Inquiry Task
16-18 points assessed with a mix of 2- and 3-point SA

17. Grade 4 Science Pilot Test Design:
Session 1: 50 Minutes*
Session 2: 95 Minutes**
29 Multiple Choice
(1 pt each)
8 short-answer questions
Making Your Predictions
2 Constructed Response
(4 pts each)
Setting Up and Conducting
Your Investigation
*For Session 1, students are allowed an additional 45 minutes without an accommodation.
Organizing and Presenting
Your Data
Analyzing and Using Your Results
A New Investigation
**For Session 2, students should complete the Inquiry Task and all questions within 95 minutes.

18. Grade 8 Science Pilot Test Design:
Session 1: 50 Minutes*
Session 2: 95 Minutes**
29 Multiple Choice
(1 pt each)
8 short-answer questions
Making Your Predictions
2 Constructed Response
(4 pts each)
Setting Up and Conducting
the Investigation and Collecting Data
*For Session 1, students are allowed an additional 45 minutes without an accommodation.
Organizing and Presenting
Your Data
Analyzing and Using Your Results
**For Session 2, students should complete the Inquiry Task and all questions within 95 minutes.

19. Grade 11 Science Pilot Test Design:
Session 1: 50 Minutes*
Session 2: 80 Minutes**
29 Multiple Choice
(1 pt each)
8 short-answer questions
Prediction
2 Constructed Response
(4 pts each)
Analyzing and Using Data
Organizing and Presenting Data
*For Session 1, students are allowed an additional 45 minutes without an accommodation.
Using Evidence and Applying What You Learned
**For Session 2, students should complete the Inquiry Task and all questions within 80 minutes.

20. Inquiry Task Design: Pilot Test
Grade 4 & 8 INVESTIGATION
Introduction Prompt with Content Question
Make a predictions (gr. 4) or hypothesis (gr. 8) and explain.
Conduct Investigation with a partner ~ Collect and display data
Summarize results
Develop and evaluate explanations with content
Propose new question (gr. 4) that could be investigated
or investigation (gr. 8)

21. Inquiry Task Design: Pilot Test
Grade 11 NON–INVESTIGATION
Introduction prompt with content question
Review results from an investigation
Develop and evaluate explanations
Formulate questions and hypothesize
Plan/Critique Investigation
Construct or analyze alternative explanation
Link to Enduring Knowledge concept

22. The New England Common Assessment Program (NECAP)
Science Assessment Changes of Note:
For the pilot ONLY, session 1 will be 1 domain per student.
Every school will have all domains present.
Student Test Booklet and Student Answer Booklet are separate documents for Grades 4, 8, and 11.
Districts/schools may decide if students can use a calculator on the assessment (not recommended at grade 4.)
A science reference sheet will be provided for each student in grades 8 and 11. (There are different sheets at grade 8 and 11.) The reference sheets are available now on the NH Science web page.

23. Setting up the Inquiry Task
Questions

24. School Test Coordinator’s Responsibilities (page 2)
Primary responsibilities:
serve as the school’s contact person with Measured Progress
coordinate all test-related activities
prepare test administrators to administer NECAP according to directions in the Test Administrator Manual
oversee the inventory, distribution, collection, and return of ALL test materials
ensure test security and compliance with test administration procedures

25. Test Security (page 3)
Test Security relies on the professional integrity of everyone in our schools across all three states. No student should be advantaged or disadvantaged based on how or where the test is administered.
All test items and responses to those items in the NECAP are secure and may not be copied or duplicated in any way or kept by the school after testing is completed.
Using secure test material to prepare students in any way for this test administration is a violation of test security and testing procedure.

26. Breaches in Test Security (page 3)
Any concern about breaches in test security must be reported immediately to the test coordinator and/or principal.
The test coordinator/principal is then responsible for reporting breaches to the district superintendent and the state department of education.

27. Getting Ready Select each school’s Test Coordinator
Communicate test plan to staff
Ensure test security is in place
Schedule testing
Plan logistics around testing—especially for the Inquiry Task

28. Preparation for Test Administration
BEFORE TESTING (page 4)
Preparation for Test Administration
Manuals
Read the Principal/Test Coordinator and Test Administrator Manuals
Student Participation and Accommodations
The Accommodations and Procedures: Administrators Training Guide covers these topics:
Who should be tested
Determining how students will participate using accommodations
Documenting and bubbling in accommodation codes

29. Who should be tested for the pilot? (page 4)
As many students as possible, including:
Students with disabilities
English language learners
Students attending career and technical centers
EXCEPTIONS for the pilot test ONLY:
Students who would normally participate in alternate assessment
ELL students enrolled in U.S. schools less than one year
Students absent for entire testing window
Students experiencing extraordinary personal circumstances

30. Classroom Environment
Preparing for the Inquiry Task ~ Grades 4 and 8 Only
Check to ensure there are enough materials for the Inquiry Task.
Materials are packed by “type”, not by kit.
Ensure that students have enough room to place materials on the 11” x 17” Placemat.
Identify plan for setting up materials for the Inquiry Task.
Identify process for grouping students (see Appendix 6 of the Principal/Test Coordinator Manual).

31. Appendix 6: Guidelines for Grouping Students in Session 2 ~ Grades 4 & 8 only
Part 1 – Making your prediction
Students will make predictions and record them on their own Prediction Sheet.
Part 2 – Setting up and conducting your investigation and collecting data
Students will work in collaborative groups.
All students must record data on their Data Sheets for use in Parts 3 and 4 ( and Part 5 for grade 4).
Parts 3 and 4 (and Part 5 for grade 4) – Organizing and presenting your data, and analyzing and using your results
Students will work alone with data collected from Parts 1 and 2 and record all their answers in their own Student Answer Booklet.

32. Accommodations for the Pilot
Who is eligible for testing accommodations?
ALL students
Accommodations do not change what we expect students to know and be able to do.
Test accommodations are based on individual student needs and classroom assessment practice; they are not for the use of an entire classroom or category of students.
They should not give students unfair advantages; rather they are meant to remove barriers that may exist due to a student’s learning style or disability.

33. Appendix 5: Table of Standard Test Accommodations
(Page A-6)

34. Accommodations for the Pilot
Accommodations, Guidelines, and Procedures: Administrator Training Guide – Still available on state DOE website under NECAP, but not yet updated for Science. Everything listed there is still available.
For the Science Pilot, Use the Table of Standard Test Accommodations found in Appendix 5 of the Test Coordinator and the Test Administrator Manuals.
Only these manuals have the most recent updates.
School teams may use, without state approval, only standard accommodations listed in categories A, B, C, or D. Please note: Categories E and F work differently, as follows:

35. Accommodations for the Pilot
Use of Category E “Other” Accommodations -
Contact NHDoE, Gaye Fedorchak, in advance of testing
to discuss any other (non-listed) accommodations you want to
use during the pilot.
Accommodation(s) must be consistent with those used in student’s regular classroom instruction.
If the DOE finds the Category E-Other accommodation to be comparable to a standard accommodation, we will note this and consider for future updates to Accommodations Manual.
DOE is seeking & collecting teacher ideas for the Inquiry Task
During full test implementation (May 2008), student work done using category A, B, C, D, or state approved E accommodations will be fully credited & scored.

36. Accommodations for the Pilot
Use of Category F Modifications -
If the state determines that your request for a (non-listed) E-Other Accommodation will change what the test measures, then the state will respond in writing that use of this procedure will produce a test “modification” and must therefore be documented as an F-Modification.
After the pilot, during full test administration, use of an F-Modification will result in no credit given for student work during test sessions in which this F-Modification was used.
When full assessment starts, any E –Other Accommodation not registered as “approved” by your state DOE will be treated as an F- Modification.

37. Accommodations for Pilot
After Testing, Document all accommodations and modifications actually used on page 2 of the Student Answer Booklet. (If not used, don’t bubble.)
Accommodation Updates for the Science Pilot:
C-4 ……. Now includes Science
C-12 ….. Now includes Science
C-13 ….. Does not appear in Test Manuals but is still in effect
for NECAP and will return in future manuals.
An abacus is not likely to be needed for the Science
Pilot.
D-5 ……. Now includes Science
D-6 ……. Now includes Science
D-7 ……. Reserved for Future Standard Accommodation (after
pilot data is gathered)

38. Accommodations - Thinking long term
Support teachers through the accommodations decision-
making process.
Include all of a student’s classroom teachers, parents, and,
whenever possible, the student in the decision-making
process.
Consult with parents regarding use of accommodations
through phone or similar kinds of contacts. A face-to-face
meeting is not required.
Standardize the accommodation administration process and
plan the resources necessary for large-scale implementation.
Ensure that the students’ records include the decisions made
to inform both current and future educational planning.

39. Scheduling Test Sessions (page 5)
Session 1 of the NECAP Science pilot test in grades 4, 8, and 11 is designed to be completed in approximately 50 minutes.
Students are allowed an additional 45 minutes for Session 1 without an accommodation. Plan accommodations for those students who typically take more than 50% additional time for regular classroom assessment. Only those students with an extended time accommodation may be permitted more than 95 minutes to complete Session 1.
Session 2 of the NECAP Science pilot test in grades 4 & 8 is designed to be completed in approximately 95 minutes. Session 2 in grade 11 is designed to be completed in approximately 80 minutes.
The student questionnaire for grades 4, 8, and 11 is designed to be completed in 20 minutes.

40. Scheduling Test Sessions (page 5)
All testing, including accommodated sessions, must occur within the testing window.
Test sessions must be scheduled and given in the order presented in the Student Test Booklet.
All classrooms of students in a school should take the same test session simultaneously.

41. Student ID Labels (page 7)
Labels created for students based on beginning of school year enrollment files
2 identical labels printed for each student (one for Student Answer Booklet, one for Student Test Booklet)
Student labels are sorted by group field prior to printing (if requested)

42. Student ID Labels (page 7)
Students enrolled in your school WITH Student ID Labels
3 fields MUST be correct in order to use label: student name, state-assigned Student ID number, and school name
If any of the 3 fields are incorrect or missing, DO NOT USE the label.
Call your state DOE to report incorrect information.
Follow procedure for students without Student ID Labels.

43. Student ID Labels (page 7)
Student ID Labels for students NOT in your school
Labels are NOT transferable between schools.
Throw away any labels provided for students not enrolled in your school.
DO NOT forward these labels on to other schools.
DO NOT affix these labels to Student Answer Booklets.

44. Student ID Labels (page 7)
Students WITHOUT ID labels
Complete the student information on pages 1 and 2 of the Student Answer Booklet.

45. Preparing Student Test Booklets and Answer Booklets for Testing (page 7)
Booklets will be shrink-wrapped in packs of 15, 10, 5, and singles.
Count the booklets to verify that the quantity received matches the quantity sent. Call Measured Progress if your count does not match the quantity indicated on the Material Summary form sent by Measured Progress.
Do not re-sequence test booklets or answer documents.
Student Answer Booklets come inserted in the Student Test Booklet, paired by form.

46. Preparing Student Test and Answer Booklets for Testing (page 7)
DO NOT separate the Student Answer Booklets from the Student Test Booklets.
If the booklets do become separated, you will need to match the form number on the front cover of the Student Test Booklet with the bracketed portion of the number printed on the bottom right corner of the Student Answer Booklet.
The unique serial numbers on Student Test Booklets and Student Answer Booklets are not designed to match.

47. Preparing Student Test Booklets and Answer Booklets for Testing (page 7)
For students WITH Student ID labels
For students enrolled with a label, affix the label to the front cover of the Student Answer Booklet.
Affix second label on the front cover of the Student Test Booklet
For students WITHOUT Student ID labels
For students enrolled without a label, fill in all required information.
Write student name and school name on cover of the Student Test Booklet

50. New Hampshire

51. Prior to Test Administration (page 8)
Designating Test Administrators
Administer content area test sessions simultaneously within each grade level at the school and district.
Test students in surroundings that will provide them the opportunity to do their best work. (Grades 4 and 8 will need a level workspace for session 2).
Students who require accommodations must be supervised by trained test administrators (refer to Accommodations, Guidelines, and Procedures: Administrator Training Guide)

52. Preparing Test Administrators (page 8)
Assign each Test Administrator to a specific group of students.
Notify Test Administrators of the testing schedule.
Explain security procedures.
Plan for grouping students into pairs in grades 4 & 8 prior to Session 2.
Plan for inventorying, distributing, collecting, and storing materials.
Create a plan for applying Student ID Labels or code student identification info on covers of Student Test Booklets and Answer Booklets.
For students without a label, plan for completing student info on page 2 of Student Answer Booklet.

53. Preparing Test Administrators (cont.)
Discuss additional materials needed:
calculators,
scratch paper and/or Post-Its,
Science reference sheets
Explain guidelines for classroom environment.
Encourage completion of Test Administrator Questionnaire.
Answer questions regarding test administration and security.

54. Test Materials (pages 10-14)
Inventory Test Materials
Packing Order of NECAP Science Materials
Quantities of Student Test Booklets and Answer Booklets
Quantities of Other Materials
Ordering Additional Materials
Storing and Access to Test Materials
Equipment and Materials Permitted During Test Administration
Equipment and Materials Prohibited During Test Administration
Ancillary Test Materials

55. DURING TESTING (page 14) Test Administration
Distributing Test Materials
Make sure materials are kept in a locked storage area prior to testing and between sessions.
Include an additional set of test materials for the test administrator to use while giving directions.
Monitoring Test Administration
Test administrators may not comment on students’ work. Test administrators may not help students in any way except during the General Instructions, Student Questionnaire, or as specified in the Test Administrator Manual.

56. Preparation of Test Materials for Return
AFTER TESTING (page 15)
Preparation of Test Materials for Return
Collecting Materials After Testing
List on page 15 of Principal/Test Coordinator Manual
Special Materials
Make sure that all non-standard, student-generated work (computer-generated, large-print, and Braille responses) have been transcribed into a regular Student Answer Booklet.
Examples of materials for the Special Handling envelope: torn booklets, responses written with anything other than a #2 pencil, damaged test booklets

57. Verifying Completion of Student Information on Student Answer Booklets (page 16)
Ensure that a label is affixed properly for all students with a Student ID Label.
Ensure that all applicable student information has been competed for students without a Student ID Label.
Ensure that accommodation information has been coded on page 2 of the Student Answer Booklet for students who used an accommodation(s).

60. Completing Principal’s Certification of Proper Test Administration (page 16)
Complete 1 form online for each grade tested.
Must be done prior to return of materials
Numbers you need:
total # of booklets sent to your school
# of used booklets being returned
total # of booklets being returned
Detailed instructions will be shipped with test materials.
Print, sign, and return a copy of the form with test materials.

61. Return of Materials (page 17)
Packaging test materials for return to Measured Progress
UPS One-Day Pickup on May 25th at 8:00 a.m.
Use original shipping cartons.
Pack materials for one grade only per carton.
Follow packing instructions on the bottom on page 17 of your Principal/Test Coordinator Manual.

62. DO NOT return the following (page 18):
Manipulatives from the Inquiry Task Kits
Inquiry Task Placemats
Materials Summary Form & Packing Slips *Secured Material*
Science reference sheets
Principal/Test Coordinator Manual and Test Administrator Manuals
Principal/Test Coordinator Questionnaire (Return completed answer sheets only.)
Test Administrator Questionnaire (Return completed answer sheets only.)
Student Questionnaires (Students answered the questions in their Student Answer Booklets.)

63. NH Science NECAP Resources
NECAP Page on NH Dept. of Ed Website.
Programs and Services N  NECAP2007 Science pilot
Student Support and Testing Materials
Science Reference Sheets
Policy Material
Accommodations, Guidelines, and Procedures: Administrator Training Guide
Calculator Policy
2007 NECAP Science Principal/Test Coordinator & Test Administrator Manuals
Reference Materials
2007 Test Administration Workshop Presentation

64. Questions and Answers