1. Questions & Answers about the Science Exams
OSPI Science Assessment
Information Update
Session 4.4

2. Presenters Dawn Cope—Secondary Science Assessment Specialist
Kara Monroe—Elementary Science Assessment Specialist
Science Assessment—WERA December 2013

3. Today’s Topics Next Generation Science Standards (NGSS) update
Spring 2013 results
MSP/EOC overview
Biology EOC
Assessment resources available
Test development
Upcoming events
Science Assessment—WERA December 2013

4. Quick poll Who is in the room with us today? Teachers Administrators
High school
Middle school
Elementary
Science Assessment—WERA December 2013

5. Washington adopted the NGSS…what happens to our state exams?
Science Assessment—WERA December 2013

6. We keep giving them…
If you hear “2014 is the last year of the MSP,” add “except for science.”
NCLB and state law require that we give a state science exam once each in elementary, middle, and high school
We will continue to give our state exam (based on 2009 standards) until an exam based on the NGSS is developed
Science Assessment—WERA December 2013

7. Next Generation Science Standards
February 20, 2012
Adopted:
June 2009
First assessed:
2011 (MSP)
2012 (EOC)
Adopted:
October 2013
Possible first
assessment:
2017 or 2018 (?)

8. What are the steps to building a new assessment?
Develop item specifications from the standards
Determine the test map
Develop test items (including a pilot test)
Develop Performance Level Descriptors (PLDs) from the standards
Administer an operational test
Set performance level standards (Standard Setting)
For the 2009 standards, this process took 25 months
Science Assessment—WERA December 2013

9. WA’s NGSS Involvement & Process Summer 2011 to Present
DEVELOPMENT
K-12 Framework for Science Education
NGSS Drafting Process
Confidential Drafts
Summer 2011
WA INVOLVEMENT:
- WA Selected as NGSS Lead State – Fall 2011
- Drafting Process – Fall 2011 – Spring 2012
- Statewide educator, stakeholder input
REVIEW/INPUT
Public Review
Revision Process
- Student input
- National input
- Comments on Final Drafts
ADOPTION
States have discretion to voluntarily adopt NGSS
Final April 2013
WA STATUS:
- Comparisons
- Bias and Sensitivity
- SBE Presentations
- Adoption
October 2013
BUILD AWARENESS & CAPACITY
State Collaboration and Sharing
Focus on understanding Science and Engineering Practices
Crosscutting Concepts
Appendices
Examine Equity Case Studies
Build PD modules
TRANSITION &
APPLICATION
- Intentional transition plans
- Best use and placement of instructional materials and resources
-Identify community resources
- Assessment system adjustments
We are here
Science Assessment—WERA December 2013

10. Still to be determined:
Will the science tests be developed by Washington or with a consortium of states?
When and how will pilot and/or field testing occur?
What year will be the first year of operational testing?
If the high school test is comprehensive, will it be administered at grade 10 or grade 11?
Will the elementary test cover just grade 5 standards or a broader grade band of standards?
Science Assessment—WERA December 2013

11. Engrossed House Bill 1450 From 2013 legislature
Legislature intends that we transition to a new high school science assessment as is being done with ELA and Mathematics
Science Assessment—WERA December 2013
11/30/2018

12. How do we prepare for state exams in 2014-2016?
Will my state test scores go down if I shift my instruction to the NGSS now?
Science Assessment—WERA December 2013

13. What are the key shifts in the NGSS?
Focus: The NGSS are focused on deeper understanding and application of science content reflecting real-world interconnectedness
Coherence: Science and engineering build coherently across K-12
Integration: Science and engineering are integrated across K-12
Science Assessment—WERA December 2013

14. What are the key shifts in the NGSS?
Focus: The NGSS are focused on deeper understanding and application of science content reflecting real-world interconnectedness
Coherence: Science and engineering build coherently across K-12
Integration: Science and engineering are integrated across K-12
Science Assessment—WERA December 2013

15. Embed the Science & Engineering Practices
~50% of points on MSP/Biology EOC are from Systems, Inquiry, and Application standards
Science Assessment—WERA December 2013

16. Grade 8 example Practice 2: Develop and use models
Crosscutting 2: Cause and effect
Crosscutting 3: Scale, proportion and quantity
More?
Core Idea 2: Life science
From 2014 Updates
Science Assessment—WERA December 2013

17. Grade 5 (et al) example Practice 6: Design solutions More?
Crosscutting 2: Cause and effect
Core Idea 1: Physical sciences
From 2012 Updates
Science Assessment—WERA December 2013

18. Biology EOC example Practice 6: Construct explanations More?
Crosscutting 2: Cause and effect
Core Idea 2: Life science
From 2013 Updates
Science Assessment—WERA December 2013

19. Biology (et al) example
Practice 3: Plan and carry out investigations
Crosscutting 2: Cause and effect
More?
Core Idea 2: Life science
From 2014 Updates (and many others)
Science Assessment—WERA December 2013

20. Where do we get more NGSS information?
Science Teaching & Learning:
Ellen Ebert, Ph.D.,
Amber Farthing,
WERA session 5.2 at 12:45pm today
Environmental and Sustainability Education:
Gilda Wheeler,
Science Support Staff:
Sultana Shah,
NGSS OSPI Website:
Report from Symposium on Science Assessment:
Science Assessment—WERA December 2013

21. What were the 2013 spring MSP and EOC results?
Science Assessment—WERA December 2013

22. Statewide Measurements of Student Progress Results
Science Assessment—WERA December 2013

23. Statewide Biology EOC Results
Science Assessment—WERA December 2013

24. State Report Card
Science Assessment—WERA December 2013

25. Test Overview—MSP Test Length Grade 5: Single session 75-90 minutes*
*additional time needed for passing out materials and reading directions
Test Window
April 23 to May 15 for paper/pencil tests
April 23 to May 30 for online tests
Online Testing
Voluntary in grades 5 and 8 in 2014
Science Assessment—WERA December 2013

26. Online Testing—MSP Tutorial Videos Online Tools Training (OTT)
Learn about the features of the test engine
Non-interactive
Installing test engine is not required to view
Online Tools Training (OTT)
Requires test engine installation on computer
Interactive
Practice using features of the test engine
Versions A and B—version B was new in 2013
OTT Lesson Plan
Available for grade 5
Uses version A of OTT
Flexible interaction for teachers and students
Guidance for leading students through login and directions
Suggestions for using specific features (tools) of the test engine with specific items
To be updated by January 13, 2014
Science Assessment—WERA December 2013

27. Online Testing—MSP
Science Assessment—WERA December 2013

28. Test Overview—EOC Test Window Winter—January 2 to February 7
Spring—May 5 to June 20
Locally determined schedule, during last 3 weeks of the course
Test Length
Three sessions: 50 minutes each OR
Single session: about 150 minutes*
*additional time needed for passing out materials and reading directions
Science Assessment—WERA December 2013

29. Test & Item Specifications
Scenario formats
Test map (item types and percentages)
Item specification statements matched to the standards
Vocabulary lists
Science Assessment—WERA December 2013

30. Test & Item Specifications
Science Assessment—WERA December 2013

31. What about the Biology EOC?
Science Assessment—WERA December 2013

32. Is the Biology EOC still a graduation requirement?
Yes. Remember the…
Legislative intent regarding high school science assessment (2013 Engrossed House Bill 1450, Section 4 )
Classes of 2015 and beyond must pass to graduate
Biology EOC—Until NGSS are adopted, implemented and assessed
Comprehensive NGSS Test—When NGSS are adopted, implemented and assessed
Science Assessment—WERA December 2013

33. Who and when? Winter (January/February) 2014 Spring 2015
Any student (2015+) who took the EOC previously and did not meet standard
Students completing a biology course mid-year
Spring 2015
Any student (class of 2015+) enrolled in a high school level biology course
All 10th graders who have not yet met standard
Meets the high school science testing requirement of NCLB
9th grade scores from 2012 were banked for NCLB reporting in 2013
9th grade scores from 2013 were banked for NCLB reporting in 2014
Science Assessment—WERA December 2013

34. Special Education and ELL alternatives:
Biology EOC available in 6 translation languages
Spanish, Russian, Korean, Chinese, Vietnamese, and Somali
IEP can designate Level 2 (Basic) to meet graduation requirement
Developmentally Appropriate Proficiency Exam(DAPE)
ES DAPE and MS DAPE available fall 2013, spring 2014
For more information:
John Bresko Special Education Program Supervisor
Lesley Siegel Alternate Assessment Coordinator
Science Assessment—WERA December 2013

35. CAA Options:
Begins with students in class of 2015 (current 11th graders)
GPA comparison—draft
A student’s grades in science courses are compared with the grades of students who took the same courses and passed the Biology EOC.
Available to students in their 12th-grade year who have an overall grade-point average of 3.2 or higher.
Students must attempt the Biology EOC at least once before attempting this CAA option.
Advanced Placement (AP) score of 3 or higher:
Biology, Physics, Chemistry, or Environmental Sciences
International Baccalaureate(IB) score of 4 or higher:
Biology, Physics, Chemistry
For more information:
Science Assessment—WERA December 2013

36. CAA Options: Collection of Evidence (COE) available fall 2013
Must take EOC twice
First submission June 2014
Independent work of students
6-8 tasks chosen from a bank of 16 Inclusion Tasks
Completed under the supervision of a teacher
Two tasks “On Demand”
Cut scores will be determined in August 2014.
Selected tasks must include items which assess each of the six reporting strands (System, Application, Inquiry, LS1, LS2, LS3) three-four times. Task Matrix:
Science Assessment—WERA December 2013

37. Biology COE Task Matrix
Science Assessment—WERA December 2013

38. Biology COE Resources ESD 113 http://www.coe.k12.wa.us/domain/49
Guidelines, policies, and sufficiency requirements
Generate staff and student groups and accounts, access and complete tasks, submit collections
Recorded webinars
Task Matrix
Brief description of the 16 tasks available
Biology COE Moodle
Forum
Task development information
Links to recorded webinars
Salmonberry Habitat Practice COE task (adapted from Bio EOC scenario- Updates 2013)
WERA session 5.5 at 12:45pm today
Kim Andersen COE Mathematics & Science Specialist OSPI
Science Assessment—WERA December 2013

39. What resources are available?
Science Assessment—WERA December 2013

40. OSPI Resources
Science Assessment—WERA December 2013

41. Science Assessment—Educator Resources

42. Updates for 2014
Science Assessment—WERA December 2013

43. Lessons Learned
Science Assessment—WERA December 2013

44. Short Answer Templates
Science Assessment—WERA December 2013

45. Released Item Documents (RID)
Science Assessment—WERA December 2013

46. Who develops and scores the science assessments?
Science Assessment—WERA December 2013

47. Science Assessment Development Cycle
Test and Item Specifications
Scenario & Item Writing Committee
Content Review & Bias/Sensitivity Committees
Scenario & Items reviewed for content by OSPI/contractor
Scenario & Item
Pilot Testing
Pilot
Range Finding
Committee
Items available for Operational Testing
Data Review
Committee
Pilot Scoring
Operational
Rangefinding
Operational Scoring 47

48. What about scoring? Who are the scorers?
Professionals; must have a college degree. Many are teachers.
Trained before scoring by Scoring Director (SD):
Scenario, item, and rubric
Anchor and Practice sets
Qualifying sets. Must be 90% correct to qualify to score that item.
During scoring:
Use the rubric and training sets to score live responses
Team Leaders and SD available
Statistics:
Inter-rater reliability
Validity papers
If a scorer is unable to improve after retraining, they are removed from project and ALL responses they scored are re-scored.
Science Assessment—WERA December 2013

49. Upcoming assessment events
Date
Event
Jan/Feb 2014
Biology EOC Exam Winter Administration
February 2014
Scenario and Item Writing Workshop
April 2014
Content Review
April/May 2014
MSP Administration
May/June 2014
Biology EOC Exam Spring Administration
July 2014
Pilot Rangefinding
Sept 2014
Data Review
Science Assessment—WERA December 2013

50. SALT and PEPPER Teams PEPPER SALT
PreSALTers Enthusiastically Promoting Powerful Educational Resources
Members include science educators throughout Washington interested in receiving Science Assessment updates.
Members receive invitations to participate in various events such as Scenario Writing Workshops, Content Reviews, Range Findings and Data Review.
SALT
Science Assessment Leadership Team
PEPPERS who complete an application to participate in a science assessment event become members of SALT.
Science Assessment—WERA December 2013

51. SALT Information: http://www.k12.wa.us/Science/ProfDevelopment.aspx
Science Assessment—WERA December 2013

52. More questions?
Science Assessment Contact Information
Dawn Cope, Secondary Science Assessment
Kara Monroe, Elementary Science Assessment
Jessica Cole, Administrative Assistant
Cinda Parton, Director of Assessment Development
Science Assessment Web Page
Science Assessment—WERA December 2013