1. Getting Ready for the Pennsylvania State Assessments, 2017-2018
October 2017
11/28/2018

2. Introduction 2 Contacts
Ray Young, Chief, Division of Instructional Quality;
ACCESS;
Lisa Hampe, Special Education Advisor;
Drew Schuckman, NAEP;
Diane Simaska, PSSA ELA/Keystone Literature/Accommodations;
Rebekah Baum-Leaman, PSSA ELA/Keystone Literature/EL Accommodations/PBA Assessment;
Charlie Wayne, PSSA Math/Keystone Algebra I;
Craig Weller, PSSA Science/Keystone Biology;
11/28/2018

3. Overview of Statewide Assessments Resources and Tools PSSA
Agenda
General Information
Overview of Statewide Assessments
Resources and Tools
PSSA
Keystone Exams
11/28/2018

4. General Information 4 Updates PA Accountability System; ra-pas@pa.gov
School Performance Profile (PDE website)or PA School Performance Profile (website);
Pennsylvania Value Added Assessment System (PVAAS);
Educator Effectiveness System;
Test Security – or
11/28/2018

5. Statewide Assessments 5
Assessing Communication and Comprehension in English State-to-State for English Language Learners (ACCESS for ELLs);
Project Based Assessment (PBA);
National Assessment of Educational Progress (NAEP); – For questions use
Pennsylvania Alternate System of Assessment (PASA);
11/28/2018

6. PSSA Testing Window 6 Assessment Dates Grades English Language Arts
April 9 – 13, 2018
3 – 8
Mathematics
April 16 – 20, 2018
Science
April 23 – 27, 2018
4, 8
Make-up
April 30 – May 4, 2018
11/28/2018

7. Keystone Exams Testing Window
Assessment
Dates
Winter: Wave 1
December 4 – 15, 2017
Winter: Wave 2
January 8 – 22, 2017
Spring
May 14 – 25, 2018
Summer
July 30 – August 3, 2018
11/28/2018

8. 2018 Keystone Exams & PSSA Accommodations 8
English Learner Accommodations
ELs in their first 12 months of enrollment in U.S. schools are not required to take the Reading/ELA/Literature state assessments
ELs who meet the eligibility criteria to take the PASA follow the same requirements
Accommodations:
Word-to word translation dictionaries, without definitions and without pictures for Mathematics PSSA, Keystone Algebra I and the Science PSSA or Keystone Biology only; not for any part of the ELA PSSA or Keystone Literature Exam
Qualified interpreters/sight translators for Mathematics PSSA or Keystone Algebra I and Science PSSA or Keystone Biology only; not for any part of the ELA PSSA test (except for the TDA prompts) or Keystone Literature Exam
Spanish/English Mathematics and Science PSSA and Keystone Algebra I and Biology Exams
For more information on EL participation in state assessments, please see Accommodations Guidelines for ELs
All ELs, K-12, are required to take the WIDA ACCESS for ELs English Proficiency Test
Visit the WIDA ACCESS for ELLs Summative Assessment webpage for information on testing and testing accommodations for the ACCESS for ELLs®

9. PA Alternate System of Assessment
Who Participates in the PASA?
Students with the most significant cognitive disability who meets the six eligibility criteria
Eligibility is determined by the IEP Team based upon the six eligibility criteria
A student who is in the assessed grades of 3-8 and 11 for English Language Arts/Math
A student who is in the assessed grades of 4, 8 and 11 for Science
11/28/2018

10. PA Alternate System of Assessment (PASA)
Important Dates for   PASA Testing Cycle
Assessment Activity
Date
Enrollment
October 2-November 17
Test Administrator Training
January 2- February 16
Test Administration Window (all content areas within window)
February 19-April 13*
Test Materials Returned to PASA
Due to PASA by April 27, 2018
Score Reports Mailed
August 17, 2018
* No student responses may be entered or student videos uploaded after this date
11/28/2018

11. PA Alternate System of Assessment
NEW
PASA
A new website that includes PASA information for ALL content areas.
All assessments will be delivered digitally through the website. Student test kits will be mailed.
Schools are strongly encouraged to upload all recorded assessments digitally.
Webcams are available through the vendor.
11/28/2018

12. PA Alternate System of Assessment 12
NEW
PASA
Writing will be assessed on the ELA test this year, but the score will not count.
Online training is required for all assessment coordinators and assessors this year.
A Handbook for Assessment Coordinators has been developed.
11/28/2018

13. PA Alternate System of Assessment 13
PASA Training
Training specific to enrollment, test administration and security is required and available online at
A video conference sponsored by the BSE and PaTTAN is scheduled for November 20th at each PaTTAN location and will include information pertaining to the PASA, ESSA regulations, the 1% cap and waiver process, and instructional resources.
This is intended for Directors of Special Education, Special Education Supervisors, PASA Test Coordinators.
11/28/2018

14. PA Alternate System of Assessment 14
Contact Information
Questions regarding regulations, policies, procedures, etc. should be directed to the Bureau of Special Education or PaTTAN.
Lynda Lupp, Statewide Assessment Coordinator,
Lisa Hampe, Special Education Adviser,
Questions regarding procedures for enrollment, digital platform, etc. should be directed to the test vendor.
Phone: (412)
General Inquiries and Questions:
Technical assistance during the testing window:
11/28/2018

15. Resources and Tools 15 eDirect PSSA Testing Calendars
Keystone Exams Testing Calendars
Performance Level Descriptors and Cut Scores (All Grades/Subjects)
Technical Reports (PSSA/Keystone)
Accommodations
Pennsylvania Standards Aligned System (SAS)
Classroom Diagnostic Tools (CDT)
11/28/2018

16. PSSA Math 16 Pennsylvania System of School Assessment (PSSA)
Mathematics Test Design
Mathematics Item and Scoring Samplers
Scoring Guidelines
Calculator Policy
Assessment Anchors and Glossary
11/28/2018

17. 5 Reporting Categories per Grade
PSSA Math
5 Reporting Categories per Grade
11/28/2018

18. Test Design Mathematics – 2016-2017 3-8 3 60 12 1 204 72 10-12 Grades
# Sections
# MC - Core
# MC – Non-core
# OE – Core
# OE – Non-core
Time in Minutes
Total Points per Student (Core only)
Minimum # of Points per Reporting Category
3-8 3 60 12 1
204 72
10-12
11/28/2018

19. Mathematics – 2017 and beyond
Test Design
Mathematics – 2017 and beyond
Grades
# Sections
# MC - Core
# MC – Non-core
# OE – Core
# OE – Non-core
Time in Minutes
Total Points per Student (Core only)
Minimum # of Points per Reporting Category
3-8 2 40 8 3 1
156 52
7-9
11/28/2018

20. Advantages: Impact of New Design Eliminates one of three test sessions
Shortens testing time by 48 minutes
Preserves content blueprint percentages
Maintains the number of points coming from open-ended questions
Ensures the level of rigor is not decreased
Maintains sufficient points in each reporting category to continue strength profile reporting
Preserves Math reporting
Measures same construct; no impact on the Performance Level Descriptors
11/28/2018

21. PSSA Math: Test Item Specifics
Embedded Field Test based on PA Core Standards (PCS)
Open-ended items scored on a 0-4 point scale
Item specific scoring guidelines (no general rubric)
Formula sheets will be provided for grades 4-8 (See Resource Materials on PDE’s web site for the formula sheets and item samplers)
MC items are based on the AA-EC aligned to the PCS
The EC is considered Assessment Limits
All items may cross EC, Descriptors, Anchors and Reporting Categories
All items align to an Anchor
Use the Glossary! It defines how terms are used in PA (e.g. “number sentence”)
11/28/2018

22. Examples of Phrasing in OE items
Show or explain all your work
Show all your work. Explain why you did each step
Explain why [something is true or false]
Describe how [doing something affects something else; to find something, etc.]
Reminder: Have students read all items carefully, especially the open-ended items, and answer exactly what is being asked
11/28/2018

23. PSSA Math: Test Item Specifics 23
Example of an Open-Ended Item
Roy is running for class president. He polls 50 students. 60 percent of them say they will vote for him.
A. There are 350 students in Roy’s class. Based on his survey, how many students should he expect to vote for him? Show or explain all your work.
B. Roy will sell fruit drinks to raise money for his campaign. A fruit drink cost $0.10 and he sells it for $0.50. How many fruit drinks does Roy need to sell to earn $80? Show all your work. Explain why you did each step.
11/28/2018

24. PSSA Math: Test Item Specifics 24
Example Rubric (for sample item only):
Part A:
- ½ point for correct answer AND
- 1 point for complete and correct work OR
½ point for correct but incomplete work
Part B:
- 1 point for correct and compete work OR
½ point for correct but incomplete work AND
- 1 point for correct and complete explanation
½ point for correct but incomplete explanation
11/28/2018

25. PSSA Math: Test Item Specifics 25
Rubric Metric
Total Points (within) Score (on)
3-3 ½ 3
2-2 ½ 2
½-1 ½ 1
11/28/2018

26. PSSA Math: Test Item Specifics 26
Some notes about open-ended items:
Guess and Check is a valid method but at least two incorrect guesses must be shown to receive full credit.
Not all open-ended items require a “why.”
At least half the score points must come from one Anchor. The rest can come from anywhere else.
11/28/2018

27. PSSA Math: Test Item Specifics 27
Can have a “blemish” and still get a 4.
“e.g. missing $” may or may not be a blemish depending on the item and grade.
If an answer box is given the answer does not have to be in the answer box to receive full credit, but if there is an answer in the answer box it overrides any other answer given.
An incorrect answer carried through correctly will receive full credit for the correct part.
11/28/2018

28. PSSA Math: Test Item Specifics 28
Rulers and protractors will be provided where needed. Students must use the rulers and protractors provided for the PSSA.
Rulers will be used in grade 3 only and will be scaled to the ⅛ inch and millimeter. Students will be required to measure to the ¼ inch and centimeter.
Protractors will be used only for the grade 4 PSSA.
11/28/2018

29. PSSA Math: Test Item Specifics 29
Grade 3
Cannot use calculators
Answers marked in test booklet
Grade 4 and up:
Calculators are permitted on all but the beginning few items
11/28/2018

30. PSSA ELA 30 Pennsylvania System of School Assessment (PSSA)
English Language Arts (ELA) Test Design
English Language Arts (ELA) Item and Scoring Samplers
Scoring Guidelines
Assessment Anchors and Glossary
11/28/2018

31. PSSA ELA
Pennsylvania System of School Assessment (PSSA)
11/28/2018

32. PSSA ELA
English Language Arts (ELA) Test Design
11/28/2018

33. English Language Arts (ELA) Item and Scoring Samplers
PSSA ELA
English Language Arts (ELA) Item and Scoring Samplers
11/28/2018

34. PSSA ELA
Scoring Guidelines
11/28/2018

35. Assessment Anchors and Eligible Content
PSSA ELA
Assessment Anchors and Eligible Content
Assessment Anchors and Glossary
Under Revision

36. PSSA ELA 36 Pennsylvania Core Standards for English Language Arts:
The new testing blueprint eliminates the mode-specific writing prompt; however, the writing standards are assessed in the language multiple-choice items and the Text Dependent Analysis prompt.
As stated in Chapter 4, LEAs are responsible to prepare students to attain the academic standards. The LEA’s curriculum shall be designed to provide students with planned instruction needed to attain these academic standards.
The Text Dependent Analysis essay continues to demand writing skills as an element of scoring.
The analytic essay requires strong writing skills—it does require the teaching and learning of effective writing.
11/28/2018

37. PSSA ELA 37 Resources: Item Samplers ELA Assessment Community
TDA Toolkit
Pennsylvania Learns in iTunes
Development of performance-based writing assessment resources to add to the SAS portal
11/28/2018

38. PSSA Science Pennsylvania System of School Assessment (PSSA)
Science Test Design
Science Item and Scoring Samplers
Scoring Guidelines
Assessment Anchors and Glossary
11/28/2018

39. Science Test Design - Grade 4
PSSA Science
Science Test Design - Grade 4
Section
Content Emphasis
Number of MC
(w/ Field Test)
Number of OE
Estimated Section Testing Time (in Minutes) 1
Science 23 3 38 2
Total 46 6 76
11/28/2018

40. Science Test Design - Grade 8
PSSA Science
Science Test Design - Grade 8
Section
Content Emphasis
Number of MC
(w/ Field Test)
Number of OE
Estimated Section Testing Time (in Minutes) 1
Science 24 3 45 2
Total 48 6 90
11/28/2018

41. Science PSSA – Test Plan/Form Reduction Design
PSSA Science
Science PSSA – Test Plan/Form Reduction Design
Grade
MC – Core
MC – Psychometric Use
MC – Field Test
OE – Core
OE – Field Test
Total Core Items
Total Core Points 4 38 2 6 5 1
38 MC / 5 OE 48 8
11/28/2018

42. Keystone Exams
Keystone Exams Test Designs: Algebra I, Biology, Literature Assessment Anchors/Eligible Content Item and Scoring Samplers Scoring Guidelines Pennsylvania Standards Aligned System (SAS)
11/28/2018

43. Getting Ready –
For more information on Getting Ready for the State Assessments please visit PDE’s Assessment and Accountability webpages.
The mission of the department is to academically prepare children and adults to succeed as productive citizens. The department seeks to ensure that the technical support, resources and opportunities are in place for all students, whether children or adults, to receive a high quality education.
11/28/2018