Getting Ready for the Pennsylvania State Assessments, 2017-2018 October 2017 11/28/2018

Introduction 2 Contacts Ray Young, Chief, Division of Instructional Quality; rayyoung@pa.gov. ACCESS; ra-lep@pa.gov Lisa Hampe, Special Education Advisor; lihampe@pa.gov Drew Schuckman, NAEP; dschuckman@pa.gov Diane Simaska, PSSA ELA/Keystone Literature/Accommodations; dsimaska@pa.gov Rebekah Baum-Leaman, PSSA ELA/Keystone Literature/EL Accommodations/PBA Assessment; rbaumleama@pa.gov Charlie Wayne, PSSA Math/Keystone Algebra I; cwayne@pa.gov Craig Weller, PSSA Science/Keystone Biology; crweller@pa.gov 11/28/2018

Overview of Statewide Assessments Resources and Tools PSSA Agenda 3 General Information Overview of Statewide Assessments Resources and Tools PSSA Keystone Exams 11/28/2018

General Information 4 Updates PA Accountability System; ra-pas@pa.gov School Performance Profile (PDE website)or PA School Performance Profile (website); ra-paprofile@pa.gov Pennsylvania Value Added Assessment System (PVAAS); pdepvaas@iu13.org Educator Effectiveness System; ra-edeff@pa.gov Test Security – ra-ed-PSSA-Keystone@pa.gov or 844-418-1651 11/28/2018

Statewide Assessments 5 Assessing Communication and Comprehension in English State-to-State for English Language Learners (ACCESS for ELLs); ra-lep@pa.gov Project Based Assessment (PBA); rbaumleama@pa.gov National Assessment of Educational Progress (NAEP); dschuckman@pa.gov – For questions use ra-ednaepoffice@pa.gov Pennsylvania Alternate System of Assessment (PASA); llupp@pattankop.net 11/28/2018

PSSA Testing Window 6 Assessment Dates Grades English Language Arts April 9 – 13, 2018 3 – 8 Mathematics April 16 – 20, 2018 Science April 23 – 27, 2018 4, 8 Make-up April 30 – May 4, 2018 11/28/2018

Keystone Exams Testing Window Assessment Dates Winter: Wave 1 December 4 – 15, 2017 Winter: Wave 2 January 8 – 22, 2017 Spring May 14 – 25, 2018 Summer July 30 – August 3, 2018 11/28/2018

2018 Keystone Exams & PSSA Accommodations 8 English Learner Accommodations ELs in their first 12 months of enrollment in U.S. schools are not required to take the Reading/ELA/Literature state assessments ELs who meet the eligibility criteria to take the PASA follow the same requirements Accommodations: Word-to word translation dictionaries, without definitions and without pictures for Mathematics PSSA, Keystone Algebra I and the Science PSSA or Keystone Biology only; not for any part of the ELA PSSA or Keystone Literature Exam Qualified interpreters/sight translators for Mathematics PSSA or Keystone Algebra I and Science PSSA or Keystone Biology only; not for any part of the ELA PSSA test (except for the TDA prompts) or Keystone Literature Exam Spanish/English Mathematics and Science PSSA and Keystone Algebra I and Biology Exams For more information on EL participation in state assessments, please see 2018 Accommodations Guidelines for ELs All ELs, K-12, are required to take the WIDA ACCESS for ELs English Proficiency Test Visit the WIDA ACCESS for ELLs Summative Assessment webpage for information on testing and testing accommodations for the ACCESS for ELLs®

PA Alternate System of Assessment Who Participates in the PASA? Students with the most significant cognitive disability who meets the six eligibility criteria Eligibility is determined by the IEP Team based upon the six eligibility criteria A student who is in the assessed grades of 3-8 and 11 for English Language Arts/Math A student who is in the assessed grades of 4, 8 and 11 for Science 11/28/2018

PA Alternate System of Assessment (PASA) Important Dates for 2017-2018  PASA Testing Cycle Assessment Activity Date Enrollment October 2-November 17 Test Administrator Training January 2- February 16 Test Administration Window (all content areas within window) February 19-April 13* Test Materials Returned to PASA Due to PASA by April 27, 2018 Score Reports Mailed August 17, 2018 * No student responses may be entered or student videos uploaded after this date 11/28/2018

PA Alternate System of Assessment NEW PASA 2017-2018 A new website that includes PASA information for ALL content areas. www.pasaassessment.org All assessments will be delivered digitally through the website. Student test kits will be mailed. Schools are strongly encouraged to upload all recorded assessments digitally. Webcams are available through the vendor. 11/28/2018

PA Alternate System of Assessment 12 NEW PASA 2017-2018 Writing will be assessed on the ELA test this year, but the score will not count. Online training is required for all assessment coordinators and assessors this year. A Handbook for Assessment Coordinators has been developed. 11/28/2018

PA Alternate System of Assessment 13 PASA Training Training specific to enrollment, test administration and security is required and available online at www.pasaassessment.org. A video conference sponsored by the BSE and PaTTAN is scheduled for November 20th at each PaTTAN location and will include information pertaining to the PASA, ESSA regulations, the 1% cap and waiver process, and instructional resources. This is intended for Directors of Special Education, Special Education Supervisors, PASA Test Coordinators. 11/28/2018

PA Alternate System of Assessment 14 Contact Information Questions regarding regulations, policies, procedures, etc. should be directed to the Bureau of Special Education or PaTTAN. Lynda Lupp, Statewide Assessment Coordinator, llupp@pattan.net Lisa Hampe, Special Education Adviser, lihampe@pa.gov Questions regarding procedures for enrollment, digital platform, etc. should be directed to the test vendor. Phone: (412) 624-3034 General Inquiries and Questions: PASAtest@pitt.edu Technical assistance during the testing window: PASAdigi@pitt.edu 11/28/2018

Resources and Tools 15 eDirect PSSA Testing Calendars Keystone Exams Testing Calendars Performance Level Descriptors and Cut Scores (All Grades/Subjects) Technical Reports (PSSA/Keystone) Accommodations Pennsylvania Standards Aligned System (SAS) Classroom Diagnostic Tools (CDT) 11/28/2018

PSSA Math 16 Pennsylvania System of School Assessment (PSSA) Mathematics Test Design Mathematics Item and Scoring Samplers Scoring Guidelines Calculator Policy Assessment Anchors and Glossary 11/28/2018

5 Reporting Categories per Grade PSSA Math 17 5 Reporting Categories per Grade 11/28/2018

Test Design Mathematics – 2016-2017 3-8 3 60 12 1 204 72 10-12 Grades # Sections # MC - Core # MC – Non-core # OE – Core # OE – Non-core Time in Minutes Total Points per Student (Core only) Minimum # of Points per Reporting Category 3-8 3 60 12 1 204 72 10-12 11/28/2018

Mathematics – 2017 and beyond Test Design 19 Mathematics – 2017 and beyond Grades # Sections # MC - Core # MC – Non-core # OE – Core # OE – Non-core Time in Minutes Total Points per Student (Core only) Minimum # of Points per Reporting Category 3-8 2 40 8 3 1 156 52 7-9 11/28/2018

Advantages: Impact of New Design Eliminates one of three test sessions Shortens testing time by 48 minutes Preserves content blueprint percentages Maintains the number of points coming from open-ended questions Ensures the level of rigor is not decreased Maintains sufficient points in each reporting category to continue strength profile reporting Preserves Math reporting Measures same construct; no impact on the Performance Level Descriptors 11/28/2018

PSSA Math: Test Item Specifics Embedded Field Test based on PA Core Standards (PCS) Open-ended items scored on a 0-4 point scale Item specific scoring guidelines (no general rubric) Formula sheets will be provided for grades 4-8 (See Resource Materials on PDE’s web site for the formula sheets and item samplers) MC items are based on the AA-EC aligned to the PCS The EC is considered Assessment Limits All items may cross EC, Descriptors, Anchors and Reporting Categories All items align to an Anchor Use the Glossary! It defines how terms are used in PA (e.g. “number sentence”) 11/28/2018

Examples of Phrasing in OE items Show or explain all your work Show all your work. Explain why you did each step Explain why [something is true or false] Describe how [doing something affects something else; to find something, etc.] Reminder: Have students read all items carefully, especially the open-ended items, and answer exactly what is being asked 11/28/2018

PSSA Math: Test Item Specifics 23 Example of an Open-Ended Item Roy is running for class president. He polls 50 students. 60 percent of them say they will vote for him. A. There are 350 students in Roy’s class. Based on his survey, how many students should he expect to vote for him? Show or explain all your work. B. Roy will sell fruit drinks to raise money for his campaign. A fruit drink cost $0.10 and he sells it for $0.50. How many fruit drinks does Roy need to sell to earn $80? Show all your work. Explain why you did each step. 11/28/2018

PSSA Math: Test Item Specifics 24 Example Rubric (for sample item only): Part A: - ½ point for correct answer AND - 1 point for complete and correct work OR ½ point for correct but incomplete work Part B: - 1 point for correct and compete work OR ½ point for correct but incomplete work AND - 1 point for correct and complete explanation ½ point for correct but incomplete explanation 11/28/2018

PSSA Math: Test Item Specifics 25 Rubric Metric Total Points (within) Score (on) 4 4 3-3 ½ 3 2-2 ½ 2 ½-1 ½ 1 0 0 11/28/2018

PSSA Math: Test Item Specifics 26 Some notes about open-ended items: Guess and Check is a valid method but at least two incorrect guesses must be shown to receive full credit. Not all open-ended items require a “why.” At least half the score points must come from one Anchor. The rest can come from anywhere else. 11/28/2018

PSSA Math: Test Item Specifics 27 Can have a “blemish” and still get a 4. “e.g. missing $” may or may not be a blemish depending on the item and grade. If an answer box is given the answer does not have to be in the answer box to receive full credit, but if there is an answer in the answer box it overrides any other answer given. An incorrect answer carried through correctly will receive full credit for the correct part. 11/28/2018

PSSA Math: Test Item Specifics 28 Rulers and protractors will be provided where needed. Students must use the rulers and protractors provided for the PSSA. Rulers will be used in grade 3 only and will be scaled to the ⅛ inch and millimeter. Students will be required to measure to the ¼ inch and centimeter. Protractors will be used only for the grade 4 PSSA. 11/28/2018

PSSA Math: Test Item Specifics 29 Grade 3 Cannot use calculators Answers marked in test booklet Grade 4 and up: Calculators are permitted on all but the beginning few items 11/28/2018

PSSA ELA 30 Pennsylvania System of School Assessment (PSSA) English Language Arts (ELA) Test Design English Language Arts (ELA) Item and Scoring Samplers Scoring Guidelines Assessment Anchors and Glossary 11/28/2018

PSSA ELA Pennsylvania System of School Assessment (PSSA) 11/28/2018

PSSA ELA 32 English Language Arts (ELA) Test Design 11/28/2018

English Language Arts (ELA) Item and Scoring Samplers PSSA ELA 33 English Language Arts (ELA) Item and Scoring Samplers 11/28/2018

PSSA ELA 34 Scoring Guidelines 11/28/2018

Assessment Anchors and Eligible Content PSSA ELA Assessment Anchors and Eligible Content Assessment Anchors and Glossary Under Revision

PSSA ELA 36 Pennsylvania Core Standards for English Language Arts: The new testing blueprint eliminates the mode-specific writing prompt; however, the writing standards are assessed in the language multiple-choice items and the Text Dependent Analysis prompt. As stated in Chapter 4, LEAs are responsible to prepare students to attain the academic standards. The LEA’s curriculum shall be designed to provide students with planned instruction needed to attain these academic standards. The Text Dependent Analysis essay continues to demand writing skills as an element of scoring. The analytic essay requires strong writing skills—it does require the teaching and learning of effective writing. 11/28/2018

PSSA ELA 37 Resources: Item Samplers ELA Assessment Community TDA Toolkit Pennsylvania Learns in iTunes Development of performance-based writing assessment resources to add to the SAS portal 11/28/2018

PSSA Science Pennsylvania System of School Assessment (PSSA) Science Test Design Science Item and Scoring Samplers Scoring Guidelines Assessment Anchors and Glossary 11/28/2018

Science Test Design - Grade 4 PSSA Science 39 Science Test Design - Grade 4 Section Content Emphasis Number of MC (w/ Field Test) Number of OE Estimated Section Testing Time (in Minutes) 1 Science 23 3 38 2 Total 46 6 76 11/28/2018

Science Test Design - Grade 8 PSSA Science 40 Science Test Design - Grade 8 Section Content Emphasis Number of MC (w/ Field Test) Number of OE Estimated Section Testing Time (in Minutes) 1 Science 24 3 45 2 Total 48 6 90 11/28/2018

Science PSSA – Test Plan/Form Reduction Design PSSA Science 41 Science PSSA – Test Plan/Form Reduction Design Grade MC – Core MC – Psychometric Use MC – Field Test OE – Core OE – Field Test Total Core Items Total Core Points 4 38 2 6 5 1 38 MC / 5 OE 48 8 11/28/2018

Keystone Exams Keystone Exams Test Designs: Algebra I, Biology, Literature Assessment Anchors/Eligible Content Item and Scoring Samplers Scoring Guidelines Pennsylvania Standards Aligned System (SAS) 11/28/2018

Getting Ready – 2017-2018 For more information on Getting Ready for the 2017-18 State Assessments please visit PDE’s Assessment and Accountability webpages. The mission of the department is to academically prepare children and adults to succeed as productive citizens. The department seeks to ensure that the technical support, resources and opportunities are in place for all students, whether children or adults, to receive a high quality education. 11/28/2018