1. 2010 SAS Institute Bridging Research and Practice Implementation of the Keystone Exams

2. Objectives Participants will examine and discuss the Keystone Exam’s design and implementation. Participants will examine and discuss the Keystone Exam’s design and implementation. Participants will view curriculum maps designed to complement the Keystone Exams. Participants will view curriculum maps designed to complement the Keystone Exams. Participants will review information from Dr. Maraschiello’s General Session presentation on the Keystone Exams. Participants will review information from Dr. Maraschiello’s General Session presentation on the Keystone Exams.

3. Activity In groups of 4-5 discuss how to craft a presentation for your colleagues based on what you have learned thus far at the Institute. In groups of 4-5 discuss how to craft a presentation for your colleagues based on what you have learned thus far at the Institute. Articulate the model on poster paper. Articulate the model on poster paper. Share out to large group. Share out to large group.

4. Keystone Resources Course curriculum maps are being developed to aid districts in the development of curriculum. Course curriculum maps are being developed to aid districts in the development of curriculum. Developed by educators. Developed by educators. Algebra I, Biology, and Literature maps are in the final stages of development. Algebra I, Biology, and Literature maps are in the final stages of development.

5. Curriculum Course Maps Each map has the same organizational structure Each map has the same organizational structure Alignment Alignment Materials and Resources Materials and Resources Competencies Competencies Tier 3 Vocabulary Tier 3 Vocabulary

9. Keystone Exam Design Modules Modules Skill and content based Skill and content based Type of questions Type of questions Students must also meet local district credit and attendance requirements and complete a culminating project, along with any additional district requirements. Students must also meet local district credit and attendance requirements and complete a culminating project, along with any additional district requirements.

10. Keystone Assessment Jeopardy

11. Are you ready to play?

12. State Assess- ments Keystone Design HowFAQ 100 200 400 300 600 400 800 500 1000 600 1200

13. State Assessment for 100 QUESTION: What grade levels will continue to take the PSSAs?

14. State Assessment for 100 ANSWER: 3 rd -8 th and 11 th

15. State Assessment for 200 QUESTION: Will the accommodations in place for students with IEPs or 504 plans for the PSSA assessment apply to the Keystone Exams as well?

16. State Assessment for 200 ANSWER: ANSWER:Yes

17. State Assessment for 300 QUESTION: What forms the basis of the Keystone and PSSA exams?

18. State Assessment for 300 ANSWER: Eligible Content

19. State Assessment for 400 QUESTION: What are two of the four specific accommodations for students with an IEP or a 504 Plan?

20. State Assessment for 400 ANSWER: -Presentation Accommodation -Response Accommodation -Setting Accommodation -Timing/Scheduling Accommodation http://www.portal.state.pa.us/portal/se rver.pt/community/testing_accomo dations___security/7448

21. State Assessment for 500 QUESTION: What are two of the four types of accommodations available to ALL students taking a state assessment?

22. State Assessment for 500 ANSWER:Time Scheduled extended time Place Classroom adaptations Grouping Small group testing Other Other accommodations, not listed here http://www.portal.state.pa.us/portal/serv er.pt/community/testing_accomodati ons___security/7448 http://www.portal.state.pa.us/portal/serv er.pt/community/testing_accomodati ons___security/7448

23. State Assessment for 600 QUESTION: What is PVAAS?

24. State Assessment for 600 ANSWER: Pennsylvania Value-Added Assessment System (PVAAS). PVAAS is a statistical analysis of PSSA assessment data, and provides districts and their schools with progress data to add to achievement data. http://www.portal.state.pa.us/portal/server.pt/community/bureau_of_assessment___accoun tability/7332 http://www.portal.state.pa.us/portal/server.pt/community/bureau_of_assessment___accoun tability/7332

25. Keystone Design for 100 QUESTION: What three Keystone Exams will be available to all districts in 2011?

26. Keystone Design for 100 Literature Algebra I Biology PDE. Keystone Exams Program Overview. Keystone Exams Schedule. Page 3

27. Keystone Design for 200 QUESTION: The Keystone Exams are aligned to what standards?

28. Keystone Design for 200 ANSWER: The Pennsylvania Keystone Course Standards, Assessment Anchors/Eligible Content and the Curriculum Frameworks, each of which were developed by Pennsylvania educators. (PDE. Keystone Exams Program Overview. “Keystone Assessment Anchors/Eligible Content.” Pg. 3)

29. Keystone Design for 300 QUESTION: The Algebra I Keystone Exam will have two different types of constructed response items. Both types of constructed response items will be scored on a scale ranging from 0-4 points. What are these types of constructed response items?

30. Keystone Design for 300 ANSWER: Scaffolding Completion Items are constructed response items that elicit two-to-four distinct responses from a student. Scaffolding Completion Items are constructed response items that elicit two-to-four distinct responses from a student. Extended Scaffolding Completion Items are constructed response items that require students to respond with extraneous work or explanation for at least part of the item. Extended Scaffolding Completion Items are constructed response items that require students to respond with extraneous work or explanation for at least part of the item. (PDE. Keystone Exams Program Overview. “Algebra I.” Pg. 5) (That really was too easy for 300 points!)

31. Keystone Design for 400 QUESTION: What is the point scale for the constructed response items on the Biology Keystone Exam? 0-30-40-50-10

32. Keystone Design for 400 ANSWER:0-3 (PDE. Keystone Exams Program Overview. “Biology.” Pg. 7)

33. Keystone Design for 500 QUESTION: What types of questions will be on the Keystone Exam?

34. Keystone Design for 500 ANSWER: Multiple Choice (approximately 65% of total score) Constructed Response (approximately 35% of total score) (PDE. “Pennsylvania Keystone Exams.” Frequently Asked Questions.)

35. Keystone Design for 600 QUESTION: What is the time limit that should be allotted for each Keystone Exam?

36. Keystone Design for 600 ANSWER: There is no time limit for taking the Keystones; however, each Keystone Exam will take approximately 2.5 hours to complete. (PDE. “Pennsylvania Keystone Exams.” Frequently Asked Questions.)

37. Keystone Implementation for 100 QUESTION: For the graduating classes of 2015 and 2016, students must demonstrate successful completion of secondary level course work in what disciplines?

38. Keystone Implementation for 100 ANSWER: Algebra I BiologyLiterature English Composition (PDE. Keystone Exams Program Overview. “Demonstration of Proficiency... As Determined by:” Pg. 2)

39. Keystone Implementation for 200 QUESTION: Can students retake a Keystone Exam?

40. Keystone Implementation for 200 ANSWER: Yes. Students who do not score proficient or above may retake the exam (or exam module) at the next available testing date. (PDE. “Stronger high School Graduation Requirements: Fact Sheet and Frequently Asked Questions.” Pg3)

41. Keystone Implementation for 300 QUESTION: Can a student who scores proficient or advanced retake a Keystone Exam?

42. Keystone Implementation for 300 ANSWER: Yes. The regulation does not preclude proficient or advanced students from re- taking a Keystone Exam. (PDE. “Stronger high School Graduation Requirements: Fact Sheet and Frequently Asked Questions.” Pg3)

43. Keystone Implementation for 400 QUESTION: Can students “test-out” of a course by passing a Keystone Exam?

44. Keystone Implementation for 400 ANSWER: Yes, at the district’s discretion and provided that the student scores “Advanced” on the related Keystone. (PDE. “Stronger high School Graduation Requirements: Fact Sheet and Frequently Asked Questions.” Pg3)

45. Keystone Implementation for 500 QUESTION: Will Keystone Exam scores for students in middle school count toward high school graduation requirements?

46. Keystone Implementation for 500 ANSWER: Yes. The student must also meet the district’s graduation requirements (attendance, course requirements, etc.) (PDE. “Stronger high School Graduation Requirements: Fact Sheet and Frequently Asked Questions.” Pg3)

47. Keystone Implementation for 600 QUESTION: When will the Keystone Exam scores for students in middle school count toward AYP?

48. Keystone Implementation for 600 ANSWER: ANSWER: A student in middle school who takes a Keystone Exam may have his/her scores “banked” for AYP attribution at a later date. (PDE. “FAQ” p.9)

49. FAQ for 200 QUESTION: How will students qualify to complete a project-based assessment?

50. FAQ for 200 Any student who does not score proficient on a Keystone Exam after two attempts will be eligible to complete a project-based assessment, provided the student has taken the course and met local attendance and supplemental instruction requirements. (PDE. “Stronger high School Graduation Requirements: Fact Sheet and Frequently Asked Questions.” Pg5)

51. FAQ for 400 QUESTION: Can a student who scores proficient or advanced complete a project-based assessment to raise their score?

52. FAQ for 400 No. The project-based assessment is designed expressly to help students supplement a Keystone Exam score in order to meet the graduation requirement of proficiency. A project-based assessment can raise a student’s Keystone score to the proficient cut score, but not beyond it. (PDE. “Stronger high School Graduation Requirements: Fact Sheet and Frequently Asked Questions.” Pg5)

53. FAQ for 600 QUESTION: If a project-based assessment raises a student’s Keystone score, will that proficient score count toward AYP?

54. FAQ for 600 No. The score from a student’s highest Keystone exam will be used for the purpose of determining AYP.

55. FAQ for 800 QUESTION: Are the Keystone Exams aligned with the National Common Core Standards ?

56. FAQ for 800 ANSWER: There is a strong alignment between the Common Core Standards and the PA Academic Standards; refer to the Keystone Assessment Anchors and Eligible Content to see what specifically will be assessed. (Dr. Richard Maraschiello and Dr. Jean Dyszel)

57. FAQ for 1000 QUESTION: What are the four Performance Levels for the Keystone Exams? What are the four Performance Levels for the Keystone Exams?

58. FAQ for 1000 ANSWER: Below Basic Below Basic Basic Basic Proficient Proficient Advanced Advanced (Draft Proficiency Level Descriptors. 2010)

59. FAQ 1200 QUESTION: What is the basis for the questions on the SAS Classroom Diagnostic Tools?

60. FAQ 1200 ANSWER: The Classroom Diagnostic Tools are based on content covered by the Keystone Exams and the Pennsylvania System of School Assessments and includes an interactive and dynamic reporting suite.

61. BONUS ROUND! QUESTION: Are Keystone Exams the only component necessary to complete graduation requirements?

62. BONUS ROUND ANSWER: The Keystone Exams are one component of Pennsylvania’s new system of high school graduation requirements. To receive a diploma, students must also meet local district credit and attendance requirements, complete a culminating project, and pass any additional district requirements.