1. PVAAS Update March, 2014 IU 5 Curriculum Directors

2. SY12-13 Scatterplots O Due to the recent update of Keystone achievement and growth results, the SY12-13 statewide scatterplots have also been updated. O New document containing statewide scatterplots can be found on PVAAS PDE website. O Included slides in the PPT so you can review. O For Keystone content areas, achievement AND growth are based only on students enrolled in the Keystone-related course at the time of taking the respective Keystone exam.

3. SY12-13 Math, Grade 4

4. SY12-13 Math, Grade 5

5. SY12-13 Math, Grade 6

6. SY12-13 Math, Grade 7

7. SY12-13 Math, Grade 8

8. SY12-13 Algebra I

9. SY12-13 Reading, Grade 4

10. SY12-13 Reading, Grade 5

11. SY12-13 Reading, Grade 6

12. SY12-13 Reading, Grade 7

13. SY12-13 Reading, Grade 8

14. SY12-13 Literature

15. SY12-13 Science, Grade 4

16. SY12-13 Science, Grade 8

17. SY12-13 Biology

18. Experience with PVAAS as a Tool for Decision-Making AdminsTeachers Expert 6%1% Skilled 48%9% Novice 38%44% Amateur 8%47%

19. Conversations between Admins & Teachers about Reporting 88% Admins said they talked to Teachers O One-on-one O Collaborative O Open and honest O Discovery followed by discussion O Encouraging and reflective O Supportive and inquiry- oriented O “We’re in this together” 55% Teachers said they talked to their Admin(s) O One-on-one O Direct and encouraging O Positive and supportive O Open and honest O Informal discussion O Open to suggestions and concerns O Goal-oriented O Friendly and informative O “How did the results make me feel”

20. Admins: Were you able to answer Teachers’ questions? Teachers: Was your Admin able to answer your questions?

21. Questions Not Answered O How does PVAAS measure growth for Science in grade 4? O Why is PVAAS used in teacher evaluations when it was stated in early 2000s that it would not be? O What are the methodologies used to measure growth? O How can you show growth with students who have perfect scores? How do you show growth for students receiving instruction above grade level? O How is the predicted score calculated? O Why are some students included in the analyses and others are not? O Why is attendance not used or considered? O Specific scenarios related to calculating % Student+Teacher Enrollment and Full/Partial % of Instruction

22. Creating a Culture of Trust and Support about PVAAS & Other Data Admins O Being available for questions O Open dialogue about growth; two-way conversation O Share best practices O Promote and model this is a team effort O Non-threatening discussion, not accusatory or judgmental O Involve teachers in process from the beginning O Collaborative, team approach O Focus on goal of improved student learning and not identification of poor instruction O Provide time for teachers to work together Teachers O Open conversation amongst teachers to share and improve teaching practices O Open forum for questions O Team planning & collaboration O Open communication between admins and teachers O Sharing of resources and materials O Creating atmosphere where teachers are not compared to each other O Clear expectations from Admins O Time to work with other Teachers

23. PVAAS Methodologies

24. O Sent to all IU PVAAS Contacts February 24 O Available on PVAAS Login Page O Purpose:

25. Guide to SY12-13 PILOT Teacher Specific Reporting

26. O Sent to all IU PVAAS Contacts February 24 O Available on PVAAS Login Page

27. Roster Verification: Sample Scenarios O Purpose: To assist LEAs in understanding the total % of Instructional Responsibility for students, considering both % Student + Teacher Enrollment and Full or Partial % of Instruction O Currently in development! O To be released in April 2014

28. New PVAAS Login Page

29. New PVAAS Admin Page

30. Updated Excel Files O Updated Excel files containing existing accounts sent on March 20 to all LEAs O April 4 th, COB, is the LAST day for information in PIMS to be used for PVAAS account creation O After April 4, COB: PVAAS accounts must be created and managed locally/manually via PVAAS system

31. Who Participates? O Which teachers are eligible for PVAAS Teacher Specific Reporting? O Act 82 does NOT exclude temporary or permanent professional employees based on how they are funded, such as Title I O Act 82 does NOT exclude temporary or permanent professional employees based on which LEA/school students are from or where students are tested O PVAAS teacher specific reporting is about WHICH teachers had the instructional responsibility for a tested subject/grade/course

32. COGNOS Report for PVAAS O New COGNOS Reports for PVAAS in PIMS O Can help an LEA see what data will be pre- populated in PVAAS O PIMS Administrators in each LEA can and SHOULD consider running these reports today, as PIMS Course/HQT closed March 21 O Suggest that the PIMS Administrator share and discuss these reports with District and School Admins

33. COGNOS Report for PVAAS

34. Roster Verification Timeline

35. IU Support O Suggest principals run a usage report at end of week one – include step-by-step directions O Reminder to principals that they can start reviewing rosters that have been submitted early O But overclaiming and underclaiming of students may occur until ALL teachers have submitted their rosters! O Suggest types of data will teachers need to verify O Student enrollment dates by roster O Co-teaching, flexible grouping, etc.

36. Contact SAS EVAAS with HOW TO questions (Click on “Contact Us” link on PVAAS login page) O Accessing & Using Roster Verification system O Username & Password issues O PPID errors & omissions O Adding/removing teachers O Adding/removing rosters O Adding/removing students O Verifying & submitting rosters O Sending rosters back to a teacher or School Admin District Admin/District Verifiers ONLY Contact the PVAAS Statewide Team with Policy and Guidance questions (Email pdepvaas@iu13.org) O Which PA teachers? O Claiming issues O % Student + Teacher Enrollment O % Full/Partial Instruction O % Instructional Responsibility O PVAAS Teacher-Specific Reporting SY13-14 PVAAS Roster Verification

37. Creating a Usage Report

38. Live Help Desk (Q&A) Sessions

39. Instructional Responsibility (IR) for Students O While a student who is claimed for less than 10% overall IR will NOT be included in a teacher’s value-added analyses, teachers DO need to roster those students and accurately report the % IR for that student. O PVAAS Team did NOT and would NOT advise anyone to move the % of IR for a student to less than 10% so that a teacher does not receive reporting!! O ALL STUDENTS should be rostered!!!

40. Roster Verification Checklist O Checklist for each Roster Verification window O Have you…? O Full checklist for all RV windows can be found O On the PVAAS login page O In the Roster Verification Virtual Learning Module O The smaller checklist pertaining to a specific Roster Verification window will be attached to the reminder emails sent to users prior to each RV window opening.

41. Roster Verification Checklist

42. O Lori_patton@iu5.org Lori_patton@iu5.org