1. SY13-14 PVAAS Roster Verification Training February, 2014 3-Hour Sessions PVAAS Statewide Team for PDE

2. Welcome! Session Needs: Jen Kurtz, pdepvaas@iu13.orgpdepvaas@iu13.org PVAAS Statewide Team for PDE Session Facilitator: Kristen Lewald, Ed.D. PVAAS Statewide Project Director for PDE SY13-14 PVAAS Roster Verification Session Facilitator: Joan Perekupka PVAAS Statewide Team for PDE Session Facilitator: Jennifer Ross PVAAS Statewide Team for PDE Session Facilitator: Deanene Deaton Educator Support Specialist SAS EVAAS for K-12

3. Session Focus SY13-14 PVAAS Roster Verification

4. Session Materials Session PPT pushed out to you in PDF format As of Thursday Feb 6 th – you can access the PPT format and a link to the archived version of this webinar on the PVAAS login page: https://pvaas.sas.com https://pvaas.sas.com Additional materials are posted on PVAAS login page https://pvaas.sas.com https://pvaas.sas.com Quick Start Guide for Roster Verification SY13-14 LEA Guide for Implementation PVAAS FAQ (Anticipate update with new questions added in early March) PVAAS Teacher Implementation Timeline Teacher Value-Added Literature Resource SY13-14 PVAAS Roster Verification

5. Questions and Clarifications Enter questions into “Chat Box” We are monitoring questions Will pause throughout webinar at the end of each section to respond to questions Due to the quantity of questions, we would ask that you hold your question until the respective section of the webinar Any unanswered questions, please email pdepvaas@iu13.org pdepvaas@iu13.org SY13-14 PVAAS Roster Verification

6. Questions and Clarifications Option on chat box to deselect “Show Event Messages” This will allow you to better view the questions and answers posed in the Chat Box. SY13-14 PVAAS Roster Verification

7. Roster Verification Professional Development Opportunities There are three (3) options for professional development on what educators have to know and be able to do to verify and submit rosters in Spring 2014. 8 Webinars in February 9 Face-to-Face Sessions in March Virtual Learning Module accessible 24/7 via PVAAS website (Coming Soon!) SY13-14 PVAAS Roster Verification

8. Roster Verification Webinars Primarily designed for School and District Admins (or, school level and district level verifiers) May want to have lead teachers participate to assist them locally in rolling out the roster verification process to all staff Archived and accessible on the PVAAS login page as of Thursday, February 6 th https://pvaas.sas.com SY13-14 PVAAS Roster Verification

9. Suggestions… Start Early – Don’t Wait!! Start early in the window rather than waiting until the end of the window to begin (remember, deadlines are HARD deadlines!) Don’t wait – this is a new process! Access Support – Don’t Struggle!! Attend a training session (webinar, face-to-face, archived) View the Roster Verification Virtual Learning Module Quick Start Guide Help Menus PVAAS Website: “Contact Us” link SY13-14 PVAAS Roster Verification

10. Session Focus SY13-14 PVAAS Roster Verification

11. What is PVAAS Teacher-Specific Reporting? PVAAS teacher-specific reporting provides a measure of academic growth for a teacher’s group of students in a specific subject and grade, or for a specific Keystone-related course in the most recently completed school year. PVAAS provides a measure of academic growth for a teacher’s group of students by taking into account both the endpoint and the entering achievement of students. By concentrating on growth, PVAAS puts the emphasis on what educators can influence. SY13-14 PVAAS Roster Verification

12. PVAAS Teacher-Specific Reporting

13. Teacher’s Group of Students in Previous Year Teacher’s Group of Students in Current Year Measuring Academic Growth PVAAS does NOT compare the teacher’s group of students from the current year to the teacher’s group of students from the previous year. In other words, it is NOT comparing different groups of students!

14. Below BasicBasicProficientAdvanced PVAAS does NOT compare the percentages of students at various academic performance levels to measure growth for a group of students! Measuring Academic Growth SY13-14 PVAAS Roster Verification

15. What is the purpose of PVAAS Teacher-Specific Reporting? SY13-14 PVAAS Roster Verification Purpose: To inform teaching practice in order to guide replication, changes, or adjustments for continual professional growth.

16. SY13-14 PVAAS Roster Verification

17. Who provides PVAAS reporting for teachers in PA? SY13-14 PVAAS Roster Verification

18. What will PDE be providing to PA educators? A PVAAS teacher-specific report in each Pennsylvania assessed grade and subject, or Keystone-related course for each school year. Exception to this is grade 3 as this is the first year students are assessed in PA; hence, no growth measures are available in grade 3. Additionally, a PVAAS 3-year rolling average will be provided when available. This 3-year rolling average does NOT need to be comprised of 3 years of reporting in the same grade/subject/course. Diagnostic reports for: assessing the academic growth of students at varying achievement levels assessing the academic growth of demographic subgroups of students SY13-14 PVAAS Roster Verification

19. What to expect? PVAAS Teacher-Specific reporting is based ONLY on the students for which the teacher had instructional responsibility in the specified grade and subject, or Keystone-related course. This means that the accurate verification of all rosters and allocation of instructional responsibility for EACH student is CRITICAL ! PVAAS Roster Verification is the final opportunity for that verification by teachers and administrators. SY13-14 PVAAS Roster Verification

20. Session Focus SY13-14 PVAAS Roster Verification

21. What is PVAAS Roster Verification? Roster Verification is a process in which teachers and administrators ENSURE and VERIFY that the right students are linked to the right teachers for the EACH state-tested grade and subject or Keystone-related course, and for the right proportion of instructional responsibility! SY13-14 PVAAS Roster Verification

22. What is PVAAS Roster Verification? Important for a teacher’s rosters to accurately reflect ALL students in EACH tested grade and subject, or Keystone- related course for a given school year AND the proportion of responsibility for each tested grade, subject, or Keystone- related course! Teacher Student Proportion of Instructional Responsibility Grade/Subject & Keystone Course SY13-14 PVAAS Roster Verification

23. From your LEA into PIMS into PVAAS Course/HQT: Pre-population of Rosters Course/HQT Correction Window: February 10 – March 21, 2014

24. Course/HQT: For Pre-population of Rosters Course/HQT Correction Window: February 10 – March 21, 2014 March 21 is the FINAL day for any corrections in PIMS; NO PIMS post correction window Course/HQT Submission Window: Closes February 3, 2014

25. What is PVAAS Roster Verification? It is the FINAL opportunity to review and correct rosters, and adjust the proportion of instructional responsibility for EACH student BEFORE the data are analyzed and teacher- specific reports provided. SY13-14 PVAAS Roster Verification

26. Final Submission of All Rosters from the LEA/District Admin “The submission of all rosters from your LEA as of the closing date of the District Admin PVAAS Roster Verification window below is indication that all roster data has been reviewed and verified, and is true and correct to the best of your knowledge. This is also an indication that any and all disputes related to an individual educator’s roster data have been resolved prior to submission.” Monday, June 2 – Sunday, June 8 @ 11:59pm SY13-14 PVAAS Roster Verification

27. Verifying Instructional Responsibility BE AWARE! Students are weighted differently for teacher- specific reporting than they are for school-level accountability and reporting. For PVAAS Teacher-Specific Reporting, students are weighted based on teachers’ instructional responsibility that is verified for each student! For PVAAS school-level reporting, students are weighted equally! NOTE: Full academic year/Oct 1 does NOT apply to PVAAS teacher reporting. SY13-14 PVAAS Roster Verification

28. Who Participates? SY13-14 PVAAS Roster Verification District AdministratorsSchool Administrators Teachers Permanent or temporary professional employees with a valid PA teaching certificate who have full or partial responsibility for assessed eligible content as assessed by the PSSA or Keystone exams

29. Who Participates? SY13-14 PVAAS Roster Verification Teachers Includes teachers who teach: o Reading and Math in grades 4-8; o Science in grades 4 and 8; and o Writing in grades 5 and 8. o Keystone related courses Includes teachers responsible for the instruction of students enrolled in a Keystone course as identified by the district or LEA. May include teachers other than those who are a teacher of record

30. Who Participates? SY13-14 PVAAS Roster Verification If another teacher(s) shares the responsibility for the content- specific instruction for a student, each teacher needs to claim that responsibility on his or her own roster for each student within the PVAAS Roster Verification System.

31. PDE Guidance for Who Participates SY13-14 PVAAS Roster Verification A teacher provides direct instruction when he/she has the responsibility to: Plan instruction of assessed eligible content Provide instruction Use assessment information to evaluate instructional activities Includes technology-enhanced and online instruction Note: The teacher’s student may be performing below grade level, working towards at least grade level proficiency

32. PDE Guidance for Who Participates SY13-14 PVAAS Roster Verification

33. PDE Guidance for Who Participates SY13-14 PVAAS Roster Verification Full/Partial (Shared) Instruction includes teachers in program approaches such as: Co-teaching Team teaching Response to Instruction and Intervention (RtII) Push-in/Pull-out programs Teachers with full or partial/shared instruction can include (not limited to list below): General and special education teachers Intervention specialists Reading and Math specialists Title I teachers ESL teachers Gifted teachers

34. Students Included in Reporting SY13-14 PVAAS Roster Verification To actually be included in PVAAS teacher- specific reporting, a student MUST: Have a PSSA or Keystone score Be claimed at a minimum of 10% instructional responsibility Not be a foreign exchange student Not be a first-year ELL student Not have tested with the PASA (alternate assessment)  Students should NOT be removed from rosters based on these criteria.  SAS EVAAS will apply PA business rules to exclude students as necessary!

35. Ensuring Accuracy and Consistency SY13-14 PVAAS Roster Verification ALL teachers responsible for a student’s instruction MUST verify instructional responsibility, even if the student may not be included. ALL teachers responsible for content- specific instruction in a tested subject MUST complete roster verification, even if the teacher may not receive a PVAAS teacher-specific report (due to final N count).

36. Accessing Roster Verification ALL teachers with prepopulated rosters automatically receive access to the system ONE School Admin account for EACH School Administrator who will verify rosters for EACH school automatically receives access to the system ONE District Admin account for the District Administrator who will verify rosters for the district automatically receives access to the system STAY TUNED! There is a new option to add others to assist with roster verification! SY13-14 PVAAS Roster Verification

37. Accessing Roster Verification Access to the PVAAS Roster Verification system PVAAS User Name PVAAS Password PPID: for Double Level of Authentication No account sharing!! 1 Person per PVAAS Account Teachers will need a SCHOOL User account to access Roster Verification A teacher CANNOT verify his/her rosters via a DISTRICT User account. SY13-14 PVAAS Roster Verification

38. Accessing Roster Verification Audit trail for all actions/activity in the PVAAS Roster Verification system Date stamped Time stamped Linked to the specific PVAAS User Account WHO did WHAT and WHEN? Again, no account sharing If someone needs access to PVAAS, create an account with the correct permissions SY13-14 PVAAS Roster Verification

39. Accessing Roster Verification All teachers, School Admins (or school level verifiers), and District Admins (or district level verifiers) who will verify PVAAS rosters need to have the correct type of PVAAS account. Use the PIMS Staff Template as a way to mass create staff accounts until April 4, 2014. New accounts needed after April 4, or the modification of existing PVAAS accounts after April 4, will need to occur locally/manually by your LEA. Details on PVAAS Account Management are available via an archived webinar from January, 2014. https://sas.elluminate.com/p.jnlp?psid=2014-01- 29.0520.M.FE5E041A676B5BD816E177E713F1A7.vcr&sid=2013180 https://sas.elluminate.com/p.jnlp?psid=2014-01- 29.0520.M.FE5E041A676B5BD816E177E713F1A7.vcr&sid=2013180 SY13-14 PVAAS Roster Verification

40. Accessing Roster Verification Extra permissions are managed by local Admins/Account Managers Access shared via PVAAS system “Admin” Tools School Admins can: Create new School User/teacher accounts Grant School Users access to view/edit/verify all rosters for the school District Admins can: Create new District User accounts Grant District Users access to view/edit/verify all rosters SY13-14 PVAAS Roster Verification

41. CAUTION!!! Limit access to ONLY those staff with authority to review, edit and verify all teacher rosters at the school or LEA/District level! SY13-14 PVAAS Roster Verification More Later on New Roster Verifier Role!

42. QUESTIONS: SECTIONS 1 & 2 SY13-14 PVAAS Roster Verification

43. Session Focus SY13-14 PVAAS Roster Verification

44. Main PVAAS Roster Verification Windows Make sure the system is ready for your teachers! Teachers can Preview as well! LEA Preview (Apr 28-May 2) SY13-14 PVAAS Roster Verification

45. Main PVAAS Roster Verification Windows Dates listed on previous slide indicate business days Dates listed below include weekends LEA decision on how to address windows of “work time”  LEA Preview: Monday, April 28 – Sunday, May 4 @ 11:59 pm  Teacher: Monday, May 5 – Sunday, May 18 @ 11:59 pm  School Admin: Monday, May 19 – Sunday, June 1 @ 11:59 pm  District Admin: Monday, June 2 – Sunday, June 8 @ 11:59 pm SY13-14 PVAAS Roster Verification HARD DEADLINES! HARD DEADLINES! (Windows lock at 11:59pm)

46. LEA Preview Window Monday, April 28 – Sunday, May 4 @ 11:59pm Ensure that the list of teachers involved in roster verification is correct Does EACH teacher who has full or partial responsibility for instruction towards assessed eligible content have a roster? Ensure that each teacher has the correct list of rosters Does each teacher have a separate roster for EACH tested grade and subject, or Keystone-related course? The “roster name” is the name of the state Assessment, not your LEA’s course names SY13-14 PVAAS Roster Verification

47. Managing Rosters NOTE: Rosters should be by grade/subject/course NOT by class period. Example: A teacher who teaches 4 periods of a year- long 8 th grade Reading will have only ONE Roster for Grade 8 Reading, NOT 4 separate rosters. All students, in all 4 periods, for this teacher would be listed under one roster. SY13-14 PVAAS Roster Verification

48. Roster Examples SY13-14 PVAAS Roster Verification Ex. 5 th GradeEx. Keystone Course with students in a PSSA tested grade(s) Ex. One Year- Long Biology Course, Multiple Sections Ex. Two Semester-Long Algebra I Courses in Same School Year Grade 5 MathGrade 8 MathBiologyAlgebra I (Winter) Grade 5 ReadingAlgebra IAlgebra I (Spring) Grade 5 Writing For Keystones: Only students ENROLLED in LEA identified Keystone courses should be included on a teacher’s rosters for PVAAS reporting!

49. Roster Examples SY13-14 PVAAS Roster Verification Ex. 4 th and 5 th Grade Intervention/Rea ding Specialist/Title I Ex. Final Keystone Keystone Course in a sequence of Keystone course (ex. Alg I C) Ex. Teacher providing intervention/Re mediation for student(s) also enrolled in a Keystone course Grade 4 ReadingAlgebra I Grade 5 Reading For Keystones: Only students ENROLLED in LEA identified Keystone courses should be included on a teacher’s rosters for PVAAS reporting!

50. From your LEA into PIMS into PVAAS LEA Preview Window Course/HQT Correction Window: February 10 – March 21, 2014

51. LEA Preview Window Admins can add and remove students to each teacher’s roster…and can also adjust % Student+ Teacher Enrollment, and Full or Partial % of Instruction, as needed during the Preview window.

52. LEA Preview Window School admins (and school verifiers) can do the following DURING the LEA Preview window: add/remove teachers School Verifier can only add/remove teachers if he/she has account management rights add/remove rosters add/remove students change the percentages

53. LEA Preview Window District admins (and district verifiers) can do the following below DURING the LEA Preview window IF they remove control/take control of the rosters from the School Admin (and school verifiers): add/remove rosters add/remove students change the percentages

54. DEMO OF PREVIEW WINDOW FOR ADMINS/VERIFIERS

55. Teacher Verification Window Monday, May 5 – Sunday, May 18 @ 11:59pm Make sure their list of rosters is correct Make sure the list of students in EACH roster is correct Claim an appropriate portion of instructional responsibility for EACH student Submit all rosters to School Admin SY13-14 PVAAS Roster Verification

56. Teacher Verification Window “Student roster data must be verified by educators within 2 weeks of notification of the opening of the roster verification window. Educators are responsible for making any needed corrections and submitting their personal roster verification within the 2 weeks allotted. By submitting a roster verification within the 2 week window, an educator is verifying that the student roster data is true and correct to the best of his/her knowledge. For educators who fail to submit a roster verification within the 2 week window, the existing roster data will be considered true and correct. Verified student roster data will be reviewed by the LEA and any disputes related to roster data shall be resolved by the educator and the LEA.” SY13-14 PVAAS Roster Verification

57. DEMO OF VERIFICATION PROCESS FOR TEACHERS

58. School Admin Verification Window Monday, May 19 – Sunday, June 1 @ 11:59pm Review and verify each teacher’s rosters Edit and return rosters to a teacher, if necessary Complete rosters for teachers who are not available to verify rosters Medical Leave Maternity Leave Help resolve under-claiming and over-claiming issues Submit all rosters to District Admin SY13-14 PVAAS Roster Verification

59. School Admin Verification Window “Student roster data must be verified and/or corrected within 2 weeks of notification of the opening of the School Administrator roster verification review window. School Administrators are responsible to complete the roster verification review within the 2 weeks allotted. Any disputes related to roster data shall be resolved by the educator and the LEA.” SY13-14 PVAAS Roster Verification

60. District Admin Verification Window Monday, June 2 – Sunday, June 8 @ 11:59pm Review and verify each school’s rosters Help resolve under-claiming and over-claiming issues, if needed Over-claimed students are students claimed for more than 100% across teachers/schools/LEAs. All over-claiming within your LEA must be resolved Over-claiming across LEAs does NOT need resolved Under-claimed students are claimed for less than100% across teachers/school/LEAS. There are legitimate reasons for under-claiming Pass rosters back to School Admin for additional changes, if needed Submit all schools to SAS EVAAS ® SY13-14 PVAAS Roster Verification

61. District Admin Verification Window “The roster verification process is the FINAL opportunity to make any corrections to rosters. The District Admin must verify that all roster data has been reviewed and is true and correct to the best of his or her knowledge, and that any and all disputes related to an individual educator’s roster data have been resolved prior to submission.” SY13-14 PVAAS Roster Verification

62. Roster Verifier: Assistance in Verifying Rosters What is a Roster Verifier? A roster verifier is a District or School User who has been granted “Roster Verifier” permission within the Admin tool to assist the District or School Admin with the Roster Verification process for their school or district. This feature was requested by PILOT LEAs. Roster Verifier permission may be given to one, or more than one, person. **CAUTION – Only provide verifier privileges to those with the authority for Roster Verification. SY13-14 PVAAS Roster Verification

63. Tasks BY Role School Admin District Admin School Verifiers District Verifiers SY13-14 PVAAS Roster Verification

64. Tasks BY Role IMPORTANT: A School Verifier CAN: See & do almost everything in the Roster Verification portal that their Admin can. A School Verifier CANNOT: Manage PVAAS accounts for teachers unless they also have Account Management permission.

65. Tasks BY Role PVAAS District Admin Superintendent/CEO or Designee Asst. Superintendent for Elementary Ed Asst. Superintendent for Secondary Ed Special Education Director District User Account w/ RV Permission Dean of Students SY13-14 PVAAS Roster Verification CAUTION – Only provide verifier privileges to those with the authority for Roster Verification.

66. Tasks BY Role Elementary/Middle Principal: School Admin Assistant Principal Others? School User Account w/ RV Permission 5 th grade 6 th grade All Students with IEPs CAUTION – Only provide verifier privileges to those with the authority for Roster Verification. SY13-14 PVAAS Roster Verification

67. Tasks BY Role PrincipalAP 1AP 2AP 3 Literature √ Biology √ Algebra I √ Special Education √ Overclaim/Underclaim √ Preview Due DateApril 28 – May 4 Teacher VerifyingMay 5 – May 18 Admin Submission Due May 19 – June 1 Note: On June 1, AP 3 will submit all rosters to the district.

68. Tasks BY Role IMPORTANT: Have an organized plan 1.Who will verify which grades, courses, teachers, or schools? 2.What timelines will be in place? 3.When and how will each verifier receive training? 4.How will disagreements be resolved? 5.What is the communication plan to help everyone remain on track? 6.How will this administrative group verify information is correct? Authoritative sources? SY13-14 PVAAS Roster Verification

69. Tasks BY Role EXAMPLE: Have an organized plan A high school principal and 3 APs agree to work together to complete RV. Together, they attend training and discuss all they learned to ensure their understanding of upcoming tasks, due dates, and shared responsibilities. SY13-14 PVAAS Roster Verification

70. Tasks BY Role EXAMPLE: Our Agreements Although we can see all rosters for our entire school, we will only work on our own assigned subject rosters to avoid errors. If we need assistance or help, we will ask each other. We will notify teachers of their assigned Administrator for Roster Verification so the teachers will know who to see with questions. SY13-14 PVAAS Roster Verification

71. VERIFICATION FOR SCHOOL ADMIN/VERIFIERS AND DISTRICT ADMINS/VERIFIERS

72. Suggestions… Start Early – Don’t Wait!! Start early in the window rather than waiting until the end of the window to begin (remember, deadlines are HARD deadlines!) Don’t wait – this is a new process! Access Support – Don’t Struggle!! Attend a training session (webinar, face-to-face, archived) View the Roster Verification Virtual Learning Module Quick Start Guide Help Menus PVAAS Website: “Contact Us” link SY13-14 PVAAS Roster Verification

73. QUESTIONS: SECTION 3

74. Session Focus SY13-14 PVAAS Roster Verification

75. Goal of Roster Verification GOAL: To ensure that EACH roster reflects EACH student that a teacher had instructional responsibility for, the proportion of concurrent enrollment between each teacher and student, and the proportion of full or partial responsibility for the instruction for each student. This is a student level verification by teacher and roster. SY13-14 PVAAS Roster Verification

76. Verifying Instructional Responsibility Verify all students for which the teacher had the responsibility for full or partial instruction in a PSSA-tested grade and subject, or Keystone-related course, including: Students enrolled for part of the year or course This is NOT attendance! Students for whom instructional responsibility was shared Receiving core instruction, with or without intervention/remediation/ additional instruction Enrolled in a Keystone course, with or without intervention/remediation/additional instruction SY13-14 PVAAS Roster Verification

77. Verifying Instructional Responsibility Instructional responsibility is a combination of: Proportion of the subject/grade or course in which the student and teacher were concurrently enrolled Proportion of instruction the teacher had responsibility for while enrolled with that student This may vary by student - and by subject/grade/course SY13-14 PVAAS Roster Verification

78. % Instructional Responsibility % Student + Teacher Enrollment Full or Partial % of Instruction The % Instructional Responsibility is calculated by multiplying (% Student + Teacher Enrollment) by (Full or Partial % of Instruction). % Instructional Responsibility SY13-14 PVAAS Roster Verification

79. % Instructional Responsibility % Student + Teacher Enrollment Full or Partial % of Instruction What proportion of the grade/subject/course are the student and teacher concurrently enrolled? Of time the student & teacher were enrolled together, are you the only PA certified educator providing content- specific instruction (Domains 1 and 3) of the assessed eligible content in the grade/subject/course or is it shared with another teacher(s)? % Instructional Responsibility SY13-14 PVAAS Roster Verification

80. Verifying Instructional Responsibility The percentage of instructional responsibility claimed determines how much each student is weighted in generating the individual teacher value-added measures! % Instructional Responsibility SY13-14 PVAAS Roster Verification

81. Verifying Instructional Responsibility % Student + Teacher Enrollment SY13-14 PVAAS Roster Verification Full or Partial % of Instruction SY13-14 PVAAS Roster Verification

82. % Student + Teacher Enrollment Is the proportion of the subject and grade, or course, in which the teacher and student were concurrently enrolled IS NOT Attendance!!! % Student + Teacher Enrollment SY13-14 PVAAS Roster Verification

83. % Student + Teacher Enrollment Calculate from Day 1 through the last school day before the LEA’s testing window opens for that tested subject/grade or course Calculate enrollment, NOT attendance!! Divide student + teacher concurrent enrollment days by total possible concurrent enrollment days % Student + Teacher Enrollment SY13-14 PVAAS Roster Verification

84. % Student + Teacher Enrollment Do NOT include as enrolled days: Holidays Student-Parent-Teacher conferences District professional development days Weather/community emergency closures % Student + Teacher Enrollment SY13-14 PVAAS Roster Verification

85. Example: % Student + Teacher Enrollment Alicia’s enrollment 93 days Teacher’s enrollment 160 days Number of possible enrolled days 160 days Student + Teacher Enrollment 58% SY13-14 PVAAS Roster Verification

86. % Student + Teacher Enrollment CANNOT be decreased for: Daily absences, illness, or vacation- student or teacher Student teacher or paraprofessional providing instruction Participation in extracurricular activities Meetings, professional development, or coaching % Student + Teacher Enrollment SY13-14 PVAAS Roster Verification

87. % Student + Teacher Enrollment CAN be decreased for: Extended, pre-approved or board-approved leave of absence Student hospitalization or psychiatric treatment Internship/apprentice programs % Student + Teacher Enrollment SY13-14 PVAAS Roster Verification

88. Full or Partial % of Instruction Is the proportion of instruction the teacher was responsible for during the time the student and teacher were enrolled together o How much of the instruction (Domains 1 and 3) belongs with this teacher? o How much of the instruction (Domains 1 and 3) belongs with another teacher? Full or Partial % of Instruction SY13-14 PVAAS Roster Verification

89. Full or Partial % of Instruction Is 100%, if teacher was the only person responsible for the instruction while concurrently enrolled with the student Is < 100%, if other teachers also provided instruction Verify/edit for EACH student! May vary BY student! Full or Partial % of Instruction SY13-14 PVAAS Roster Verification

90. Full or Partial % of Instruction Full or Partial % of Instruction = 100% Of time the student & teacher were enrolled together, is the teacher the only PA certified educator providing content- specific instruction (Domains 1 and 3) of the assessed eligible content in the grade/subject/course? YES NO Full or Partial % of Instruction = Proportion of instruction for which each teacher had responsibility of the assessed eligible content in the grade/subject/course SY13-14 PVAAS Roster Verification

91. Full or Partial % of Instruction An individual teacher CAN claim < 100% for a student in: Co-teaching situations Response to Instruction and Intervention (RTII) Team teaching Push-in or Pull-out programs Instruction is shared – the 100% full/partial instruction is shared/split between teachers Full or Partial % of Instruction In any situation in which instruction is shared, teachers and administrators will need to determine together the appropriate percentage of partial instruction to attribute to each teacher involved.

92. Verifying Instructional Responsibility % Student + Teacher Enrollment Full or Partial % of Instruction The TOTAL overall % of Instructional Responsibility is automatically calculated in the system. SY13-14 PVAAS Roster Verification

93. Underclaiming of Students If total % Instructional Responsibility < 100%, the student will be underclaimed in the system. SY13-14 PVAAS Roster Verification

94. Underclaiming of Students There are scenarios where underclaiming IS accurate. Example: Student and/or teacher is new to PA/public schools and enrolls in course part of the way into the course. SY13-14 PVAAS Roster Verification

95. Overclaiming of Students All overclaiming of students WITHIN a district/LEA must be resolved! SY13-14 PVAAS Roster Verification

96. Overclaiming and Underclaiming Over-claimed students are students claimed for more than 100% across teachers/schools/LEAs. All over claiming of students WITHIN a district/LEA must be resolved. LEAs are not expected to resolve issues of over claiming of students ACROSS LEAs. Unless the LEAs are sharing a student(s) simultaneously, such as an IU and District Under-claimed students are claimed for less than100% across teachers/school/LEAS. There are legitimate reasons for under-claiming such as where a student moved into PA/new to PA public schools part way through school year.

97. Disclaimer on Scenarios Provided The scenarios that follow are only to be used as general examples! Any numbers or decisions indicated in these scenarios are shown for illustration purposes ONLY! It is the local decision of the LEA to determine appropriate rosters, % of Student+Teacher enrollment, and Full/Partial % of Instruction! SY13-14 PVAAS Roster Verification

98. Scenario #1 Mrs. Johnson teaches Grade 4 Reading. Her class consists of 3 students: Billy, Jane, and Mary. This is a full year course, and Mrs. Johnson is the only teacher in this grade/subject. All 3 students and Mrs. Johnson are enrolled concurrently from Day 1 of Grade 4 Reading until the last school day before the PSSA Reading testing window opens for Mrs. Johnson’s LEA. SY13-14 PVAAS Roster Verification

99. Scenario #1 READING ROSTER % Student+Teacher Enrollment Full/Partial % of Instruction Total Instructional Responsibility Billy100% Jane100% Mary100% Mrs. Johnson DISCLAIMER: Any numbers or decisions indicated in this example/scenario are shown for illustration purposes ONLY! It is the local decision of the LEA to determine appropriate rosters and % Instructional Responsibility for each student.

100. Scenario #2: Self-Contained Elementary Classroom Mrs. Johnson teaches Grade 4. She teaches both Math and Reading in a self-contained environment. Her class consists of three students: Billy, Jane, and Mary. Both Math and Reading are full year courses, and Mrs. Johnson is the only teacher in these subjects. SY13-14 PVAAS Roster Verification

101. READING ROSTER % Student+Teacher Enrollment Full/Partial % of Instruction Total Instructional Responsibility Billy100% Jane100% Mary100% Scenario #2: Self-Contained Elementary Classroom MATH ROSTER % Student+Teacher Enrollment Full/Partial % of Instruction Total Instructional Responsibility Billy100% Jane100% Mary100% Mrs. Johnson DISCLAIMER: Any numbers or decisions indicated in this example/scenario are shown for illustration purposes ONLY! It is the local decision of the LEA to determine appropriate rosters and % Instructional Responsibility for each student.

102. Scenario #3: Shared Instruction Mr. Smith and Mrs. Wolf co-teach Algebra I to a class of three 9 th grade students: Charlie, Angela, and Phillip. They have agreed that they share the instruction for all three students 50/50. All students/teachers are enrolled for the entire course. SY13-14 PVAAS Roster Verification

103. ALGEBRA I ROSTER % Student+Teacher Enrollment Full/Partial % of Instruction Total Instructional Responsibility Billy100%50% Jane100%50% Mary100%50% Scenario #3: Shared Instruction ALGEBRA I ROSTER % Student+Teacher Enrollment Full/Partial % of Instruction Total Instructional Responsibility Billy100%50% Jane100%50% Mary100%50% Mr. Smith Mrs. Wolf DISCLAIMER: Any numbers or decisions indicated in this example/scenario are shown for illustration purposes ONLY! It is the local decision of the LEA to determine appropriate rosters and % Instructional Responsibility for each student.

104. Scenario #4: Shared Instruction Mr. Smith teaches Biology to three students: Charlie, Angela, and Phillip. Phillip has an IEP and receives additional content instruction from Mrs. Wolf. They have determined that Mrs. Wolf has 10 percent of the shared instruction for Phillip in this course. All students/teachers are enrolled for the entire course. SY13-14 PVAAS Roster Verification

105. BIOLOGY ROSTER % Student+Teacher Enrollment Full/Partial % of Instruction Total Instructional Responsibility Phillip100%10% Scenario #4: Shared Instruction BIOLOGY ROSTER % Student+Teacher Enrollment Full/Partial % of Instruction Total Instructional Responsibility Charlie100% Angela100% Phillip100%90% Mr. Smith Mrs. Wolf DISCLAIMER: Any numbers or decisions indicated in this example/scenario are shown for illustration purposes ONLY! It is the local decision of the LEA to determine appropriate rosters and % Instructional Responsibility for each student.

106. Scenario #5: Student/Teacher Movement Mrs. Gardner teaches Biology to a class of three 9 th grade students: Gary, Tony, and Liz. Tony enrolled in the course 70% of the way into it. Mrs. Gardner went on maternity leave 70% of the way into the course. She was not enrolled with Tony. Tony can be removed from her roster, if he was on it. Mrs. Stafford filled in for the rest of the year. SY13-14 PVAAS Roster Verification

107. BIOLOGY ROSTER % Student+Teacher Enrollment Full/Partial % of Instruction Total Instructional Responsibility Gary30%100%30% Tony30%100%30% Liz30%100%30% Scenario #5: Student/Teacher Movement BIOLOGY ROSTER % Student+Teacher Enrollment Full/Partial % of Instruction Total Instructional Responsibility Gary70%100%70% Tony0% Liz70%100%70% Mrs. Gardner Mrs. Stafford DISCLAIMER: Any numbers or decisions indicated in this example/scenario are shown for illustration purposes ONLY! It is the local decision of the LEA to determine appropriate rosters and % Instructional Responsibility for each student.

108. Scenario #6: Open Campus/Consortium Mrs. Rodriguez teaches an online Keystone Literature class. The class is part of an open campus program and is open to students from neighboring partner-districts. She teaches three students: Tim, Jessica, and Laura. Tim comes from a neighboring district. Jessica and Laura are from her employing district/LEA. All students and the teacher are enrolled for the entire course. SY13-14 PVAAS Roster Verification

109. Scenario #6: Open Campus/Consortium LITERATURE ROSTER % Student+Teacher Enrollment Full/Partial % of Instruction Total Instructional Responsibility Tim100% Jessica100% Laura100% Mrs. Rodriguez DISCLAIMER: Any numbers or decisions indicated in this example/scenario are shown for illustration purposes ONLY! It is the local decision of the LEA to determine appropriate rosters and % Instructional Responsibility for each student.

110. QUESTIONS: SECTION 4 INSTRUCTIONAL RESPONSIBILITY

111. SY13-14 PVAAS Roster Verification THIS YEAR (SY13-14) COUNTS!! SY13-14 is Year One for PVAAS Teacher Specific Reporting to be used towards a teacher’s PVAAS 3-year rolling average. In Summary…

112. Counts Towards the FIRST 3 Year Rolling Average! This Year!

113. SY13-14 + SY14-15 + SY15-16= First PVAAS 3 Year Rolling Average in SY15-16

114. Session Focus SY13-14 PVAAS Roster Verification

115. Accessing Help 24-7 Where to go… PVAAS FAQs Implementation Guide Quick Start document Virtual Learning Modules Help Menus Role Specific Window Specific Context Dependent Archived Webinars PVAAS website: “Contact Us” link SY13-14 PVAAS Roster Verification

116. PVAAS FAQs with Table of Contents SY13-14 PVAAS Roster Verification

117. What is the intent of PDE’s guidance for PVAAS Teacher- Specific reporting? PDE is developing statewide policy and guidance for PVAAS teacher-specific reporting that fairly represents the unique schedules, instructional programs, and the attribution of each teacher’s group of students to the teacher to yield a measure of academic growth in the tested subjects/courses where PVAAS reporting is applicable. SY13-14 PVAAS Roster Verification

118. What is the intent of PDE’s formal guidance for PVAAS Teacher- Specific reporting? PDE will provide flexibility and guidance for LEAs to locally address, within the state policy and guidelines, to provide a measure of growth of the teacher’s group of students based on PVAAS teacher-specific reporting. SY13-14 PVAAS Roster Verification

119. So, How Do You Calculate % Student+Teacher Enrollment? Total # Days Student + Teacher Concurrently Enrolled* Total # Days for Course/Subject/Grade** % Student + Teacher Enrollment *Total # Days Student + Teacher Concurrently Enrolled  Number of school days for a course/subject/grade that student AND teacher are enrolled together, up to and including last school day before LEA testing window. o Examples of days that can decrease this number: Extended board-approved leave of absence for student or teacher Hospitalized or psychiatric treatment Student in internship or apprentice program o Examples of days that cannot decrease this number: Teacher or student absent for sick day or vacation Instruction provided by student teacher or paraprofessional Student out for extracurricular activity Teacher out for meeting, professional development, or coaching **Total # Days for Course/Subject/Grade  Number of school days for a course/subject/grade, up to and including last school day before LEA testing window. o Does NOT include days when ALL students are not in school: Holidays Student-Parent-Teacher Conferences Professional Development Day School closed due to weather or community emergency SY13-14 PVAAS Roster Verification

120. Contact SAS EVAAS with HOW TO questions (Click on “Contact Us” link on PVAAS login page) Accessing & Using Roster Verification system Username & Password issues PPID errors & omissions Adding/removing teachers Adding/removing rosters Adding/removing students Verifying & submitting rosters Sending rosters back to a teacher or School Admin District Admin/District Verifiers ONLY Contact the PVAAS Statewide Team with Policy and Guidance questions (Email pdepvaas@iu13.org) Which PA teachers? Claiming issues % Student + Teacher Enrollment % Full/Partial Instruction % Instructional Responsibility PVAAS Teacher-Specific Reporting SY13-14 PVAAS Roster Verification

121. Guidance for Policy Questions District Admin/District Verifiers ONLY Email: pdepvaas@iu13.org Which PA teachers? Claiming issues % Student + Teacher Enrollment % Full/Partial Instruction % Instructional Responsibility PVAAS Teacher-Specific Reporting

122. SY13-14 PVAAS Roster Verification SAS EVAAS Support Team has staff in the office each day to respond to questions; They have access to the entire roster system. The PVAAS Statewide Team does NOT have access. PVAAS Statewide Team members are on the road providing professional development sessions to educate you on this process Response from SAS EVAAS will be quicker as a result!

123. Roster Verification Professional Development Opportunities There are three (3) options for professional development on what educators have to know and be able to do to verify and submit rosters in Spring 2014. 8 Webinars in February 9 Face-to-Face Sessions in March Virtual Learning Module accessible 24/7 via PVAAS website (Coming Soon!) SY13-14 PVAAS Roster Verification

124. Roster Verification Webinars Primarily designed for School and District Admins (or, school level and district level verifiers) May want to have lead teachers participate to assist them locally in rolling out the roster verification process to all staff Link to archived session will be available on PVAAS login page as of the night of Thursday, Feb 6th SY13-14 PVAAS Roster Verification

125. Roster Verification Webinars NO Registration Necessary!! To join a session, click on the link on the day of the session. https://sas.elluminate.com/m.jnlp?sid=2013180&password=M. 6B9666A839FB45B94DE2CC4A2C4EB6 https://sas.elluminate.com/m.jnlp?sid=2013180&password=M. 6B9666A839FB45B94DE2CC4A2C4EB6 Please contact us at pdepvaas@iu13.org or 717-606-1911 should you experience difficulties in accessing this site or the webinar session.pdepvaas@iu13.org SY13-14 PVAAS Roster Verification Dates/Times: February 4, 2014 @ 12:30-3:30pm February 5, 2014 @ 8:30-11:30am February 10, 2014 @ 12:30-3:30pm February 13, 2014 @ 8:30-11:30am February 18, 2014 @ 12:30-3:30pm February 20, 2014 @ 8:30-11:30am February 24, 2014 @ 12:30-3:30pm February 27, 2014 @ 8:30-11:30am

126. Face-to-Face Roster Verification Sessions Primarily designed for School and District Admins (or, school level and district level verifiers) May want to have lead teachers participate to assist them locally in rolling out the roster verification process to all staff Registration REQUIRED for ALL Face-to-Face sessions!! If your IU is serving as a downlink site for the March 13-14 sessions, you will register locally through your IU. For the Face-to-Face sessions at the 3 PaTTAN locations, please register by visiting www.pattan.net by February 28, 2014www.pattan.net SY13-14 PVAAS Roster Verification

127. Face-to-Face Roster Verification Sessions SY13-14 PVAAS Roster Verification Locations/Dates/Times: PaTTAN Pittsburgh Office March 6, 2014 – 8:30-11:45am OR 12:30-3:45pm March 7, 2014 – 8:30-11:45am PaTTAN King of Prussia Office March 11, 2014 – 8:30-11:45am OR 12:30-3:45pm March 12, 2014 – 8:30-11:45am PaTTAN Harrisburg Office (Check with your local IU to see if they are serving as a downlink site for these 3 dates/times) March 13, 2014 – 8:30-11:45am OR 12:30-3:45pm March 14, 2014 – 8:30-11:45am

128. Roster Verification Virtual Learning Module Accessible 24/7 through PVAAS website Segments for Teachers, School and District Admins, and School level and District level Verifiers To be released mid-February Approximately 75 minutes Two additional segments for School and District Admins, and School level and District level Verifiers To be released mid-March Approximately 20 minutes each SY13-14 PVAAS Roster Verification

129. Roster Verification Virtual Learning Module SY13-14 PVAAS Roster Verification Segments for teachers, school administrators, school level-verifiers, district administrators, and district level-verifiers (to be released in February) include the following: What is PVAAS Teacher Specific reporting and its purpose? What is Roster Verification and why is it necessary? Who verifies rosters? What is the timeline and process? Which teachers will participate? How will the data be used? Accessing and navigating the system Guidance on percentage Instructional Responsibility % Student + Teacher Enrollment and %Full/Partial Instruction) Teacher Actions - What are the steps in the process? Adding/removing rosters Adding/removing students Verifying/Editing instructional responsibility Submitting rosters Resources and Support TOTAL TIME for above = Approx. 75 minutes.

130. Roster Verification Virtual Learning Module SY13-14 PVAAS Roster Verification The two segments for school administrators, school level-verifiers, district administrators, and district level-verifiers include info on action actions they will need to take to: review rosters address over-claiming and under-claiming of students send rosters back to the teacher or school submit rosters To be released in Mid-March..

131. Additional Questions?

132. PVAAS Materials or Statewide Implementation pdepvaas@iu13.org PVAAS Report Web Site https://pvaas.sas.com

133. www.pde.state.pa.us PENNSYLVANIA Value Added Assessment System ______________________________________________________________________ PVAAS 333 Market Street Harrisburg, PA 17126