PAIU Curriculum Coordinators Meeting November 2015 PVAAS Update PVAAS Statewide Team for PDE

PVAAS Update Topics Transition of State Assessments/PSSA and PVAAS PVAAS Accounts and Access PVAAS and PEERS Reporting Releases Performance and Quintile Diagnostic Resource Doc PVAAS Fall Professional Development ASA and AERA Statements Spring 2016 Roster Verification Questions/Feedback/Follow-up Needed?

Transition of State Assessments: Impact on PVAAS?

Transition of State Assessments/PSSA: PVAAS Is the group of students (indicated by the yellow star) at the same RELATIVE position in the distribution of statewide scores from SY to SY14-15? Yes = Green on PVAAS.

Transition of State Assessments/PSSA: PVAAS - Pennsylvania Distribution of school value-added levels over the past two years, SY13-14 and SY14-15 for PSSA Math in grades four through eight. Despite the changes in proficiency over the past two years, the distribution of PVAAS color indicators has remained fairly constant (Red is the lowest and Dark Blue is the highest).

Transition of State Assessments/PSSA: PVAAS - Pennsylvania Distribution of school value-added levels over the past two years, SY13-14 and SY14-15 for PSSA Reading/ELA in grades four through eight. Despite the changes in proficiency over the past two years, the distribution of PVAAS color indicators has remained fairly constant (Red is the lowest and Dark Blue is the highest).

Transition of State Assessments/PSSA: PVAAS New document with these illustrations will be available soon on the PVAAS login page! New version will replaced by end of next week!

PVAAS User Accounts and Access

PVAAS User Accounts PVAAS user accounts should not be shared. LEA staff should provide each staff who will access PVAAS with the appropriate type of account and the appropriate access IU staff should not be using another user’s account from an LEA. LEAs may choose to provide the IU staff with their own account for the LEA. Let the LEA contact login with his/her PVAAS User Account Audit Trail – record of who logged in (PVAAS username) and what actions were taken. Protect yourself, and encourage your LEAs to protect their staff and the confidentiality of their data. For help managing PVAAS accounts and access, click “Contact Us” at the top right of any PVAAS page!

PVAAS Reporting Access Access for IU Consultants, PATTAN, PDE Staff “State User” accounts, with access to reporting for multiple LEAs and no student names Access was provided on November 6 The PVAAS Statewide Team manages account changes (creating, deactivating) for your IU consultants Note that these “State User” accounts, with access to multiple LEAs within the IU region and NO student names, are managed by the PVAAS Statewide Team. Other accounts at your IU, for your IU as an LEA, are managed locally. Accounts with your IU as an LEA have access to reporting to only your IU, not other LEAs in your region.

PVAAS and PEERS Reporting Releases SY14-15 Reporting

Password Protected Site: Currently Enrolled Projections, GIEP Currently enrolled data released November 5 LEAs who submitted complete data into PIMS as of Oct 16, COB, can now access the PVAAS Student Projection Reports and PVAAS Projection Summary Reports for students who have changed grade levels, have changed schools (elementary to middle school, and middle to high school), and/or who are new to the LEA. GIEP flag will be added in PVAAS with next release/update in December - using the November PIMS Enrollment file

Password Protected Site: Currently Enrolled and New Projections PVAAS Projections are available for the following assessments: Math, ELA and Science (4,8): Students enrolled in grades 4-8 Keystones Algebra I, Literature, Biology: Students enrolled in grade 6 and higher PSAT: Students enrolled in grades 6-11 ACT, SAT: Students enrolled in grades 9-12 Advanced Placement (AP) Exams: Students enrolled in grades 6-12 AP Biology AP Calculus AB AP Statistics AP English Literature AP English Language AP Government Politics AP US History AP Psychology

PVAAS Public Site Anticipated date of release – November 19, 2015 Includes reporting ACROSS GRADES by subject/Keystone content area. Reporting is ONLY included on the PVAAS Public Site if more than one grade level of students is represented in the PVAAS score for the specific subject/Keystone content area. (This is defined in Act 104.) An announcing the release of the PVAAS Public Site will be sent, when the site is released, from EVAAS Support to: District Admin account holders (Supt or designee/1 per LEA) District User account holders School Admin account holders (Principal/1 per school building) Intermediate Unit, PATTAN, and PDE account holders will be included in this announcement.

PEERS Update with SY14-15 FINAL SPP score When SY14-15 score is available in PEERS, an notification will be sent (from EVAAS Support) to: District Admin account holders (Supt or designee/1 per LEA) District User account holders School Admin account holders (Principal/1 per school)

Performance and Quintile Diagnostic Resource Document

PVAAS Diagnostic Reports: Performance Diagnostic and Quintile Diagnostic How are they different? How can each be used? Updated documents shared with PAIU CC and IU PVAAS Contacts (via ) on October 30. Please share this information with your LEAs! Documents will also be posted on the PVAAS login page soon!

PVAAS Diagnostic Reports: Performance Diagnostic and Quintile Diagnostic

PVAAS Fall Professional Development Follow up and Common Questions

Fall 2015 PVAAS Sessions Face-to-Face Admins Sessions? 35 Sessions Completed 12 More Sessions to go! Thoughts? Feedback? “Coach” Videoconference Sessions 9 VCs Completed VC Archive Link 6 Follow-up Webinars Link will be sent to all VC participants Archived Thoughts? Feedback?

Reporting of LEA Participation at IU Sessions Information needed for Report to PDE Please provide information in spreadsheet or table format (MS Excel or Word; please, no pdf files or scanned sign in sheets) Include information about the PVAAS session(s) at your IU: Date, time, and title of session Participant Name Participant Address Participant LEA Participant building (if available) Participant role (if available) File doesn’t need to be pretty! If possible, pull right from your registration system. Include whatever fields of information you collect; we’ll use the ones above and delete others. When sending final sign-in sheets to us, as record of who was actually in the session, please do so IN ADDITION TO the above spreadsheet/table. Thanks!

1:1 Sessions with Some LEAs Auditor General Report on PDE Support to Struggling Schools in PA Larger LEAs; Lower Achieving LEAs – difficult to leave district/school for all needed trainings We are offering 1:1 sessions 1:1 Sessions Completed in 10 LEAs so far – approx 70 1:1 sessions 1:1 Session with each principal and district debrief Example: Erie Public Schools, 2 consultants, 2 days, Thurs/7:30AM-5:00PM and Fri/7:30AM -3:00PM, 18 schools, 90 min per school, district admin debrief session; ARL; CRO; IU debrief being scheduled MANY Other LEAs still on the invite/to be scheduled list I will the IU PVAAS Contract regarding outreach from our team – which LEAs, your IU participation/debrief

PVAAS Fall Professional Development Common Questions

Common Questions/Topics We’re Hearing in Training Sessions… What does the 0-3 mean on the Teacher List by School Report? 0-3 score (last column) is NOT the AGI 0-3 score for Composite indicates conversion of AGI to what score would be IF used on 82-1 rating tool/evaluation Intended for people to see score “along the way” to a 3 year rolling average 0-3 score NOT to be used yet unless from a 3 year rolling average

Common Questions/Topics We’re Hearing in Training Sessions… How can Composite be yellow/red but all singles green? MORE evidence! How can 2 teachers be green, but 1 teacher red if they taught same students? 2 teachers had 35 students each for only 20% of the time (small amount of IR), but the other teacher had all 70 students combined and for 80% of the time (larger amount of IR). That one teacher had twice as many students and a lot more %IR (more data, more evidence). MORE evidence! Response:– the model for PVAAS Teacher Specific Reporting assumes that the group of students is GREEN, UNLESS…. There is enough data/evidence in the students’ assessment results to indicate otherwise and pull them to the “other colors” (dark blue, light blue, yellow, red)

Common Questions/Topics We’re Hearing in Training Sessions… What to address with principals when they ask “how teacher can go from dark blue to red”, or “from red to dark blue”? Is it red flag if they say they didn’t do anything different? If they didn’t do anything different, what does that mean ? Short Response: DIG Deeper!!!!!!!!!!! Also look at prior achievement of students; if teacher/admin indicates teacher did not “do anything different”, but the teacher had students at a different achievement level……

Common Questions/Topics We’re Hearing in Training Sessions… What does GREEN mean? Green DOES mean growth!!!!!

ASA and AERA Statements SAS EVAAS Response

ASA and AERA: Value-Added Modeling American Statistical Association (ASA) Position Statement Technical Considerations American Educational Research Association (AERA) Statement Technical and Policy Considerations SAS EVAAS' response to this most recent AERA statement and their statistical/technical considerations: AERA's statement on the use of value-added models includes several technical and policy recommendations. SAS agrees with many of the technical points and believes they would be true of any measure of schooling and teaching effectiveness, such as classroom observations or student surveys. Not all value-added models are the same, and the EVAAS models address many of AERA's recommendations, such as using multiple years of student data, reporting multiple years of growth estimates with their standard error, and adopting a robust approach to accommodating different tests. We view the policy recommendations as suggestions to educators and policymakers for implementing value-added reporting within education systems rather than limitations of value-added modeling itself.

PVAAS Roster Verification Are you reeaddddddy to rosteeeerrrrrrr?!!!!!!

Roster Verification Phases: Spring 2016 Please note the adjustment for the opening and closing of each phase: Each phase will close on a Friday, at 11:59 pm, and roll into the next phase Saturday at midnight. notifications to the appropriate users for the next phase, informing them of the opening of the phase, will be sent on the Monday of each phase. The change was made to reflect when the work of verifying rosters is generally completed: during the work week (M-F). LEA Preview Phase, by School May 2-13, 2016 (2 weeks) Teacher Verification Phase May 14*-27, 2016 (2 weeks) *Notifications of phase opening will be sent via on Monday, May 16. School Administrator Verification Phase May 28*-June 10, 2016 (2 weeks) *Notifications of phase opening will be sent via on Monday, May 30. LEA Verification Phase June 11*-24, 2016 (2 weeks) *Notifications of phase opening will be sent via on Monday, June 13.

SY15-16 Updated RV Resources Posted! RV VLM Part I Posted!! What is RV….

Questions? Feedback? Follow-up Needed?