PVAAS Update PAIU Curriculum Coordinators Meeting November 2016 Kristen Lewald, Ed.D., PVAAS Statewide Director

Topics PVAAS Reporting Release Currently Enrolled Students – PVAAS Student Level Projections PVAAS Common Questions – Teacher Reporting PVAAS Google Site PVAAS Professional learning PVAAS Roster Verification Other?

PVAAS Reporting Release SY15-16 PVAAS and PEERS

Sy15-16 PVAAS and PEERS Reporting Release All PVAAS Reporting has been released to all account holders District Reporting School Reporting Teacher Reporting Student projections (last tested) PVAAS Public Site has been updated with Sy15-16 reporting PEERS has been updated with PVAAS 3 year avg. scores and SY15-16 SPP scores A few LEAs with suppressed SPP scores will have Sy15-16 SPP scores updated 11/11

Enrollment data will be updated in PVAAS on Thursday (11/10) evening Current Enrollment Enrollment data will be updated in PVAAS on Thursday (11/10) evening

PVAAS Projections SAS EVAAS initially releases projections based on where students last tested Student may have moved/gone elsewhere; SAS EVAAS would not know where to release the projection Protecting confidentiality of student data Projections can be “surfaced” after enrollment data is submitted by the district into PIMS If enrollment data was submitted into PIMS by noon on 10/18, enrollment info will be available in PVAAS by 11/11 Next date for PIMS submission on Wednesday 11/9, TODAY Next Date is January 2017 Students who did not test in the previous year: projections are not “surfaced” within PVAAS SAS EVAAS initially releases projections based on where students last tested Student may have moved/gone elsewhere; SAS EVAAS would not know where to release the projection Protecting confidentiality of student data Projections can be “surfaced” after enrollment data is submitted by the district into PIMS If enrollment data was submitted into PIMS by noon on 10/18, enrollment info will be available in PVAAS by 11/11 Next date for PIMS submission on Wednesday 11/9, TODAY Next Date is January 2017

Changes/Updates in Menu Options (with the release of “currently enrolled” data; IF LEA submitted student data into PIMS by Oct 18) In Reports menu, new report called Projection Summary (Single Enrolled Grade) In Reports menu, College/Career Readiness will now indicate Single Enrolled Grade In Student Search, will now be a drop-down menu to search by “grade last tested” OR “grade enrolled” Students who did not test in the previous year: projections are not “surfaced” within PVAAS SAS EVAAS releases projections based on where students last tested Student may have moved/gone elsewhere; SAS EVAAS would not know where to release the projection Protecting confidentiality of student data Projections can be “surfaced” after enrollment data is submitted by the district into PIMS If enrollment data was submitted into PIMS by noon on 10/18, enrollment info will be available in PVAAS by 11/11 Next date for PIMS submission on Wednesday 11/9 – no current timeframe for availability in PVAAS

Common Questions and Answers about PVAAS Teacher Reports https://drive.google.com/file/d/0B5FAJU-k0YoNREJJNUJXVW83dm8/view

Keystone Business Rule: Highest Score Used Does not apply to PVAAS teacher reporting! This business rule does NOT apply to PVAAS teacher reports Business rule applies to district & school reporting only https://pvaas.sas.com/suppor t/PVAAS- IncludingRetestersKeystoneS cores.pdf

Roster Verification Summary Spring 2016 roster verification summary is still available for access! This can be used to investigate numbers of students on rosters, %s verified, etc. If any questions on why a student was/was not included, Click on Contact Us and submit a ticket to SAS EVAAS

Access to Teacher Reports for Teachers Who Changes Schools/LEAs Access to Teacher Reports if teacher changed schools within SAME district/LEA: Teacher is able to see his/her report within the same district even if s/he changed schools School Admin is able to see teacher reports for school users that have a teacher report at the SAME school School Admin will NOT see any data tied to a different school even if the teacher has an account at their own school District Admin is able to see all data within the district/LEA When the next round of reporting is released, the current year principal only sees previous years of reporting IF from the same district Access to teacher reports if teacher changes LEAs/districts and wants a 3 year average across districts (teacher choice): Email pdepvaas@iu13.org for How-To info

“How could Composite be a different color than any other color I’ve had in a single year?” A teacher’s group of students is assumed to be green UNLESS we have enough evidence to say otherwise Composite is not an average, but really an accumulation of the evidence across 3 years, across grades/subjects that we have in students’ growth Starting Point: Refer to the Understanding the Composite video (available via the online Help system, link for Teachers: Using PVAAS for a Purpose on PVAAS login page, or PVAAS Resources site!) https://drive.google.com/file/d/0B5FAJU-k0YoNcGdJUUQ2TWR6LUk/view Refer to additional details/formula in the PVAAS online Help system

“Why is School Value-Added different than Teacher Value-Added when I only have one or two teachers in that grade/subject?” District-level and school-level value-added reports are not a simple aggregate, or average, of teacher-level reports The main reason is that different students may be included in each model/analysis. Teachers may claim students on their rosters who are not attributed to a school, and the school model may include students who are not claimed by a teacher Also, students are counted and weighted differently in the district/school level analyses than they are in the teacher level analyses as % instructional responsibility is taken into account

“Why are Value Added results different between teachers who share instruction?” PVAAS measures the INFLUENCE of each teacher on the growth of their group of students. The purpose of shared instruction is to portion out the evidence of what occurred with students. It is all about the amount of evidence in the student assessment results. The teacher with the higher percentage of shared instruction (higher percentage of Full/Shared % Instruction) would have MORE evidence of that teacher’s influence on a group of students as compared to the other teacher. The more data available, the more evidence we have to see if the group of students exceeded the PA standard for academic growth OR not.

“Why are Value Added results different between teachers who share instruction,” cont’d A conceptual example: Two teachers teach the same group of students, but you observe Teacher A 73 times versus you observe Teacher B 27 times. Which teacher do you have more evidence of their practice? The teacher who was observed 73 times. Transfer this analogy to the example above. Two teachers teach the same group of students, but Teacher A has 73% of instructional responsibility versus 27% instructional responsibility by Teacher B. There is more evidence for the teacher with the 73% for the student group. You will also see a smaller standard error on Teacher A’s report as compared to Teacher B’s as teacher A has “more evidence.”

PVAAS Resources - Google Site Accessible via direct url, the PVAAS login page, and the online Help system https://sites.google.com/a/iu13.org/pvaas-pl-resources/

PVAAS Resources Google Site Access directly http://tinyurl.com/PVAAS-Resources If your LEA blocks the use of tiny urls, use the full hyperlink, https://sites.google.com/a/iu13.org/pvaas-pl-resources/ Access through the PVAAS login page https://pvaas.sas.com Links in the Using PVAAS section point to different pages in the site, for District Leaders, School Leaders, and Teachers. Access through the PVAAS online Help System Click “Help” at the top right of any PVAAS page and look for the Using PVAAS section under Additional Resources – those links point to pages of the site!

PVAAS Resources Google Site Search bar to help you locate resources! https://sites.google.com/a /iu13.org/pvaas-pl- resources/ Contact our team for help: pdepvaas@iu13.org

PVAAS Resources Google Site: Guides & How-To Quickly access resources using the Navigation box, always on the left hand side of your screen. In particular, note the Guides & How-To Resources page!  PVAAS Guides and How-To Resources Guides to Reporting Short, “how-to” documents (how to export data, how to create a custom student report, etc.) Using Reports for a Purpose (how to use custom student reports, how to use student projections with other data for decision-making, etc.) Key Concepts Methodology documents

PVAAS Resources Google Site: Teacher Page The Teachers: Using PVAAS for a Purpose page includes: Online Learning Link to e-Learning module about PVAAS teacher specific reports Link to the “Understand the Composite” video (15 min) Link to the “Respond to Teachers’ Common PVAAS Questions” webinar recording (1 hr) and PowerPoint Resource Documents Teacher Self Reflection Guide (fillable pdf and an annotated sample available!) Teacher Specific Reporting FAQ How to Create a Custom Student Report What Educators Should Know about PVAAS Student Probabilities Digging Deeper into Content Areas

PVAAS Professional Learning January-June 2017 offerings coming soon! e-Learning Modules

PVAAS Professional Learning – Winter/Spring 2017 New webinars and resources will be available this winter/spring! Look for updated Professional Learning booklets soon (by December) advertising these offerings; LEAs and IUs will be emailed link to the updated booklet Updated booklets will be accessible via the PVAAS login page, online Help system, and the PVAAS Resources site! January-June 2017 offerings coming soon!

Certificates of Completion Certificates of Completion now available for most e-Learning modules!!! Reminder: Completing a module does not automatically earn a user Act 48 credit. Certificate can be used as proof of completion, as part of a district’s/LEA’s requirements towards Act 48 credit.

Spring 2017 Roster Verification https://sites.google.com/a/iu13.org/pvaas-pl-resources/roster-verification- resources

Roster Verification e-Learning Module Part 1 is now available! Welcome (1 min) What is Roster Verification (10 min) Roster Verification Overview (12 min) Instructional Responsibility (19 min) RV Phase Dates and Resource Docs coming in next 2 weeks! IUs and LEA Admins will be emailed this info Part 2 available by the end of February 2017

Spring 2017 Roster Verification Roster Verification Resources page available on our PVAAS Resources Google site Currently posted: Roster Verification FAQ, SY16-17 Spring 2017 PVAAS Roster Verification Training & Resources flyer Additional resources coming soon! Spring 2017 Phase Dates (coming in 2 weeks) Sample Scenarios Guide to Implementation Resources coming February 2017 RV Quick Start Guide RV Checklist Student Enrollment Update (“Gap Enrollment”) Schedule for RV

Are Yoooouuuu Ready to Roster? Training webinar for new administrators! Audience? NEW administrators (district and/or school level) who have responsibility for Act 82/Educator Effectiveness and PVAAS Roster Verification Administrators wanting a refresher Any additional new LEA staff who provide support and assistance during Roster Verification Webinar scheduled for Wednesday, 2/15/2017, 8:30-11:30 am Join Live: https://attendee.gotowebinar.com/register/8648028766622985475 Prior registration isn’t necessary, but participants may register if they choose!

Educator Effectiveness Data Administrator Candice Felton (formerly Candice Schuld) Replacement for Brian Truesdale Areas of Work: SPP Data Collections PVAAS Staff-Student-Subtest Email: c-cfelton@pa.gov

Questions/Feedback/Info Needed? pdepvaas@iu13.org