Pennsylvania Value-Added Assessment System (PVAAS) Bobbie W. Pfingstler, Ed.D. Director of Continuous School Improvement Services CIU # 10 Update to CIU # 10 Curriculum Coordinators September 22, 2011

Working with Your IUs Ali Grafenstine: Jennifer Ross – IUs: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 27, 28 Joan Perekupka – IUs: 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 29 Kristen Lewald – PDE, PATTANs, Other Statewide Groups/Organizations

Agenda NEW features and enhancements to Fall 2011 PVAAS reporting: – Color Code Scheme and Legend Language – User-friendly Report Labels/Terms & Rollovers – Web-based Scatterplots – Redesign of School Search feature – Pre-defined Packets – Resources and Supports Agendaman, PDE website, PVAAS login page: NEW Features Handout and PPT

COLOR CODE SCHEME AND LEGEND LANGUAGE

Rationale The NEW color code scheme and legend language allow for alignment of the reporting for grades 4-8 AND grades reading, math, science and writing The NEW color code scheme differentiates on both ends of the continuum, whereas the previous grades 4-8 color code scheme only differentiated below ZERO (a years worth of growth). Each color code range is determined based on the standard error (SE).

NEW Color Legend for Use in Both Grades 4-8 & Grades 9-11 PVAAS Value-Added Reports

Crosswalk: Old to New Legends

Performance Diagnostic Summary Report

NEW Color Legend for Use in Both Grades 4- 8 & Grades 9-11 PVAAS Performance Diagnostic Summary Reports New ColorsSame Descriptors B G P

USER-FRIENDLY REPORT LABELS/TERMS AND ROLLOVERS

User-Friendly Terms Mean NCE Gain is now Growth Measure Std Error is now Standard Error 3-Yr-Avg NCE Gain is now 3-Yr-Avg Growth Measure (Year) Mean is now (Year) Achievement

Demo Site Access User Name: PVAAS.Training Password: PVAAS2011

New Roll-over Feature

The district value-added report…. The Growth Standard represents the minimal…. The State 3-YR-Avg… New Roll-over Feature

Common Questions Q: Will the new color codes scheme/legends be used on the Public PVAAS reporting site? A: Yes, the colors and the legends will be the same on the LEA protected site and the public PVAAS site Q: How do you interpret the different shades of blue? Does dark blue mean more growth was achieved then light blue? A: The key statement in the legend is the level of evidence – significant and moderate.

Common Questions Q: Will the roll-over text show up when I print a report? A: No, not with the Sept 2011 release of the PVAAs reporting. In future versions of PVAAS, there is a plan to offer an annotated version of a printed report that will include the roll-over text. Q: Is the roll-over text located in a document that I can use to explain certain terms to my district/school teams? A: All rollover text is fully explained in the help menus.

WEB-BASED SCATTER PLOTS

Rationale PVAAS scatterplots have been provided to LEAs in a static form (PPTs) for the past several years. Scatterplots will now be provided via the web-based PVAAS reporting site! Districts and schools can use this new web- based report to find and highlight their schools. The availability to view data from other LEAs will be aligned to legislative requirements for public access.

Accessing Scatter Plots The new scatter plot report can be accessed directly within the orange Reports tab

Customizing Scatter Plots Users can switch subjects and grade Users can also switch the the X and Y Axis

Roll-Over Feature to Identify Schools!

Demo Site Access User Name: PVAAS.Training Password: PVAAS2011

Common Questions Q: Will my district /LEA still receive a PowerPoint file with my districts scatter plots in comparison to my IU region and the state as in previous years? A: Yes! For SY11-12 all comparative scatter plot files will be distributed by mid-to-late November to IUs to disseminate to LEAs. Decisions for future years will be based upon feedback from focus groups during the school year Q: Who can access the new web-based scatter plots? A: These will be included on the LEA PVAAS protected site and the PVAAS public site; The data reported will be different on each site

Common Questions Q: Will web-based scatter plots be available on the Public PVAAS reporting site? A: Yes - however, the public site will only include data that is required via legislation; currently legislation does not require the reporting of grade level data Q: Will other districts/schools/public be able to see my districts gain and achievement levels? A: PA legislation determines what data is public reported. Since the reporting of grade level data is not required by legislation, LEAs will only see the grade level data for their respective LEA.

REDESIGN OF SCHOOL SEARCH FEATURE

Accessing School Search PVAAS School Search is accessed the same way it always has been – via links at the top of the page or using the orange Reports tab

Predictive Text to Assist in Locating Schools Example: the user enters the word Pink and school names containing the word Pink appear as options to select.

School Search Results

Finding Similar Schools

Demonstration User Name: PVAAS.Training Password: PVAAS2011

PRE-DEFINED PACKETS

Whats new? Comprehensive Planning Packet – Previously named District Improvement/eStrategic Planner) School Improvement Data Packet – Previously named School Improvement: Getting Results Data Packet) Grade Level Planning Reports Packet

Comprehensive Planning Packet This packet includes the following reports for mathematics and reading for grades 4-8 and 9-11: – District Value-Added Report – Value-Added Summary Report – District Performance Diagnostic Reports – Performance Diagnostic Summary Reports Users have the option to select subgroups to be included in this report.

Grade Level Planning Reports Packet This packet includes the following reports for mathematics and reading for grades 4-8 and 9-11: School Performance Diagnostic Reports For designated grade level(s) only School (Single Grade) Projection Summary Reports For designated grade level(s) only Currently Enrolled or Last Tested One- and Two-Year Projections if applicable

QUESTIONS ON NEW PVAAS FEATURES AND ENHANCEMENTS?

Communication: Local IU Meetings Fall Meetings – Who: Superintendents/Curriculum/Principals/Content Leaders What Might be Shared: – NEW Features: One Page Handout for Participants New Legends/Color Code Web-based Scatterplots – Suggest LIVE demo of web-based scatterplots – NEW Features PPT for your use during update sessions – PVAAS PD Booklet: Give to participants

Reminder! Opportunities this fall! Agendaman, PDE website, PVAAS login page: SY11-12 PVAAS PD Booklet

Webinar Topics Introduction to PVAAS/PVAAS Overview PVAAS 2011 Release: New Features Open Q&A/Office Hours PVAAS Public Site Tour Effectively Communicate PVAAS with your Board and Community High Growth, Achieving Schools: Is it Possible?

Using Multiple Data Sources to Identify Students at Risk of Not Reaching Proficiency Using Multiple Data Sources to Ensure High- Achieving Students Stay on the Path of High Performance Growth and High-Achieving Students Meeting the Needs of Low-Performing Students Webinar Topics

Meeting the Needs of Subgroups Using PVAAS Data for Resource Allocation Planning Using PVAAS Data As Part of Scheduling Students PVAAS and PA Data Tools: Resources for Higher Ed

Access a Recorded PVAAS Webinar To access an archived version of a webinar, go to Click on Recordings in the upper left. Using the calendar in the upper right corner of your screen, click on the day the webinar was originally held. Click on the link that displays the title of the session. Enter your address in the space provided and your first and last name as your Display Name. Click Play on the lower right portion of the screen.

Podcasts

PDE PVAAS Website

Questions?