PVAAS Train-the-Trainer Webinar for IU & PaTTAN Staff: Preparing for Fall 2014 PVAAS Training Sessions September 23, 2014  1:00 p.m. Thanks for joining us today! Our session will begin promptly at 1:00 p.m.

PVAAS Statewide Team for PDE Joan Perekupka Jennifer Ross 2

 Tools available along the bottom of your window ◦ Click here to open the Message pane. Enter your questions here! ◦ Click here to mute/unmute yourself. (Remember to mute yourself when you’re not speaking.) (The red line through the microphone indicates you are muted.)

◦ To adjust your speaker volume, hover over the phone button. This will display the “Devices” window, with a sliding volume bar for your device: 4 Hover

◦ Clicking this button will open the Participants panel, displaying who is participating in today’s session. ◦ Click the button at the bottom right to toggle your webinar layout (view): (We would suggest using the Presentation view, but you’re welcome to see which you prefer.)

 Session Logistics & Registration  Review of Session Content ◦ October “Ready, Set, Grow” Sessions (for Administrator Teams) ◦ November/December “Professional Development: Growth not Gotcha” Sessions (for Teachers and Administrators) ◦ Changes from August Building Capacity  Session Roles  Essential Knowledge & Understanding for Supporting Sessions  PVAAS Reporting Release & Accounts ◦ Release dates ◦ IU accounts ◦ Demo accounts 6

Night of October 23 – Teacher Specific Reporting released to District Admins & School Admins ONLY Night of October 30 – Teacher Specific Reporting released to teachers Reports available in: Math Reading Science Keystones

Session Logistics & Registration 8

 October Sessions ONLY! ◦ 8:30am-9:00am  Registration for session ◦ 9:00am-3:00pm  Session  What is the plan for lunch at your IU?  Might want to include in your reminder about session  November/December Sessions ONLY! ◦ 8:00am-8:30am  Registration for AM session ONLY ◦ 8:30am-11:30am  AM session ◦ 12:00pm-12:30pm  Registration for PM session ONLY ◦ 12:30pm-3:30pm  PM session ◦ Lunch Arrangements: provide a list of local options for facilitators/order in AM if possible (we will pay when on-site) 9

 Presentation PowerPoint ◦ Participants can bring this with them as paper or electronic copy! ◦ Will be available on PVAAS login page ◦ Will NOT be bringing any paper copies  Supplemental Handout ◦ PVAAS Statewide Team will be providing paper copies!  Scenario Responses & Take-Aways ◦ For October sessions ONLY ◦ PVAAS Statewide Team will be providing paper copies! 10

 Will be available on PVAAS login page ◦ Available night of September 25  Direct participants to download PPT prior to session! ◦ On Moodle, WikiSpace, IU webpage, etc.  Participants should bring printed or electronic copy to session This is similar to last year! 11

 Advertise and communicate information about sessions to LEAs  Time frame  Participants need to bring a computer and PVAAS login information  Participation in October session – Admin teams will get an opportunity to have a virtual “follow up” meeting (up to one hour) with a PVAAS Statewide Core Team member at a later date 12

 Manage registration ◦ For October sessions ONLY – Do you have a waiting list for LEAs wanting to send more than 4 admins? ◦ What is your plan for those on the waiting list?  Multiple sessions ◦ IUs with two October dates ◦ ALL November/December sessions ◦ Want to fill sessions  Do not want 50 in one session & 5 in another!  Act 45 & 48 (if IU chose to provide credits) 13

 Following this webinar do a check on registration numbers to date ◦ Do you have any sessions with less than 10 participants registered? ◦ Do you have a waiting list? ◦ Do you need to do any additional communications? ◦ Do you need to us to help send out a communication to certain account holders?  Keep an eye on registration in case any sessions need to be cancelled and some participants need to be contacted to change sessions 14

 Send reminder to all participants registered ◦ Date and time of the session ◦ Direct participants to download session PPT from PVAAS login page (available night of Sept 25)  Participants should bring printed or electronic copy to session ◦ Bring a laptop!  Ideal is 1 per person given confidentiality of data  iPads and Tablets can be used ◦ Ensure all participants have their own unique PVAAS username, PVAAS password, and PPID  Suggest they try logging in prior to session  Contact their PVAAS District or School Admin if do not have an account  Can use “Forgot Username/Password” link on PVAAS login page 15

 Room Set-Up  Projector, microphone, and wireless internet access  Provide computer for facilitator, if possible  Table Arrangement  TOT Sessions – Tables  Teacher Sessions – Tables or classroom style will work, depending on room space  Technology Support  Arrange for technology staff to assist facilitator and participants in logging onto IU network for internet access 16

 Electronic file of participants and addresses ◦ Goal is to send follow-up survey week following the session ◦ ◦ Or, mail hard copies to Lancaster-Lebanon IU 13 Attn: PVAAS, 1020 New Holland Avenue, Lancaster, PA  Copies of all sign-in sheets & evaluation forms (if using Act 45/48 evaluations) ◦ Will take with us at end of session 17

18

Review of Session Content 19

20

1.Introduction 2.Administrator Reports 3.What is PVAAS? Why is it important? 4.Teacher Specific Reports a)Value Added b)Diagnostic 5.Planning for Today 6.Developing Plan to Train, Support, and Communicate with Staff 7.Resources and Support 8.Next Steps ** - Responding to Teachers’ Questions throughout session 21

 Scenarios ◦ Immediate “report out” of responses ◦ Documentation of “report out” for each scenario ◦ Removed 2 scenarios – now a total of 9 ◦ Slight rewording of several scenarios  Adjustments for October Admin sessions ◦ Admin reports – earlier in session ◦ Shortened sections on Custom Diagnostic Reports & Bridging Reports ◦ Expanded section on Developing a Plan to Train, Support, and Communicate with Teachers Session “Tweaks” since August Building Capacity Session 22

 Encourage district teams to PROVIDE training for their staff ◦ Note successes, questions, concerns, struggles  AFTER training, schedule follow-up conference call/webinar between the District Admin Team participating in session and PVAAS Statewide Team member ◦ Chance to ask questions and concepts which need further clarification ◦ ONE HOUR per LEA/District ◦ First-come, first-serve ◦ Based on availability of PVAAS Statewide Team members ◦ – from LEA/District ◦ At fall session, will be asking District Admin team to provide us with District Contact Name/ /Phone Next Steps for District Admin Teams 23

 Download (for YOUR use ONLY!) ◦ PPT ◦ Supplemental Handout ◦ Take-Away Scenarios & Responses ◦ Pay close attention to ALL activities and discussion questions  Available via Dropbox ◦ Questions? To Prepare for Sessions 24

 Participate in or view: ◦ Teacher-Specific Reporting webinar  Sept 9 1:00-2:00pm (recorded)  Sept 24 9:00-10:00am ◦ Teacher-Specific Reporting Virtual Learning Modules  Teachers (45 minutes)  Admins (15 minutes) ◦ Other VLMs?  Concept of Growth  High Achievement & Growth 25

 Review Building Capacity session materials from August ◦ Where did you have questions in that session? ◦ Are you prepared to discuss the take-away responses provided to the scenarios?  Connection to A Framework for Teaching! ◦ Your background (curriculum, instruction, TAC, special education) can assist participants in the self-reflection questions related to PVAAS Teacher-Specific reporting 26

27

Session Roles 28

 Lead Facilitator(s) ◦ Jennifer Ross ◦ Joan Perekupka ◦ Cindy Goldsworthy  Session & Participant Support ◦ IU PVAAS Teams ◦ Jim Bohan & John Dellegrotto 29

 Engage Participants!  Check for Understanding! 30

 Scenarios are a strategy to support administrators in answering teachers’ questions ◦ What is the teacher REALLY asking? ◦ Do you know how YOU might respond? ◦ Do you know resources, materials, and evidence related to the question? ◦ How does your belief system impact this support? 31

 Be prepared to help participants navigate AND interpret reports  Effectively support participants by asking questions: ◦ How would YOU interpret this report? ◦ What reflection questions might you ask based on this report? 32

 Assisting participants in creating self- reflection questions of the PVAAS reports related back 22 components of professional practices in A Framework for Teaching  LEAs are struggling to make connections. We need to make connections for them! ◦ Make sure all IU staff working on various parts of the EE system make connections to the other parts 33

34

Essential Knowledge & Understanding for Supporting Sessions 35

Understanding KEY District and School reporting…AND the Concept of Growth…is KEY for educators in understanding Teacher- Specific reporting! 36

 Predictive methodology is used to estimate growth in Keystone content areas.  This is same methodology used to measure growth in Science and Writing, and even grade 11 assessments in prior years.  Students taking the Keystone exams have prior history of PSSA data. 37

 PVAAS uses all of that prior data to calculate predicted scores for the student group.  Growth is a function of the difference between the average predicted score of the student group and the average actual score of the student group.  This methodology can be used and produces reliable results because high correlations exist between the PSSA and Keystone scores across subjects, and because there is a strong relationship among scores across grade levels in single subject area. 38

 To illustrate using data: ◦ the average multiple correlation obtained when predicting PSSA Math using all prior test scores ranges from 0.82 to 0.87; ◦ the average multiple correlation obtained when predicting PSSA Reading using all prior test scores ranges from 0.79 to 0.85; ◦ the average multiple correlation obtained when predicting PSSA Science using all prior test scores ranges from 0.78 to 0.81; and ◦ the predicted scores of Keystone using PSSA prior test scores has a multiple correlation ranging from 0.77 to

Distribution of Grade 5 Scores 2015 Distribution of Grade 6 Scores 2016 Distribution of Grade 7 Scores Is the group of students (indicated by the yellow star) at the same RELATIVE position in the distribution of statewide scores? THIS IS AN EXAMPLE ONLY!

41 To actually be included in PVAAS Teacher Specific reporting, a student MUST: Have a PSSA or Keystone score from the most recent year NOT be a foreign exchange student NOT be a first-year ELL student NOT be Proficient or Advanced on a PRIOR Keystone exam NOT be claimed at less than 10% instructional responsibility NOT have tested with the PASA (alternate assessment)

PA Data Group of Students Students’ Prior Data Across Grades & Subjects Estimated Prior (or Entering) Achievement of the Group of Students Measuring Growth: Students’ Starting Point 42

Prior (or Entering) Achievement of the Group of Students Higher Achievement Lower Achievement Higher Achievement Lower Achievement Current Achievement of the Group of Students Concept of Measuring Growth In District & School Reporting, students are weighted equally. For Teacher Specific Reporting, students are weighted by taking into account the % Total Instructional Responsibility for each student. 43

 Students taking the Keystone exam in BOTH the winter and spring testing windows are included in the Value-Added reports if they are enrolled in the Keystone-related course AND took the Keystone exam at the end of the course that same school year.  Students taking the Keystone exam in the summer testing window, however, are NOT included in value-added reporting ◦ Only exception is year-round schools; currently, only one in PA. 44

PVAAS Accounts 45

46  September 19 – District Admins ONLY  September 24 – ALL PVAAS account holders  October 23 (night) – Teacher Specific Reporting to District/School Admins only  October 30 (night) – Teacher Specific Reporting to Teachers

47 As an IU account holder, you will have access to reporting on September 24 when reporting released to all account holders. If an LEA has questions about their reporting prior to September 24, please direct them to contact us at

New Accounts as of Sept 26!! PRACTICE, PRACTICE, PRACTICE! 48

49

 Does each person at your IU (who are involved with PVAAS sessions this fall) have appropriate PVAAS account access PRIOR to fall sessions?  Need changes to accounts? Need new accounts? ◦ Contact our team: with the user’s name, role, and ◦ Must cc: IU Executive Director 50

51

Questions? Feedback? Other? any thoughts before OR after fall sessions! 52

53