1. Using PVAAS for Gifted Learners Tanya Morret

2. How effectively is our system meeting the needs of our advanced learners? Are we projected to grow our advanced learners? How can we use PVAAS to inform the decisions we make regarding Chapter 16? Learning Outcomes

3. Background Knowledge How many have been to a training in past years on PVAAS?How many have been to a training in past years on PVAAS? How many have been trained at their IU on PVAAS this year?How many have been trained at their IU on PVAAS this year? How many have had access to PVAAS prior to this school year?How many have had access to PVAAS prior to this school year? How many have first time access to PVAAS?How many have first time access to PVAAS?

4. What is PVAAS? Value-added tool that reports growth of cohorts of students and projections for individual students for performance on future PSSAs Value-added tool that reports growth of cohorts of students and projections for individual students for performance on future PSSAs

5. Why use PVAAS? Monitors annual progress of all studentsMonitors annual progress of all students Measures impact of our systemMeasures impact of our system Allows for data based decision making at many levelsAllows for data based decision making at many levels Tells you the what, not the whyTells you the what, not the why Inspires questions, provides few answersInspires questions, provides few answers Offers opportunities to replicate success/avoid failureOffers opportunities to replicate success/avoid failure

6. The PVAAS Methodologies Today Looking Back/Evaluation… Value-added Growth Reports For Cohorts of Students Looking Forward/Planning… PVAAS Projection Reports For Individual Students and Cohorts of Students

7. What it tells us… Growth (Progress)Growth (Progress) –District –Building –Grade –Quintile –Sub Group

8. The PVAAS Methodologies Today Looking Back/Evaluation… Value-added Growth Reports For Cohorts of Students Looking Forward/Planning… PVAAS Projection Reports For Individual Students and Cohorts of Students

9. What it tells us… ProjectionProjection –Is each individual student on a trajectory to reach proficient or advanced levels on a future PSSA reading, math, science, and writing assessment? Is this child likely to achieve advanced?

10. Public Reporting ScatterplotsScatterplots –District –Building –Grade Bands/ Subjects

11. Losing Learning Leading Lucky

13. GrowthGrowth –District –Building –Grade –Teacher (eventually) –Sub-Groups –Performance Levels –Quintiles –Custom Groups Secured Access

14. How do districts and schools define high achievement? % Proficient & Advanced Advanced Proficient Basic Below Basic Below Basic ↑↑↑ Advanced Proficient Basic Below Basic Below Basic ↑↑↑ Advanced Proficient Basic Below Basic Below Basic % Advanced Average Achievement Level

15. Student Scores

16. Advanced Performance Level 1472 2548 ADVANCED 7 th Grade Math

17. Advanced Level Neon Yellow Middle School

18. Advanced Level Apricot Middle School

19. Advanced Level Neon Yellow Middle School Apricot Middle School

20. How many students score at the top score each year?

21. How many students are assessed annually? Approximately 875,000

22. How many students score at the top scale score? <3500 Score at the Highest Level 2012 PSSA Technical Report

23. How many students score at the top scale score two years in a row? Math <100 Reading <10

24. Calculation that compares current grade distribution from 2006 to its former position in the previous grade’s distribution of scores from 2006Calculation that compares current grade distribution from 2006 to its former position in the previous grade’s distribution of scores from 2006 Performance of other cohorts does not impact the growth of this cohortPerformance of other cohorts does not impact the growth of this cohort What is growth?

25. PA Standard for Academic Growth ↑ Year’s Growth  standard for PA Academic Growth ↓

26. Value-Added Report (Growth)

28. Fall 2012PVAAS Statewide Team for PDE Value-Added Report (Growth)

29. Performance Diagnostic (Growth) Fall 2012PVAAS Statewide Team for PDE

30. Quintile Diagnostic Report The state distribution is divided into 5 equal groups (quintile groups)The state distribution is divided into 5 equal groups (quintile groups) –Students are placed into groups based on where they fall, achievement-wise, in the state distribution of students in the same grade and subject –Where do your gifted students profile? Fall 2012PVAAS Statewide Team for PDE

31. Student Assignment to Groups – Quintile Diagnostic Fall 2012PVAAS Statewide Team for PDE

32. Student Assignment to Groups – Quintile Diagnostic Fall 2012PVAAS Statewide Team for PDE

33. Student Assignment to Groups – Quintile Diagnostic vs. Performance Diagnostic Broad range of achievement! Student achievement and growth can look different at the opposite ends of this range. Fall 2012PVAAS Statewide Team for PDE

34. Performance Diagnostic vs. Quintile Diagnostic – All Grades/Subjects Fall 2012PVAAS Statewide Team for PDE

35. Using the Performance Diagnostic vs. the Quintile Diagnostic If you want to view the growth of students in the Advanced range (or at higher achievement levels), use the Quintile Diagnostic.If you want to view the growth of students in the Advanced range (or at higher achievement levels), use the Quintile Diagnostic. If you want to view the growth of students at the lower end of the achievement spectrum, use the Performance Diagnostic.If you want to view the growth of students at the lower end of the achievement spectrum, use the Performance Diagnostic. Fall 2012PVAAS Statewide Team for PDE

36. Describe the three reports (Value-Added, Performance Diagnostic, Quintile Diagnostic) used to identify growth.Describe the three reports (Value-Added, Performance Diagnostic, Quintile Diagnostic) used to identify growth. –How are they similar? –How are they different? Turn to a partner

37. Projected State Percentile –Based on the student’s prior test scores across grades and subjects –Growth measure of the school –Testing history of similar students who have already taken this test Projection Reports (Looking Ahead)

38. Achievement Probability of scoring in a particular Performance Level…Achievement Probability of scoring in a particular Performance Level… Projection Reports (Looking Ahead)

39. PVAAS and Chapter 16 How can we use the data from PVAAS as one piece of data to inform the decisions we make in screening, identification, and educational placement?How can we use the data from PVAAS as one piece of data to inform the decisions we make in screening, identification, and educational placement?

40. Screening Use it in your child find process…Use it in your child find process… In addition to scale scores, benchmark assessments, or common assessments, let’s look at the PVAAS projectionsIn addition to scale scores, benchmark assessments, or common assessments, let’s look at the PVAAS projections

41. Let’s try an experiment What percentile would you consider a cut-off point for screening students?What percentile would you consider a cut-off point for screening students? 70 th ? 80 th ? 90th?”70 th ? 80 th ? 90th?” Before you answer, let’s reference the Fordham Report.Before you answer, let’s reference the Fordham Report.

42. Fordham University, 2011 Study 2000-2007

43. Student Projection Report Quintile Diagnostic Groups

44. Using Past Effectiveness to Inform Current Needs Advanced Student Past Effectiveness Entering Achievement Quintile Group 4

45. Using Past Effectiveness to Inform Current Needs Advanced Student Entering Achievement Quintile Group 4 Past Effectiveness

46. GIEP Planning Could we use this process for GIEP Planning?Could we use this process for GIEP Planning? How have students who are similar performed with or without specially designed instruction?How have students who are similar performed with or without specially designed instruction?

47. Let’s take a look at a 6th Grade Gifted Math Student who is currently accelerated in math by one year (Pre- Algebra).Let’s take a look at a 6th Grade Gifted Math Student who is currently accelerated in math by one year (Pre- Algebra). How can we do this? http://www.nccsc.k12.in.us/index.php/schoolstop/elementarytop/westwoodmoodletop.html

48. Present Levels show current accelerated year was successful.Present Levels show current accelerated year was successful. Classroom Diagnostic tool shows he is working above grade level in most standards – beyond 7 th grade in some cases.Classroom Diagnostic tool shows he is working above grade level in most standards – beyond 7 th grade in some cases. The plan for 7 th grade is to accelerate him one year in math. Will that help him meet the growth standard in math?The plan for 7 th grade is to accelerate him one year in math. Will that help him meet the growth standard in math? GIEP Planning

49. Student History Report for Math

50. District Value Added for Math

51. Performance Diagnostic 7 th Grade Math

52. Student Projection Report

53. Quintile Diagnostic Report – 7 th Grade Math

55. Custom Quintile Diagnostic Report – 7 th Grade - 90 th Percentile and Above

56. What next for the GIEP Planning Process? Based on past performance of students who were like our sixth grader (high ability in math, accelerated one year) it appears that at the end of seventh grade there was significant evidence of positive growth.Based on past performance of students who were like our sixth grader (high ability in math, accelerated one year) it appears that at the end of seventh grade there was significant evidence of positive growth. However, critical/important decisions like this should not be made based on one data point!However, critical/important decisions like this should not be made based on one data point! –Classroom Performance –Classroom Diagnostic Tool –Other factors impacting achievement

57. How will this piece of data inform the decision making process to assure that the plans written for a student are individualized to his/her need?How will this piece of data inform the decision making process to assure that the plans written for a student are individualized to his/her need? What concerns/questions might you have about this process?What concerns/questions might you have about this process? Reflection

58. How can we streamline this process? Connecting Student Growth/Projections to System PerformanceConnecting Student Growth/Projections to System Performance  Look at whole sub-group at one time  Determine system potential impact

59. How can we streamline this process? Overview of Growth TableOverview of Growth Table  Look at the system as a whole  Determine effectiveness of the system by grade level/subject area for whole groups and all subgroups

60. Overview of Growth Table: The Process Fall 2012PVAAS Statewide Team for PDE

61. Subject vs. GradeSubject vs. Grade Patterns

62. Patterns by Subject?

63. Patterns – by Grade

64. Step-by-Step Process Create a data packet using the Data Packet feature in PVAAS Complete an Overview of Growth Table for your school or district Fall 2012PVAAS Statewide Team for PDE

65. Things to Consider for Packet Creation School serves grades 4-8?School serves grades 4-8? School serves grades 9-12?School serves grades 9-12? — May want to include additional subgroups when creating your data packet Single grade schools (exception 9-12 schools)?Single grade schools (exception 9-12 schools)? –How many of you are in schools serving only one grade level? Schools that are “new” in SY11-12?Schools that are “new” in SY11-12? –Meaning you have NO historical data in e-Metric/PVAAS –May want to include additional subgroups when creating your data packet Single building per grade districts?Single building per grade districts? –How many of you are in districts where there is only one school per grade? –May want to do all schools (grade levels) as one data packet (and create one Overview of Growth Table) Fall 2012PVAAS Statewide Team for PDE

66. Step 1: Creation of Data Packet Log in to PVAASLog in to PVAAS o https://pvaas.sas.com https://pvaas.sas.com o PVAAS Username and Password Excel Template – Select up to 3 subgroupsExcel Template – Select up to 3 subgroups –GIEP –GIEP Male –GIEP Female Fall 2012PVAAS Statewide Team for PDE

67. Creating Data Packets Districts optionDistricts option –District Overview of Growth Reports (Quintile Diagnostic Reporting) School OptionSchool Option –School Overview of Growth Reports (Quintile Diagnostic Reporting) Follow along as we model creating a packetFollow along as we model creating a packet Fall 2012PVAAS Statewide Team for PDE

68. Step 2: Excel Template Fall 2012PVAAS Statewide Team for PDE

69. Excel Template Multiple tabs on Excel spreadsheet All tabs are numbers Gold tabs – input data Blue tabs – output results Fall 2012PVAAS Statewide Team for PDE

70. Working alone or working in pairsWorking alone or working in pairs Step 3 : Getting Organized Fall 2012PVAAS Statewide Team for PDE

71. Step-by-Step Directions Key Cheat Sheet Quick Guide to Reports Resources to Use as You Create the Overview of Growth Table Fall 2012PVAAS Statewide Team for PDE

72. Patterns of Progress Serve as an indicator ofServe as an indicator of –Where programs are effectively growing students –Where programs are not effectively growing students Should be viewed through the context of the achievement goals of your schoolShould be viewed through the context of the achievement goals of your school

73. Guiding Questions for Patterns Is the pattern found in one grade level across multiple subjects?Is the pattern found in one grade level across multiple subjects? Is the pattern found consistent across multiple grade levels in the same subject area?Is the pattern found consistent across multiple grade levels in the same subject area? Is the pattern in the most recent year consistent with the pattern of previous years?Is the pattern in the most recent year consistent with the pattern of previous years? Is the patter consistent for key demographic sub- groups, compared to all students in the grade level?Is the patter consistent for key demographic sub- groups, compared to all students in the grade level?

74. Patterns – by Subject

75. Patterns – by Grade

76. Sub Groups - GIEP

77. How effectively is our system meeting the needs of our advanced learners? Are we projected to grow our advanced learners? How can we use PVAAS to inform the decisions we make regarding Chapter 16? Learning Outcomes

78. Combination of Current PSSA Score Percentiles and PVAAS Projections to a PercentileCombination of Current PSSA Score Percentiles and PVAAS Projections to a Percentile Projections one and two year’s outProjections one and two year’s out Unidentified students may need and are NOT receiving what they need instructionallyUnidentified students may need and are NOT receiving what they need instructionally PVAAS and Screening

79. Use past effectiveness to justify “meaningful benefit”Use past effectiveness to justify “meaningful benefit” Use Projection to Percentiles in Present Levels to proactively planUse Projection to Percentiles in Present Levels to proactively plan –Key – if you see the projected percentile take a dive – look at Past Effectiveness of previous cohorts who have received that planned instruction, don’t assume it is the student until you have analyzed your system Projections to keystone will start this year as low as 5 th grade – could indicate a need for accelerationProjections to keystone will start this year as low as 5 th grade – could indicate a need for acceleration GIEP Planning

80. Questions??

81. Questions? Tanya Morret – tmorret@caiu.orgTanya Morret – tmorret@caiu.orgtmorret@caiu.org Statewide PVAAS Team – pdepvass@iu13.orgStatewide PVAAS Team – pdepvass@iu13.orgpdepvass@iu13.org