1. Beginning – Intermediate – Advanced Friday, September 14, 2012 EVAAS for Educators

2. Today’s Presenters Gregory McKnight Professional Development Consultant Region 3 gregory.mcknight@dpi.nc.gov Adriane Mingo Professional Development Consultant Region 6 adriane.mingo@dpi.nc.gov Jessica Garner Professional Development Consultant Region 6 jessica.garner@dpi.nc.gov

3. Our Agenda Welcome, Introductions, Agenda Overview Resources Pre-Assessment EVAAS and Data System Overview Reflective Assessments Student Pattern Reports Exit Ticket 3

4. Outcomes: Be familiar with reflective assessments Be familiar with student pattern reports Understand the various EVAAS reports Be able to create custom reports based on a set of criteria

5. Can We Agree? To be actively involved Value differences Agree to disagree Listen

6. Resources

7. Additional Resources: EVAAS Wiki Page Here

8. Virtual Professional Development https://ncdpi.sas.com

9. Data Literacy Module https://center.ncsu.edu/nc Data Resource Guide http://www.ncpublicschools.org/acre/improvement/resources/

10. Pre-Assessment

11. What do you know about EVAAS? Tell us what you know using PollEverywhere

12. Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Poll: I am very familiar with the Education Va...

13. Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Poll: I know how to login to the EVAAS website...

14. Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Poll: I know how to navigate the EVAAS website...

15. Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Poll: I understand EVAAS report names.

16. Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Poll: I know how to use the EVAAS website to g...

17. Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Poll: I know how to access EVAAS reports for i...

18. Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Poll: I am able to analyze the metrics in EVAA...

19. Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Poll: I know how to collect evidence from EVAA...

20. Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Poll: I know how to collect evidence from EVAA...

21. Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Poll: I know how to interpret the following re...

22. Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Poll: I am able to communicate the findings of...

23. Don’t forget: You can copy- paste this slide into other presentations, and move or resize the poll. Poll: I am able to use data analysis to initia...

24. It’s Connected

25. What is EVAAS? Education E Value V Added A Assessment A System S So What Does It Do?

26. What is Data? Data can be defined as information organized for analysis or used to make decisions.

27. What is Data Literacy? Understanding needed to: Find Evaluate Utilize to inform instruction.

28. A Data Literate Person Can… A data literate person possesses the knowledge to gather, analyze, and graphically convey information to support short and long-term decision-making.

29. NC Professional Teaching Standards Standard I: Teachers demonstrate leadership.  Take responsibility for the progress of all students  Use data to organize, plan, and set goals  Use a variety of assessment data throughout the year to evaluate progress  Analyze data Standard IV: Teachers facilitate learning for their students.  Use data for short and long range planning Standard V: Teachers are reflective on their practice.  Collect and analyze student performance data to improve effectiveness

30. Standard 6 for Teachers Teachers contribute to the academic success of students. The work of the teacher results in acceptable, measurable progress for students based on established performance expectations using appropriate data to demonstrate growth.

31. Benefits and Considerations for Teachers Understand academic preparedness of students before they enter the classroom. Monitor student progress, ensuring growth opportunities for all students. Modify curriculum, student support, and instructional strategies to address the needs of all students. Professional Development is the Key Culture of School Sensitivity of Data Finger Pointing and Blame Game Window vs. Mirror

32. NC Standards for School Executives Standard 2: Instructional Leadership Focuses his or her own and others’ attention persistently and publicly on learning and teaching by initiating and guiding conversations about instruction and student learning that are oriented towards high expectations and concrete goals; Creates processes for collecting and using student test data and other formative data from other sources for the improvement of instruction Ensures that there is an appropriate and logical alignment between the curriculum of the school and the state’s accountability program Creates processes for collecting and using student test data and other formative data from other sources for the improvement of instruction

33. Standard 8 for School Executives Academic Achievement Leadership School executives will contribute to the academic success of students. The work of the school executive will result in acceptable, measurable progress for students based on established performance expectations using appropriate data to demonstrate growth.

34. Benefits for Principals Gain a consolidated view of student progress and teacher effectiveness, as well as the impact of instruction and performance. Bring clarity to strategic planning and function as a catalyst for conversations that must take place to ensure that all students reach their potential. Understand and leverage the strengths of effective teachers. Use the valuable resource of effective teaching to benefit as many students as possible.

35. ACHIEVEMENT VS. GROWTH

36. Student Achievement End of School Year Proficient

37. Student Growth End of School Year Proficient Start of School Year Not Proficient Change over time

38. Achievement vs. Growth Student Achievement: Where are we? Highly correlated with demographic factors Student Growth: How far have we come? Highly dependent on what happens as a result of schooling rather than on demographic factors

39. The EVAAS Philosophy All students deserve opportunities to make appropriate academic progress every year. There is no “one size fits all” way of educating students who enter a class at different levels of academic achievement.

40. The EVAAS Philosophy Adjustments to instruction should be based on the students’ academic needs, not on socio-economic factors. "What teachers know and can do is the most important influence on what students learn." (National Commission on Teaching and America's Future, 1996)

41. Achievement and Poverty How is this fair?

42. Academic Growth and Poverty No one is doomed to failure.

43. Elementary Math – High Poverty

44. Elementary Math – Low Poverty

45. Middle School Math–High Poverty

46. Middle School Math–Low Poverty

47. High School Math – High Poverty

48. High School Math – Low Poverty

49. Proficiency vs Growth ScenarioProficientGrowth 5 th grader begins the year reading at a 1 st grade level. Ends the year reading at a 4 th grade level. 5 th grader begins the year reading at a 7 th grade level. Ends the year reading at the 7 th grade level. NO YES

50. EVAAS Overview

52. What is EVAAS? Education E Value V Added A Assessment A System S So What Does It Do?

53. What is EVAAS? SAS EVAAS Analyses WritingACT End of Course End of Grade LOOKING AHEAD Planning for Students’ Needs: Student Projections to Future Tests LOOKING BACK Evaluating Schooling Effectiveness: Value Added & Diagnostic Reports

54. How can EVAAS help me? Improve the Education Program EVAAS: Looking Back Past Program Effectiveness Local Knowledge & Expertise EVAAS: Looking Ahead Incoming Student Needs

55. Education Value Added Assessment System –Answers the question of how effective a schooling experience is –Produces reports that Predict student success Show the effects of schooling at particular schools Reveal patterns in subgroup performance

56. Changes in Reporting for 2012-13 2011-122012-13 Above Not Detectably Different Below Exceeds Expected Growth Meets Expected Growth Does Not Meet Expected Growth

57. District Value Added Report Use to evaluate the overall effectiveness of a district on student progress Compares each district to the average district in the state for each subject tested in the given year Indicates how a district influences student progress in the tested subjects

58. Value-Added Reporting

60. The NCE Base is by definition set at 50.0, and it represents the average attainment level of students in the grade and subject, statewide. If the school mean is greater, the average student in the school is performing at a higher achievement level than the average student in the state.

61. District Diagnostic Reports Use to identify patterns or trends of progress among students expected to score at different achievement levels

62. Diagnostic Report

63. District Performance Diagnostic Reports Use to identify patterns or trends or progress among students predicted to score at different performance levels as determined by their scores on NC tests Students assigned to Projected Performance Levels based on their predicted scores Shows the number (Nr) and percentage of students in the district that fall into each Projected Performance Level

64. District Performance Diagnostic Reports

65. Interpreting the Pie Chart Light Red Green Yellow

66. BREAK Return in 15 minutes. 66

67. Reflective Assessments

68. Value-Added Reports

69. Diagnostic Reports Looking for Patterns

70. School Diagnostic Shed Pattern

71. School Diagnostic Reverse Shed Pattern

72. School Diagnostic Tent Pattern

73. School Diagnostic V Pattern

74. School Diagnostic Opportunity Gap Pattern

75. What would an ideal pattern on a Diagnostic Report look like for closing the achievement gap?

76. Diagnostic Reports – Desirable Pattern

77. Diagnostic Report Desirable Pattern

78. DIAGNOSTIC & PERFORMANCE DIAGNOSTIC REPORTS (PART 2)

79. Diagnostic Reports – the whiskers

80. Overview of School Effects (sample data)

86. 1. Go to the website www.ncdpi.sas.com

87. 1. Go to the website ncdpi.sas.com

88. 1. Go to ncdpi.sas.com 2. BOOKMARK IT! 3. Secure & Convenient Online Login

89. Do you see this? Then Sit Tight!

90. Overview of School Effects It’s Your Turn! Find the blank table. Do this by yourself. Using sample data Fill in your table.

91. Overview of School Effects What did you find? Interesting Patterns Insights Areas of Concern Areas of Celebration

92. Lunch

93. 1. Go to the website ncdpi.sas.com

94. Finding Your Patterns

95. Interpreting Your Results

96. Student Pattern Report

97. Student Patterns Report Key points to remember: The report shows growth for the lowest, middle, and highest achieving students within the chosen group. The report can be used to explore the progress of students with similar educational opportunities. Like all diagnostic reports, this report is for diagnostic purposes only. A minimum of 15 students is needed to create a Student Pattern Report.

98. Student Pattern Report

100. Key Questions

101. Student Pattern Report – Key Questions Different experience? Different strategies? Different needs? Number of hours?

102. Student Pattern Report – Key Questions Different experience? Different strategies? Different needs? Number of hours? Rerun the report with new criteria. YES!

103. Student Pattern Report – Next Steps 16 Students who attended for 40+ hours All 31 Students in the Program

104. Less Informed Conclusion: We need to change the selection criteria for this program. More Informed Conclusion: We need to adjust the recommended hours for participants.

105. Proactive Assessments

106. Academic At-Risk Reports Reports –Academic At-Risk Report

107. Academic At-Risk Reports 3 Categories AYP at Risk- at risk for not meeting the academic indicators for AYP Graduation at Risk-reports for students at risk for not making a Level III on EOC subjects required for graduation Other at Risk-reports for students at risk for not making Level III on other EOC subjects

108. Academic at Risk Reports Be Proactive Use these reports to determine local policy for providing targeted intervention and support to students who are at risk for not meeting future academic milestones. 108

109. Making Data Driven Decisions

110. What Are Projections?

111. What Are Projections Anyway? Given a specific set of circumstances… …what’s the most likely outcome?

112. What Are Projections Anyway? Given this student’s testing history, across subjects… …what is the student likely to score on an upcoming test, assuming the student has the average schooling experience?

113. EVAAS Projections What are they based on? Expectations based on what we know »About this student and other students who have already taken this test »Prior test scores (EOC/EOG), across subjects »Their scores on the test we’re projecting to

114. What’s the Value of the Projections? Projections are NOT about predicting the future. They ARE about assessing students’ academic needs TODAY.

115. Assessing Students’ Needs What are this student’s chances for success? What goals should we have for this student this year? What goals should we have for this student in future years? What can I do to help this student get there?

116. Using Projections to Take Action Identify students Assess the level of risk Plan schedules Identify high-achievers Assess the opportunities Inform

117. Making Data Driven Decisions

118. Data Mining

119. REFLECTION + PROJECTION = TODAY

120. Student Project Report

123. Thinking of the State Distribution by QUINTILES QUINTILE 1 QUINTILE 2 QUINTILE 3 QUINTILE 4 QUINTILE 5

124. Note the Student’s Projected QUINTILE QUINTILE 2

125. Past Effectiveness Reflecting on Past Effectiveness to Plan for Differentiating Student Instruction Entering Achievement

126. Past Effectiveness Reflecting on Past Effectiveness to Plan for Differentiating Student Instruction QUINTILE 2 Entering Achievement

127. ACADEMIC PREPAREDNESS REPORT

128. Academic Preparedness Report 128

129. CUSTOM STUDENT REPORT

130. Custom Student Report HANDOUT

131. Exit Tickets http://go.ncsu.edu/ncdpi-resa_survey

132. Thank You! Presenter 2 Professional Development Consultant Region ? email@dpi.nc.gov Presenter 3 Professional Development Consultant Region ? email@dpi.nc.gov Presenter 1 Professional Development Consultant Region ? email@dpi.nc.gov Presenter 4 Professional Development Consultant Region ? email@dpi.nc.gov