Wake County Public School System Reading 3D Quintiles & Progress Planning February 23, 2017
Agenda Introductions & Today’s Purpose Wake County MOY Data Story Important Post-MOY reports Comparing Populations, Measure Breakdown & Effectiveness Current State: 2016-17 School Year What are Quintiles? Wake County Quintile Data Scatter plot and charts Progress Planning Tool – Introduction Goal Setting Activity Parting Thoughts Appendix
Agenda Introductions & Today’s Purpose Wake County MOY Data Story Important Post-MOY reports Comparing Populations, Measure Breakdown & Effectiveness Current State: 2016-17 School Year What are Quintiles? Wake County Quintile Data Scatter plot and charts Progress Planning Tool – Introduction Goal Setting Activity Parting Thoughts Appendix
How do we evaluate progress and set goals? How many of you have seen (or set) goals like this? All students will be at grade level by end of the year All grades will increase at least 10% in proficiency this year Every school will end the year with 80% of students at proficient Are these goals equally appropriate for all schools or across all grades? For schools that start with 55% of schools at proficient? For those that start with 70% at proficient? And for the few that begin with 80% already at proficient? Presenter: Scott Miller
Agenda Introductions & Today’s Purpose Wake County MOY Data Story Important Post-MOY reports Comparing Populations, Measure Breakdown & Effectiveness Report Focus: TRC Performance What are Quintiles? Wake County Quintile Data Scatter plot and charts Progress Planning Tool – Introduction Goal Setting Activity Parting Thoughts Appendix
Reporting & Analysis Suite: Key MOY Reports
TRC Performance 2016-17; by Grade
TRC Performance 2015-16; by Grade
Agenda Introductions & Today’s Purpose Wake County MOY Data Story Important Post-MOY reports Comparing Populations, Measure Breakdown & Effectiveness Current State: 2016-17 School Year What are Quintiles? Wake County Quintile Data Scatter plot and charts Progress Planning Tool – Introduction Goal Setting Activity Parting Thoughts Appendix
A Different Approach Our approach to evaluating growth and setting goals relies on the following principles: Goals should be attainable, measurable, and meaningful (as Dr. Good often says), and driven by a sense of urgency. Expectations should be relative to where a school begins. As a result, our approach does the following: Sets expectations according to the percent of students at Benchmark at the Beginning of the Year. Divides growth seen by schools into different bands of performance.
What are Quintiles? Bands of performance categorize progress from BOY to MOY (or EOY) for schools beginning at the same starting point. District or School Uses: Helps teachers help students reach grade level goals and exit high risk levels Planning/goal setting purposes for schools and/or teachers Progress Quintiles Measure: Prior year data across entire mCLASS user base If schools are making progress, relative to their peers Peers = schools starting with similar percentages of students at performance levels Progress Qunitiles Available: DIBELS Reaching Benchmark DIBELS Exiting Well Below Benchmark TRC Reaching Proficient/Above TRC Exiting Well Below Proficient
Understanding Bands of Performance Cut-points for the bands of performance are determined by the range of progress made by schools in each quintile (or 20% of schools). For example, Well Below Average is reflective of the 20% of schools making the least amount of progress. Progress Categories Range of Distribution Well Below Average Bottom Quintile (20%) Below Average 2nd Quintile (20%) Average 3rd Quintile (20%) Above Average 4th Quintile (20%) Well Above Average Top Quintile (20%)
DIBELS: All Grades (K-3) for % of Students at/above Proficient National mCLASS® Performance Ranges DIBELS: All Grades (K-3) for % of Students at/above Proficient Beginning of Year Well -below Average Progress Below Average Progress Average Progress Above Average Progress Well-above Average Progress 0 - 30% 0 - 32% 32 - 34% 34 - 38% 38 - 43% 43 - 100% 31 - 40% 0 - 37% 37 - 42% 42 - 46% 46 - 51% 51 - 100% 41 - 45% 0 - 44% 44 - 49% 49 - 53% 53 - 56% 56 - 100% 46 - 50% 0 - 48% 48 - 53% 56 - 61% 61 - 100% 51 - 55% 0 - 53% 53 - 58% 58 - 61% 61 - 66% 66 - 100% 56 - 60% 0 - 59% 59 - 63% 63 - 67% 67 - 71% 71 - 100% 61 - 70% 0 - 65% 65 - 69% 69 - 73% 73 - 76% 76 - 100% 71 - 80% 0 - 74% 74 - 77% 77 - 80% 80 - 83% 83 - 100% 81 - 90% 0 - 83% 83 - 86% 86 - 87% 87 - 90% 90 - 100% 91 - 100% 0 - 90% 90 - 93% 93 - 94% 94 - 96% 96 - 100% To find starting point: First, find the row in the first column corresponding to the percent of students scoring at proficient on the composite score at the beginning of year To analyze progress: Find column corresponding to the percent of students scoring at proficient on the composite score at the middle of year
Getting Oriented with Progress Quintiles: Progress Comparison for Proficient
North Central Schools 2016-17 BOY-MOY mCLASS:TRC % Reaching Proficient/Above
Example Quintile Table; NC K-3 Aggregate
Agenda Introductions & Today’s Purpose Wake County MOY Data Story Important Post-MOY reports Comparing Populations, Measure Breakdown & Effectiveness Current State: 2016-17 School Year What are Quintiles? Wake County Quintile Data Scatter plot and charts Progress Planning Tool – Introduction Goal Setting Activity Parting Thoughts Appendix
Wake County 2016-17 BOY-MOY mCLASS:TRC % Reaching Proficient/Above
Wake County TRC Quintile Table; K-3 Consider 21 Wake schools that began BOY in the same peer group: What changed at MOY for each school? What if the goal for EOY was 80% at benchmark? What can schools learn by collaborating together?
School Progress YTD 2016-17 BOY-MOY (# of Schools) Wake County 2016-17 BOY-MOY mCLASS:TRC Progress YTD Summary Progress Category School Progress YTD 2016-17 BOY-MOY (# of Schools) % Reaching Proficient % Far Below Proficient Well Above Average 37 24 Above Average 31 Average 26 25 Below Average 10 20 Well Below Average 1 11
Agenda Introductions & Today’s Purpose Wake County MOY Data Story Important Post-MOY reports Comparing Populations, Measure Breakdown & Effectiveness Current State: 2016-17 School Year What are Quintiles? Wake County Quintile Data Scatter plot and charts Progress Planning Tool – Introduction Goal Setting Activity Parting Thoughts Appendix
Progress Planning Tool: Evaluating Progress Step 1 establishes the progress level your district achieved by grade and aggregately for the prior school year. Drop-down to select grade band Use Comparing Populations report (for prior year, by grade) to complete the chart
Progress Planning Tool: Setting Goals Step 2 allows districts (or schools) to set a goal for each grade and aggregate. Based on prior year data and district’s current year BOY start MOY % and EOY % needed to meet goal will populate based on level selected Uses Comparing Populations report (for current year, by grade)
Agenda Introductions & Today’s Purpose Wake County MOY Data Story Important Post-MOY reports Comparing Populations, Measure Breakdown & Effectiveness Current State: 2016-17 School Year What are Quintiles? Wake County Quintile Data Scatter plot and charts Progress Planning Tool – Introduction Goal Setting Activity Parting Thoughts Appendix
Administrator Session: Using the Progress Planning Tool Log into www.mclasshome.com and click on Reporting: Run the Comparing Populations Report with the following criteria Segmented: by grade Population: K-3 Time: 2015-16 BOY&EOY; 2016-17 BOY&MOY Students Enrolled: On Test Day Measure: TRC Proficiency
Administrator Session: Completed Progress Planning Tool* * Results shown are for all Wake County Schools
Progress Planning Tool: Things to Consider Now that we have reviewed how to determine progress… Who on my team do I need involve? What are my next steps? What obstacles facing my staff may impact this? Is there a shift in my schedule or resources that may need to happen?
Parting Thoughts… We want your feedback! For Additional Information Contact: Debbie Owens National Vice President dowens@amplify.com 804-402-6933 Scott Miller Senior Account Manager smiller@amplify.com 704-641-5704
Agenda Introductions & Today’s Purpose Wake County MOY Data Story Important Post-MOY reports Comparing Populations, Measure Breakdown & Effectiveness Current State: 2016-17 School Year What are Quintiles? Wake County Quintile Data Scatter plot and charts Progress Planning Tool – Introduction Goal Setting Activity Parting Thoughts Appendix
DIBELS Next Performance 2016-17; by Grade
DIBELS Next Performance 2015-16; by Grade
DIBELS Next Effectiveness; BOY-MOY 16-17 Presenter: Claudia Lanier
TRC Effectiveness; BOY-MOY 16-17 Presenter: Claudia Lanier
PM Fidelity (K-3) by week; post-BOY Presenter:
School Progress YTD 2016-17 BOY-MOY (# of Schools) North Central Schools 2016-17 BOY-MOY mCLASS:DIBELS Progress YTD Summary Progress Category School Progress YTD 2016-17 BOY-MOY (# of Schools) % Reaching Benchmark % Well Below Benchmark Well Above Average 50 44 Above Average 40 49 Average 52 51 Below Average 60 Well Below Average 55 61 Presenter: