1. Accountability Training Review Agenda for Today: Review of calculation changes and what’s new In depth review of Closing Gaps calculations Graduation Rates Review of the district report card Data quality and collections used in the report cards Questions? Wisconsin Department of Public Instruction September 16, 2014

2. Report Card Changes for 2013-14 Absenteeism Rate and Dropout Rate These indicators can now be met by the current year calculation or the three-year calculation. Previously only current year calculations were used. Non-Tested Students Non-tested students will not be included in achievement-based calculations. This includes any calculations in all four priority areas that use WSAS data.

3. Report Card Changes for 2013-14 Closing Gaps Priority Area Comparisons will be made between targeted subgroups at a school- level to the comparison group at the state-level The change in the gap will be calculated across school years, rather than by comparing Student Achievement Priority Area scores across years The rate of improvement of the subgroup will be compared to the rate of improvement of the state comparison group A ‘hold harmless’ rule will be applied for any subgroups with 3-year average point-based proficiency rates above 90%, the subgroup will receive the maximum number of points, regardless of the amount of improvement.

4. Report Card Changes for 2013-14 Annual Measureable Objectives Attendance or Graduation AMO will be reported at the school level. This is similar to what was done under AYP. Both Attendance and Graduation AMOs will be reported at the district level

5. Calculating the Closing Gaps Change Score

6. From 2009-10 to 2010-11, SwD point-based proficiency rate decreased by 3.2% From 2010-11 to 2011-12, SwD point-based proficiency rate increased by 0.3% From 2011-12 to 2012-13, SwD point-based proficiency rate increased by 3.2%

7. From 2009-10 to 2010-11, State non-SwD point-based proficiency rate increased by 0.6% From 2010-11 to 2011-12, State non-SwD point-based proficiency rate decreased by 0.2% From 2011-12 to 2012-13, State non-SwD point-based proficiency rate increased by 0.8%

8. Gap in Rates: School Target Group Change in Rate – State Comparison Group Change in Rates (-3.2%) – (0.6%) = -3.8% = -0.038 (0.3%) – (-0.2%) = +0.5%= +0.005 (3.2%) – (0.8%) = +2.4%= +0.024 Next we will calculate weights, and the final step will be to apply the weights to the Gap in Rates calculated above…

9. Calculate weights for each year that account for the differences in numbers of students tested each year: Students Tested Weights: Number Tested / 3 Yr Average Tested Prior Year Two = 102 / [(102+88+71)/3]= 1.17 Prior Year = 88 / [(102+88+71)/3]= 1.01 Current Year = 71 / [(102+88+71)/3]= 0.82

10. Calculate a weight that assigns more credit to more recent years progress: Multiply the Students Tested Weights calculated in the previous step, by a number that will place more weight to more recent years data. Students Tested WeightAnnual Weight Final Weight Prior Year 2 Weight =1.17 * 1.0=1.17 Prior Year 1 Weight =1.01 * 1.25=1.26 Current Year Weight =0.82*1.5=1.23

11. Final Step to Determining Change Score: Determine Weighted Gap Rates Change Score = Sum of Weighted Gap Rates / Sum of Final Weights = -0.01 / 3.66 = -0.003 Weighted Gap Rates = Gap in Rates*Final Weight Prior Year 2 =-0.038 * 1.17=- 0.045 Prior Year 1 =+0.005 * 1.26=+ 0.006 Current Year =+0.024 * 1.23=+ 0.029 - 0.01 = Sum of Weighted Gap Rates

12. Graduation Rates

13. On-Track, Closing Gaps, AMOs Cohort Rates –Percentage of students starting high school together who graduate within a certain time period. On-Track: average of the 4-Year and the 6-Year Cohort Rates Gaps :4-Year Cohort Rates (2013), 6-Year added AMOs: 4-Year & 6-Year Current year, 4-Year average of current year and previous year Graduation only includes Regular Diplomas –Note there is a process for converting HSED to Regular Diplomas Special Education Students –Treated like any other students –If they don’t graduate within the 4 year time frame they will be in the denominator but not the numerator of the 4-year cohort rate. If they then do graduate within the 6 year time frame, they will be in the denominator and numerator (counting as a graduate) for the 6 year cohort rate.

14. District Accountability District Report Cards will be created for 2013-14. –District treated like one big school –Same four Priority Areas, Student Engagement Indicators –Will include more data on supplemental pages than School Report Cards: Summary of school-level performance Mobility data –School and District Accountability calculations are largely the same.

15. Example District Report Card – School Summary Page

16. Example District Report Card – District Mobility Page

17. Report Card/Data Inquiries, Data Quality and DPI Data Collections

18. 2014 Report Card Inquiries Deduction Inquiry Process & Preliminary Secure Release Inquiries

19. Report Card Data Sources WSAS files 2013 Testing Window: October 28 – November 29 Demographics for WSAS come from ISES This pull is on 3 dates Oct 3, Oct 29, Dec 11 WSAS Record Editing System (RES) Jan 13-22: Clean-up FAY, New to Country and Demographics ISES files (Individual Student Enrollment System) Districts and schools provide the data. The Third of September Count Day Enrollment File The Year End Collection File ISES Editing for 3 rd Friday of Sept Count (CYR), ISES YE (PYR) Nov 4-27: Editing of all fields, For Report Cards focus on Demographics, Attendance, Graduation, Exit and Entrance Types ISES information:http://lbstat.dpi.wi.gov/lbstat_isesapp

21. School Information Derived from ISES CD 2013 This data is meant to provide viewers with an idea of the setting of the school. This specific data from ISES CD is not used elsewhere in the calculations.

22. Student Achievement Derived from WSAS 2010-11, 2011-12, 2012-13 Proficiency Levels FAY Status Demographics only used for supplemental information.

23. Student Growth Derived from WSAS 2011, 2012 Proficiency Levels FAY Status Demographics only used for supplemental information.

24. Closing Gaps Achievement Derived from WSAS 2009-10 through 2012-13 Proficiency Levels FAY Status Demographics (used to form subgroups) Graduation Derived from ISES YE 2008-09 through 2011-12 Demographics (used to form subgroups)

25. On-Track Graduation ISES YE Cohort Year (derived from Grade Level) Attendance ISES YE Days Possible & Days Attended Demographics (to derive lowest group rate) 3 rd Gr Reading, 8 th Gr Math WSAS FAY Proficiency Levels ACT ACT & ISES CD Scores Grade Level

26. Student Engagement Indicators Test Participation WSAS Proficiency Levels Demographics (new to country) ISES ELP Codes Absenteeism Rate ISES YE Days Possible & Days Attended Dropout Rate ISES YE Exit and transfer codes

27. Resources for You Parent Guide to School and District Report Cards Summary of Report Card Updates (What’s New) Interpretive Guides (School and District) Accountability System Overview (School and District) –PPT Sample Parent Letter - School and District Accountability Sample Report Cards http://acct.dpi.wi.gov/acct_accountability

28. Thank you! Questions? Comments? Suggestions?