Urban Charter Schools IMPACT in Ohio March 2015
Notice This presentation contains interactive graphics which should be viewed in the context of a powerpoint presentation. Viewing presentation as static slides will cause some data to be hidden from the viewer and may cause labels to appear with the wrong graph. 2
Impact Research Questions This impact study answers the following questions: How does the academic progress of charter school students compare to their traditional public school (TPS) counterparts in Ohio? We examine: Total average academic growth for all charter students relative to TPS Average academic growth for charter school students for separate time periods Charter school student growth by elementary / middle / high school grade levels Charter school student growth by prior year academic achievement Charter school student growth by the major student subgroups Charter school student growth by the number of years student continuously attended charter schools For the group of charter schools in Cleveland and Columbus, how do they perform compared to their peer schools in the same community? 3
A Quick Word About Methods Charter school students may be different than a typical student in TPS, so care is needed in testing their learning gains. We use a “Virtual Twin” approach to match each charter school’s students to TPS students who look just like them drawn from the TPS schools that have lost students to the charter school. A Technical Appendix provides a full explanation of our research methodology.Technical Appendix 4
A Quick Word About Methods Unlike other recent CREDO studies, this study does not include a conversion of effect sizes to days of learning. As the days of learning computation is based on the national NAEP scores, it would not be appropriate to apply it to the limited regional samples which almost certainly DO NOT progress at the same rate as the national population. 5
6 Understanding the Slides A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN U RBAN R EGION – Average TPS Growth There are two growth values for reading. The left is for TPS students and the right for Charter students There are also two growth values for math. As before, the left is for TPS students and the right for Charter students This graph looks at the difference between the charter and TPS growth values – – These are the marginal effects of charter enrollment. The left is for reading and the right for math. To compute the difference, we take the Charter growth value minus the TPS growth value for each subject.
CLEVELAND Results 7
8 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL STUDENTS Average TPS Growth
Student-Level Results 9 A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL STUDENTS BY G ROWTH P ERIOD Average TPS Growth
Student-Level Results 10 A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL STUDENTS BY G RADESPAN Average Elementary TPS Growth
Student-Level Results 11 A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL STUDENTS BY Y EARS OF C HARTER S CHOOL E NROLLMENT This analysis includes only students who entered a charter school after Average TPS Growth
12 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL WHITE STUDENTS Average White TPS Growth
13 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL ASIAN STUDENTS Average Asian TPS Growth Average White TPS Growth ‡ There were not enough Cleveland Asian students in Math to compute an effect size.
14 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL NATIVE AMERICAN STUDENTS ‡ There were not enough Cleveland Native American students in Reading or Math to compute an effect size. Average White TPS Growth Average Native American TPS Growth
15 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL BLACK STUDENTS Average Black TPS Growth Average White TPS Growth
16 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL HISPANIC STUDENTS Average Hispanic TPS Growth Average White TPS Growth
17 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL STUDENTS ELIGIBLE FOR FREE / REDUCED PRICE LUNCH Average Non-Poverty TPS Growth Average TPS in Poverty Growth
Student-Level Results 18 A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL BLACK STUDENTS IN POVERTY Average White, Non- Poverty TPS Growth
Student-Level Results 19 A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL HISPANIC STUDENTS IN POVERTY Average White Non- Poverty TPS Growth
20 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL ENGLISH LANGUAGE LEARNERS Average ELL TPS Growth Average Non-ELL TPS Growth
21 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL STUDENTS WITH SPECIAL EDUCATION NEEDS Average SPED TPS Growth Average Non-SPED TPS Growth
22 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C LEVELAND – ALL STUDENTS WHO WERE RETAINED IN PRIOR YEAR Average Retained TPS Growth Average Non- Retained TPS Growth
COLUMBUS Results 23
24 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL STUDENTS Average TPS Growth
Student-Level Results 25 A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL STUDENTS BY G ROWTH P ERIOD Average TPS Growth
Student-Level Results 26 A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL STUDENTS BY G RADESPAN Average Elementary TPS Growth
Student-Level Results 27 A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL STUDENTS BY Y EARS OF C HARTER S CHOOL E NROLLMENT This analysis includes only students who entered a charter school after Average TPS Growth
28 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL WHITE STUDENTS Average White TPS Growth
29 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL ASIAN STUDENTS Average Asian TPS Growth Average White TPS Growth
30 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL NATIVE AMERICAN STUDENTS Average Native American TPS Growth Average White TPS Growth ‡ There were not enough Columbus Native American students in Reading or Math to compute an effect size.
31 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL BLACK STUDENTS Average Black TPS Growth Average White TPS Growth
32 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL HISPANIC STUDENTS Average Hispanic TPS Growth Average White TPS Growth
33 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL STUDENTS ELIGIBLE FOR FREE / REDUCED PRICE LUNCH Average TPS in Poverty Growth Average Non-Poverty TPS Growth
Student-Level Results 34 A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL BLACK STUDENTS IN POVERTY Average White, Non- Poverty TPS Growth
Student-Level Results 35 A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL HISPANIC STUDENTS IN POVERTY Average White Non- Poverty TPS Growth
36 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL ENGLISH LANGUAGE LEARNERS Average ELL TPS Growth Average Non-ELL TPS Growth
37 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL STUDENTS WITH SPECIAL EDUCATION NEEDS Average SPED TPS Growth Average Non-SPED TPS Growth
38 Student-Level Results A VERAGE A CADEMIC G ROWTH FOR C HARTER S CHOOL STUDENTS RELATIVE TO PERFORMANCE OF V IRTUAL T WINS IN T RADITIONAL P UBLIC S CHOOLS IN C OLUMBUS – ALL STUDENTS WHO WERE RETAINED IN PRIOR YEAR Average Retained TPS Growth Average Non- Retained TPS Growth