Does Remediation Help All Students

Slides:



Advertisements
Similar presentations
The Student Progression Study 2002 Update: Floridas Public High School Graduates Seven Years Later.
Advertisements

BOARD POLICY GRADES 3, 6, 8. Passing grade on final report card in READING AND MATH Summer school not required, promote to next grade, participate in.
Developmental Education Assessment, Placement, and Progression Thomas Bailey Based on Research by Katherine Hughes, Shanna Jaggars, Judith Scott-Clayton.
Success is what counts. A Better Way to Measure Community College Performance Presentation about the ATD Cross-State Data Workgroup NC Community College.
Measuring the Effects of Delayed or Avoided Developmental Coursework A Suggested Approach for Assessing the Effectiveness of Pre-College Courses T.M.
College & Career Readiness in Illinois Brian Durham Senior Director for Academic Affairs & CTE Illinois Community College Board
GATEWAY COURSE SUCCESS Transforming Remediation Bruce Vandal
PROF. ERIC BETTINGER STANFORD UNIVERSITY, NBER Postsecondary Remediation: How can we serve the needs of Underprepared Students?
Illinois High School to College Success Report High School Feedback Reporting In Cooperation with ACT, Inc. Illinois Community College Board Illinois Board.
INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ,
Using a Regression Discontinuity Design to Estimate the Impact of Placement Decisions in the Los Angeles Community College District Tatiana Melguizo &
Gordon Associates Why Do We Do What We Do, And How Do We Know if it’s Working? By Ron Gordon, EdD.
Randomized Controlled Trials in Community Colleges Successes, Challenges, and Next Steps for Research on Developmental Education U.C. Davis March 16, 2015.
Principles of Reform Bruce Vandal, Education Commission of the States April 12, 2012.
Joe Pickens, J.D. President, St. Johns River State College.
GATEWAY COURSE SUCCESS Scaling Corequisite. Too many students start college in remediation. 2.
State of Texas Assessments of Academic Readiness.
THE SOLUTION A cademic M astery P roject. BLACK SWAN THEORY Black Swan Events are high-impact, hard-to-predict, and rare events that are beyond the realm.
Michael Lawrence Collins, Jobs for the Future
Getting Students to Graduate: Developmental Education Thomas Bailey National Center for Postsecondary Research Community College Research Center Teachers.
Staar Trek The Next Generation STAAR Trek: The Next Generation Performance Standards.
The Promise of Developmental Summer Bridge Programs Elisabeth Barnett, Thomas Bailey, and the NCPR Team IES Conference June 2010.
1 Predicting Success in Math: The relationship between high school courses and remedial math in college Brandon Lagerquist Northshore School District Paul.
 Gregory Schutz Rion McDonald Chris Tingle TASSR Fall Conference October 24, 2013.
The Impact of Postsecondary Remediation Using a Regression Discontinuity Approach: Addressing Endogenous Sorting and Noncompliance Juan Carlos Calcagno.
Overview of the Early College High School Initiative Evaluation Susan Cole Mengli Song Andrea Berger American Institutes for Research Presentation at the.
Institutional Effectiveness 2010/2011 Core Indicators Institutional Research Wendy Dove – October 2011 COMMON GROUND “Progress towards a decade of student.
Dual Credit and Advanced Placement: Do They Help Prepare Students for Success in College? Mardy Eimers, Director of Institutional Research & Planning Robert.
Evaluating the Impact of the Advancement Via Individual Determination Program on Ninth-Grade Students' Learning and Study Skills Jenny Nagaoka, Melissa.
How Much of a “Running Start” Do Dual Enrollment Programs Provide Students? James Cowan & Dan Goldhaber Center for Education Data & Research (
Academic Success First-time/Full-time Students Fall 2008, 2009 and 2010 Concurrently Enrolled in English and Select Courses.
C A H S junior parent night English III AP/Dual Credit THREE STRANDS  Meet standards outlined in 11 th grade English/Language Arts TEKS 
Advanced Placement Program in Belton ISD Past, Present, and Future.
ABLE + COLLEGE EQUALS SUCCESS OAACE April
Why am I in this class?. Who said I have to take it? Senate Bill 1 (2009) legislated the need for schools to intervene on the behalf of students who are.
Accelerating Achievement Designing a State-Level Response to the Developmental Education Challenge Presentation for Southern Regional Education Board June.
High School Reform in Florida FCAN Conference 2008 Ft. Lauderdale, FL.
Success is what counts. Achieving the Dream: Supporting Community College Student Success Richard Kazis Jobs for the Future Arkansas Legislative Task Force.
Fall 2011NEnd of Fall 2011 GRCC GPA FTIACs with HS GPA 3.00 or higher 2, FTIACs with HS GPA below ,
College Preparatory Course Certification Pilot May 5th,
Transforming the High School Experience: Early Lessons from the New York City Small Schools Initiative Council of the Great City Schools October 21, 2010.
The Transformative Power of Remediation Steven Spurling City College of San Francisco.
Key Considerations in Collecting Student Follow-up Data NACTEI May 15, 2012 Portland, OR Promoting Rigorous Career and Technical Education Programs of.
DR. JOHN HUGHES DEPUTY DIRECTOR OF THE REGIONAL EDUCATION LABORATORY - SOUTHEAST College Readiness.
EDUCATION CURRENT GENDER STATUS STEM Fields. NATIONAL EDUCATION TRENDS  About 20.1 million women have bachelor's degrees, compared to nearly 18.7 million.
It Takes a College! KARI KAHLER AND ASHLEY DARGA NORTHWESTERN MICHIGAN COLLEGE.
Developmental Education Assessment Workshop for College of the Redwoods.
Developmental Education of Kentucky’s Public Postsecondary Entering Class of 2004 Developmental Education Taskforce November 8, 2006.
Predicting Student Retention: Last Students in are Likely to be the First Students Out Jo Ann Hallawell, PhD November 19, th Annual Conference.
Weighing the Evidence: Considering Three Approaches that Improve Student Skills Elisabeth Barnett, CCRC Thomas Brock, MDRC Donna McKusick, Community College.
College and Career Readiness Initiative OBJECTIVE To improve the college and career readiness rate of high school students and reduce the percent needing.
Delaware College Success Report February Join Us Engage with us live on social media using hashtag: #CollegeSuccessDE 2 #CollegeSuccessDE.
Institutional Effectiveness at CPCC DENISE H WELLS.
The College & Career Readiness Dilemma for High School Graduates What’s Our Responsibility? Jibril Gabriel Solomon, Doctoral Candidate, Education Studies.
Validating Nevada’s College Readiness Standards For Presentation to the High School Graduation Committee February 24, 2016.
Subtle Messages and Practices in Higher Education: Are We Increasing the Gap? An Investigation of Developmental Math Courses Catherine Callow-Heusser,
Following the Illinois High School Class of 2002 Jennifer B. Presley Karen J. DeAngelis Illinois Education Research Council Yuqin Gong, University of Illinois.
University Academic Advising Center (UAAC) Marilyn Hagerty ACADEMIC POLICIES and Advisement Issues.
Dual Credit Parent Night RIO VISTA HIGH SCHOOL.
English 4 Credits Math 4 Credits Algebra I ( 8 th gr. Alg. doesn't count as 1 of the 4 required HS math credits) Geometry Algebra II Math Beyond.. Science.
Krum High School Scheduling Rising 12 th Graders Krum High School.
Summer Data Conference – June 6, (2008) National Completion Goals (Lumina’s Big Goal: 60% of those will have an Associate Degree or above.
February 7-9, 2017 Lakeway, Texas
A Study of the Student-Athlete’s Academic Achievements: The Relationship Between Student-Athlete Academic Support Programs and Academic Progress Rate Dr.
University of Michigan
STUDENT SUPPORTS: Developmental Education and Other Academic Programs
The Basics of High School
Educational Master Plan
Tehama County Strategic Reading & Expository Writing (prof/adv)
Attendance and Absenteeism in MA
Presentation transcript:

Does Remediation Help All Students Does Remediation Help All Students? How the Effects of Postsecondary Developmental Courses Vary by Background and Ability Bridget Terry Long Angela Boatman Harvard Graduate School of Education IES Conference June 2010

Florida Remediation Studies Remedial and Developmental Postsecondary Courses  Lack of academic prep is a significant barrier to success –  Nationally approx. 40% of 1st year students are placed into college remediation (55-60% at CCs) How should this problem be addressed? Florida Remediation Studies Developmental courses at the community colleges All schools use the same placement instrument and have the same cutoff for placement Florida Administrative Dataset: Sample: All first- time, degree-seeking CC students who began in Fall 1997, 1998, 1999, or 2000 (over 100,000 records) Juan Carlos Calcagno and B.T. Long – "The Impact of Postsecondary Remediation Using a Regression Discontinuity Approach: Addressing Endogenous Sorting & Noncompliance“ and “Does Remediation Help All Students? The Heterogeneous Effects of Postsecondary Developmental Courses"

Regression Discontinuity: The Intuition Beth and Becky are observationally similar Beth and Becky both take the College Placement Test (CPT) Beth scores just above the cut-off score Becky scores just below the cut-off score Beth to college-level courses Becky to remediation Crossover: Beth takes remediation anyway Compare the outcomes of Beth & Becky No Show: Becky never enrolls in remediation => Explain setting! Then strategy 1 - COMPARE “SIMILAR” STUDENTS IS THE KEY 2 – DON’T DROP NON-COMPLETERS – BIAS RESULTS 3 – Limitation: students on the margin of the cutoff! Retesting: some students may be permitted to take the placement exam multiple times to pass out of the courses. Problem A: Re-taking might invalidates the key identifying assumption behind the RD design (i.e. students around the cutoff are “similar”). Results will be subject to selection bias. Problem B: No information on a student’s multiple test attempts; only the score used for placement is included Solution-Intuition: Identify colleges where retesting is allowed, and drop them from the sample. Mention cutoff – cutoff used for credit score applications I’ll use this exogenous force to solve the selection problem and predict outcomes, and not to look at the place of the cutoff – talk about this later Endogenous Sorting: Beth retests to place out of remediation

Negative Effects on Passing First College-Level Course Passing the First College-Level Course by Reading CPT Score at the Discontinuity Placed in Developmental Reading Placed in College Level Negative Effects on Passing First College-Level Course

Total Credits Earned by Reading CPT Score at the Discontinuity Placed in Developmental Reading Placed in College Level Positive Effects on Total Credits Earned

Florida Remediation Studies Being assigned to a developmental course appears to increase total credits completed for students on the margin of passing out of the requirement Does not increase the completion of college-level credits or eventual degree completion.  Remediation might promote early persistence but does not necessarily help students on the margin of passing the cutoff to make long-term progress What about students of different backgrounds? The effects were: More positive for female (compared to male), older (compared to younger), and LEP (compared to non-LEP) More negative for low-income student (compared to non-Pell-eligible)

Does remediation work for students with far less preparation? Past studies (FL, OH, TX) focus on students on the margin of needing remediation -- they do not investigate the effects of remediation on students who are extremely under-prepared (i.e. don’t have an appropriate control group) The Tennessee Case Multiple cutoffs and changes in placement policy over time  Investigate effects of different levels of remediation using multiple RDs Sample: Fulltime students under 21 who began at a TN public college or university in the fall of 2000 “Does Remediation Work for All Students? How Remedial and Developmental Courses Affect Students With Different Levels of Academic Preparation” – A. Boatman and B.T. Long

Remediation in Tennessee Go to College-level courses ACT/SAT score determines which placement exam (if any) Take Developmental Algebra II Take COMPASS Algebra exam Take Developmental Algebra I Take COMPASS Arithmetic exam Take Remedial Arithmetic College Level Devel. Alg II Devel. Alg I Remed. Arith. COMPASS Algebra II test Score 50-100 Score 28-49 Score 0-27 COMPASS Arithmetic test Score 30-100 Score 0-29 8

RD #1: Developmental Algebra II vs. College-level Devel. Alg II Devel. Alg I Remed. Arith. COMPASS Algebra II test Score 50-100 Score 28-49 Score 0-27 COMPASS Arithmetic test Score 30-100 Score 0-29

Credits Accumulated Over Three Years RD #1: Effects of Recommendation to Develop. Algebra II –vs– College-Level Math Credits Accumulated Over Three Years Not much Difference in Total Credits Diff in College Credits

Negative Effects in Cumulative College Credits RD #1: Effects of Recommendation to Develop. Algebra II –vs– College-Level Math Negative Effects in Cumulative College Credits

RD #3: Remedial Arithmetic vs. Develop Algebra I College Level Devel. Alg II Devel. Alg I Remed. Arith. COMPASS Algebra II test Score 50-100 Score 28-49 Score 0-27 COMPASS Arithmetic test Score 30-99 Score 0-29

Math Developmental/Remedial Education Total College Credits Completed after 3 years Smaller in Magnitude

College-Level vs. Developmental vs. Remedial Writing Composition Developmental Writing Remedial Writing COMPASS English test ACT English Score Score 68-100 Score 28-67 Score 0-27 RD #2: Develop. vs. Remedial Writing

Grade in first college-level course Not causal analysis, but interesting estimates…

Summary of Tennessee Results Generally negative effects if placed in a lower math class, but the size of the effect is smaller farther down the test score distribution Similar effects found for Developmental and Remedial Reading In Writing, the effects are negative at the college/developmental threshold but positive at the developmental/remedial threshold Positive effects on first college-level grade (though these results are not causal)

Implications and Remaining Questions Remedial and Developmental courses do not affect all types of students equally (by background, ability level, or college level) What is the best way to offer remediation? Characteristics of strong remedial programs? What are the effects of limitations states impose on remedial course-taking (e.g., only at CCs, time limits)? Early Placement Testing – a preventative measure?

Contact Information Prof. Bridget Terry Long, Ph.D. Harvard Graduate School of Education, NCPR, and NBER longbr@gse.harvard.edu Angela Boatman, Doctoral Candidate Harvard Graduate School of Education angela_boatman@mail.harvard.edu