Redesigning Remedial Education TENNAIR – Fall 2012 Greg Schutz – TBR Lilly Hsu – TBR

Purpose  Introduce Tennessee Board of Regents (TBR) Learning Support (developmental education) course redesign results as background for analysis.  Set the stage for the importance of understanding Learning Support.  Provide some methods and tools for researching the impact of Learning Support (developmental education) and course redesign.

Definition The field of developmental education supports the academic and personal growth of underprepared college students through instruction, counseling, advising, and tutoring. The clients of developmental education programs are traditional and nontraditional students who have been assessed as needing to develop their skills in order to be successful in college (The National Center for Developmental Education, Retrieved from Web on 8/8/12).

Background  1984 – System-Wide Developmental Studies (DSP) Courses for High School Gaps  2001 – Defining our Future  2006 – NCAT Developmental Studies Redesign Grant o Partner: Education Commission of the States (ECS) o Partner: National Center for Higher Education Management Systems (NCHEMS)  2007 – Redesign Planning for Developmental Studies  2008 – Pilots (Spring 08, Fall 08, Spring 09)  2010 – Policy Change from Developmental Studies Program (DSP) to Learning Support (LS)  2010 – Complete College Tennessee Act  2013 – System-Wide Implementation of LS

National Environment  Completion Agenda  More Credentials (Degrees/Certificates)  Outcome based assessment, funding, program planning, student learning  Course Embedded Remediation  Course Redesign  Fast Track to Degree Completion with dual enrollment, dual admission, reverse articulation, prior learning assessment

TBR Policy Changes (TBR A100)  New focus on success in college curriculum and away from high school gaps  Flexibility for new approaches and technology  Individualized plans based on diagnostic assessment  Competency-based mastery of academic skills and knowledge  Technology adaptive  Tracking of college success indicators

Assessment for Placement  Initial assessment as a screening tool (ACT or comparable)  Diagnostics (many options available)

Learning Support Defined Minimum scores are based upon national concordant score of February  Note: Prior to new A-100 guidelines subject scores were English = 19, Reading = 19, and Math = 19. TestCollege Course(s)ACT Benchmark Score Minimum Subject Concorded Score ACTCOMPASSASSET EnglishEnglish Composition ReadingSocial Studies MathCollege Algebra

TBR A-100 Accountability Evaluation of the learning support services must be a continuous process. As a component of the approved plan, the institution will establish benchmarks and subsequent annual performance indicators to demonstrate progress of students who are placed in learning support. (TBR A-100 Guideline)

Delivery of LS is (very) Different  Under former Developmental Studies Program (DSP), students took traditional developmental studies courses in Reading, Writing and Math with each course as one semester in length.  Under the new Learning Support (LS) Initiative, the goal is for the student to be able to complete all required competencies in one semester. o Students only engage in LS competencies where they are diagnosed as requiring remediation. o Delivery of LS is technology driven

TBR A-100 Measures of Success  Common Student Outcomes o student completion of learning support, o enrollment and success in college entry-level courses, o fall to fall retention, and o graduation rates.  Unique institutional measures.  Tracking od students with ACT of 12 or below.  Annual reports from institutions to TBR  Intervention systems with the high school districts’ Local Educational Agency (LEA)

Each Redesign Pilot Unique  NeSCC – Emporium Model (reading)  CoSCC – Replacement Model (reading/writing)  APSU – Structured Learning Assistance (SLA) (math)  ClSCC – Emporium Model (math)  JSCC – Emporium Model (math)  ChSCC – Replacement Model (math)

Traditional Eight Courses College Level Algebra IIAlgebra I Basic Math College Level Dev. Reading Basic Reading College Level Dev. Writing Basic Writing College Level Study Skills

Retention and Graduation UniversitiesCommunity Colleges DSP CoursesACT Fall to Fall Retention Six Year Grad RateACT Fall to Fall Retention Six Year Grad Rate Zero %45.4% %29.1% One %31.4% %22.2% Two %27.2% %19.0% Three %21.7% %13.1% Four %23.2% %9.3% Five %25.1% %10.7% Six %18.3% %7.3% Seven %19.2% %6.5% Eight %17.2% % 3.8% Totals %36.8% % 18.0% 2000 First-Time Freshman Cohort. Based upon returning to or graduating from initial enrolling institution.

Sixteen Departure Points College Level Algebr a II Algebra I Basic Math College Level Dev. Reading Basic Reading College Level Dev. Writing Basic Writing College Level Study Skills Do not complete Do not enter

Five Other Departure Points 1. Never enter college or university 2. Never enter college Math 3. Never complete college Math 4. Never enter college English 5. Never complete college English

Austin Peay State University (APSU) Traditional Model Complete 3-6 hours non-university level courses before enrolling in Core Mathematics course MATH1010 Mathematical Thought and Practice Earn a D or Higher 85.0% all students 43.5% DSP students DSPM 0800 Elementary Algebra ACT % Complete course with a grade of C or higher DSPM 0850 Intermediate Algebra ACT 17-18; or Completed DSPM % Complete course with a grade of C or higher Math 1530 Fundamentals of Statistics Earn a D or Higher 61.2% all students 28.8% DSP students

APSU Linked Workshop (Redesign) Model Professor: Classroom Core course content Grade determination SLA Leader: Workshop Prerequisite competencies Reinforce key course concepts Test review Guidance Feedback

APSU: Results CourseRedesign (LS)Traditional (DSP) Math 1010 (Mathematical Thought and Practice) 76.3%43.5% Math 1530 (Fundamentals of Statistics) 61.2%28.8% Course Completion of Student’s Requiring Support for Below College Level Competencies Notes: 1.Students completing the course earn a D or higher. 2.Below college level is Learning Support (LS) after redesign and Developmental Studies Program (DSP) prior to redesign.

Cleveland State Outcomes Total Pre-College Success Next Course Entry Next Course Success Count % % % Prior to Redesign % %7754.6% Redesign % % % All % % %

Cleveland’s Math Success TBR Study (Schutz & Tingle) - Cleveland State Redesign ◦ Students tracked 3 semesters before and after redesign ◦ Students tracked from dev math into college math ◦ Examined impact on course success & next course success ◦ Logistical regression, significance level 95% The Results ◦ Redesign had a strong positive impact on course success ◦ Redesign had a strong positive impact on next course success, including both dev math and college math ◦ Gender and race were not factors in predicting course success - achievement gaps were closed

Jackson State Outcomes 41% 54% 57% 59% 74% 72% 75% 83% Student Learning = Students making ABC Course Retention = Students enrolled in the course to the end of semester

Northeast State Community College Learning Outcomes  Student success ( “C” of better) increased from 52% (traditional) to 58% (redesigned delivery).  Students with a grade of “A” increased from 14% (traditional) to 30% (redesigned delivery).

Recommendations  Use technology to cut costs and improve student engagement  Embrace change for improvement from both inside the organization and out  Data-driven integration of tracking (trend), comparisons, and predictive benchmarking  Reduce student departure points  Best practice adoption and sharing  Tailor to individuals and student populations

Practical Tips  Recording of completion o Banner automation of courses and tests o Competency achievement codes Satisfied by assessment (diagnostic) Waived by advisor (manual recording equivalent to satisfied) Completed by course or post-test  Completion of college level course satisfies all competencies Required to complete In progress  TBR Indicators and Trajectories  TBR collection of Census and End-of-Term data

Models for Study  Cleveland State/TBR tracking through entry and completion with logistic regression.  Austin Peay comparison of traditional model and new model.  Enrollment extract competency tracking o R = Required o I = In Progress o S = Satisfied by Test o W = Waived Manually (Equivalent to S) o C = Completed (by Course or Test)  Complete College America tracking o Uses Banner modified form SZAADEF  National Center for Developmental Education publications -

Next Steps for TBR Institutions  Under the TBR Completion Delivery Unit (CDU), the System will be focusing on learning support this year with projected impact on student degree completion.  TBR A-100 Guidelines have tracking mechanisms outlined.  State will be asking for Math and English course level data, which will likely be collected in the enrollment extract in fall  Institutions will be looking at costs and impact on funding formula.

Redesigning Remedial Education TENNAIR – Fall