1. Sierra College ERIK COOPER

2. A Brief History  The RP Conference 2013  STEPS Project  Sierra College  Paul Neal & Craig Kelly  Working with the English Faculty  Logistic Regression  Prototyping with Excel

3. The Tool  http://www.sierracollege.edu/admissions/assessment/index.php http://www.sierracollege.edu/admissions/assessment/index.php  http://bit.ly/SierraAssess http://bit.ly/SierraAssess

4. Early Results TermPlacementSuccess Rate Fall 2010All68.2% Fall 2011All71.7% Fall 2012All73.3% Fall 2013All70.3% Fall 2014Accuplacer73.3% HS Transcripts78.9% Other70.6% All72.7%

5. Next Steps  Adjusting the cut score  English A placement  “Non-cognitive measures”  Math Placement

6. LONG BEACH CITY COLLEGE ANDREW FUENMAYOR

7. LBCC’s Promise Pathways: Background Promise Pathways is a first year experience program for students matriculating directly from high school – Alternative assessment using multiple measures – Prescriptive scheduling emphasizing full-time enrollment and early completion of basic skills courses – Priority registration – Achievement coaches and other pilot experiments

8. Alternative Assessment Longitudinal Analysis of LBUSD students revealed high school performance dramatically predicts success in college courses. Traditional Placement Mechanisms ignored high school performance and relied only on Standardized Assessment Exam (Accuplacer). New Assessment Model was devised which leveraged the combined predictive utility of multiple measures of student achievement.

9. Drastic Transformation of Remediation

10. Performance in Transfer Level

11. Performance by Qualification in Transfer Level English

12. Performance by Qualification in Transfer Level Math

13. Achievement of Milestones in Two Years by Ethnicity: Fall 2011 LBUSD

14. Achievement of Milestones in Two Years by Ethnicity: Promise Pathways Cohort 1

15. Predictive Early Momentum Points, Using PSM to Compare Mid Term Outcomes

16. Significance can be quickly shared with simple t-test Outcomet-statisticsignificance Transfer Math Success3.69.000 Transfer English Success11.63.000 Achieve Intent to Complete2.55.011 Achieve Behavioral Intent to Transfer 8.35.000

17. New Challenges Revealed When capable students are being placed into remediation, institution will overestimate overall success of remediation program. Once capable students are removed, it became very apparent that remediation was working much worse than we thought.

18. Bringing it all together

19. Implementation challenges The missing fourth presentation Change management Assessment and matriculation Enrollment management Support services Faculty and staff professional development and communication English, Math, Counseling

20. Second order effects Examination of effectiveness existing developmental education Enhancement of capacity for evaluation of interventions Reflection on long-standing processes Galvanization of innovation

21. Why does this matter?

22. Level of first attempt, Fall 2007 students (by levels below transfer of first attempt)

23. Percentage completion of transfer-level course (by level of first attempt)

24. Among completers, average year of completion of transfer-level course (by level of first attempt)

25. Among completers, distribution of completions by F2007 first-time students

27. Middle of road statewide projection: MMAP For much, much more, on MMAP join us tomorrow at 10:10 in the beautiful Fresno room.

28. What that means: all students Math: IrvineEnglish: Anaheim

29. What that means: all students Math: IrvineEnglish: Anaheim

30. What that means each year: first time students Math: AT&T ParkEnglish: Dodger Stadium

31. What that means each year: first time students Math: AT&T ParkEnglish: Dodger Stadium

32. What does that mean for students? Average reduction of development education of 1-2 semesters/student Direct costs to student Direct costs to state Potential reduction in opportunity costs of college Fewer students met at our front doors to be told they don’t belong in college

33. What might this mean for all of us? The worst financial recession in our lifetimes took a million people out of the workforce for a year or more in California, causing suffering on an epic scale. What is the scale of the human and economic impacts of 1-2 semesters per student for two million students….

34. Contact information John Hetts jhetts@edresults.org, 916-498-8980 jhetts@edresults.org Janet Fulks jfulks@bakersfieldcollege.edu Erik Cooper ecooper1@sierracollege.edu Andrew Fuenmayor afuenmayor@lbcc.edu