1. INVESTIGATING MILESTONES AND COMPLETIONS AT A LOCAL INSTITUTION BASED ON ADELMAN’S STUDY, “THE TOOLBOX REVISITED.” What’s in YOUR toolbox? DANIEL MARTINEZ, PHD ASSOCIATE DEAN, INSTITUTIONAL RESEARCH RIVERSIDE COMMUNITY COLLEGE DISTRICT

2. Inspiration What this is not  Critique  Replication What it is  What if?  Verification of milestones  Exploration

3. Difference From Toolbox Datasets  Adelman  NCES transcript-based grade cohort study  Cooperative Institutional Research Project (CIRP)  NCES Beginning Postsecondary Students (BPS) Survey  Martinez  State MIS data  Local administrative system  Local assessment database  National Student Clearinghouse Decision rules Type of regression

4. Analytic Steps: Adelman 1. Demographic background & high school history 2. Postsecondary entrance 3. 1 st postsecondary year history 4. Factors of financing postsecondary education 5. Postsecondary attendance patterns 6. Extended postsecondary performance 7. Final model with complete academic history

5. Analytic Steps: Martinez 1. Demographics 2. High school history 3. 1 st semester performance 4. 1 st year performance 5. Completion of transfer level English or math within 1 st 2 years of enrollment 6. Extended postsecondary performance 7. Continuous enrollment

6. Population First time students (self-reported) in Fall 2002 Prior enrollments used to verify Age?

7. Age Distribution

8. Population First time students (self-reported) in Fall 2002 Prior enrollments used to verify Age < 20 High school graduates

9. Demographics Gender Ethnicity  White/Asian  Black/Latino 1 st generation  FG4  FG2

10. High School History Placement test scores  English  Math/Math test  Reading Self-reported high school information  English grade  Highest level of math  Grade in highest level of math  Time since last math class  Geometry  HS GPA

11. 1 st Semester Performance Units attempted Units earned GPA Delay Time of day

12. 1 st Year Performance Units attempted Units earned GPA

13. Transfer Level English/Math in 1 st 2 Years Units earned in transfer level math in the 1 st 2 years of postsecondary enrollment Units earned in transfer level English in the 1 st 2 years of postsecondary enrollment

14. Extended Postsecondary Performance Overall GPA Transfer units Developmental education units Summer enrollment Winter enrollment Part-time Financial aid Withdrawals Repeats

15. Final Step Continuous enrollment

16. Completer Tracked for 6 years 2 year degree or certificate 4 year degree Transfer to a 4 year school

17. The Analyses

18. Step 1: Demographics What was entered: Gender Ethnicity 1 st generation

19. Step 1: Demographics What survived: Gender Ethnicity 1 st generation (modified)

20. Step 1: Demographics What survived: Gender Ethnicity 1 st generation (modified) R=.181 R 2 =.033

21. Step 2: High School History What was entered: Gender Ethnicity 1 st generation Followed by: Placement test scores  English/Math/Math test/Reading Self-reported high school information  English grade  Highest level of math  Grade in highest level of math  Time since last math class  Geometry  HS GPA

22. Step 2: High School History What survived: Gender 1 st generation Placement Test: Reading HS: Grade in English HS: Highest level of math HS: Grade in highest level of math HS: Geometry

23. Step 2: High School History What survived: Gender 1 st generation Placement Test: Reading HS: Grade in English HS: Highest level of math HS: Grade in highest level of math HS: Geometry R=.328 R 2 =.108

24. Step 3: 1 st Semester Performance What was entered: Gender 1 st generation Placement Test: Reading HS: Grade in English HS: Highest level of math HS: Grade in highest level of math HS: Geometry Followed by: Units Attempted 1st Units Earned 1st GPA 1st Delay Time of day

25. Step 3: 1 st Semester Performance What survived: Gender 1 st generation HS: Highest level of math HS: Grade in highest level of math HS: Geometry Units earned 1st GPA 1st

26. Step 3: 1 st Semester Performance What survived: Gender 1 st generation HS: Highest level of math HS: Grade in highest level of math HS: Geometry Units earned 1st GPA 1st R=.429 R 2 =.184

27. Step 4: 1 st Year Performance What was entered: Gender 1 st generation HS: Highest level of math HS: Grade in highest level of math HS: Geometry Units earned 1 st GPA 1st Followed by: Units attempted year Units earned year GPA year

28. Step 4: 1 st Year Performance What survived: Gender 1 st generation HS: Highest level of math HS: Grade in highest level of math HS: Geometry Units earned 1 st GPA 1 st

29. Step 4: 1 st Year Performance What survived: Gender 1 st generation HS: Highest level of math HS: Grade in highest level of math HS: Geometry Units earned 1 st GPA 1 st R=.427 R 2 =.182

30. Step 5: Transfer English/Math in 1 st 2 Years What was entered: Gender 1 st generation HS: Highest level of math HS: Grade in highest level of math HS: Geometry Units earned 1 st GPA 1st Followed by: Units earned in transfer level English in 1 st 2 years Units earned in transfer level math in 1 st 2 years

31. Step 5: Transfer English/Math 1 st 2 Years What survived: Gender 1 st generation HS: Highest level of math HS: Geometry Units earned 1 st GPA 1 st Transfer level math in 1st 2 years

32. Step 5: Transfer English/Math 1 st 2 Years What survived: Gender 1 st generation HS: Highest level of math HS: Geometry Units earned 1 st GPA 1 st Transfer level math in 1st 2 years R=.478 R 2 =.228

33. Step 6: Extended Postsecondary Performance What was entered: Gender 1 st generation HS: Highest level of math HS: Geometry Units earned 1 st GPA 1 st Transfer level math in 1st 2 years Followed by: Overall GPA Transfer units Developmental education units Summer enrollment Winter enrollment Part-time Financial aid Withdrawals Repeats

34. Step 6: Extended Postsecondary Performance What survived: Gender 1 st generation HS: Geometry Units earned 1 st Transfer level math in 1 st 2 years Summer enrollment Developmental education units

35. Step 6: Extended Postsecondary Performance What survived: Gender 1 st generation HS: Geometry Units earned 1 st Transfer level math in 1 st 2 years Summer enrollment Developmental education units R=.520 R 2 =.270

36. Step 7: Continuous Enrollment What was entered: Gender 1 st generation HS: Geometry Units earned 1 st Transfer level math in 1 st 2 years Summer enrollment Developmental education units

37. Step 7: Continuous Enrollment What was entered: Gender 1 st generation HS: Geometry Units earned 1 st Transfer level math in 1 st 2 years Summer enrollment Developmental education units Followed by: Continuous enrollment

38. Step 7: Continuous Enrollment What survived: Gender 1 st generation HS: Geometry Units earned 1 st Transfer level math in 1 st 2 years Summer enrollment Developmental education units Continuous enrollment

39. Step 7: Continuous Enrollment What survived: Gender 1 st generation HS: Geometry Units earned 1 st Transfer level math in 1 st 2 years Summer enrollment Developmental education units Continuous enrollment R=.526 R 2 =.276

40. What’s NOT Here Ethnicity Placement test scores Part-time enrollment Financial aid Withdrawals Repeats 20 unit milestone

41. Implications Milestone research may not be applicable to local institutions Effectiveness of placement tests needs to be examined 1 st generation data needs to be utilized The outcomes used in research need to be critically examined

42. Limitations/Future Research Not disaggregated by student characteristics Measures could be strengthened Identify gateway courses and investigate their impact on student achievement

43. THANK YOU