1. An initiative of the Research & Planning Group for California Community Colleges Three Studies to Drive Campus Conversations on Student Success Rob Johnstone, RP Group

2. An initiative of the Research & Planning Group for California Community Colleges Today we’ll cover: Working toward a “Culture of Inquiry” – selected findings from statewide projects Grades & Success in Sequenced Courses Levels of Preparedness in GE Courses – success of simultaneously enrolled students in Math / English courses Cohort Tracking in Basic Skills

3. An initiative of the Research & Planning Group for California Community Colleges Ground Rules Ask lots of questions – especially nagging and tough ones If I’m talking too fast, throw something at me (preferably not something sharp) Data doesn’t make meaning; we make meaning from data Spontaneous outbursts of applause are encouraged

4. An initiative of the Research & Planning Group for California Community Colleges Data, Evidence, College Decision- making, Student Success, and You…

5. An initiative of the Research & Planning Group for California Community Colleges How do colleges make good decisions ? “Learning emerges from an ongoing conversation about things that matter with both passion and discipline” -Parker Palmer The Courage to Teach If you want to learn you have to take part in the conversation Learning is founded on evidence and inquiry

6. An initiative of the Research & Planning Group for California Community Colleges Framing Thought #1 “Data do not speak for themselves. What is also needed are occasions that bring educators together to examine evidence about student learning, reflect on its meaning and identify approaches that yield better results.”  Carnegie Foundation (2009)

7. An initiative of the Research & Planning Group for California Community Colleges Framing Thought #2 Decision making in complex systems is a highly social process, not solely an intellectual exercise. The process is composed of many small acts, carried out by different people at different points in time.

8. An initiative of the Research & Planning Group for California Community Colleges Institutional Research (IR) & You IR is about helping the college and its practitioners make better decisions Institutional research is fundamentally an interventionist discipline. We are using non-experimental data to examine behavior in complex human systems We are not seeking absolute truths; rather we are looking for patterns of evidence that inform action-oriented decisions

9. An initiative of the Research & Planning Group for California Community Colleges Linear Model of Institutional Research Faculty/Staff Researcher Primary Responsibility Key Features: Request-driven Highly delineated tasks Emphasis is on generating metrics

10. An initiative of the Research & Planning Group for California Community Colleges Collaborative Model of Inst. Research Faculty/Staff Researcher Joint Activity Primary Responsibility Key Features: Dialogue-rich Jointly-driven processes

11. An initiative of the Research & Planning Group for California Community Colleges Colleges may be focusing on the wrong data. Finding from RP Research

12. An initiative of the Research & Planning Group for California Community Colleges Retention Rate Success Rate Consider the multitude of changes over this period: - faculty/staff turnover - program successes/failures - changing student demographics - budget contractions/expansion - evolving state & accreditation mandates - leadership turnover and yet these performance metrics remained amazingly stable. What does that tell us about the usefulness of these metrics in setting institutional strategies? Twenty Year Trend for Common Institutional Outcome Measures

13. An initiative of the Research & Planning Group for California Community Colleges Much of what is needed to support good decision making lies beyond the current grasp of our institutional databases. An Observation

14. An initiative of the Research & Planning Group for California Community Colleges What is Our College’s Transfer Rate?

15. An initiative of the Research & Planning Group for California Community Colleges Insight from the Field: A Look at Three Studies

16. An initiative of the Research & Planning Group for California Community Colleges Section 2: Grades & Success in Sequenced Courses

17. An initiative of the Research & Planning Group for California Community Colleges

18. An initiative of the Research & Planning Group for California Community Colleges

19. An initiative of the Research & Planning Group for California Community Colleges

20. An initiative of the Research & Planning Group for California Community Colleges

21. An initiative of the Research & Planning Group for California Community Colleges

22. An initiative of the Research & Planning Group for California Community Colleges

23. An initiative of the Research & Planning Group for California Community Colleges

24. An initiative of the Research & Planning Group for California Community Colleges Section 3: Success in GE Courses by Simultaneously Enrolled English / Math Students

25. An initiative of the Research & Planning Group for California Community Colleges Psychology 100 Success of Students Simultaneously Enrolled in English Note: Enrollments from Summer 2000 to Spring 2009; Success is defined as A/B/C/CR grade

26. An initiative of the Research & Planning Group for California Community Colleges Psychology 100 Success of Students Simultaneously Enrolled in Math Note: Enrollments from Summer 2000 to Spring 2009; Success is defined as A/B/C/CR grade

27. An initiative of the Research & Planning Group for California Community Colleges Success in 5 Highly Enrolled GE Courses by English Enrollment Level Note: Enrollments from Summer 2000 to Spring 2009; Success is defined as A/B/C/CR grade

28. An initiative of the Research & Planning Group for California Community Colleges Success in 5 More Highly Enrolled GE Courses by English Enrollment Level Note: Enrollments from Summer 2000 to Spring 2009; Success is defined as A/B/C/CR grade

29. An initiative of the Research & Planning Group for California Community Colleges Success in 5 Highly Enrolled GE Courses by Math Enrollment Level Note: Enrollments from Summer 2000 to Spring 2009; Success is defined as A/B/C/CR grade

30. An initiative of the Research & Planning Group for California Community Colleges Success in 5 More Highly Enrolled GE Courses by Math Enrollment Level Note: Enrollments from Summer 2000 to Spring 2009; Success is defined as A/B/C/CR grade

31. An initiative of the Research & Planning Group for California Community Colleges Section 4: Cohort Tracking in Basic Skills Sequences

32. An initiative of the Research & Planning Group for California Community Colleges Cohort Tracking Cohorts tracked include students whose first math course at Skyline was between 2002-03 and 2006- 07. Students were tracked for three academic years. Students were tracked based on the first math/English/ESL course that they took at Skyline (not on their placement).

33. An initiative of the Research & Planning Group for California Community Colleges Math Cohort Tracking – Starting in Fundamentals Starting Level Att. Fund Pass Fund Att. Beg. Pass Beg. Att. Inter. Pass Inter. Att. Tran. Pass Tran. Fundamentals1,8631,21593962433121213499 % of starting cohort 100%50%18%7% % from previous step ---65%77%66%53%64%63%74% *Note: Fundamentals = Math 811, Beginning Algebra = 110 or 111+112, Intermediate Algebra = 120 or 122+123, Transfer = 130, 150, 200-level 11%33% 5%65%

34. An initiative of the Research & Planning Group for California Community Colleges Math Cohort Tracking – Starting in Beginning Algebra Starting Level Att. Beg. Pass Beg. Att. Inter. Pass Inter. Att. Tran. Pass Tran. Beginning Algebra 3,4492,3061,363934577440 % of starting cohort 100%40%27%17% % from previous step ---67%59%69%62%76% *Note: Beginning Algebra = 110 or 111+112, Intermediate Algebra = 120 or 122+123, Transfer = 130, 150, 200-level 27%13%67%

35. An initiative of the Research & Planning Group for California Community Colleges Math Cohort Tracking – Starting in Intermediate Algebra Starting Level Att. Inter. Pass Inter. Att. Tran. Pass Tran. Intermediate Algebra 2,0861,494891647 % of starting cohort 100%43% % from previous step ---72%60%73% *Note: Intermediate Algebra = 120 or 122+123, Transfer = 130, 150, 200-level 31%72%

36. An initiative of the Research & Planning Group for California Community Colleges English Tracking – Starting in Two Levels Below Transfer Starting Level Att. Two Below Pass Two Below Att. One Below Pass One Below Att. Trans. A Pass Trans. A Att. Trans. B Pass Trans. B Two Levels Below Transfer 2,3281,5661,179924742591440362 % of starting cohort 100%51%32%19% % from previous step ---67%75%78%80% 74%72% *Note: Two Levels Below = 826, One Level Below = 836 or 846, Transfer A = English 100 or 105, Transfer B = 110 or 165 25% 40% 16% 67%

37. An initiative of the Research & Planning Group for California Community Colleges English Tracking – Starting in One Level Below Transfer Starting Level Att. One Below Pass One Below Att. Trans. A Pass Trans. A Att. Trans. B Pass Trans. B One Level Below Transfer 3,0172,2461,6661,3911,038879 % of starting cohort 100%55%27%34% % from previous step ---74% 83%75%85% *Note: One Level Below = 836 or 846, Transfer A = English 100 or 105, Transfer B = 110 or 165 46%29%74%

38. An initiative of the Research & Planning Group for California Community Colleges English Tracking – Starting in Transfer A Starting Level Att. Trans. A Pass Trans. A Att. Trans. B Pass Trans. B Transfer A3,3202,6151,6411,406 % of starting cohort 100%49% % from previous step ---79%63%86% *Note: Transfer A = English 100 or 105, Transfer B = 110 or 165 42%79%

39. An initiative of the Research & Planning Group for California Community Colleges ESL Tracking – Starting in Pre Intermediate Starting Level Att. Pre Inter. Pass Pre Inter. Att. Inter. Pass Inter. Att. High Inter. Pass High Inter/ Att. Trans. Pass Trans. Pre Intermediate 2591771239178564432 % of starting cohort 100%68%47%35%30%22%17%12% % from previous step ---68%69%74%86%72%79%73% *Note: Pre Intermediate = 820 / 821-822 / 852-862-872; Intermediate = 830 / 831-832 / 853-863-873; High Intermediate = 840 / 841-842; Transfer = 400 or English 100/105 22%35% 11%68%

40. An initiative of the Research & Planning Group for California Community Colleges ESL Tracking –Starting in Intermediate Starting Level Att. Inter. Pass Inter. Att. High Inter. Pass High Inter/ Att. Trans. Pass Trans. Intermediate3612501771339979 % of starting cohort 100%69%49%37%27%22% % from previous step ---69%71%75%74%80% *Note: Intermediate = 830 / 831-832 / 853-863-873; High Intermediate = 840 / 841-842; Transfer = 400 or English 100/105 37%22%69%

41. An initiative of the Research & Planning Group for California Community Colleges ESL Tracking – Starting in High Intermediate Starting Level Att. High Inter. Pass High Inter/ Att. Trans. Pass Trans. High Intermediate 366243158123 % of starting cohort 100%66%43%34% % from previous step ---66%65%78% *Note: High Intermediate = 840 / 841-842; Transfer = 400 or English 100/105 34%66%

42. An initiative of the Research & Planning Group for California Community Colleges Something to consider… 25%40% 16%67% 46%29%74% 42%79% English Progression 34% 37% 22% 69% 22%35% 11%68% ESL Progression 66% 11%33% 5%65% 27%13%67% 31%72% Math Progression

43. An initiative of the Research & Planning Group for California Community Colleges 25%40% 16%67% 46%29%74% 42%79% English Progression 34% 37% 22% 69% 22%35% 11%68% ESL Progression 66% 11%33% 5%65% 27%13%67% 31%72% Math Progression Something to consider… 25%40% 16%67% 46%29%74% 42%79% English Progression 34% 37% 22% 69% 22%35% 11%68% ESL Progression 66% 11%33% 5%65% 27%13%67% 31%72% Math Progression

44. An initiative of the Research & Planning Group for California Community Colleges 25%40% 16%67% 46%29%74% 42%79% English Progression 34% 37% 22% 69% 22%35% 11%68% ESL Progression 66% 11%33% 5%65% 27%13%67% 31%72% Math Progression Something to consider…

45. An initiative of the Research & Planning Group for California Community Colleges Rob Johnstone, Project Director johnstoner@smccd.edu Priyadarshini Chaplot, Project Coordinator pchaplot@rpgroup.org Lead Technical Coaches Darla Cooper Janet Fulks Bob Gabriner Cathy Hasson Ken Meehan Bob Pacheco Greg Stoup Ian Walton BRIC TAP Core Team

46. An initiative of the Research & Planning Group for California Community Colleges Find Out More! RP Group Website www.rpgroup.org BRIC TAP http://www.rpgroup.org/projects/BRIC.html Rob Johnstone, BRIC Project Director johnstoner@smccd.edu Kathy Booth, RP Group Executive Director kbooth@rpgroup.org Priya Chaplot, BRIC Project Coordinator pchaplot@rpgroup.org