1. Big Picture Learning Longitudinal Study Karen Arnold Boston College December 12, 2008 arnoldkc@bc.edu

2. Research Team Boston College Higher Education Department –Karen Arnold, Katie Wartman, Samantha Carney, Percy Napier, Jennifer May, Charlotte Martin Big Picture Learning –Shezwae Fleming, Mario De Anda Met Providence: Ben Castleman College Transition Counselor: Carmen Perez

3. Longitudinal Study Questions What becomes of Big Picture graduates in higher education, occupations, families, and communities? What makes a difference in these outcomes? –High school experiences –Transition support –College conditions –Personal qualities –Parent, family and adult support

4. Study Mission The Big Picture Longitudinal study tracks the lives of students from high school until age 30 in order to document their outcomes, inform school improvement, and support the continued personal and professional development of alumni…

5. Big Picture Distinguishers AHSI Distinguishers Sedlacek Non- Cognitive Variables -Personalization -Learning in the Real World -Authentic Assessments -School organization -Advisory Structure -School Culture -Leadership -Parent/family engagement-adult support -College preparation /Partnership -Professional Dev’t. -Authentic Learning, Teaching and Performance Assessment -Personalized School Culture -Shared Leadership and Responsibility -Supportive Partnerships -Future Focus -Positive Self concept -Realistic self- appraisal -Deals with racism -Long-range goals -Leadership -Strong support person -Community service -Nontraditional learning

6. Big Picture Distinguishers AHSI Distinguishers Sedlacek Non- Cognitive Variables -Personalization -Learning in the Real World -Authentic Assessments -School organization -Advisory Structure -School Culture -Leadership -Parent/family engagement-adult support -College preparation /partnership -Professional Dev’t. -Authentic Learning, Teaching and Performance Assessment -Personalized School Culture -Shared Leadership and Responsibility -Supportive Partnerships -Future Focus -Positive Self concept -Realistic self- appraisal -Deals with racism -Long-range goals -Leadership -Strong support person -Community service -Nontraditional learning

7. Big Picture Distinguishers AHSI Distinguishers Sedlacek Non- Cognitive Variables -Personalization -Learning in the Real World -Authentic Assessments -School organization -Advisory Structure -School Culture -Leadership -Parent/family engagement-adult support -College preparation /partnership -Professional Dev’t. -Authentic Learning, Teaching and Performance Assessment -Personalized School Culture -Shared Leadership and Responsibility -Supportive Partnerships -Future Focus -Positive Self concept -Realistic self- appraisal -Deals with racism -Long-range goals -Leadership -Strong support person -Community service -Nontraditional learning

8. Big Picture Distinguishers AHSI Distinguishers Sedlacek Non- Cognitive Variables -Personalization -Learning in the Real World -Authentic Assessments -School organization -Advisory Structure -School Culture -Leadership -Parent/family engagement-adult support -College preparation /partnership -Professional Dev’t. -Authentic Learning, Teaching and Performance Assessment -Personalized School Culture -Shared Leadership and Responsibility -Supportive Partnerships -Future Focus -Positive Self concept -Realistic self- appraisal -Deals with racism -Long-range goals -Leadership -Strong support person -Community service -Nontraditional learning

9. Senior Transition Survey Advisor Survey of Seniors First Fall Update Survey Student Tracker May/JuneOctober Study Instruments

10. Student and Advisor Survey Responses Participating Schools Student Response Rate Advisor Response Rate Class of 2006 994% 90% Class of 2007 1743%54% Class of 2008 2163%72%

11. Additional Data Collection First Fall Update Survey –66 alumni from Class of 2006 (33%) –114 alumni from Class of 2007 (17%) –64 alumni from Class of 2008 (17%) National Student Clearinghouse Student Tracker college enrollment of 2000-08 alumni from participating schools (~600) Summer studies of college transition National admission survey on summer melt

12. Survey Results on School Effectiveness: What’s Working Advisor connection Parent, family and adult involvement College-going culture Student self-knowledge Real-world learning

13. What High School Taught Best #1 Knowing own strengths & weaknesses #2 Speaking clearly and effectively #3 Naming & following passions/interests #4 Preparing for post high school success #5 Learning on their own #6 Preparing for work world success #7 Knowing how to make decisions

14. % Seniors Assessed by Advisors as Somewhat or Extremely Weak Preparation for college math 59% Preparation for college science54% Readiness for college writing43% Readiness for college reading35% Time management48% Organizational skills39% Ability to ask for help36% Ability to work alone30%

15. Senior Transition Survey Advisor Survey of Seniors First Fall Update Survey Student Tracker May/JuneOctober Connecting the Dots: Analysis Model

16. Advisor Survey of Seniors Senior Transition Survey Accepted to College: 95% -100% Expecting Fall Enrollment: 88% Expecting BA Degree: 43% Expecting Grad Degree: 37% Senior Year (May/June) College Plans and Degree Expectations

17. Post-Secondary Plans for 2008 Big Picture School Graduates

18. Senior Survey Advisor Survey Committed to Beginning College: 83% Committed to Earning a Degree: 82% Advisor Reports of Seniors’ College Plans and Degree Expectations

19. Seniors Enrollment Plan & Degree Plan Correlation=.189** Advisors Enrollment Plan & Degree Plan Correlation=.843** Correspondence of Senior Year Degree Expectations and Plans for Beginning College

20. Advisor sees senior as NOT strongly committed to beginning college Advisor sees senior as strongly committed to beginning college Senior planning fall enrollment 9%91% Senior not planning fall enrollment Advisor Assessment of Seniors’ Intentions for Fall College Enrollment & Senior Plans

21. Advisor sees senior as NOT strongly committed to beginning college Advisor sees senior as strongly committed to beginning college Senior planning fall enrollment 9%91% Senior not planning fall enrollment 57%43% Advisor Assessment of Seniors’ Intentions for Fall College Enrollment & Senior Plans

22. New Graduates’ College Outcomes 66% enrolled in college (compared with 54% of low-income students nationally) Clearinghouse Student Tracker and First Fall Update differ on enrollment #s No difference in college enrollment by gender, race, parents’ education, or income status

23. Graduate not enrolled in fall Graduate enrolled in fall Senior planning fall enrollment 35%65% Senior not planning fall enrollment Student Reports of Senior Year Intentions for Fall College Enrollment (per StudentTracker)

24. Graduate not enrolled in fall Graduate enrolled in fall Senior planning fall enrollment 35%65% Senior not planning fall enrollment 87.2%12.8% Student Reports of Senior Year Intentions for Fall College Enrollment (per Student Tracker)

25. Advisor sees senior as NOT strongly committed to beginning college Advisor sees senior as strongly committed to beginning college Student enrolled 7%93% Student not enrolled Advisor Assessment of Seniors’ Intentions for Fall College Enrollment & Student Fall Status

26. Advisor sees senior as NOT strongly committed to beginning college Advisor sees senior as strongly committed to beginning college Student enrolled 7%93% Student not enrolled 36%64% Advisor Assessment of Seniors’ Intentions for Fall College Enrollment & Student Fall Status

27. SUMMER FLOOD Post-graduate Summer Changes (~1/3 of all graduates) JOB Part time 2-yr New College

28. Summer Flood Follow-up 2007 summer interview study 2008 summer intervention study –Met Providence, Bronx Guild, Williams –Summer intervention outreach treatment and control groups –Enrollment results in January 2009 2008 national summer melt study (national admission organization NACAC)

29. Last Year’s Study Take-Homes Over 3/4 of seniors plan fall college enrollment at the point of H.S. graduation Substantial reconsideration of college plans over the summer New college students generally satisfied

30. What We Learned This Year The Big Picture equalizes opportunity for its students

33. What We Learned This Year The Big Picture equalizes opportunity for its students Seniors’ degree aspirations do not connect directly to their college plans Advisors cannot reliably predict students’ college enrollment The Clearinghouse Student Tracker is THE BEST AND BOLDEST WAY to get good college data

34. What we need to do: Move beyond college acceptance to attendance –Post-graduation summer intervention needed –Need to make sure everyone has a plan A and B Increase response rates and outreach to alumni –Clearinghouse data superior to self-report –Need for relationship-based data collection Make degree aspirations realistic and tied to clear understanding of college and career paths Enable multiple paths within a college-going culture –Needs to be acceptable to make a postponed college plan –Schools need to balance college-going ethos and parallel pathways to adult success

35. Steps for Schools Using Alumni Manager Supporting survey responses Providing summer support to grads. Tracking graduate contact info Subscribing to Student Tracker Sharing and using study findings

36. Next Steps for the Study Help principals interpret school-specific data Report on summer intervention results Help schools subscribe to Student Tracker Explore non-survey-based methods to reach older alumni Continue feedback to schools Develop consortia for alumni follow-up studies

37. Next Steps for the Study Help principals interpret school-specific data Report on summer intervention results Help schools subscribe to Student Tracker Explore non-survey-based methods to reach older alumni Continue feedback to schools Develop consortia for alumni follow-up studies

38. Contact Information For information about the Big Picture Longitudinal Study: Karen Arnold Boston College arnoldkc@bc.edu For information about the Big Picture College Transition Network: Shezwae Fleming The Big Picture Company sfleming@bigpicture.org For a copy of the 2008 Principal's Retreat Power Point and supplemental materials relevant to the longitudinal study, please log onto the Big Picture website (www.bigpicture.org), click on the "INNOVATION" link and scroll down to the list of topics and click on "A Longitudinal Study of Big Picture School Graduates."www.bigpicture.org