LaunchBoard in Action Presentation will be live but sample Powerpoint for future reference can be found at: http://bit.ly/LaunchBoardinAction Presenters: Karen Beltramo, Sr. Project Mgr Louis Quindlen, Dept. Chair Machine Technology WestEd Laney College kbeltra@wested.org lquindlen@peralta.edu

Agenda: Two Examples of LaunchBoard Data Used to Support and Check Outcomes of Local Improvement and Expansion Efforts 11:40 - noon Intro and Regional Example: New program recommendation report student outcomes section (Karen Beltramo: kbeltra@wested.org) noon - 12:40 College Example: Machining and Machine Tools validating data, ideas for investments and for where to focus student outreach, program review (Louis Quindlen: lquindlen@peralta.edu) Please ask questions throughout the session

Reminder of Data Sources for LaunchBoard Student and program data, including characteristics, progress, and completion from the CCCCO MIS database Employment and earnings data from Employment Development Department CTEOS outcomes from the CTE Outcomes Survey Labor market information from EMSI Inner vs External Factors

Bay Region: New Program or Revision to Existing Program Recommendations If a college in a region is going to invest in developing a new program or substantially revise an existing ones, are students exiting from existing programs (on the same TOP code) getting hired and making a living wage or transferring? If not, then should the investment be made to develop that program? Added Student Outcomes Information from LaunchBoard to the CoE Template

Laney College: Request for Review of an Existing Electrical Technology Program Looked at four metrics

Diablo Valley College: Request for a New Digital Marketing Program Looked at four metrics

Two Examples of LaunchBoard Data Used to Support and Check Outcomes of Local Improvement Efforts Bay Region: New program recommendation report student outcomes section Laney College: Machining and Machine Tools validating data, ideas for where to focus student outreach, program review

Using the Data in LaunchBoard and CTEOS as Directional Signage and/or Verification Verifying Institutional Data Reported to MIS Modifying Curriculum – TOP code alignment Leading to Development of Tools to Obtain More Actionable Data Making Investment Recommendations Reporting Student Outcomes for Program Review

Bay Region: Programs on 0956.30 Machining and Machine Tools Programs on 0956.30 in the Bay Region

Laney College| Enrollments | Machining and Machine Tools Little bit of a downward trend in enrollments

Laney College | Students by Ethnicity| Machining and Machine Tools | Compared to Region Ethnic breakdown of students taking courses on 0956.30 at Laney vs Bay Region

Laney College | First-Time Students| Machining and Machine Tools | Compared to Region 10% Increase from 2014-15 to 2015-16 – Ability to verify that your institutional data is reported correctly to MIS from your college

Laney College | Economically Disadvantaged| Machining and Machine Tools | Compared to Region Jump in economically disadvantaged (per Perkins definition) for Laney College

Laney College | Students Who Previously Took a HS CTE Course| Machining and Machine Tools | Compared to Region 6% lower than region

Laney College | Primary Reasons Students Studied at a College| Machining and Machine Tools | Compared to Region | Survey Data CTEOS Survey on primary reason students studied at college. Note high % who were updating job skills

Laney College | Persistence Rate| Machining and Machine Tools | Compared to Region Similar to region – note a bit of a dip

Laney College | Persistence Rate| Machining and Machine Tools | Compared to All CTE Programs at Laney College Compared to all CTE Programs at Laney College

Laney College | No. of Students Who Earned Awards| Machining and Machine Tools | Compared to Region Looks like a large jump – be careful of scale of graph from 16 to 19

Laney College | Employed 4th Q After Exit| Machining and Machine Tools | Compared to Region Similar to region but drop from high of 82% in 2014-15

Laney College | Employed 4th Q After Exit| Machining and Machine Tools | Compared to Region | By Ethnicity How does employment look by ethnic group?

Laney College | Employed 4th Q After Exit| Machining and Machine Tools | Compared to Region | By Completion Status Only Skillsbuilders Matched in UI wage data set

Laney College | Job in Field of Study| Machining and Machine Tools | Compared to Region | Survey Data Employed in field of study at higher rates than region but note significant drop but fairly small sample size of 14 students in 2015-16 and 9 students in 2014-15 who responded from Laney

Laney College | Proportion of Students Who Attained a Living Wage| Machining and Machine Tools | Compared to Region 10% drop for Laney college students from 2014-15 at 85% to 75% in 2015-16

Laney College | Proportion of Students Who Attained a Living Wage| Machining and Machine Tools | Compared to Region | By Ethnicity Not enough students matched to see differences – Masked category is large

All the Tabs on the Launchboard

The LaunchBoard offers a suite of dashboards that helps community colleges track progress toward economic mobility Community College Pipeline: program review Guided Pathways tab: first year progress indicators SWP tab: end-of-college indicators K14 CTE Pathway tab: transition from K-12 into college CTEOS tab: nuanced employment indicators (integrated into the Community College Pipeline in summer 2018) Adult Ed Pipeline: transition from adult ed into college (summer 2018)

Infographics on Data Sources in the Launchboard

Resources Access a searchable database of resources, or find related resources embedded in the Community College Pipeline

Perkins Indicator Reports What are some of the potential inconsistencies of the data in Launchboard vs other sources AT THIS TIME? Datamart vs Launchboard Data Mart Launchboard Data Can be updated any time by colleges Refreshed quarterly with MIS data Enrollments include drop-outs Enrollments do NOT include drop-outs Perkins vs Launchboard Perkins Indicator Reports Launchboard Data Limited cohort of students reported: more than one credit vocational course, valid SSN, did not enroll in K-12, no prior post-secondary credential, either completed 12+ vocational units under same 2-digit TOP or earned a vocational award Broad cohort of students: taken one or more course in the selected TOP code in the selected year Focus on Five Core Indicators: technical skills attainment; earned a credential, certificate or degree; persistence or transfer; job placement; nontraditional participation and completion 100s of metrics: shown more at a granular level without combining metrics i.e. completion and transfer are shown separately I was wondering about trying to be really upfront about the inconsistencies and limitations of the data.

Perkins Indicator Reports What are some of the potential inconsistencies of the data in Launchboard vs other sources AT THIS TIME (continued)? Perkins vs Launchboard (continued) Perkins Indicator Reports Launchboard Data Diaggregations: gender, nontraditional students, displaced homemakers, economically disadvantaged, limited English proficiency, single parents, students with disabilities, Tech Prep status Diaggregations: gender, students with disabilities and limited English proficiency In Addition to Perkins: took non-introductory courses, skills-builders, exiters, race/ethnicity, age group, foster youth, veterans, first-generation, ever received financial aid, every took basic skills English or math course, first-time status, returning after an absence, ever attended another college in the same pathway, previously received a CCC award, previously graduated from a 4-Yr, and previously took a high school CTE course

What are some of the potential limitations of the data in Launchboard AT THIS TIME? Employment & Earnings Data Who is Included Who is Left Out What Could Be Done Students with Valid SSNs matched to EDD UI wage file Any student without a valid SSN Not sure??? Self-Employed Franchise Tax Board Employed outside of California Get info. From Federal database Serving in the Military Notes on representation of students in the Launchboard: 70-80% of students with valid SSNs are matched From the CTE Outcomes Survey, about 10% of students report being self-employed