Continuing Progress Towards Powerful TAACCCT Applications April 12, 2012

Welcome  COMPLETE COLLEGE AMERICA is a national nonprofit working to significantly increase the number of Americans with a college degree or credential of value and to close attainment gaps for traditionally underrepresented populations  CCA is again providing facilitation and support to: – Build state-based consortia to develop strong proposals incorporating completion objectives for the U.S. Department of Labor’s TAA Community College Career and Training Grant – To create a national consortia of colleges to focused on embedded remediation  Technical Assistance Team: Complete College America and our strategic partners— FutureWorks and Corporation for a Skilled Workforce (CSW)  This meeting is an important component of our technical assistance activities = draws on success of last year’s Dallas meeting 2

Arkansas Colorado Connecticut Florida Georgia Hawaii Idaho Illinois Indiana Kentucky Louisiana Maine Maryland Massachusetts Minnesota Mississippi Missouri Nevada New Mexico Ohio Oklahoma Oregon Pennsylvania Rhode Island South Dakota Tennessee Texas Utah Vermont West Virginia 30 Member States

TAACCCT Logic Model Inputs What we have now & need going forward Statement of Need Strategy What we will do to address the needs Strategic Approach and Core Elements Outputs Accelerated pathways to certificates & degrees Implementation Results Outcomes produced by our new program Skilled Workers with Good Jobs, and Competitive Industries  TAA Certification in at least one community and associated threat to or loss of jobs  Education needs of TAA workers  Evidence of job opportunities and understanding of education requirements in targeted industries  Evidence of gaps in ed/training programs and impact on institutions serving TAA workers  Evidence-Based Design and change strategies  Stacked and Latticed Credentials that are market-relevant and interconnected  Online and Technology-Enabled Learning  Transferability and Articulation from non- credit to credit  Strategic Alignment with WFS, educational institutions and employers  Expanded and improved ability to deliver education & training  Improved education and employment outcomes, particularly for TAA workers  Work Plan  Outcome measures – participant and deliverable  Evaluation Plan

Recommended Milestones By now you should have: Confirmed lead college Identified all colleges in consortium Identified the relevant TAA certification(s) By now you may have: Begun (or finished) assessment of TAA worker education and training needs Begun engaging employers to help plan strategy Selected occupational areas of focus Consulted with public workforce system Connected with key state level contacts Ideally you have also: Begun outlining your approach to the five Core Elements Started connecting this approach with activities required for implementation Begun mapping out tasks and their sequence Identified outcomes and begun inventorying systems available (and gaps) to track Thought about project management and consortium organizational plan Assigned responsibility for budgetary planning 5

Statement of Need 6 Total points: 20/101 1.Serving the Education and Training Needs of TAA- Eligible Workers (10 points) –TAA Certification determinations in one or more community to be served (on or after 1/1/2007) and impact of foreign trade –Partnerships with TAA Agencies –Education & training needs of TAA workers in communities to be served –Industries/occupations in which these workers were employed; –Current skill and educational attainment levels; –Additional barriers Statement of Need

2.Evidence of Job Opportunities in the Targeted Industries and Occupations (5 points) Factor One: Identify targeted industries and occupations, describe how employers are involved and what resources they are bringing to the project. Factor Two: Provide strong evidence (LMI) that the targeted industries and occupations will yield job opportunities for TAA workers; identify specific employers expected to hire participants. Factor Three: Demonstrate understanding of the job knowledge, skills, abilities and credentials required to work in the targeted industries and occupations; describe employer engagement to provide feedback on content developed in grant. 7

Statement of Need 3.Gap Analyses (5 points) Factor One: Describe the gaps in existing education and training programs and infrastructure based on data collected through community outreach and MIS or other data sources. (Match geographic scope and provide summary of outreach process.) Factor Two: Describe the current institutional technology and systems infrastructure and activities related to the SGA’s Core Elements and identify areas for improvement. Factor Three: Describe the overall impact of the gaps described above on your ability to effectively serve TAA and other workers – how does this limit your capacity? 8

Point-Value Overview Statement of Need 9 Serving the Education and Training Needs of TAA Eligible Workers (10 pts) Gap Analyses (5 pts) Evidence of Job Opportunities in the Targeted Industries and Occupations (5 pts) Evidence Based Design (8 pts) Stacked and Latticed Credentials (8 pts) Project Work Plan (10 pts) Project Management (10 pts) Process for Tracking and Reporting Outcome Measures (10 pts) Analysis of Outcome Projections (5 pts) Statement of Need Description of the Project: Strategic Approach and Core Elements Outcomes Online and Technology- Enabled Learning (8 pts) Transferability and Articulation (8 pts) Strategic Alignment (8 pts) Using Data for Continuous Improvement (5 pts) Work Plan & Project Management

Point-Value Overview Statement of Need 10 Statement of Need Tips and Pitfalls Execute a plan to meaningfully engage employers and workforce partners Consider surveying colleges to inventory services currently available in order to identify gaps Research outstanding questions unaddressed by outreach (i.e., trade impact certification, labor market information, etc.) Use the freshest data available Remember to document outreach processes Don’t rely solely on old outreach performed for unrelated projects Remember that this section sets the stage for your strategic approach and work plan Serving the Education and Training Needs of TAA Eligible Workers (10 pts) Gap Analyses (5 pts) Evidence of Job Opportunities in the Targeted Industries and Occupations (5 pts)

Description of the Project: Strategic Approach and Core Elements Total points: 40/101 1.Evidence-Based Design (8 points) – Factor One: Describe research findings and present the strongest evidence available for your proposed program design, discuss any mixed or negative evidence. Cite all sources and identify as strong, moderate or preliminary. – Factor Two: Describe the education and training strategies you are proposing, and how the evidence cited above influenced the design, as well as how this evidence will be incorporated into program development/delivery plans. Indicate here whether you will be implementing new strategies or replicating existing evidence- based strategies and cite applicable research. 11

Description of the Project: Strategic Approach and Core Elements Total points: 40/101 2.Stacked and Latticed Credentials (8 points) – Factor One: Describe plans to work with industry to identify clusters of courses and market-relevant credentials. – Factor Two: Describe plans to develop interconnected specific credentials, how they are compatible with or same as those use broadly, and process for connecting these credentials. (Indicate which institutions will award each credential.) – Factor Three: Describe plans to assess prior learning, identify types of assessments to be used and explain how credit will be awarded for prior learning. Military personnel experience considered. 12

Description of the Project: Strategic Approach and Core Elements Total points: 40/101 3.Online and Technology Enabled Learning (8 points) – Factor One: Describe how technology is incorporated into the design of the program and describe how online and technology enabled learning will be used in your project. – Factor Two: Explain how this use of technology will impact program outcomes (such as accelerating completion, expanding reach and capacity, improving learning outcomes, etc.) Technology-based infrastructure projects must support all proposed programs. 13

Description of the Project: Strategic Approach and Core Elements Total points: 40/101 4.Transferability and Articulation (8 points) – Factor One: Describe plans to establish transferability options and strengthen credit to non-credit transitions, including across consortium members, other TAACCCT funded programs and other institutions. – Factor Two: Describe plans to develop articulation strategies that support career pathways, including at least one agreement between 2- and 4-year institutions. Credit to non-credit potential. 14

Description of the Project: Strategic Approach and Core Elements Total points: 40/101 4.Strategic Alignment (8 points) – Factor One: Show substantial involvement of at least one employer or group of employers for each targeted industry (include letter of commitment.) Specify roles for employers and industry. – Factor Two: Describe your plan to collaborate with the public workforce system in developing and delivering programs. Provide evidence of their commitment. – Factor Three: Describe your plans to outreach to first round winners and other educational institutions. 15

Point-Value Overview Strategic Approach and Core Elements 16 Serving the Education and Training Needs of TAA Eligible Workers (10 pts) Gap Analyses (5 pts) Evidence of Job Opportunities in the Targeted Industries and Occupations (5 pts) Evidence Based Design (8 pts) Stacked and Latticed Credentials (8 pts) Project Work Plan (10 pts) Project Management (10 pts) Process for Tracking and Reporting Outcome Measures (10 pts) Analysis of Outcome Projections (5 pts) Statement of Need Description of the Project: Strategic Approach and Core Elements Outcomes Online and Technology- Enabled Learning (8 pts) Transferability and Articulation (8 pts) Strategic Alignment (8 pts) Using Data for Continuous Improvement (5 pts) Work Plan & Project Management

Point-Value Overview Strategic Approach and Core Elements 17 Strategic Approach and Core Elements Tips and Pitfalls Work together to develop a strategic approach that addresses identified needs with common strategies across the consortium Clearly address each Core Element Avoid cobbling together disparate strategies at each institution CCA can help equip you with evidence supporting completion-related strategies Evidence Based Design (8 pts) Stacked and Latticed Credentials (8 pts) Online and Technology- Enabled Learning (8 pts) Transferability and Articulation (8 pts) Strategic Alignment (8 pts)

Work Plan and Project Management Total points: 20/101 1.Project Work Plan (10 points) – Factor One: Present clear and reasonable activities with associated timeframes and deliverables that reflect understanding of costs and activities required for implementation. – Factor Two: Identify and outline adequate and reasonable costs associated with each major project activity described. – Factor Three: Describe new intellectual property that will be developed or improved and expected date of delivery to DOL. 18

Work Plan and Project Management Total points: 20/101 2.Project Management (10 points) – Factor One: Demonstrate that project will be lead by a competent, full-time project manager, involve well-qualified fiscal and administrative management, and staff with marketing expertise. Describe qualifications and hiring plan. – Factor Two: Propose a management structure for effective communication among project staff and organizations. Attach an organizational chart identifying leadership, program, administrative, advisory positions. – Factor Three: Explain how project will ensure timely and accurate financial and performance reporting and enable expedient procurement. You must: Demonstrate that you’ve submitted timely reports for most recent ETA or other grants; Describe grant management used to complete grant activities on time; and Describe procurement processes, systems, procedures and those of consortium members. – Factor Four: List consortium members’ roles and responsibilities throughout planning and implementation. Attach a Consortium Agreement. – Factor Five: Explain how you’ll use data to determine which strategies were effective and how to integrate in the future. Describe how you’ll sustain relationships with employers. 19

Point-Value Overview Work Plan and Project Management 20 Serving the Education and Training Needs of TAA Eligible Workers (10 pts) Gap Analyses (5 pts) Evidence of Job Opportunities in the Targeted Industries and Occupations (5 pts) Evidence Based Design (8 pts) Stacked and Latticed Credentials (8 pts) Project Work Plan (10 pts) Project Management (10 pts) Process for Tracking and Reporting Outcome Measures (10 pts) Analysis of Outcome Projections (5 pts) Statement of Need Description of the Project: Strategic Approach and Core Elements Outcomes Online and Technology- Enabled Learning (8 pts) Transferability and Articulation (8 pts) Strategic Alignment (8 pts) Using Data for Continuous Improvement (5 pts) Work Plan & Project Management

Point-Value Overview Work Plan and Project Management 21 Work Plan and Project Management Tips and Pitfalls Designate a Grantee (lead) Applicant… …but maintain a functional team with shared responsibility for planning and implementation Develop tools to develop consistent cost estimates for college labor and equipment needs Agree on a process for selecting project management staff Discuss what kinds of future financial resources may be available, and be realistic about your ability to raise outside funds Project Work Plan (10 pts) Project Management (10 pts)

Outcomes Total points: 20/101 1.Analysis of Outcome Projections (5 points) – Factor One: Provide numerical outcome projections (raw, not percentages) for each of nine outcome measures for each grant year and total grant period. Include as a table in the technical proposal. – Factor Two: Explain how the outcome projections are appropriate targets for program by providing an explanation of how the targets were derived and fit into implementation timeframe. – Factor Three: Provide an explanation for a mix of proposed outcomes (participants served) vs other deliverables (courses developed). 22

Outcomes Total points: 20/101 2.Process or System for Tracking and Reporting Outcome Measures (10 points) – Factor One: Provide specifics about existing procedures for tracking students, including which outcomes are already captured. – Factor Two: Describe and explain gaps between what is already collected and what is required and plans to bridge those gaps. Provide a specific plan (staffing, resources, technology, etc.) as well as the process to obtain employment outcome information. 23

Outcomes Total points: 20/101 3.Using Data for Continuous Improvement (5 points) – Factor One: Describe the process that will be used to formally review the data within educational institutions, with partners as applicable. Include how often reviews will occur, staffing and partners involved and how they are involved, how decisions will be made about adjustments, and how progress or improvement will be assessed. 24

Non-Participant Data Submission Bonus Point Total points: 1/101 Background: USDOL will facilitate tracking of employment outcomes for a broader population of students by arranging for grantees to submit basic individual-level information (name, SSN, DOB) about students enrolled in selected non-TAACCCT funded programs. USDOL will arrange for matching the data with employment records using secure IT, and will provide grantees with a report on employment and earnings outcomes aggregated by program. – Factor One: Provide an affirmative statement committing to provide data annually during grant performance. – The Grantee (lead) Institution or one consortium member must make this commitment to be eligible for the bonus. 25

Point-Value Overview Outcomes 26 Serving the Education and Training Needs of TAA Eligible Workers (10 pts) Gap Analyses (5 pts) Evidence of Job Opportunities in the Targeted Industries and Occupations (5 pts) Evidence Based Design (8 pts) Stacked and Latticed Credentials (8 pts) Project Work Plan (10 pts) Project Management (10 pts) Process for Tracking and Reporting Outcome Measures (10 pts) Analysis of Outcome Projections (5 pts) Statement of Need Description of the Project: Strategic Approach and Core Elements Outcomes Online and Technology- Enabled Learning (8 pts) Transferability and Articulation (8 pts) Strategic Alignment (8 pts) Using Data for Continuous Improvement (5 pts) Work Plan & Project Management

Point-Value Overview Outcomes 27 Outcomes Tips and Pitfalls Invite college staff that work with data to participate in planning Agree on measures Work with your local workforce partners to see what information they already track Identify system software compatibility issues Use leveraged expertise Analysis of Outcome Projections (5 pts) Process for Tracking and Reporting Outcome Measures (10 pts) Using Data for Continuous Improvement (5 pts)

Point-Value Overview 28 Serving the Education and Training Needs of TAA Eligible Workers (10 pts) Gap Analyses (5 pts) Evidence of Job Opportunities in the Targeted Industries and Occupations (5 pts) Evidence Based Design (8 pts) Stacked and Latticed Credentials (8 pts) Project Work Plan (10 pts) Project Management (10 pts) Process for Tracking and Reporting Outcome Measures (10 pts) Analysis of Outcome Projections (5 pts) Statement of Need Description of the Project: Strategic Approach and Core Elements Outcomes Online and Technology- Enabled Learning (8 pts) Transferability and Articulation (8 pts) Strategic Alignment (8 pts) Using Data for Continuous Improvement (5 pts) Work Plan & Project Management

Program Evaluation Plan 29 – You are required to hire (may be paid for from grant funds) a third party evaluator. Many applicants engage an evaluator during the proposal development process to help them write this section. However, it is important to note that you will still have to competitively procure the evaluator after receiving the grant funds. – The evaluation plan page limit does not count against Technical Proposal page limit, but cannot exceed 10 pages. – Evaluation plans will be reviewed separately from technical proposals. – Technical proposal rankings will serve as the initial basis for selection. – As with round one, two general types of outcomes will be tracked to measure participant progress and implementation progress. – You can expect to track more implementation (or process) measures in the first year of implementation.

Program Evaluation Plan 30 1.Participant Outcomes or Impacts – Provide a detailed plan for rigorous evaluation of the participant outcomes or impacts, including a complete description of methodology and data collection methods. – Explain how the methodology proposed is the most rigorous for the participant outcomes or impacts given the number of participants (including TAA workers) the project intends to serve. – Explain how the anticipated follow-up data will be successfully collected from participants and the control/comparison group. Identify chosen methodology on first page of evaluation plan. For random assignment, fully explain: – How the recruitment plan will yield a sufficient number of qualified applicants (program and controls) to produce valid estimates of the key outcomes: program completion, credential attainment, placement into employment, and employment retention, as well as average earnings; – How random assignment will be performed; and – What procedures will be in place to ensure fidelity of random assignment. Note that TAA workers cannot be randomly assigned. For comparison group methodology, fully explain: – The source of the comparison group and how individuals will be selected into this group, including showing that data on both the comparison and program participant group will be from comparable sources.

Program Evaluation Plan 31 2.Program Implementation Provide a detailed plan for the program implementation analysis component of the evaluation, including how the evaluation will: – Analyze the steps taken by the consortium to create and run the program; – Assess the operational strengths and weaknesses of the project after implementation; and – Suggest how it might be improved. Specific questions to be answered through evaluation activities must include: – How was the particular curriculum selected, used, or created? – How were the programs and design improved or expanded with grant funds? What delivery methods were offered? What was the administrative structure? What support and other services were offered? – Did the grantees conduct an in-depth assessment of participants’ abilities, skills, interests to select for inclusion in program? What assessments were used? Who conducted them? How were the results used? Were the results useful in determining the appropriate program and course sequence for participants? Was career guidance provided and, if so, through what methods? – What contributions did each partner (including employer, workforce, philanthropy, etc.) make in terms of program design, curriculum development, recruitment, training, placement, program management, leveraging resources and commitment to sustainability. What contributed to involvement? Which contributions were most critical? Which were not?

Program Evaluation Plan and Budget Narrative 32 3.Selection of Third Party Evaluator – Describe the process for selecting and procuring a third party evaluator prior to enrolling participants, including the capacity and expertise required. Program Evaluation Budget Narrative – The program evaluation budget narrative is separate from the overall budget narrative for the proposed project. Has no page limit. – Program evaluation costs should not exceed 10% of the total proposed grant budget. – The program evaluation budget narrative should provide a description of all program evaluation costs, and all costs should be reasonable and appropriate to timelines and deliverables. – Be sure to include the program evaluation costs together with all grant activities on the SF-424 and SF-424A forms.

Required Reporting 33 Fourteen required outcome measures:  Unique participants served  Total number who have completed a grant-funded program of study  Total number still retained in their program of study or another grant-funded program  Total number retained in other (non-grant funded) programs of study  Total number of credit hours completed  Total number of students completing credit hours  Total number of earned degrees/certificates  Total number of students earning certificates (less than one year)  Total number of students earning certificates (more than one year)  Total number of students earning degrees  Total number employed after grant-funded program of study completion  Total number retained in employment after program of study completion  Total number of those employed at enrollment (incumbent workers) who receive a wage increase post-enrollment.

Next Steps  We will offer an in depth review of your draft proposals. Please submit your draft by: – Monday, May 7 (to have response back by May 10); OR – Monday, May 14 (to have response back by May 17)  Applications are due Thursday, May

Discussion 35 What are the implications of what you’ve heard here today for your grant development process? Do any key areas of your grant process require attention or refocusing? Have you identified any specific areas of confusion?

Thank you. COMPLETE COLLEGE AMERICA and our strategic partners— FutureWorks and Corporation for a Skilled Workforce (CSW) ______ Questions, comments or feedback: Dominique (Domy) Raymond