What’s Happening with Performance Accountability – WIA to WIOA California Workforce Association Spring Conference Denise Dombek ETA Region 6, San Francisco, CA May 12, 2015

Workforce Innovation and Opportunity Act - WIOA

Federal Register Notice Workforce Innovation and Opportunity Act; Joint Rule for Unified and Combined State Plans, Performance Accountability, and the One-Stop System Joint Provisions; Notice of Proposed Rulemaking Pages 20573 - 20687 (115 pages) [FR DOC #: 2015-05528] Published on April 16, 2015 Written Comments must be received by no later than June 15, 2015

WIOA Performance Accountability – System Alignment Ensuring that federal investments in employment and training programs are evidence-based, data-driven, and accountable to participants and taxpayers by establishing a common performance accountability system for the core programs and requiring other authorized programs to report on the common performance indicators.

Data Collection For the most part, most of the performance data required by WIOA is already being collected. However, the primary indicators of performance specify outcomes with respect to quarters after exit that are different from WIA. There are also some additional data elements that will be required such as credentials attainment, measurable skills gain, training-related costs and information regarding employer engagement.

Policies/Procedures and Training Data management and the resultant quality of reported data are derived from and influenced by the policies, procedures and protocols utilized at the state and/or local levels Grantees should develop guidance for staff and sub-grantees involved in the collection of data: Definitions of data elements Sources of information Participant record and documentation requirements Procedures for collecting, entering and reporting data and associated “business rules” that cover timeliness and completeness Procedures for entering data into an automated database Procedures for correcting data

Training and Monitoring Data collection and data entry: Routine training should be provided for data management guidance All staff involved in the collection or entry of data should be trained in the procedures The data entry process should include steps for verifying entered data against original sources on a sample basis or for entire population of records

REPORTING If Data is not collected and reported, it didn’t happen!!

WIOA Identified Programs – Common Performance Accountability measures Core Programs WIA (Title I) Adult, Dislocated Worker, Youth Wagner-Peyser (Title III) Vocational Rehabilitation (Title IV) Adult Education (Title II) Additional Programs Job Corps Native American Migrant and Seasonal Farmworker YouthBuild

WIA Notable Changes - Performance 10 WIA Notable Changes - Performance Additional Measures – Employer, Skills Tracking of “Efficiency” Outputs Common Reporting/Tracking: Core Programs UI Wage Record Access for Core Programs Sanctions for “Failure” – Reporting, Outcomes ETPL Reporting Changes – incl. scope of trainees Regression Models - Negotiations, Measurement Pay-for-Performance Contracting Allowability Dissemination of Effective Practices

Pay for Performance Local Areas may use up to 10% of Adult and Dislocated Worker funds for pay-for-performance contract strategies. Based on the achievement of specified levels of performance on the core program’s performance measures (primary indicators of performance) Further provisions included in Notice of Proposed Rulemaking (NPRM) and additional guidance planned on the appropriate use of pay-for-performance contract strategies.

Performance Accountability *unless State ‘early implementer’ WIA (Workforce Investment Act) effective through PY15 WIOA (Workforce Investment and Opportunity Act) effective PY16* ‘Services’ based Participation and Exit Data Validation required Reporting Cohort primarily 1st to 3rd Qtr after Exit Nine Common Measures Reporting Participant Information Sequence of Services – Core, Intensive, Training ‘Services’ based Participation and Exit Data Validation codified Reporting Cohort extended 2nd to 4th Qtr after Exit Twelve Primary Indicators of Performance Expanded Reporting Participant Information ‘Career Services’ and Training Performance Accountability *unless State ‘early implementer’

WIA Participant An individual determined eligible to participate in the program who receives a service funded by the program in either a physical location (e.g., One-Stop Center) or remotely through electronic technologies. Three Components Determined eligible to participate in the program Receives a funded service In either a physical location or through electronic technologies

WIOA “Participant” When does participation begin? What services commence participation and inclusion in performance accountability? What is impact of self service? Reported across Core Programs?

WIA Exiter A participant who hasn’t received a program or partner-funded service for 90 consecutive days and no future services are scheduled Three components Hasn’t received a service For 90 consecutive days No future services scheduled

WIOA “Exit” When is it appropriate to Exit? Same for all Programs? Youth participants? Common or Program Exit?

A WIA Service Is: Any core, intensive or training activity made available to eligible participants that allows them to benefit from specific programs in the workforce system.

WIOA “Service” No longer ‘sequence of services’ Core and Intensive = Career Services What commences and continues participation?

WIA Entered Employment Rate Of those who are not employed at the date of participation: Number of adult participants who are employed in the 1st quarter after the exit quarter Number of adult participants who exit during the quarter

WIA Employment Retention Rate Of those who are employed in the first quarter after the exit quarter: Number of adult participants who are employed in both the second and third quarters after the exit quarter Number of adult participants who exit during the quarter

WIA Average Six-Month Earnings Of those adult participants who are employed in the first, second and third quarters after the exit quarter: Total earnings in the second quarter plus total earnings in the third quarter after the exit quarter Number of adult participants who exit during the quarter

WIA PLACEMENT IN EMPLOYMENT OR EDUCATION Of those not employed, in the military or in post-secondary education at participation: Number of youth employed, in the military or enrolled in post-secondary education and/or advanced training or occupational skills training in the 1st quarter after exit Number of exiters

WIA ATTAINMENT OF DEGREE OR CERTIFICATE Of those enrolled in education at participation or any time during the program: Number of Youth who attained a diploma, GED or certificate by the end of the 3rd quarter after exit Number of Exiters 23

WIA LITERACY/NUMERACY GAINS Of those out-of-school youth who are basic skills deficient: Number of Youth participants who increase one or more educational functioning levels Number of youth who completed a year of participation (based on date of 1st youth service) PLUS Number of youth who exit before completing a year of participation 24

Core Programs’ Performance Measures (except WIOA Youth) Employment 2nd quarter after exit 4th quarter after exit Earnings New; Median earnings 2nd quarter after exit Credential Rate New; Up to one year after exit; Doesn’t apply to WP In-Program Skills Gain New; Achieving measurable skills gains, Doesn’t apply to WP Employer Effectiveness New; before PY16

WIOA Youth Performance Measures Education/Employment 2nd quarter after exit 4th quarter after exit Earnings Median earnings 2nd quarter after exit Credential Rate Up to one year after exit If HS Dip/GED, must include Employment/Postsecondary In-Program Skills Gain Achieving measurable skills gains Employer Effectiveness before PY16

Employment Measure - WIA to WIOA Reporting Time Periods For the Quarter ending Sept 2014 2013 2014 Jan-Mar Apr-June July-Sept Oct-Dec Exit Cohort   Employment/Education Qtr 2 Qtr Wage Delay Nov 15th 2015 Jan-Mar Feb 14th

WIOA – What’s Eliminated Literacy/Numeracy indicator for youth Although utilized in development of Skills Gain measure Customer Satisfaction as statutory measure State Incentive Funds But Governor’s reserve may be used for local incentives

WIOA Youth Program Design Focus on Out of School Youth 75% of formula youth funds minimum Work Experience Expenditure 20% of local area funds minimum Eligible Out-of-School Youth Age 16-24 year olds In-School Youth Age 14-21 year olds New Program Elements 5 new elements

WIOA Youth Program Transition Youth PY 2015 Funding April 1, 2015 WIOA Implementation July 1, 2015 TEGL 23-14. While WIOA is effective July 1, 2015 and the Youth funds allotments are provided April 1, 2015, and it will take some time to transition, States and Local Areas must begin to incorporate strategies for recruiting and serving more OSY with the receipt of PY 2015 funds. Progress must be documented, including plans to achieve 75% expenditure rate with future funds.

Additional Provisions State Targets Must use statistical adjustment model—use now codified (Sec. 116(b)(3)(A)(viii)) Targets for first two years included in State Plans Additional Information required in Annual Reports Example: Amount of funds spent on each type of service Data Validation now codified (Sec. 116(d)(5))

Additional Provisions Sanctions State Level If a state fails performance a first year, TA will be provided (used to say will provide TA upon request) If a state fails performance a 2nd consecutive year or fails to submit an Annual Report for any year, it can lead to a 5% reduction in statewide funds (stronger language) Local Level If failure continues for a 3rd consecutive year, the Governor must take corrective action which shall include development of a reorganization plan (and new local board)

WIOA State Reporting State Performance Reports will include: Information specifying levels of performance for the primary indicators State adjusted levels of performance for each program Performance information aggregated by individuals with: Barriers to employment Subpopulation of these individuals according to race, ethnicity, sex and age Total participants served by each program The percentage of the State’s annual allotment spent on administrative costs

WIOA State Reporting (cont) Information on participants in career and training services during the program year and the 2 preceding programs years: The number of participants enrolled The number of participants who exited The total amount of funding expenditures The average cost/participant The number of participants enrolled in more than 1 program The number of participants with barriers to employment Administrative costs

WIOA State Reporting-Pay for Performance Pay-for-performance contracts for program strategies: The performance of the service providers measured against contract-specified performance measures An evaluation of the design of the programs and performance of the strategies Where possible, levels of satisfaction among employers and participants Other information that facilitates comparisons with programs in other states.

WIOA Local Reporting Local Performance Reports will include everything in the State reports in addition to the following: The percentage of the Local’s annual allotment spent on administrative costs; and Other information that facilitates comparisons of programs in other local areas

WIOA Eligible Training Providers (ETP) Reporting ETPs provide student performance outcome data in State reports, which must include: The Total number of individuals exiting a program (WIOA-funded and non-WIOA-funded) Elements relating to the number of WIOA participants receiving & exiting training Average cost Number of special populations served.

Timeline for WIOA Performance Transition Date Action Proposed regulations published Comment Period Ends Templates for state, local, and ETP performance reports PY2016 Performance Targets negotiated Employer Effectiveness measure developed Full implementation of WIOA performance measures April 16, 2015 June 15, 2015 July 22, 2015 March 3, 2016 June 30, 2016 July 1, 2016

WWW.DOLETA.GOV/WIOA WIOA Resource Page 39 Fact Sheets NPRM Webcast Notice of Proposed Rulemaking Updates Guidance WIOA Technical Assistance Tools and Resources      

Questions Final Questions or Comments