Welcome to the Common Measures Webinar Press *6 to mute your telephone Please do not put your phone on HOLD In the ‘chat’ box, please enter and send us your MWA or organization name, address, and the names of everyone participating at your location. Thanks!! We’ll get started soon!

AGENDA Webinar Housekeeping Introductions Common Measures TEGL DLEG-BWP PI Performance Measures VAPIS MIS Changes

TEGL 17-05

Establishing Common Measures Effort led by OMB as part of President’s Management Agenda –Linking performance to budget –Supporting effective programs –Comparing similar programs across agencies Includes six federal departments

The Common Measures Adult Measures –Entered Employment –Employment Retention –Average Earnings* * Average Earnings become effective PY 2006; for PY 2005, the measure is an Earnings Change.

The Common Measures Youth Measures –Placement in Employment or Education –Attainment of a Degree or Certificate –Literacy or Numeracy Gains

Common Measures Benefits Focus on the core purposes of the workforce system Break down barriers to integration Resolve questions regarding consistency and reliability of data Reduce confusion

PY 2005 Accountability Accountable for specific Common Measures –Entered Employment Rate (WIA, W-P, VETS, Trade) –Employment Retention Rate (WIA, W-P, VETS, Trade)

PY 2005 Accountability Accountable for specific WIA statutory performance measures –Adult, DW, and OY Average Earnings Gain/Replacement (WIA, W-P, VETS, Trade) –Adult and DW Employment and Credential –OY Entered Employment, Retention, Earnings, Credential –YY Retention, Skill Attainment, Diploma Attainment –Customer Satisfaction (Participants and Employers)

PY 2005 Accountability Accountable for reporting on specific Common Measures –Youth Attainment of Degree/ Certificate –Youth Placement in Employment/ Education

PY 2005 Accountability Reporting recommended for Youth Literacy/Numeracy –Required beginning in PY 2006 WIA performance accountability for PY 2005 still consists of the “17” measures –With some changed definitions

Program Reporting In general, individuals who are eligible for a program and receive any service should be reported in participant counts

Youth Program Design Implication #1 Long-Term Participation Common Measure outcomes are unlikely to be met unless youth participate for extended periods

Youth Program Design Implication #2 Network of Services Since long-term participation is needed to achieve outcomes, now more than ever, WIA youth must have access to a network of services, not a single program or provider

Youth Program Design Implication #3 Assessment Youth friendly assessments Tell youth why they are being tested and how the test will be used Do not retest too soon Consider other assessments Remove the high-stake test pressure

QUESTIONS

DLEG BWP – PI 05-41

Definition of a “Participant”

RequiredData to Record ParticipantCounts

ServicesThatCommenceParticipation

Definition of an “Exiter”

ServicesThat Extend the Exit Date

Services That Do Not CommenceParticipationor Extend Exit

QUESTIONS

Performance Measures

Adult Common Measures Entered Employment Rate Employment Retention Rate Average Earnings

Programs Covered WIA Adult WIA Dislocated Worker Trade Act Wagner-Peyser VETS

Entered Employment Rate Definition: For those not employed at participation, the percentage employed in the 1 st quarter after exit

Entered Employment Rate Calculation: Of those not employed at participation… Number employed in 1 st quarter after exit Number who exit during the quarter

Highlights of Adult Entered Employment Rate Excludes Adults employed at participation Employment at participation is based on information collected from the individual

Highlights of Adult Entered Employment Rate Those who received a notice of termination or the employer has filed a WARN or similar notice are considered not employed Transitioning Service Members (expected to retire within 12 months) are considered not employed

Employment Retention Rate Definition: For those employed in the 1 st quarter after exit, the percentage employed in the 2 nd and 3 rd quarter after exit Calculation: Of those employed in the first quarter after exit… Number employed in the 2 nd and 3 rd quarter after exit Number who exit during the quarter

Highlights of Adult Employment Retention Rate Includes all those employed in the 1 st quarter after exit regardless of employment status at participation Positive outcome requires employment in two post-exit quarters (does not have to be with the same employer)

PY 2006 Average Earnings Definition: For those employed in the 1 st, 2 nd, and 3 rd quarter after exit, average six-month earnings in the 2 nd and 3 rd quarter after exit

PY 2006 Average Earnings Calculation: Of those employed in the 1 st, 2 nd and 3 rd quarters after exit… Earning from the 2 nd and 3 rd quarter after exit Number who exit during the quarter

Highlights of Adult Average Earnings Includes those employed in 1 st, 2 nd, and 3 rd quarter after exit Only allowable data source is wage records

Highlights of Adult Average Earnings Those whose employment was determined based on supplemental data are excluded from the earnings measure WIA programs will use the current Adult Earnings Change measure for PY 2005

QUESTIONS

Youth Common Measures Placement in Employment or Education Attainment of Degree or Certificate Literacy/Numeracy Gains

Program Covered WIA Youth

Placement in Employment or Education Definition: Of those not in post- secondary education, employment, or the military at participation, the percentage in employment, the military or enrolled in post-secondary education and/or advance training/occupational skills training in the 1 st quarter after exit.

Placement in Employment or Education Calculation: Of those not employed, in the military, or in post-secondary education at participation… Number of youth employed, in the military, or enrolled in post-secondary education and/or advanced training or occupational skills training in the 1 st quarter after exit Number of exiters

Highlights of Youth Placement in Employment or Education Excludes youth in employment, the military, or post-secondary education at participation Employment, military, and education status at participation is based on information collected from the individual Employment and military status in the 1 st quarter after exit is based on wage records (supplemental data allowed)

Highlights of Youth Placement in Employment or Education Education status in the 1 st quarter after exit is based on administrative records Youth in secondary school at exit are included, consistent with ETA’s vision to ensure youth successfully complete their secondary education

Defining Specific Terms Post-Secondary Education A program at an accredited degree-granting institution leading to an academic degree.

Defining Specific Terms Advanced Training/Occupational Skills Training

Attainment of Degree or Certificate Definition: Of those enrolled in education at or during participation, the percentage who attained a diploma, GED, or certificate by the end of the 3 rd quarter after exit.

Attainment of Degree or Certificate Calculation: Of those enrolled in education at participation or any time during the program… Number or youth who attained a diploma, GED, or certificate by the end of the 3 rd quarter after exit Number of exiters

Highlights of Youth Attainment of Degree or Certificate Youth in secondary school at exit are included, which is consistent with ETA’s vision to ensure youth successfully complete their secondary education

Highlights of Youth Attainment of Degree or Certificate Diplomas, GEDs, or certificates can be obtained during participation or at any point by the end of the 3 rd quarter after exit Work readiness certificates will not be accepted for this measure

Defining Specific Terms Education Participation in secondary or post- secondary school, adult education programs, or any other organized program of study leading to a degree or certificate

Defining Specific Terms Diploma Any credential accepted by the State educational agency as equivalent to a HS diploma; also includes post-secondary degrees

Defining Specific Terms Certificate Awarded in recognition of an individual’s attainment of technical or occupational skills. Does not include work readiness certificates or certificates awarded by local boards.

Literacy/Numeracy Gains Definition: Of those out-of-school youth who are basic skills deficient, the percentage who increase one or more education functioning levels within one year of participation.

Literacy/Numeracy Gains Calculation: Of those out-of-school youth who are basic skills deficient… Number of Youth participants who increase one or more educational functioning levels Number of youth who completed a year of participation (based on date of 1 st youth service) Number of youth who exit before completing a year of participation

Highlights of Literacy & Numeracy Gains Only common measure that is not exit- based Excludes in-school youth and out-of- school youth who are not basic skills deficient Includes individuals with learning disabilities

Highlights of Literacy /Numeracy Gains A positive outcome means the youth must advance one or more ABE or ESL functioning levels Gains can occur in literacy or numeracy Educational levels are consistent with Department of Education’s National Reporting System (NRS) Reporting begins July 1, 2006

About the Assessments The same standardized assessment must be used for pre- and post- testing

About the Assessments If a youth continues to be basic skills deficient after the first 12 months of participation, they should continue to receive training in literacy and/or numeracy skills

About the Assessments All out-of-school youth must be assessed in basic reading, writing, and math

About the Assessments Pre-testing must occur within 60 days of the first youth program service; can use pre-test from up to six months prior to date of first youth service

About the Assessments Must use one of the assessment tools listed in Attachment C of TEGL 17-05

About the Assessments Youth should be post-tested by the end of one year of participation and compared to pre-test results obtained during the initial assessment

About the Assessments Youth should be post-tested and included in the measure at the completion of the 2 nd year if they complete two years in the program

Exclusions from Common Measures A participant in any of the following categories, may be excluded –Institutionalized –Health/Medical or Family care –Deceased –Reserve Forces Called to Active Duty –Relocated to a Mandated Program –Invalid or Missing Social Security Number

WIA Program Accountability MWAs will continue to be held accountable for all current (17) WIA performance measures WIA Adult performance measures will utilize the Adult Common Measures definitions

QUESTIONS

VALUE ADDED PERFORMANCE IMPROVEMENT SYSTEM V A P I S

VAPIS Provides adjusted performance data for the State and local areas. Predicts local area performance. Provides data to support identification of local area strengths and weaknesses, leading to system improvements.

Programs Included WIA Adult WIA Dislocated Worker Wagner-Peyser

Common Measures Entered Employment Rate Employment Retention Rate Average Earnings

Quarterly VAPIS Report by Program Measure Actual and Adjusted performance results. Prediction of future performance results. Measure of Value Added by local area.

QUESTIONS

Common Terminology Participant = Enrollment = Registrant Activity = Service = Transaction

Participant Counts For new participants in Wagner-Peyser, the system will create a new participant in WIA.

Participant Counts For new participants in WIA, the system will create a new participant in Wagner-Peyser.

Participant Counts For new participants in Trade, the system will create a new participant in Wager-Peyser and WIA.

Wagner-Peyser Changes The activity “Assigned to Case Management” will now require a manual End Date entry.

Wagner-Peyser Changes Exit information will be available for User Input All records will now have an Exit Date

WIA Changes The pre-registration screen will be altered to capture Employment Status, Education Status, UI Claim Data and Migrant Worker

WIA Changes A new section for Youth Assessment data will be added to the system

WIA Changes A temporary Exit Date will be added for User input

Estimated Activity End Dates All activities that have Manual End Dates will have the Estimated End Date pre-filled by the system

Reports A new report will be created to list those individuals who are approaching the 90-day Exit limit.

Conversion of Data All WIA pre-registration, pending Trade and Wagner-Peyser records that are 91-days old or more will be Exited

Conversion of Data All other records will be checked to determine if they can be considered a concurrent participation

Conversion of Data All records 90-days old or less will have a new display page showing concurrent participation and other information pertaining to when the record will be Exited

Open Record Display Information 1 Latest Reg. Date: 01/01/2006 Has Activities: Y Latest Act End Date: 03/04/2006 Wagner- Peyser?: YWIAYTAA?N Latest Gap Date: 06/07/2006 Latest Future Svc: When Exit Will Occur: 06/08/2006

Open Record Display Information 2 Latest Reg. Date: 01/01/2006 Has Activities: Y Latest Act End Date: 03/04/2006 Wagner- Peyser?: YWIAYTAA?N Latest Gap Date: Latest Future Svc: ---- When Exit Will Occur: 06/05/2006

Open Record Display Information 3 Latest Reg. Date: 01/01/2006 Has Activities: Y Latest Act End Date: Wagner- Peyser?: YWIAYTAA?N Latest Gap Date: Latest Future Svc: When Exit Will Occur:

Exited Record Display Information Latest Reg. Date: 01/01/2006 Has Activities: Y Latest Act End Date: 03/04/2006 Wagner- Peyser?: YWIAYTAA?N Latest Gap Date: Latest Future Svc: Exit Date: 03/04/2006

Exit from the System The system will now Exit all Records

Exit from the System The Exit will occur 90-days after the latest Activity has Ended and there are no GAPs or Future Services planned.

Exit from the System For concurrently enrolled participants, all records will have the same Exit Date.

Exit from the System For concurrently enrolled participants, if an Exclusionary Exit reason is recorded in any of the programs, that reason will be used for all of the programs.

Questions

For More Information and Q & A’s Please Visit www. Michigan.gov/b wptraining Common Measures