STATE PLANNING GUIDANCE: Performance Negotiation and Common Measures ETA Performance Webinar April 20, 2005

Virtual Classroom Layout Presentation Slide Area Participant List Chat Room Performance Negotiation and Common Measures

Submitting Questions Chat Room Enter questions into the Chat Room (located in lower left corner of the virtual classroom). To submit a question, type the question in the text box and click the arrow button. To send questions to the Presenter only (not to Everyone), select Presenter from the drop-down menu before clicking the arrow button. Questions will be answered at the end of the presentation. Arrow Button Text Box Drop-Down Menu Performance Negotiation and Common Measures

Practice In the chat room, please type the name of your organization, your location, and how many people are attending with you. Performance Negotiation and Common Measures

Access to Webinar Materials Materials and presentation slides used in this webinar will be available for download from the Resources & Information section of the Workforce3 One Webspace. All webinars are recorded and available for viewing after the event. Recorded webinars will be posted to the Multimedia Information/ Self-Paced Learning section of the Workforce3 One Webspace. Performance Negotiation and Common Measures

Office of Performance and Technology Karen Staha Division Chief Office of Performance and Technology Performance Negotiation and Common Measures

ETA Presenters Presenters: Karen Staha, Division Chief, Office of Performance and Technology Gail Eulenstein, Office of Workforce Investment, Office of Adult Services Evan Rosenberg, Office of Workforce Investment, Office of Youth Services Resources: John Ladd, Office of Field Operations Stephanie D. Cabell, Office of Workforce Investment, Office of Adult Services Brian Pasternak, Office of Performance and Technology Performance Negotiation and Common Measures

Workforce System Performance: Improving Performance Results Reporting performance is a fundamental element of improving customer services and good public administration Performance information should be easily understood by all customers, stakeholders, and operators of the workforce investment system Establishing common measures and standardizing customer data collection improves the comparability and understanding of performance results by all customers, stakeholders, and operators of the workforce investment system Ensuring the accuracy and timeliness of performance results is necessary for demonstrating system integrity and value Performance Negotiation and Common Measures

ETA Performance Activities Update ETA issued TEGL 18-04 on February 28, 2005, announcing intent to implement common performance measures for WIA, Wagner-Peyser Act, and TAA in PY 2005/FY 2006. ETA published a request for OMB emergency clearance for revised reporting requirements on March 29, 2005. Final state plan guidance was issued in the Federal Register on April 12, 2005. State plans are due to ETA by May 31, 2005. Performance Negotiation and Common Measures

ETA Performance Activities Update (Cont’d) Final negotiation guidance (TEGL 27-04) was issued on April 14, 2005. http://wdr.doleta.gov/directives/attach/TEGL27-04.pdf The negotiation of performance goals for WIA is a component of the planning process. ETA will negotiate WIA performance levels with states for PY 2005 and PY 2006 so that final goals are established by June 30, 2005. Wagner-Peyser Act and TAA programs will establish benchmarks for the common performance measures in PY 2005/FY 2006. Revised Common Measures policy guidance (TEGL 28-04) was issued on April 15, 2005. http://wdr.doleta.gov/directives/attach/TEGL28-04.pdf Performance Negotiation and Common Measures

State Plans and Demand-Driven Expectations “Effective Accountability System” = Program Design + Results Achieved Performance Negotiation and Common Measures

Planning Guidance- Section X, Part D State Plans: The Intersection of Performance Negotiations and Common Measures Planning Guidance- Section X, Part D Describe state efforts to prepare for implementation of common measures Include proposed levels for performance measures BEYOND the Planning Guidance, Adjustments to: Common Measures Policy Performance Negotiation Policy Reporting Instructions Performance Negotiation and Common Measures

WIA Negotiations Negotiating for WIA Performance Levels for PY2005 and PY2006: Follow Existing Statute Adults/Dislocated Workers Entered employment Employment retention Earnings change Employment and Credential rate Customer Satisfaction Employers Job Seekers Older Youth Entered employment Employment retention Earnings change Employment and Credential rate Younger Youth Skill attainment rate Diploma attainment rate Retention rate Performance Negotiation and Common Measures

State Plans and Common Measures Negotiations will take place on all measures required by statute. Where possible, performance measures will reflect common definitions. Additionally, states will begin collecting information for youth common measures. For Adults and Dislocated Workers, the common measure definitions will be substituted for those originally defined in TEGL 7-99. For Youth, data collection and reporting will begin for the common measures as follows: Placement in Employment/Education and the Attainment of Diploma or Certificate measures in PY05. Literacy/Numeracy Gains measure will be encouraged, but not required, in PY05. States will not negotiate levels for the youth common measures during this planning cycle. Performance Negotiation and Common Measures

Common Measures In addition to common measures, other information collected will continue to be valuable. Management and oversight of programs will continue to require information that is relevant to each program. Information on statutorily-required performance measures will continue to be collected and reported. Additional information about participants, services and outcomes must supplement the story told by the common measures. Performance Negotiation and Common Measures

Value of Common Measures Key benefits from common measures: Focus on the core purposes of the workforce system– employment for adults and skill gains for youth; Break down barriers to integration resulting from different definitions, data and reports for each workforce program; Resolve questions raised by GAO and other oversight agencies regarding the consistency and reliability of data; and Reduce confusion among our customers and stakeholders who want to know about results. Performance Negotiation and Common Measures

Common Measures Key Definitions: Participant – An individual who is determined eligible to participate in the program and receives a service funded by the program in a physical location.* Exit – Participant does not receive a service funded by the program or a partner program for 90 consecutive calendar days and is not scheduled for future services Some global exclusions from the measures * States and grantees are encouraged to consider as participants those individuals who receive services that are available through the Internet and are not accessed through a physical location. Performance Negotiation and Common Measures

Office of Workforce Investment Office of Adult Services Gail Eulenstein Office of Workforce Investment Office of Adult Services Performance Negotiation and Common Measures

Adult Common Measures Summary of Major Policy Changes TEGL 15-03 Old Policy TEGL 28-04 New Policy ADULT MEASURES Entered Employment Rate No change in methodology from WIA or TEGL 15-03 Permits grantees to use wage records and supplemental data Employment Retention Rate Measurement at 1st, 2nd, and 3rd quarters No change in methodology from TEGL 15-03 Earnings Increase Measure Separated into two distinct indicators of performance Percent change pre- to post-program Qtr 1 Percent change post-program Qtr 1 to Qtr 3 Replaces the two-part earnings increase measure identified in TEGL 15-03 with a single Six Month Earnings Increase measure (pre- to post-program) Wage records are the only data source Grantees that do not have access to wage records can use supplemental data as an interim means of reporting Program Efficiency identified as a core common measure Eliminates program efficiency as a reportable measure at the grantee level Performance Negotiation and Common Measures

Adult: Entered Employment Measure: Of those not employed at the date of participation: The number of participants employed in the 1st quarter after the exit quarter divided by the number of participants who exit during the quarter Same as current WIA Adult, Dislocated Worker, and TAA Entered Employment definition Includes only those not employed at entry Employment at participation is based on information from the individual, not wage record data Performance Negotiation and Common Measures

Adult: Employment Retention Measure: Of those employed in the 1st quarter after the exit quarter: Number of participants employed in both the 2nd and 3rd quarters after the exit quarter divided by the number of participants who exit during the quarter Additional measurement point (2nd quarter) compared to current definition Includes all participants employed in the 1st quarter regardless of their employment status at participation Employment in the 1st, 2nd, and 3rd quarters does not have to be with the same employer Performance Negotiation and Common Measures

Adult: Earnings Increase Measure: Of those employed in 1st quarter after exit: Total post-program earnings (in Q2 & Q3 after exit) minus pre-program earnings (in Q2 & Q3 prior to participation) divided by the number of adults who exit during the quarter Same as current WIA Adult Earnings Gain measure, but different calculation than current wage replacement rate for WIA Dislocated Worker and TAA programs Completely new measure for ES/VETS programs Designed as a six month pre- and post-program look at earnings change Verified through wage record data only Performance Negotiation and Common Measures

Any Questions on the Adult Common Measures? Performance Negotiation and Common Measures

Office of Workforce Investment Office of Youth Services Evan Rosenberg Office of Workforce Investment Office of Youth Services Performance Negotiation and Common Measures

Youth Common Measures Summary of Major Policy Changes TEGL 15-03 Old Policy TEGL 28-04 New Policy YOUTH MEASURES Placement in Employment or Education Excluded individuals in secondary school at exit from performance calculations Individuals in secondary school at exit are now included in the measure Permits grantees to use wage records and supplemental data Attainment of Degree or Certificate Clarifies the definition of Diploma Includes degrees/certificates awarded by tribally-controlled colleges and universities Literacy and Numeracy Gains Included all in-school and out-of-school youth who were basic skills deficient In-school youth are now excluded from the measure Provides additional guidance on providing reasonable accommodations for testing youth with disabilities Program Efficiency identified as a core common measure Eliminates Program Efficiency as a reportable measure at the grantee level Performance Negotiation and Common Measures

Youth: Placement in Education or Employment Measure: Of those who are not in any of the following at date of participation - post-secondary education, employment, or the military: Number of participants in employment or the military or enrolled in post-secondary education and/or advanced training/occupational skills training in the 1st quarter after exit divided by the number of participants who exit during the quarter Similar to current Younger Youth Retention measure in that it recognizes the same outcomes – improvement from Older Youth Entered Employment Includes first quarter after exit only Tighter definition of Advanced Training Includes individuals in secondary school at participation and exit Performance Negotiation and Common Measures

Youth: Attainment of Degree or Certificate Measure: Of those enrolled in education at participation or any time during the program: Number of participants who attain a diploma, GED, or certificate by the end of the 3rd quarter after the exit quarter divided by number of participants who exit during the quarter Similar to a combination of the Younger Youth Diploma Rate and Older Youth Credential Rate Tighter definition of certificate and does not have employment as a component like the current credential measure Diplomas, GEDs, or certificates can be obtained while a person is still receiving services or at any point prior to the end of the 3rd quarter after exit Education refers to those in secondary, post-secondary, adult education, or any other organized program of study Includes individuals in secondary school at participation and exit Performance Negotiation and Common Measures

Definition of Certificate Certificate – awarded in recognition of attainment of measurable technical or occupational skills necessary to gain employment or advance within an occupation Based on standards developed or endorsed by employers Certificates awarded by workforce investment boards or in recognition of attaining generic pre-employment or work readiness skills are not included in this definition Performance Negotiation and Common Measures

Definition of Certificate (Cont’d) Awarding Institutions include: A State educational agency Institution of higher education Professional, industry or employer organization or a product manufacturer Registered apprenticeship program Public regulatory agency A program approved by the Department of Veterans Affairs Office of Job Corps Tribally-controlled colleges and universities Performance Negotiation and Common Measures

Youth: Literacy and Numeracy Gains Measure: Of those out of school youth who are basic skills deficient: Number who increase one or more educational functioning levels in literacy or numeracy divided by number who completed a year of participation and number who exit before completing a year of participation Performance Negotiation and Common Measures

Literacy/Numeracy Gains Excludes persons who are not basic skills deficient Includes individuals with learning disabilities, with accommodations and alternate testing options Creates specific focus on improving basic skills rather than including basic skills among work readiness and occupational skills training Does not mean work readiness and occupational skills no longer important (impact of those skills will be seen in placement rate) Standard for success much higher than with less-defined skill attainment rate Performance Negotiation and Common Measures

Literacy/Numeracy Gains To be included in the numerator, an individual must advance one or more Adult Basic Education (ABE) or English as a Second Language (ESL) functioning levels Gain can occur in literacy or numeracy – can pre-test at different levels in each category Levels consistent with Adult Basic Ed. National Reporting System (NRS) Individuals should be post-tested by the end of one year of participation and compared to pre-test results obtained during the initial assessment Participants only included in measure a second time if they complete a second full year of participation Performance Negotiation and Common Measures

Assessment Tools Must use one of NRS cross-walked tests or equate alternate test to NRS scale Tests cross-walked with ABE and ESL levels include: Comprehensive Adult Student Assessment Instrument (CASAS) Test of Adult Basic Education (TABE) Adult Basic Learning Examination (ABLE) Student Performance Levels for ESL Basic English Skills Test (BEST) for ESL WorkKeys (for the top 3 ABE levels) Performance Negotiation and Common Measures

Any Questions on the Youth Common Measures? Performance Negotiation and Common Measures

Questions? Questions? Performance Negotiation and Common Measures

Additional Resources Questions about program policy and/or performance issues? The following DOL-ETA resources are available: ETA Performance Website and General Email Account www.doleta.gov/performance ETAperforms@dol.gov ETA Regional Offices http://www.doleta.gov/regions/regoffices/ Today’s Presenters: ETA’s Office of Performance and Technology Karen Staha, staha.karen@dol.gov ETA’s Office of Workforce Investment Evan Rosenberg, rosenberg.evan@dol.gov (Youth) Gail Eulenstein, eulenstein.gail@dol.gov (Adult/Dislocated Workers) Performance Negotiation and Common Measures

Stay Informed, Get Connected! Workforce3 One: Communities of practice Live Web-based events Register for updates! You can learn more and stay connected with trends and innovations by logging on to Workforce3 One, where you’ll find: Engaging communities of practice where you can share ideas, questions and innovations and connect with peers; Learning through live web-conferencing events that feature leaders and experts from industry and from government; and, A means of registering to be informed of news and events as they occur. We encourage you to make note of Workforce3 One – it is a powerful new tool, funded by ETA and “powered” by YOU! You can also learn more about working with the public workforce system by visiting www.careerinfonet.org, by calling 1-877-US2-JOBS, or by contacting the Business Relations Group directly. (ADVANCE SLIDE) Performance Negotiation and Common Measures

Thanks! www.workforce3one.com Performance Negotiation and Common Measures