1. STATE PLANNING GUIDANCE: Performance Negotiation and Common Measures ETA Performance Webinar April 20, 2005

2. Virtual Classroom Layout
Presentation Slide Area
Participant List
Chat Room
Performance Negotiation and Common Measures

3. Submitting Questions
Chat Room
Enter questions into the Chat Room (located in lower left corner of the virtual classroom).
To submit a question, type the question in the text box and click the arrow button.
To send questions to the Presenter only (not to Everyone), select Presenter from the drop-down menu before clicking the arrow button.
Questions will be answered at the end of the presentation.
Arrow Button
Text Box
Drop-Down Menu
Performance Negotiation and Common Measures

4. Practice
In the chat room, please type the name of your organization, your location, and how many people are attending with you.
Performance Negotiation and Common Measures

5. Access to Webinar Materials
Materials and presentation slides used in this webinar will be available for download from the Resources & Information section of the Workforce3 One Webspace.
All webinars are recorded and available for viewing after the event. Recorded webinars will be posted to the Multimedia Information/ Self-Paced Learning section of the Workforce3 One Webspace.
Performance Negotiation and Common Measures

6. Office of Performance and Technology
Karen Staha
Division Chief
Office of Performance and Technology
Performance Negotiation and Common Measures

7. ETA Presenters Presenters:
Karen Staha, Division Chief, Office of Performance and Technology
Gail Eulenstein, Office of Workforce Investment, Office of Adult Services
Evan Rosenberg, Office of Workforce Investment, Office of Youth Services
Resources:
John Ladd, Office of Field Operations
Stephanie D. Cabell, Office of Workforce Investment, Office of Adult Services
Brian Pasternak, Office of Performance and Technology
Performance Negotiation and Common Measures

8. Workforce System Performance: Improving Performance Results
Reporting performance is a fundamental element of improving customer services and good public administration
Performance information should be easily understood by all customers, stakeholders, and operators of the workforce investment system
Establishing common measures and standardizing customer data collection improves the comparability and understanding of performance results by all customers, stakeholders, and operators of the workforce investment system
Ensuring the accuracy and timeliness of performance results is necessary for demonstrating system integrity and value
Performance Negotiation and Common Measures

9. ETA Performance Activities Update
ETA issued TEGL on February 28, 2005, announcing intent to implement common performance measures for WIA, Wagner-Peyser Act, and TAA in PY 2005/FY 2006.
ETA published a request for OMB emergency clearance for revised reporting requirements on March 29, 2005.
Final state plan guidance was issued in the Federal Register on April 12, State plans are due to ETA by May 31, 2005.
Performance Negotiation and Common Measures

10. ETA Performance Activities Update (Cont’d)
Final negotiation guidance (TEGL 27-04) was issued on April 14, 2005.
The negotiation of performance goals for WIA is a component of the planning process.
ETA will negotiate WIA performance levels with states for PY 2005 and PY 2006 so that final goals are established by June 30, 2005.
Wagner-Peyser Act and TAA programs will establish benchmarks for the common performance measures in PY 2005/FY 2006.
Revised Common Measures policy guidance (TEGL 28-04) was issued on April 15, 2005.
Performance Negotiation and Common Measures

11. State Plans and Demand-Driven Expectations
“Effective Accountability System” = Program Design + Results Achieved
Performance Negotiation and Common Measures

12. Planning Guidance- Section X, Part D
State Plans: The Intersection of Performance Negotiations and Common Measures
Planning Guidance- Section X, Part D
Describe state efforts to prepare for implementation of common measures
Include proposed levels for performance measures
BEYOND the Planning Guidance, Adjustments to:
Common Measures Policy
Performance Negotiation Policy
Reporting Instructions
Performance Negotiation and Common Measures

13. WIA Negotiations
Negotiating for WIA Performance Levels for PY2005 and PY2006: Follow Existing Statute
Adults/Dislocated Workers
Entered employment
Employment retention
Earnings change
Employment and Credential rate
Customer Satisfaction
Employers
Job Seekers
Older Youth
Entered employment
Employment retention
Earnings change
Employment and Credential rate
Younger Youth
Skill attainment rate
Diploma attainment rate
Retention rate
Performance Negotiation and Common Measures

14. State Plans and Common Measures
Negotiations will take place on all measures required by statute. Where possible, performance measures will reflect common definitions. Additionally, states will begin collecting information for youth common measures.
For Adults and Dislocated Workers, the common measure definitions will be substituted for those originally defined in TEGL 7-99.
For Youth, data collection and reporting will begin for the common measures as follows:
Placement in Employment/Education and the Attainment of Diploma or Certificate measures in PY05.
Literacy/Numeracy Gains measure will be encouraged, but not required, in PY05.
States will not negotiate levels for the youth common measures during this planning cycle.
Performance Negotiation and Common Measures

15. Common Measures
In addition to common measures, other information collected will continue to be valuable.
Management and oversight of programs will continue to require information that is relevant to each program.
Information on statutorily-required performance measures will continue to be collected and reported.
Additional information about participants, services and outcomes must supplement the story told by the common measures.
Performance Negotiation and Common Measures

16. Value of Common Measures
Key benefits from common measures:
Focus on the core purposes of the workforce system– employment for adults and skill gains for youth;
Break down barriers to integration resulting from different definitions, data and reports for each workforce program;
Resolve questions raised by GAO and other oversight agencies regarding the consistency and reliability of data; and
Reduce confusion among our customers and stakeholders who want to know about results.
Performance Negotiation and Common Measures

17. Common Measures Key Definitions:
Participant – An individual who is determined eligible to participate in the program and receives a service funded by the program in a physical location.*
Exit – Participant does not receive a service funded by the program or a partner program for 90 consecutive calendar days and is not scheduled for future services
Some global exclusions from the measures
* States and grantees are encouraged to consider as participants those individuals who receive services that are available through the Internet and are not accessed through a physical location.
Performance Negotiation and Common Measures

18. Office of Workforce Investment Office of Adult Services
Gail Eulenstein
Office of Workforce Investment
Office of Adult Services
Performance Negotiation and Common Measures

19. Adult Common Measures Summary of Major Policy Changes
TEGL 15-03
Old Policy
TEGL New Policy
ADULT MEASURES
Entered Employment Rate
No change in methodology from WIA or TEGL 15-03
Permits grantees to use wage records and supplemental data
Employment Retention Rate
Measurement at 1st, 2nd, and 3rd quarters
No change in methodology from TEGL 15-03
Earnings Increase Measure
Separated into two distinct indicators of performance
Percent change pre- to post-program Qtr 1
Percent change post-program Qtr 1 to Qtr 3
Replaces the two-part earnings increase measure identified in TEGL with a single Six Month Earnings Increase measure (pre- to post-program)
Wage records are the only data source
Grantees that do not have access to wage records can use supplemental data as an interim means of reporting
Program Efficiency
identified as a core common measure
Eliminates program efficiency as a reportable measure at the grantee level
Performance Negotiation and Common Measures

20. Adult: Entered Employment
Measure: Of those not employed at the date of participation:
The number of participants employed in the 1st quarter after the exit quarter divided by the number of participants who exit during the quarter
Same as current WIA Adult, Dislocated Worker, and TAA Entered Employment definition
Includes only those not employed at entry
Employment at participation is based on information from the individual, not wage record data
Performance Negotiation and Common Measures

21. Adult: Employment Retention
Measure: Of those employed in the 1st quarter after the exit quarter:
Number of participants employed in both the 2nd and 3rd quarters after the exit quarter divided by the number of participants who exit during the quarter
Additional measurement point (2nd quarter) compared to current definition
Includes all participants employed in the 1st quarter regardless of their employment status at participation
Employment in the 1st, 2nd, and 3rd quarters does not have to be with the same employer
Performance Negotiation and Common Measures

22. Adult: Earnings Increase
Measure: Of those employed in 1st quarter after exit:
Total post-program earnings (in Q2 & Q3 after exit) minus pre-program earnings (in Q2 & Q3 prior to participation) divided by the number of adults who exit during the quarter
Same as current WIA Adult Earnings Gain measure, but different calculation than current wage replacement rate for WIA Dislocated Worker and TAA programs
Completely new measure for ES/VETS programs
Designed as a six month pre- and post-program look at earnings change
Verified through wage record data only
Performance Negotiation and Common Measures

23. Any Questions on the Adult Common Measures?
Performance Negotiation and Common Measures

24. Office of Workforce Investment Office of Youth Services
Evan Rosenberg
Office of Workforce Investment
Office of Youth Services
Performance Negotiation and Common Measures

25. Youth Common Measures Summary of Major Policy Changes
TEGL 15-03
Old Policy
TEGL New Policy
YOUTH MEASURES
Placement in Employment or Education
Excluded individuals in secondary school at exit from performance calculations
Individuals in secondary school at exit are now included in the measure
Permits grantees to use wage records and supplemental data
Attainment of Degree or Certificate
Clarifies the definition of Diploma
Includes degrees/certificates awarded by tribally-controlled colleges and universities
Literacy and Numeracy Gains
Included all in-school and out-of-school youth who were basic skills deficient
In-school youth are now excluded from the measure
Provides additional guidance on providing reasonable accommodations for testing youth with disabilities
Program Efficiency
identified as a core common measure
Eliminates Program Efficiency as a reportable measure at the grantee level
Performance Negotiation and Common Measures

26. Youth: Placement in Education or Employment
Measure: Of those who are not in any of the following at date of participation - post-secondary education, employment, or the military:
Number of participants in employment or the military or enrolled in post-secondary education and/or advanced training/occupational skills training in the 1st quarter after exit divided by the number of participants who exit during the quarter
Similar to current Younger Youth Retention measure in that it recognizes the same outcomes – improvement from Older Youth Entered Employment
Includes first quarter after exit only
Tighter definition of Advanced Training
Includes individuals in secondary school at participation and exit
Performance Negotiation and Common Measures

27. Youth: Attainment of Degree or Certificate
Measure: Of those enrolled in education at participation or any time during the program:
Number of participants who attain a diploma, GED, or certificate by the end of the 3rd quarter after the exit quarter divided by number of participants who exit during the quarter
Similar to a combination of the Younger Youth Diploma Rate and Older Youth Credential Rate
Tighter definition of certificate and does not have employment as a component like the current credential measure
Diplomas, GEDs, or certificates can be obtained while a person is still receiving services or at any point prior to the end of the 3rd quarter after exit
Education refers to those in secondary, post-secondary, adult education, or any other organized program of study
Includes individuals in secondary school at participation and exit
Performance Negotiation and Common Measures

28. Definition of Certificate
Certificate – awarded in recognition of attainment of measurable technical or occupational skills necessary to gain employment or advance within an occupation
Based on standards developed or endorsed by employers
Certificates awarded by workforce investment boards or in recognition of attaining generic pre-employment or work readiness skills are not included in this definition
Performance Negotiation and Common Measures

29. Definition of Certificate (Cont’d)
Awarding Institutions include:
A State educational agency
Institution of higher education
Professional, industry or employer organization or a product manufacturer
Registered apprenticeship program
Public regulatory agency
A program approved by the Department of Veterans Affairs
Office of Job Corps
Tribally-controlled colleges and universities
Performance Negotiation and Common Measures

30. Youth: Literacy and Numeracy Gains
Measure: Of those out of school youth who are basic skills deficient:
Number who increase one or more educational functioning levels in literacy or numeracy divided by number who completed a year of participation and number who exit before completing a year of participation
Performance Negotiation and Common Measures

31. Literacy/Numeracy Gains
Excludes persons who are not basic skills deficient
Includes individuals with learning disabilities, with accommodations and alternate testing options
Creates specific focus on improving basic skills rather than including basic skills among work readiness and occupational skills training
Does not mean work readiness and occupational skills no longer important (impact of those skills will be seen in placement rate)
Standard for success much higher than with less-defined skill attainment rate
Performance Negotiation and Common Measures

32. Literacy/Numeracy Gains
To be included in the numerator, an individual must advance one or more Adult Basic Education (ABE) or English as a Second Language (ESL) functioning levels
Gain can occur in literacy or numeracy – can pre-test at different levels in each category
Levels consistent with Adult Basic Ed. National Reporting System (NRS)
Individuals should be post-tested by the end of one year of participation and compared to pre-test results obtained during the initial assessment
Participants only included in measure a second time if they complete a second full year of participation
Performance Negotiation and Common Measures

33. Assessment Tools
Must use one of NRS cross-walked tests or equate alternate test to NRS scale
Tests cross-walked with ABE and ESL levels include:
Comprehensive Adult Student Assessment Instrument (CASAS)
Test of Adult Basic Education (TABE)
Adult Basic Learning Examination (ABLE)
Student Performance Levels for ESL
Basic English Skills Test (BEST) for ESL
WorkKeys (for the top 3 ABE levels)
Performance Negotiation and Common Measures

34. Any Questions on the Youth Common Measures?
Performance Negotiation and Common Measures

35. Questions?
Questions?
Performance Negotiation and Common Measures

36. Additional Resources
Questions about program policy and/or performance issues? The following DOL-ETA resources are available:
ETA Performance Website and General Account
ETA Regional Offices
Today’s Presenters:
ETA’s Office of Performance and Technology
Karen Staha,
ETA’s Office of Workforce Investment
Evan Rosenberg, (Youth)
Gail Eulenstein, (Adult/Dislocated Workers)
Performance Negotiation and Common Measures

37. Stay Informed, Get Connected!
Workforce3 One:
Communities of practice
Live Web-based events
Register for updates!
You can learn more and stay connected with trends and innovations by logging on to Workforce3 One, where you’ll find:
Engaging communities of practice where you can share ideas, questions and innovations and connect with peers;
Learning through live web-conferencing events that feature leaders and experts from industry and from government; and,
A means of registering to be informed of news and events as they occur.
We encourage you to make note of Workforce3 One – it is a powerful new tool, funded by ETA and “powered” by YOU!
You can also learn more about working with the public workforce system by visiting by calling US2-JOBS, or by contacting the Business Relations Group directly.
(ADVANCE SLIDE)
Performance Negotiation and Common Measures

38. Thanks! www.workforce3one.com
Performance Negotiation and Common Measures