2. Performance Reporting Under WIA Title 1B Candice Graham-Young ETA Performance Accountability Team

3. WIA Performance Team Quarterly Report  performance information used for management purposes: budgeting and GPRA  includes information about statewide outcomes on the key indicators of performance and customer satisfaction  captures number of participants and exiters  due 45 days after the end of the quarter

4. WIA Performance Team Quarterly Reporting submitted electronically from States States responsible for verification and validation Regions responsible for second validation  Submission process…

5. WIA Performance Team State Role develop standard operating procedures for data collection and handling to ensure the quality and integrity of data data verification equals checking accuracy data validation equals checking reasonableness examples of procedures for data collection are: checking accuracy against original source performing logical checks of the data random call-backs to participants having trained staff member evaluate data collection efforts  Verifying and validating data…

6. WIA Performance Team Regional Role ensure timeliness of reports ensure number of quarters submitted conforms to Table A of the quarterly report instructions note discrepancies in comment section ensure reasonableness of data become familiar with standard operating procedures which States are required to have in place  Validating reports…

7. WIA Performance Team  fields added to collect response rates  fields added to show period of time covered by data for each measure  performance is automatically calculated  additional edits added to for data validation purposes (e.g., can’t have more exiters than registrants) Changes to Quarterly Report Form

8. WIA Performance Team Common Reporting Problems  reporting correct quarters  simple oversights, like entering numerators and denominators in wrong locations  minor programming errors in edit checks  entering performance outcomes that did not match the numerator divided by the denominator

9. WIA Performance Team Amount of Data Reported by States Third Quarter Report

10. WIA Performance Team Third Quarter Performance

11. WIA Performance Team

13.  basis for awarding incentives or applying sanctions  includes information about negotiated levels, state and local outcomes on the key indicators of performance, customer satisfaction and state measures  numerators and denominators allow for aggregation of data  submitted electronically Annual Report

14. WIA Performance Team  local performance  status of state evaluations  comparison of results of those who received training and those who did not  outcomes for special populations  other outcomes listed in the Act… training-related employment wages at entry into employment cost of activities cost relative to impact of activities 12 month retention and earnings Required Items for the Annual Report

15. WIA Performance Team Annual Report to Stakeholders What our customers have to say about us TAX PAYERS appreciate increased efficiency JOB SEEKERS reaping the benefits from newly integrated services EMPLOYERS obtaining qualified employees Annual Report Format Varies

16. WIA Performance Team  though certain information mandated by the legislation must be contained in the report, the approach the State uses to tell its story is up to the State  States are encouraged to design reports that make extensive use of graphics and other communication devices  States may want to include “success stories” Annual Report State Flexibility

17. WIA Performance Team Annual Report  Required portions – Narrative Section – Tabular section – Designed to meet Sec. 136(d)

18. WIA Performance Team Annual Report  Optional portions (suggested) - Governor’s Comments - Financial (Narrative & Graphic) - Organizational Chart - Resources - Graphics - Success Stories

19. WIA Performance Team Annual Report Narrative Section  Discuss the cost of workforce investment activities relative to the effect of the activities on the performance of participants – Sec. 136(D)(2)(C)  Describe the State’s evaluations of workforce investment activities, including: – The evaluation's methodology; and – The timing of feedback and deliverables. – Sec. 136(d)(1)

20. WIA Performance Team Annual Report-- Tabular Section Financial Statement Example

21. WIA Performance Team Annual Report Tabular Section State performance measures Sec. 136(d)(1) – Numerator and denominator Allows aggregation over states – Negotiated levels – Exclude: Self-service & informational activities only National Emergency Grants Statewide activities excluded from performance – Source for determining incentives & sanctions

22. WIA Performance Team Annual Report Tabular Section  Comparison of results of those who received training and those who did not Sec. 136(d)(2)(E)  Outcomes for special populations 136(d)(2)(F)  Other outcomes listed in the legislation – Training-related employment 136(d)(2)(A) – Wages at entry to employment 136(d)(2)(B) – 12-month retention and earnings 136(d)(2)(D) – Cost of activities 136(d)(2)(C)  Local performance 136(d)(1)

23. WIA Performance Team Annual Report--Tabular Section Table A - Workforce Investment Act Customer Satisfaction Results  # surveyed = # with completed interviews  Eligible for survey (the sample frame) = – Participants: program year exiters – Employers: service completed in program year  Sec. 136(d)(1)

24. WIA Performance Team Annual Report--Tabular Section 2 Table B - Adult Program Results At-A-Glance Sec. 136(d)(1)

25. WIA Performance Team Annual Report--Tabular Section 3 Table C - Outcomes for Adult Special Populations Sec. 136(d)(2)(F)

26. WIA Performance Team Annual Report--Tabular Section Table D - Other Outcome Information for the Adult Program Does not include individuals who received only informational or self-service core activities Sec. 136(d)(2)(E)

27. WIA Performance Team Annual Report Tabular Section  Table E - Dislocated Worker Program Results At-A-Glance – Performance Measures 136(d)(1)  Table F - Outcomes for Dislocated Worker Special Populations – Performance Measures for: Veterans Displaced Homemakers Individuals With Disabilities Older Individuals – Sec. 136(d)(2)(F)

28. WIA Performance Team Annual Report Tabular Section  Table G - Other Outcome Information for the Dislocated Worker Program – Performance Measures for Individuals Who Received Training Services Individuals Who Received Only Core and Intensive Services – Sec. 136(d)(2)(E)

29. WIA Performance Team Annual Report Tabular Section  Table H - Older Youth Results At-A-Glance – Performance Measures 136(d)(1)  Table I - Outcomes for Older Youth Special Populations – Performance Measures for: Public Assistance Recipients Veterans Individuals With Disabilities Out-of-School Youth – Sec. 136(d)(2)(F)

30. WIA Performance Team Annual Report Tabular Section  Table J - Younger Youth Results At-A-Glance – Performance Measures 136(d)(1)  Table K - Outcomes for Younger Youth Special Population – Performance Measures for: Public Assistance Recipients Individuals With Disabilities Out-of-School Youth – Sec. 136(d)(2)(F)

31. WIA Performance Team Annual Report--Tabular Section Table L - Other Reported Information Sec. 136(d)(2)(A), 136(d)(2)(B), 136(d)(2)(D)

32. WIA Performance Team Annual Report--Tabular Section Table M - Participation Levels

33. WIA Performance Team Annual Report--Tabular Section Table N - Cost of Program Activities Supplements financial report

34. WIA Performance Team Annual Report--Tabular Section Table O - Local Performance  A table for each local area  Sec. 136(d)(2)(C)

35. WIA Performance Team  Time Periods to be Reported--Same as used for performance indicators: – Measures Based on Wage Records Adults, DWs, older youth, younger youth retention Exiters first quarter of PY and last 3 quarters of previous PY – ‘Real-time’ measures Youth goal attainment, Youth diploma attainment, Customer satisfaction Program Year Annual Report--Time Periods

36. WIA Performance Team ETA Performance Team Consultant services providedby… Consultant services provided by… Mr. Rich West richard_west@spra.com Social Policy Research Associates Phone Fax 202.693.3031202.693.3229 Mr. Bill Rabung, Team Leader wrabung@doleta.gov Ms. Jacqui Shoholm jshoholm@doleta.gov Mr. Bradley Sickles bsickles@doleta.gov Ms. Candice Graham-Young cyoung@doleta.gov