1. NFJP Performance and Reporting Webinar
April 30, 2019

2. Welcome and Introductions
Steven Rietzke – Division Chief Office of Workforce Investment, Division of National Programs, Tools and Technical Assistance Dr. Andrew Wiegand – President Social Policy Research Associates Marcia Hampton – Workforce Analyst National Farmworker Jobs Program Aaron Mitchell – Workforce Analyst

3. Webinar Overview This webinar will cover the following:
Review of annual performance data from Program Year (PY) 2017 and how this data is the baseline for forming 2019 performance targets
Training and Employment Guidance Letter (TEGL) 14-18, released on March 25, 2019
New performance reporting technical assistance tools and a grants management resource tool

4. How is This Webinar Tied to the Upcoming Allotment Process?
Anticipate the allotment TEGL being released within the next couple of weeks
Grant submission instructions will require the same documents as in previous years: 424, 424-A, budget narrative, and program plan
Submit documents into grants.gov and a complete electronic set to your FPO
Prior to completing/submitting your plans, you will receive an from the NFJP Program Office specifying the new PY19 targets
If your organization accepts the new proposed targets based on the regression model, incorporate them into your PY19 Program Plan
If your organization does not accept them, set up a negotiation with your FPO immediately
Once the targets are negotiated, enter them into the PY19 Program Plan

5. Process Reminders Timing of PY19 Funds: PY 2018 closeout activities:
We will process grant awards as close to the beginning of July as possible, but generally do not expect PY 2019 funds to be available to grantees until approximately mid-July. Please flag concerns to your FPO and
PY 2018 closeout activities:
As in other years, grant closeout activities must be completed for PY 2018
Two financial reports are required for the September quarter if funds are carried over from PY18. Performance reporting in the July-September quarter is only reflected for PY19
PY18 results will be incorporated into an annual report once the data is available

6. Review of PY 17 Annual Data
2nd Qtr Employment Rate
2nd Qtr Earnings
4th Qtr Employment Rate
Credential Attainment
Measurable Skills Gains
NFJP PY 17 Goals
69.9%
$5,180
66.0%
53.2%
N/A
NFJP 4th Qtr PY 17
78.0%
$5,459
69.5%
70.5%
26.1%
NFJP 1st Qtr PY 18
70.4%
$5,200
68.4%
73.2%
40.4%
NFJP 2nd Qtr PY 18
78.5%
$5,280
71.0%
54.9%
WIOA Adult PY 17
70.7%
$5,493
63.2%
56.5%
35.5%
WIOA DW PY 17
$6,965
62.7%
61.7%
28.6%

7. Review of PY 17 Annual Data
Performance is generally strong
Overall numbers remain low
Fewer than 10,000 participants
Fewer than 5,000 exiters
Some grantees’ data not available through WIPS – likely because grantees did not certify their data
We will be producing a PY 17 databook within the next several weeks
National summary
Individual state/grantee summaries

8. Regression Adjustment Model
Since moving to WIOA, all grantees have been held to the same performance standards.
But the types of participants served vary from grantee to grantee.
Educational background
Offender status
Prior work history
English proficiency, etc.
Economic Factors

9. How was the model developed?
Used a technique called regression analysis to determine which of 27 variables might significantly affect employment, earnings, credential and MSG outcomes.
Regression analyses are used to determine if there are relationships between different variables, for example:
Local poverty rate and
median earnings?
Limited English proficiency
and entered employment?
Transportation challenges and
employment retention?

10. Explanation of Regression Model
Used data from PY 17
Subsequent years will use data over multiple program years, which will strengthen the stability of the model
Model is similar in concept to those used for other WIOA programs, but is unique to the NFJP

11. Regression Analysis Results
Multiple variables were shown to significantly affect outcomes.
We then use the values calculated from the regression (parameters) for each factor to “adjust” grantees’ performance targets.
Adjustment =
(Value for Variable in Regression Model) X
(Grantee’s deviation from the national average on the Variable)

12. Example Grantee A Example:
Significant Variables
Grantee A’s Average (%)
National Grantee Average (%)
Difference Between National and Grantee Averages (%)
Limited English Proficiency
43.1
38.6
4.5%
Lack of Transportation
13.6
17.8
-4.2%
County Unemployment Rate
7.2
5.9
1.3%
We first subtract the national average from the grantee’s avg.
Then all differences (+ and -) are plugged into each measure’s formula to make adjustments to grantee targets.

13. Regression Analysis – Next Steps
National office is determining whether to implement a “cap” on changes from existing measures (i.e., no grantee’s goals could be adjusted upwards or downwards by more than, e.g., 5%, or 10%)
Adjusted goals will be shared with grantees
Opportunity for negotiation
Goals to be put in place for PY 2019

14. Where are We Now?
Since WIOA requires logical comparisons across ETA programs, ETA staff needed to work together to codify the definitions and agree on who was being counted in the calculations.
NFJP PY17’s annual data will be the primary factor in establishing baseline goals for PY19
Formal policy guidance was issued for the six core programs through TEGL Once it was released, work began on guidance for the remaining programs.

15. Where are We Now? (continued)
DOL – Only guidance, Aligning Performance Accountability Reporting, Definitions, and Policies Across Workforce Employment and Training Programs Administered by the U.S. Department of Labor, was released on March 25, 2019 for 15 programs. As the title states, the intent of this guidance is to measure ETA programs uniformly.
With the release of official guidance, National Office staff can move forward with developing data validation instructions and grantees can finalize any changes they need to make to their automated systems.

16. Key Points from Attachment 7: National Farmworker Jobs Program
NFJP uses the same WIOA primary performance indicators as the core programs and applies these indicators as described in Appendix 1 of the guidance.
NFJP also uses the same WIOA youth primary performance indicators as the core programs and applies these indicators as described in Appendix 1 of the guidance.

17. Key Differences Highlighted in Attachment 7
NFJP has its own definitions for reportable individual or participant, versus other WIOA programs.
Housing grantees do not report into WIPS and do not have the same performance indicators as career services and training grantees. Housing measures are described under the unique features of NFJP.
NFJP uses an expanded definition of “family” when describing eligible dependents.

18. Housing Performance
Although Housing grantee data is not currently reported into WIPS, the data is collected through the Quarterly Narrative Report. This information is included in the overall performance for NFJP. For reports to Congress and USDOL executive leadership, housing data is included as part of our outcomes.
Housing grantees will be asked to provide input for reporting through WIPS in the near future.

19. Appendix III – Table C Participation Level Services Chart NFJP Career Services & Training Grants
Benefit or Service Type
(WIOA, Section 167)
Does this benefit/service trigger inclusion in participation?
Category of Benefit/Service (i.e. Basic, Individualized, Training)
Applicable PIRL Data Element Number(s)
Eligibility Determination
See 20 CFR at WIOA Final Rule. No
Basic
1007
Outreach, Intake, Orientation
Initial Assessment of skill level & other service needs
Job Search Assistance
(Self-directed)
1000 and 1002
(Staff assisted)
Yes
1004
Placement Assistance (includes “Referred to Employment”)
(Staff assisted career guidance)
1004 and 1116

20. Benefit or Service Type (WIOA, Section 167)
Benefit or Service Type
(WIOA, Section 167)
Does this benefit/service trigger inclusion in participation?
Category of Benefit/Service (i.e. Basic, Individualized, Training)
Applicable PIRL Data Element Number(s)
Out-of-area job search assistance and relocation assistance
Yes
Individualized
1004 AND (1200 AND 1201)
Youth Services
See 20 CFR at WIOA Final Rule.
1004 AND (1401 AND/OR 1406)
Related Assistance (staff assisted) Services
1004 AND 2215
Training Services (includes on-the-job training and occupational skills training)
See 20 CFR at WIOA Final Rule.
Training
1300 AND Training #1 (1302, 1303, 1306, 1307, and 1308); Training #2 (1309, 1310, 1311, 1312, and 1313); Training #3 (1314, 1315, 1316, 1317 and 1318); AND (1319, 1320, OR 1332)
Basic Skills Training (includes English language acquisition and integrated education and training programs (non OJT)
2221

21. New Technical Assistance Tools Posted on WorkforceGPS
Grantee Resource Guide Performance and Reporting Scenarios Navigating Adult WIOA Performance Measures Eligibility and best practice tools are posted at: in the Agricultural Connection Community. Under ETA Grants, click National Farmworker Jobs Program. Where you see the red “Resources” tab, click on “New.” Performance and reporting tools are posted in the same area. Click on the Performance tab under “New”.

22. Recently asked question
Why doesn’t the data on the QPR match what we think the data should look like?
Make sure you are not putting an exit date in the system for reportable individuals.
Make sure you have blanks in all of the relevant elements for reportable individuals.

23. THANK YOU FOR PARTICIPATING!