1. Performance Reporting 101: The Annual Performance Report
Kristen Milstead
Department of Labor, Employment and Training Administration
Welcome!

2. Performance Reporting Q&A
Monthly Performance Reporting Q&A Live Webinars Coming Soon!
Coming soon
to a Webinar near you…
Live MONTHLY
Performance Reporting Q&A
Announce live monthly performance reporting Q&A sessions!

3. Notes About Reporting Reporting accurately is extremely important
There are many nuances to reporting for the TAACCCT program
It is beneficial to understand these nuances year-round to reduce the time it takes you to prepare your report for submission
System edit checks are in place
Reporting accurately is very important for you and your stakeholders, for ETA and our ability to provide you with technical assistance, and for Congress, OMB, and other government agencies to assess the TAACCCT program.
APR reporting season ended about three months ago, and some of you got your first taste at what it’s like, and some of you are veterans, and some of you have done it before but still learning the ropes.
All of you know that there are a lot of nuances in TAACCCT reporting, and that it is beneficial to understanding them year round because you have to track your students in order to report them, and you have to prepare your reports for submission.
As you know, there are system edit checks in place that will keep you from submitting until logical and mathematical errors are corrected. #

4. TYPES OF OUTCOMES B.1 Participants (B.1)
Educational Outcomes
Pre-Exit
(B.5-B.6)
Participant Status Outcomes (B.2-B.4)
Follow-Up Outcomes
(B.7-B.9)
Incumbent Worker Outcome (B..10)
TYPES OF OUTCOMES
Ways to organize your thinking about gathering and reporting your data that will help you as you track your students and try to figure out where they belong in each of they outcomes.
*Go through the categories of outcomes

5. KRISTEN
Demonstrates the data you should report for each student in the cohort, depending on the educational status of the student on the last day of the reporting year.
All students in the cohorts will be counted in B.1, as represented by the blue box.
From there, all students will be reported in one of the pink boxes as well. (Status outcomes)
Report all except for the Exit from Institution field.
Educational In-School Outcomes/Green boxes:
-Completed – hold onto and count every year until they *Exit*
-Still Enrolled-hold onto and count every year until they exit, even if they move into complete status because they still have not exited
-Once they have exited, stop counting
Purple boxes (follow-up outcomes/post-exit outcomes):
Once student completes a program – AND EXITS:
-eligible for two things: go on to further education or go on to employment
-retained in employment if enter employment
-Special one for incumbent workers only: receive a post-wage increase
Four exit points for reporting purposes where you stop tracking participants completely:
-enroll in another program at your instituion that isn’t TAACCCT-funded;
-leave your institution without completing;
-exit your instituion and matriculate elsewhere, for example to a four-year institution
-exit instituition and become employed then you see if they have retained that employment or not

6. Participant Status Outcomes B.1 – B.4#

7. B.1 - Unique Participants Served/Enrollees
Unique: Participants should only be included once
For the year: Participants should only be included during the first year they enroll
Definition: The total number of individuals for the year who entered any of the grant-funded programs offered to date
Unique: Participants should only be included once, even if they enroll in multiple programs and even if those programs are in different years
For the year: Participants should only be included in B.1 during the first year they enroll, even if their program lasts more than one year.
In each year, enter the new number of participants who enrolled that year.
Round 4 - Year 2 APR only new participants for this year #

8. B.2 Total Number Who Have Completed a Grant-Funded Program of Study
Completion is defined as having earned all of the credit hours (formal award units) needed for the award of a degree or certificate in that program of study.
Program/program of study used interchangeably
DOL may define program differently than the way your institution defines it
Count participants as completers in the year they actually complete their first credential
The way DOL defines for reporting purposes vs. the way your institution may define it
Count them in the year they actually complete
Definition: The total number of unique participants who completed any grant-funded program to date.
Completion is defined as having earned all of the credit hours (formal award units) needed for the award of a degree or certificate in that program of study.
Program/program of study used interchangeably
The way DOL defines for reporting purposes vs. the way your institution may define it
Count them in the year they actually complete their first credential
-Participants in Year 1, but complete in Year 2, count them in Year 2 as completers #

9. B.2a Total Number of Incumbent Workers Who Have Completed a Grant-Funded Program of Study
This number will be a subset of the number in B.2.
Participants who are employed at the time of enrollment, either full-time or part-time.
In other words, incumbent workers are included once in B.2 because B.2 includes all completers.
Incumbent workers are then counted again separately in B.2a by themselves.
All incumbent workers (employed at enrollment).
Any type of employment. #

10. B.3 Total Number Still Retained in Their Program of Study or Other Grant-Funded Program(s)
May be counted in multiple years if still enrolled
Do not count them simultaneously as having been retained in a program and having completed one in the same year
Once they complete one program, if they start another one, don’t count them again in B.3
Definition: Of the total number of unique participants enrolled who have not completed their programs, enter the total number of enrollees who were still enrolled either in their original program of study or a different grant-funded program of study at the end of the reporting year.
Of the total number of unique participants enrolled who have not completed their programs, enter the total number of enrollees who were still enrolled either in their original program of study or a different grant-funded program of study at the end of the reporting year.
*Explain how B.3 works using the in-and-out status
If a participant switches to a different program prior to completing it, he or she may still be counted as being retained in a grant-funded education program as long as it is grant-funded and they have not completed it.
Once they complete one program, if they start another one, don’t count them again in B.3. #

11. B.4 Total Number Retained in Other Education Program(s)
The future outcomes of students enrolling in non-grant funded education programs do not need to be tracked and reported.
Once counted here, if switches again to grant-funded program, he or she cannot be re-enrolled as a participant (not “unique”)
Definition: Of the total number of unique participants enrolled, enter the total number of enrollees who dropped out of a grant-funded program of study, but have enrolled in another education program not funded by the grant.
Pretty straight forward, but a couple of important things to know: #

12. Jackie enrolls in a TAACCCT-funded nursing certificate program in Year One. For the possible circumstances in questions 1-5, please write ALL status outcomes in which Jackie should be counted, using only B.1, B.2, B.3 and/or B.4 as options.
If on September 30, 2016:
Year One Report:
Jackie completed the program; earned a certificate.
Jackie completed the program; is continuing in another program
of study.
Jackie has not completed the program; is continuing in ANY grant-funded program of study.
Jackie has not completed program; is continuing in a NON-GRANT FUNDED program of study.
Jackie has not completed program; leaves college to take a job; re-enrolls later. #

13. Answer: Jackie enrolls in a TAACCCT-funded nursing certificate program in Year One. For the possible circumstances in questions 1-5, please write ALL status outcomes in which Jackie should be counted, using only B.1, B.2, B.3 and/or B.4 as options.
If on September 30, 2016:
Year One Report:
Jackie completed the program; earned a certificate.
B.1, B.2
Jackie completed the program; is continuing in another program
of study.
Jackie has not completed the program; is continuing in ANY grant-funded program of study.
B.1, B.3
Jackie has not completed program; is continuing in a NON-GRANT FUNDED program of study.
B.1, B.4
Jackie has not completed program; leaves college to take a job; re-enrolls later.
B.1 #

14. Educational Outcomes Pre-Exit B.5 – B.6#

15. B.5 Total Number of Credit Hours Completed
If a participant left all grant-funded programs during the year, the credit hours he or she did complete that year in TAACCCT-funded programs can still be counted
Non-credit hours or hours completed in which no college credit hours were recorded cannot be counted in this outcome.
Grant-funded credit hours only
Definition: The total number of credit hours to date that have been completed by participants in grant-funded certificate and degree programs
Enter the aggregate number of credit hours across all of your participants to date in that year. In other words, for Year 2, do not include the credit hours earned for Year 1, which you have already reported.
-Only the credit hours of students who are considered participants can be counted in this data element.
-Whether the participant completed or not, whether still enrolled or not, all credit, grant-funded hours count
-Credit hours are hours that figure into the grade point average
-TAACCCT reporting designed to measure the impact of TAACCCT funds.
-Wouldn’t count credit hours completed in courses not funded by TAACCCT dollars. (in grant-funded certificate and degree programs) #

16. B.5a Total Number of Students Completing Credit Hours Credit Hours
Only students whose credit hours counted in B.5 can be counted in this data element.
If a participant left all grant-funded programs during the year but earned TAACCCT-funded credit hours, he or she may still be counted in this outcome.
Definition: The total number of students who have enrolled that have completed any number of credit hours to date
-Enter the number of students who earned any number of credit hours to date during that year. In other words, for Year 2, only include students who actually earned credit hours in that year.
-If they were enrolled that year, but did not earn credit hours, they should not be counted in this outcome.
-Even if they left without completing their program, go ahead and count their hours
-Also, must be grant-funded and must be credit hours. #

17. B.6 Total Number Earned Credentials
Definition: The total number of degrees or certificates earned to date by participants in grant-funded programs
-Degrees and certificates earned in non-TAACCCT funded programs by students who were participants at one time who cannot be counted.
-The degrees and certificates earned must be industry- recognized.
-Review TEGL *Attachment 2
-Enter the aggregate number of degrees and certificates across all of your participants to date in that year. In other words, for Year 2, do not include the degrees and credentials earned for Year 1, which you have already reported.
-Only the degrees and certificates of students who are considered participants can be counted in this data element.
-If a participant left all grant-funded programs during the year, the degrees and certificates he or she did complete in TAACCCT-funded programs during that year can still be counted. #

18. B.6a, B.6b, B.6c
Can only be counted in each outcome one time, regardless of how many certificates/ of that type/degrees are earned
However, a student can be counted once in more than one type if more than one type is earned
Enter during the year in which it was earned
B.6a. Total Number of Students Earning Certificates (less than one year) :The total number of students who earned certificates designed to be completed in one year or less.
B.6b. Total Number of Students Earning Certificates (more than one year): The total number of students who earned certificates designed to be completed in more than one year.
B.6c. Total Number of Students Earning Degrees: The total number of students who earned degrees.
Enter the number of students who earned this type of credential during the year in which it was earned, regardless of which year the student was counted as having been enrolled.
-Example: Tom is in a stackable credential program. He earns two credentials of less than one year and eventually earns a degree. He can only ever count one time in 6a and one time in 6c.
Enter during the year in which it was earned.
-So even though Tom earned two certificates, count him in 6a him during the first year he earned his first certificate of less than one year, and then do not count him again in that outcome. #

19. Ed enrolls in a TAACCCT-funded program to earn an AS in Electrical Engineering. This program requires 45 credits, taken over a period of 18 months. Ed earns 30 credits during Year One, 15 credits during Year Two, and the AS in Year Two.
Year 1 Report:
Year 2 Report:
B.1 – B.4
B.5 – Total Credit Hours Completed
B.5a – Total Number of Students Completing Credit Hours
B.6 – Total Number of Earned Credentials
B.6a – Total Number of Students Earning Certificates (less than one year)
B.6c –Total Number of Students Earning Degrees #

20. Answer: Ed enrolls in a TAACCCT-funded program to earn an AS in Electrical Engineering. This program requires 45 credits, taken over a period of 18 months. Ed earns 30 credits during Year One, 15 credits during Year Two, and the AS in Year Two.
Year 1 Report:
Year 2 Report:
B.1 – B.4
B.1, B.3
B.2
B.5 – Total Credit Hours Completed 30 15
B.5a – Total Number of Students Completing Credit Hours 1
B.6 – Total Number of Earned Credentials
N/A
B.6a – Total Number of Students Earning Certificates (less than one year)
B.6c –Total Number of Students Earning Degrees #

21. Follow-Up Outcomes (Post-Exit Outcomes) B.7 – B.9#

22. -Enter during the year in which it occurs
B.7 Total Number Enrolled in Further Education After Program of Study Completion
-Exit-based outcome
-Enter during the year in which it occurs
-Do not enter a participant in both B.7 and B.8 (entered employment)
Definition: Of the total number of participants who completed at least one grant-funded program of study, enter the total number of individuals to date who entered another program of study
-Students who are entered into this outcome cannot be simultaneously entered during the same year into the outcome for “Total Number Employed After Program of Study Completion” (more on this later) #

23. B.8 Total Number Employed After Program of Study Completion
Exit is defined as being no longer enrolled at the college in any program of study (grant-funded or not) and can include formal withdrawal, expulsion, graduation, and other reasons.
Three things must occur to count a participant in this outcome
Unemployed at enrollment
Completion of a program
Exit from the institution
Do not enter a participant in both B.7 (further education) and B.8
Whichever occurs first in time
Definition: Of the total number of participants who were not incumbent workers and who completed at least one grant-funded program, enter the total number of individuals to date who entered unsubsidized employment in the first quarter after the quarter in which the student exits the college.
-Not be an incumbent worker (defined as “employed at enrollment”)
-explain
-Completed a program
-Exited the institution
-If you have already counted them in B.7. having gone on to further education, do not count them in B.8
-How do you know which to count them in? Whichever occurs first in time. #

24. More on B.8: When the Student Has to Enter Employment
If a student becomes employed after completing the first program but also enrolls in another program at the institution same time, as long as he or she is still employed in that first quarter after exiting the college, he or she can still be counted as having entered employment
Completion and exit simultaneously and then employment
Completion and enrollment into another program with simultaneous employment– then exit *while maintaining employment
Completion and enrollment into another program then exti and then employment #

25. B.9 Total Number Retained in Employment After Program of Study Completion
This definition necessarily excludes incumbent workers
This outcome can only include participants who were retained in employment in the second and third quarters after that third quarter after exit.
Count students only one time in this outcome and after the third quarter has passed
Definition: Of the total number of participants who were employed in the first quarter after the quarter in which the student exits the college (B.8), enter the total number of individuals to date who were employed in the second and third quarters after exit.
-Disqualifies incumbent workers. Refers to B.8- B.8 states those who were not employed at enrollment
-Only in both quarters; if they were only retained in the second quarter, but not the third, they cannot be counted
-Count only one time (in other words, do not count them once after the second quarter passes and then again after the third quarter passes)
And count them after the third quarter passes regardless of when they entered employment and when they the second quarter passes #

26. Incumbent Worker Outcome#

27. B.10 Total Number of Those Employed at Enrollment Who Received a Wage Increase Post-Enrollment
To be counted in this outcome:
The incumbent worker must enroll in a grant-funded program, but does not have to finish it
The wage increase can occur at any time during the period of performance
The wage increase does not necessarily have to be associated with grant-funded training
Should be included only one time
Count in the year the wage increase occurs
Definition: Of the total number of incumbent workers (those employed at enrollment) who enter a grant-funded program, enter the total number who received an increase in their wages at any time after becoming enrolled.
-From day one of enrollment to the end of the period of performance
-Does not have to complete a program
-Does not have to be training-related
-An incumbent worker can be included in this outcome only once, regardless of how many wage increases he or she may receive.
-The incumbent worker should be counted during the year in which the wage increase occurs, regardless of which year in which he or she was first enrolled
-Covers all types of employment– from part-time to full-time, promotions, training-related, #

28. Maggie Mitchell, who is unemployed when she enrolls in TAACCCT, completes a TAACCCT-funded certificate in Year 1 and immediately gets a job. She continues into another TAACCCT-funded program, also in Year 1, and continues it in Year 2. In Year 2, she finishes this program and exits the college, still employed. She enrolls in another institution’s program upon exit and, in addition, two quarters later, in Year 3, she is still employed. How would you fill out outcomes B.7-B.10?
Year 1 Report:
Year 2 Report:
Year 3 Report:
B.7 – Total Number Enrolled in Further Education
B.8 – Total Number Employed After Program of Study Completion
B.9 – Total Number Retained in Employment After Program of Study Completion
B.10 – Total Number of Those Employed at Enrollment Who Receive a Wage Increase Post-Enrollment

29. Answer: Maggie Mitchell, who is unemployed when she enrolls in TAACCCT, completes a TAACCCT-funded certificate in Year 1 and immediately gets a job. She continues into another TAACCCT-funded program, also in Year 1, and continues it in Year 2. In Year 2, she finishes this program and exits the college, still employed. She enrolls in another institution’s program upon exit and, in addition, two quarters later, in Year 3, she is still employed. How would you fill out outcomes B.7-B.10?
Year 1 Report:
Year 2 Report:
Year 3 Report:
B.7 – Total Number Enrolled in Further Education
B.8 – Total Number Employed After Program of Study Completion 1
B.9 – Total Number Retained in Employment After Program of Study Completion
B.10 – Total Number of Those Employed at Enrollment Who Receive a Wage Increase Post-Enrollment

30. More PRACTICE? #