1. Dr. Kristen Corbell Director of Program Quality and Accountability
NRS Training Part 1
Dr. Kristen Corbell
Director of Program Quality and Accountability

2. Participant vs Reportable Individual
(NC: NRS Reportable)
Reportable Individual
A reportable individual who has received services other than the services described in § (a)(3), after satisfying all applicable programmatic requirements for the provision of services, such as eligibility determination.
Reportable individual. An individual who has taken action that demonstrates an intent to use program services and who meets specific reporting criteria of the program, including:
(1) Individuals who provide identifying
information;
(2) Individuals who only use the self-service
system; or
(3) Individuals who only receive information-only
services or activities.
For Title II, when an individual in an AEFLA program has completed at least 12 contact hours they are considered a participant. (NRS Reportable)
An adult in an AEFLA program who has completed less than 12 contact hours. (LEIS Student who doesn’t stay long enough to be NRS Reportable)
Participants count towards accountability measures.
Reportable Individuals DO NOT count towards accountability measures.

3. Program Entry and Exit
Program Entry- is the date that a reportable individual enrolls in an adult education and family literacy program.
Program Exit - As defined for the purpose of performance calculations, exit is the point after which a participant who has received services hasn’t received services for 90 days. Exit date is the last date of service. **The last day of service cannot be determined until at least 90 days have elapsed since the participant last received services; services do not include self-service, information-only services, activities, or follow-up services. This also requires that there are no plans to provide the participant with future services.
Exit is calculated after 90 days has passed. However, the date is retroactive back to the last date of attendance.

4. Program Entry and Exit Program Exit is what we call separating.
A student separates only when they have not attended services for 90 days and no future services are planned.
There is not separation for receiving a HSE or telling the program they are leaving.
The separation is only recorded when the student no longer is enrolled in Adult Education instruction after 90 days.
The date of exit is the last day the student attended classes.
Exit is calculated after 90 days has passed. However, the date is retroactive back to the last date of attendance.

5. Measurable Skill Gain Indicator (MSG)
The percentage of participants who, during a program year, are in an education or training program that leads to a recognized postsecondary credential or employment and who are achieving measurable skill gains, defined as academic, technical, occupational, or other forms of progress, towards such a credential or employment.
Similar to Educational Functioning Level Gains, but with a few changes
4 ways to get a MSG now
Individuals are counted based upon periods of participation (POP)
Adult Secondary Education High is now counted for a MSG since there are now several possible routes to get a MSG that apply to them
Reported in Table 4. New Tables published on
Only one MSG counts per period of participation

6. Measurable Skill Gain
1/25/2018

7. Secondary Diploma/Equivalent
New Method to earn a MSG
Any student with 12 or more hours who receives their AHS or HSE diploma in the program year gets counted as a measurable skill gain (MSG)
1/25/2018

8. Educational Functioning Level Gain-
Documented achievement of at least once educational functioning level of a participant who is receiving instruction below the postsecondary education level. Programs may measure educational functioning level gain in one of three ways:
The approved pre- and post-tests must be based on the list of tests the Secretary of Education determines to be suitable for use in the National Reporting System for Adult Education. The list of approved assessments is published annually in the Federal Register.
(1) Comparing the participant’s initial educational functioning level, as measured by a pre-test, with the participant’s educational functioning level, as measured by a post-test.
(2) States that offer adult high school programs that lead to a secondary school diploma or its recognized equivalent may measure and report educational gain through the awarding of credits or Carnegie units.
(3) States may report an educational functioning level gain for participants who exit the program and enroll in postsecondary education and training during the program year.

9. Method 1 to EFL Gain
(1) Comparing the participant’s initial educational functioning level, as measured by a pre-test, with the participant’s educational functioning level, as measured by a post-test.
No change from how we currently track level gain (test code/component with lowest EFL at the beginning of the program year)
1/25/2018

10. Method 2 to EFL Gain
(2) States that offer adult high school programs that lead to a secondary school diploma or its recognized equivalent may measure and report educational gain through the awarding of credits or Carnegie units.
Adult High School level gain occurs when students have completed the following:
Placed at ASEL for the program year
Have completed at least 50% of required credits to earn an Adult High School Diploma
Have completed one credit in the program year
1/25/2018

11. Method 3 to EFL Gain
(3) States may report an educational functioning level gain for participants who exit the program and enroll in postsecondary education and training during the program year.
Student exits the program during the program year (not received services for 90 days and no further services scheduled)
Student enrolls in post-secondary education and training during the program year
1/25/2018

12. Periods of Participation
For the purposes of reporting measurable skill gain, each program entry per participant during the reporting period is considered a period of participation.
For the purposes of reporting on Measurable Skills Gain, Employment 2nd Quarter, Employment 4th Quarter, Median Earnings, and the Credential indicators, each program entry and exit per participant during the reporting period is considered a period of participation.
A new period of participation is counted each time a participant exits and reenters again, even if it occurs during the same program year.

13. Periods of Participation (POP)
Program Entry/ Reentry
Program Exit
PoP 1
PoP 2
PoP 3
MSG is evaluated.
Follow-up must occur for exit-based measures.
MSG is evaluated again.
Follow-up must occur again for exit-based measures.
MSG is evaluated again.
Exit based measures are NOT evaluated because there is not an exit.
Jul 1st
Jun 30th

14. Student Scenarios
Jane comes into your program on July 6 and stays in your program.
She pre-tests on July 6 at ABEHI
She post-tests on December 15 at ASEL
She remains in your program through June, but doesn’t post-test again.
How many periods of participation does Jane have?
How many Measurable Skills Gains (MSG) does she have?
1/25/2018

15. Student Scenarios
John comes into your program on July 6 and stays in your program until December 16.
He pre-tests on July 6 at ABEHI
He post-tests at ASEL on December 1
He completes all his HSE by December 16
He doesn’t come for classes after receiving his HSE
How many periods of participation does John have?
How many Measurable Skills Gains does have?
1/25/2018

16. Student Scenarios
Maria comes into your program on August 15 and stays in your program until November 16 and comes back on May 16.
He pre-tests on August 15 at ESLLI
No post-test was given before Maria exits in November
On May 16, Maria pre-tests at ESLLI
On June 30, Maria post-tests at ESLLI
How many periods of participation does Maria have?
How many measurable skills gains does Maria have?
1/25/2018

17. Additional WIOA Data
Final federal regulations included additional data elements not previously collected
An addendum of additional WIOA data elements and definitions will be coming out
In do the best you can to collect these data
Colleague: updated on September 1 with these data elements available to be marked
LACES: Will be available in the fall
1/25/2018