Dr. Kristen Corbell Director of Program Quality and Accountability NRS Training Part 1 Dr. Kristen Corbell Director of Program Quality and Accountability

Participant vs Reportable Individual (NC: NRS Reportable) Reportable Individual A reportable individual who has received services other than the services described in § 677.150(a)(3), after satisfying all applicable programmatic requirements for the provision of services, such as eligibility determination. Reportable individual. An individual who has taken action that demonstrates an intent to use program services and who meets specific reporting criteria of the program, including: (1) Individuals who provide identifying information; (2) Individuals who only use the self-service system; or (3) Individuals who only receive information-only services or activities. For Title II, when an individual in an AEFLA program has completed at least 12 contact hours they are considered a participant. (NRS Reportable) An adult in an AEFLA program who has completed less than 12 contact hours. (LEIS Student who doesn’t stay long enough to be NRS Reportable) Participants count towards accountability measures. Reportable Individuals DO NOT count towards accountability measures.

Program Entry and Exit Program Entry- is the date that a reportable individual enrolls in an adult education and family literacy program. Program Exit - As defined for the purpose of performance calculations, exit is the point after which a participant who has received services hasn’t received services for 90 days. Exit date is the last date of service. **The last day of service cannot be determined until at least 90 days have elapsed since the participant last received services; services do not include self-service, information-only services, activities, or follow-up services. This also requires that there are no plans to provide the participant with future services. Exit is calculated after 90 days has passed. However, the date is retroactive back to the last date of attendance.

Program Entry and Exit Program Exit is what we call separating. A student separates only when they have not attended services for 90 days and no future services are planned. There is not separation for receiving a HSE or telling the program they are leaving. The separation is only recorded when the student no longer is enrolled in Adult Education instruction after 90 days. The date of exit is the last day the student attended classes. Exit is calculated after 90 days has passed. However, the date is retroactive back to the last date of attendance.

Measurable Skill Gain Indicator (MSG) The percentage of participants who, during a program year, are in an education or training program that leads to a recognized postsecondary credential or employment and who are achieving measurable skill gains, defined as academic, technical, occupational, or other forms of progress, towards such a credential or employment. Similar to Educational Functioning Level Gains, but with a few changes 4 ways to get a MSG now Individuals are counted based upon periods of participation (POP) Adult Secondary Education High is now counted for a MSG since there are now several possible routes to get a MSG that apply to them Reported in Table 4. New Tables published on www.nrsweb.org Only one MSG counts per period of participation

Measurable Skill Gain 1/25/2018

Secondary Diploma/Equivalent New Method to earn a MSG Any student with 12 or more hours who receives their AHS or HSE diploma in the program year gets counted as a measurable skill gain (MSG) 1/25/2018

Educational Functioning Level Gain- Documented achievement of at least once educational functioning level of a participant who is receiving instruction below the postsecondary education level. Programs may measure educational functioning level gain in one of three ways: The approved pre- and post-tests must be based on the list of tests the Secretary of Education determines to be suitable for use in the National Reporting System for Adult Education. The list of approved assessments is published annually in the Federal Register. (1) Comparing the participant’s initial educational functioning level, as measured by a pre-test, with the participant’s educational functioning level, as measured by a post-test. (2) States that offer adult high school programs that lead to a secondary school diploma or its recognized equivalent may measure and report educational gain through the awarding of credits or Carnegie units. (3) States may report an educational functioning level gain for participants who exit the program and enroll in postsecondary education and training during the program year.

Method 1 to EFL Gain (1) Comparing the participant’s initial educational functioning level, as measured by a pre-test, with the participant’s educational functioning level, as measured by a post-test. No change from how we currently track level gain (test code/component with lowest EFL at the beginning of the program year) 1/25/2018

Method 2 to EFL Gain (2) States that offer adult high school programs that lead to a secondary school diploma or its recognized equivalent may measure and report educational gain through the awarding of credits or Carnegie units. Adult High School level gain occurs when students have completed the following: Placed at ASEL for the program year Have completed at least 50% of required credits to earn an Adult High School Diploma Have completed one credit in the program year 1/25/2018

Method 3 to EFL Gain (3) States may report an educational functioning level gain for participants who exit the program and enroll in postsecondary education and training during the program year. Student exits the program during the program year (not received services for 90 days and no further services scheduled) Student enrolls in post-secondary education and training during the program year 1/25/2018

Periods of Participation For the purposes of reporting measurable skill gain, each program entry per participant during the reporting period is considered a period of participation. For the purposes of reporting on Measurable Skills Gain, Employment 2nd Quarter, Employment 4th Quarter, Median Earnings, and the Credential indicators, each program entry and exit per participant during the reporting period is considered a period of participation. A new period of participation is counted each time a participant exits and reenters again, even if it occurs during the same program year.

Periods of Participation (POP) Program Entry/ Reentry Program Exit PoP 1 PoP 2 PoP 3 MSG is evaluated. Follow-up must occur for exit-based measures. MSG is evaluated again. Follow-up must occur again for exit-based measures. MSG is evaluated again. Exit based measures are NOT evaluated because there is not an exit. Jul 1st Jun 30th

Student Scenarios Jane comes into your program on July 6 and stays in your program. She pre-tests on July 6 at ABEHI She post-tests on December 15 at ASEL She remains in your program through June, but doesn’t post-test again. How many periods of participation does Jane have? How many Measurable Skills Gains (MSG) does she have? 1/25/2018

Student Scenarios John comes into your program on July 6 and stays in your program until December 16. He pre-tests on July 6 at ABEHI He post-tests at ASEL on December 1 He completes all his HSE by December 16 He doesn’t come for classes after receiving his HSE How many periods of participation does John have? How many Measurable Skills Gains does have? 1/25/2018

Student Scenarios Maria comes into your program on August 15 and stays in your program until November 16 and comes back on May 16. He pre-tests on August 15 at ESLLI No post-test was given before Maria exits in November On May 16, Maria pre-tests at ESLLI On June 30, Maria post-tests at ESLLI How many periods of participation does Maria have? How many measurable skills gains does Maria have? 1/25/2018

Additional WIOA Data Final federal regulations included additional data elements not previously collected An addendum of additional WIOA data elements and definitions will be coming out In 2016-17 do the best you can to collect these data Colleague: updated on September 1 with these data elements available to be marked LACES: Will be available in the fall 1/25/2018