1. Perkins IV Postsecondary Accountability
September 20, 2018
Perkins IV Postsecondary Accountability

2. Today’s Presenters Minnesota State Katie Vaccari
Senior Research Associate, System Office Research
Jeralyn Jargo
System Director of Career Technical Education
Karl Ohrn
Interim Associate Director of Career Technical Education

3. Chat, Comment, React Your Phone Line Is Muted
Use Chat to send questions/comments
Look for links, info in Chat box
Send notifications to presenters

4. Agenda
Provide overview of Perkins IV postsecondary data structure and reporting status/accountability indicators.
Review data sources for determining your Perkins IV accountability indicator performance.
Review how to access Perkins IV data in EPM 11.
Given the passing of Perkins V and that we’re in sort of that weird “in between” stage where we are still under the current Perkins IV law (in place until June 30, 2019) and are required to still do reports and plans, etc, I plan to do an overview of Perkins IV postsecondary accountability, but not go in to the depth or detail that we have in previous webinars. That depth and detail exists in the Operational Handbook and in the recording of last year’s webinar, if you need it.

5. Perkins IV Postsecondary Data Structure
Minnesota is one of a few states to use a cohort model. The use of cohorts aligns with other system initiatives and reporting.
Perkins IV: Entry Cohort Reporting
FY Cohort
FY 2016
FY 2017
FY 2018
Enter in Summer 2015
Fall 2014
Spring 2016
Summer 2016
Fall 2016
Spring 2017
Summer 2017
Fall 2017
Spring 2018
Enter in Fall 2015
Enter in Spring 2016
The FY cohort includes students entering in FY 2016 and tracked for three years: 2016, 2017 and 2018.

6. Postsecondary Definitions – Perkins Status
Participant
A student taking a CTE course OR who has a Perkins eligible major.
Concentrator
A student with a Perkins eligible major who declared a CTE award (AAS, AS, Cert, Dip) and earned 12+ college level credits OR who received an award in a short term Perkins eligible program (less than 12 credits).
The Perkins status used for reporting is typically the highest recorded Perkins status during the cohort period.
If a Concentrator changes to a non-Perkins major, that student will be counted as a Participant, not a Concentrator.
Completer
A student who received a CTE award (AAS, AS, Certificate or Diploma) in a Perkins eligible program.

7. Perkins IV Postsecondary Accountability Indicators and Data Sources
1P1 – Technical Skill Attainment
Aggregate data (not at student level): Licensure data for Radiography, Law Enforcement and Nursing; NBCOT (occupational therapy) beginning in 2016; EMS/Paramedic 2016 only
Student level data: NOCTI; ASE (Automotive) 2016 forward; EMS/Paramedic Licensure 2018 forward; Precision Exams 2018 forward
2P1 – Completion
3P1 – Retention and Transfer
5P1 – Nontraditional Participation
5P2 – Nontraditional Completion
ISRS (Integrated Statewide Record System) enrollment and completion data on CTE students
National Student Clearinghouse data on transfers to other colleges or universities
4P1 – Placement
Minnesota Dept. of Employment & Economic Development (DEED) and Graduate Follow-up data on employment following program completion
Since this is more of an “accountability lite” session, I will direct you to the Perkins IV Operational Handbook for more detailed descriptions of the indicators, data sources, reporting processes, etc. I would also suggest listening to the recorded 2017 Postsecondary Accountability webinar, where we did provide more detailed information about how each indicator is defined, etc.

8. State and Local Target Negotiations
Federal/State Negotiations
State/Local Consortia Negotiations
Evaluation of State Performance
Improvement Plans
Evaluation of Local Performance Improvement Plans
With the transition to Perkins V, unless we receive other information, the expectation for 2019 targets is that they will remain at the 2018 level.
There will be no 2019 local target negotiations on Perkins IV core accountability indicators.
If there is a need for local 2019 targets, the expectation would be you would continue to work on/meet the levels specified for 2018 performance. While the state has already negotiated the 2019 state targets as part of updating our state plan this past spring, we will not have a local target negotiation for 2019 local targets.

9. Evaluation of Annual Local Performance (for 2018)
No Action
At or above target
Negotiated Level
Report Required
Between 90% and 99%
For 2018 performance reporting, both at the state and local level, performance is evaluated on each core indicator against the target levels we/you negotiated last year for 2018 performance.
90% of Negotiated Level
Improvement Plan
Below 90% of target

10. Perkins IV Postsecondary Accountability Indicators: How/Where Do I Get My Data?
System Office staff distribute four reports to Consortia Coordinators early in the calendar year (for the most recent reporting year):
Annual Core Indicator Report
Three-Year Trend Performance Report
1P1 (Technical Skill Attainment) Report
4P1 (Student Placement) Report
More detailed data for indicators 2P1, 3P1, 5P1 & 5P2 are available in EPM 11, from aggregate data all the way down to individual person level.

11. Annual Core Indicator Report and Three-Year Trend Performance Report

12. Technical Skill Attainment (1P1)

13. Student Placement (4P1)
Talk about change in process for sharing this report. (we have to send it via MoveIt Securely).

14. EPM 11/Student Carl Perkins Folder
Data for Perkins IV core postsecondary accountability indicators 2P1, 3P1, 5P1 and 5P2 are available in EPM 11.

15. EPM 11/Process Data for Your Institution (RC_ID)

16. EPM 11/CAR Report Info (Summary Page)

17. EPM 11/Indicator Reports

18. EPM 11/Special Population Reports

19. Program Inventory Tool
Below is a link to the System Office Academic Programs website, where you can find a link to the official Program Inventory Tool:
Use the tool to:
Produce a PDF of your institution’s current academic programs.
View other information about academic programs, such as whether they are Perkins eligible or designated as nontraditional programs.

20. Program Inventory

21. Perkins V - Future Accountability?
With the transition from Perkins IV to Perkins V, there will be the need for consortia leadership involvement/input on a variety of topics, including core accountability measure development.
The exact timing/nature of this work is still unknown, as details are still forthcoming.

22. Useful Links
Perkins IV Operational Handbook (link is to Consortia Resources page; click on link to handbook there):
Recording of Postsecondary Accountability 2017 webinar (click “Webinar Recording” in Postsecondary Accountability section): _Webinars.html
EPM 11 Login (must use Internet Explorer):
EPM 11 Main SharePoint Page (links to Operational Data Security Form, EPM 11 training, etc.): ate=about
IT Service Desk (to reset expired passwords, etc.):
Academic Program Unit (Click on “Minnesota State Program Inventory”):

23. Perkins IV Accountability – Postsecondary
Katie Vaccari, (651)
Jeralyn Jargo, (651)
Karl Ohrn, (651)