Perkins IV Postsecondary Accountability September 20, 2018 Perkins IV Postsecondary Accountability

Today’s Presenters Minnesota State Katie Vaccari Senior Research Associate, System Office Research Jeralyn Jargo System Director of Career Technical Education Karl Ohrn Interim Associate Director of Career Technical Education

Chat, Comment, React Your Phone Line Is Muted Use Chat to send questions/comments Look for links, info in Chat box Send notifications to presenters

Agenda Provide overview of Perkins IV postsecondary data structure and reporting status/accountability indicators. Review data sources for determining your Perkins IV accountability indicator performance. Review how to access Perkins IV data in EPM 11. Given the passing of Perkins V and that we’re in sort of that weird “in between” stage where we are still under the current Perkins IV law (in place until June 30, 2019) and are required to still do reports and plans, etc, I plan to do an overview of Perkins IV postsecondary accountability, but not go in to the depth or detail that we have in previous webinars. That depth and detail exists in the Operational Handbook and in the recording of last year’s webinar, if you need it.

Perkins IV Postsecondary Data Structure Minnesota is one of a few states to use a cohort model. The use of cohorts aligns with other system initiatives and reporting. Perkins IV: Entry Cohort Reporting FY 2016-2018 Cohort   FY 2016 FY 2017 FY 2018 Enter in Summer 2015 Fall 2014 Spring 2016 Summer 2016 Fall 2016 Spring 2017 Summer 2017 Fall 2017 Spring 2018 Enter in Fall 2015 Enter in Spring 2016 The FY 2016-2018 cohort includes students entering in FY 2016 and tracked for three years: 2016, 2017 and 2018.

Postsecondary Definitions – Perkins Status Participant A student taking a CTE course OR who has a Perkins eligible major. Concentrator A student with a Perkins eligible major who declared a CTE award (AAS, AS, Cert, Dip) and earned 12+ college level credits OR who received an award in a short term Perkins eligible program (less than 12 credits). The Perkins status used for reporting is typically the highest recorded Perkins status during the cohort period. If a Concentrator changes to a non-Perkins major, that student will be counted as a Participant, not a Concentrator. Completer A student who received a CTE award (AAS, AS, Certificate or Diploma) in a Perkins eligible program.

Perkins IV Postsecondary Accountability Indicators and Data Sources 1P1 – Technical Skill Attainment Aggregate data (not at student level): Licensure data for Radiography, Law Enforcement and Nursing; NBCOT (occupational therapy) beginning in 2016; EMS/Paramedic 2016 only Student level data: NOCTI; ASE (Automotive) 2016 forward; EMS/Paramedic Licensure 2018 forward; Precision Exams 2018 forward 2P1 – Completion 3P1 – Retention and Transfer 5P1 – Nontraditional Participation 5P2 – Nontraditional Completion ISRS (Integrated Statewide Record System) enrollment and completion data on CTE students National Student Clearinghouse data on transfers to other colleges or universities 4P1 – Placement Minnesota Dept. of Employment & Economic Development (DEED) and Graduate Follow-up data on employment following program completion Since this is more of an “accountability lite” session, I will direct you to the Perkins IV Operational Handbook for more detailed descriptions of the indicators, data sources, reporting processes, etc. I would also suggest listening to the recorded 2017 Postsecondary Accountability webinar, where we did provide more detailed information about how each indicator is defined, etc.

State and Local Target Negotiations Federal/State Negotiations State/Local Consortia Negotiations Evaluation of State Performance Improvement Plans Evaluation of Local Performance Improvement Plans With the transition to Perkins V, unless we receive other information, the expectation for 2019 targets is that they will remain at the 2018 level. There will be no 2019 local target negotiations on Perkins IV core accountability indicators. If there is a need for local 2019 targets, the expectation would be you would continue to work on/meet the levels specified for 2018 performance. While the state has already negotiated the 2019 state targets as part of updating our state plan this past spring, we will not have a local target negotiation for 2019 local targets.

Evaluation of Annual Local Performance (for 2018) No Action At or above target Negotiated Level Report Required Between 90% and 99% For 2018 performance reporting, both at the state and local level, performance is evaluated on each core indicator against the target levels we/you negotiated last year for 2018 performance. 90% of Negotiated Level Improvement Plan Below 90% of target

Perkins IV Postsecondary Accountability Indicators: How/Where Do I Get My Data? System Office staff distribute four reports to Consortia Coordinators early in the calendar year (for the most recent reporting year): Annual Core Indicator Report Three-Year Trend Performance Report 1P1 (Technical Skill Attainment) Report 4P1 (Student Placement) Report More detailed data for indicators 2P1, 3P1, 5P1 & 5P2 are available in EPM 11, from aggregate data all the way down to individual person level.

Annual Core Indicator Report and Three-Year Trend Performance Report

Technical Skill Attainment (1P1)

Student Placement (4P1) Talk about change in process for sharing this report. (we have to send it via MoveIt Securely).

EPM 11/Student Carl Perkins Folder Data for Perkins IV core postsecondary accountability indicators 2P1, 3P1, 5P1 and 5P2 are available in EPM 11.

EPM 11/Process Data for Your Institution (RC_ID)

EPM 11/CAR Report Info (Summary Page)

EPM 11/Indicator Reports

EPM 11/Special Population Reports

Program Inventory Tool Below is a link to the System Office Academic Programs website, where you can find a link to the official Program Inventory Tool: http://minnstate.edu/system/asa/academicaffairs/programs/index.html Use the tool to: Produce a PDF of your institution’s current academic programs. View other information about academic programs, such as whether they are Perkins eligible or designated as nontraditional programs.

Program Inventory

Perkins V - Future Accountability? With the transition from Perkins IV to Perkins V, there will be the need for consortia leadership involvement/input on a variety of topics, including core accountability measure development. The exact timing/nature of this work is still unknown, as details are still forthcoming.

Useful Links Perkins IV Operational Handbook (link is to Consortia Resources page; click on link to handbook there): http://www.minnstate.edu/system/cte/consortium_resources/index.html Recording of Postsecondary Accountability 2017 webinar (click “Webinar Recording” in Postsecondary Accountability section): http://www.minnstate.edu/system/cte/professionaldevelopment/2017- 2018_Webinars.html EPM 11 Login (must use Internet Explorer): https://data2.csvc.mnstate.us/workspace/index.jsp EPM 11 Main SharePoint Page (links to Operational Data Security Form, EPM 11 training, etc.): https://mnscu.sharepoint.com/sites/its/SitePages/topic.aspx?topicID=77&st ate=about IT Service Desk (to reset expired passwords, etc.): https://servicedesk.minnstate.edu/CherwellPortal/MNSO Academic Program Unit (Click on “Minnesota State Program Inventory”): http://minnstate.edu/system/asa/academicaffairs/programs/index.html

Perkins IV Accountability – Postsecondary Katie Vaccari, (651) 201-1718 Katie.Vaccari@minnstate.edu Jeralyn Jargo, (651) 201-1650 Jeralyn.Jargo@minnstate.edu Karl Ohrn, (651) 201-1686 Karl.Ohrn@minnstate.edu