TECH PREP ACCOUNTABILITY IN PERKINS IV NACTEI CONFERENCE May 14, 2009 1 1 NATPL Special Workshop 1

State Tech Prep Director PANEL PRESENTER Mr. Dennis Fiscus NATPL Past President Arizona State Tech Prep Director 2 2 NATPL Special Workshop 2

NACTEI IT IS TECH PREP TIME! NATPL Special Workshop 12/7/2018 3 NATPL Special Workshop NATPL Special Workshop 3

Reporting Effectiveness of Tech Prep programs-From CAR outline Section 205 of Perkins IV requires each eligible agency that receives a tech prep allotment to annually prepare and submit to the Secretary a report on the effectiveness of the tech prep programs that were assisted, including a description of how grants were awarded in the State. Please provide a description of how grants were awarded during the program year, including a listing of the consortia that were funded and their funding amounts. 4 4

Reporting Effectiveness of Tech Prep programs Review the accountability data submitted by your State’s consortia as described in section 203(e) of Perkins IV. Indicate the total number of consortia that failed to meet an agreed upon minimum level of performance for any of the indicators of performance. Note trends, if any, in the performance of these consortia (i.e., the indicators that were most commonly missed, number of years the consortia missed the indicators). 5 5

Sec. 113. Accountability Tech Prep is included in all section 113 language Tech Prep is always a subset of the Perkins Performance Measures Tech Prep has new additional Performance Measures 6 6

New Student Definitions Perkins IV New Student Definitions Participant A postsecondary/adult student who has earned one or more transcripted credits in any CTE program area in the reporting year 12/7/2018 7 NATPL Special Workshop NATPL Special Workshop 7

TECH PREP IS IN FORM III NATPL Special Workshop NATPL Special Workshop 12/7/2018 8 NATPL Special Workshop NATPL Special Workshop 8

Perkins IV Participant The information provided disaggregates the total by gender, ethnicity and special populations for all students and Tech Prep identified students. Eligible Coursework Occupational courses that are a part of a postsecondary CTE program. Students completing or enrolling in non-credit coursework are not eligible for Perkins accountability purposes. Use course taking behavior 12/7/2018 9 NATPL Special Workshop NATPL Special Workshop 9

Perkins IV Participant Include all postsecondary students who have earned one or more transcripted occupational credits in any CTE program area in the reporting year. DO NOT INCLUDE STUDENTS THAT HAVE ONLY TAKEN CTE COURSES WITHIN THE PAST FIVE(5) YEARS AND ARE NOT ENROLLED THIS YEAR Include students that have achieved “concentrator” status and have taken one CTE course during the reporting year. Include all students/CTE programs whether or not the program is being funded with Perkins dollars. Exclude all high school students. 12/7/2018 10 NATPL Special Workshop NATPL Special Workshop 10

New Student Definitions Perkins IV New Student Definitions Postsecondary CTE Completer: the definition of a postsecondary CTE completer has been deleted by OVAE. 12/7/2018 11 NATPL Special Workshop NATPL Special Workshop 11

Concentrator-TP Transition section Perkins IV Concentrator-TP Transition section Reporting Guidelines-TECH PREP This section will collect those students that have transitioned from secondary to postsecondary. Students do not need to be concentrators or have taken any CTE courses (Participant) to be counted in this section. Place students in their secondary program unless PS course taking indicates otherwise. 12/7/2018 12 NATPL Special Workshop NATPL Special Workshop 12

Sec. 113. Accountability-SECONDARY 1S1: ATTAINMENT OF ACADEMIC SKILLS - READING/LANGUAGE ARTS 1S2: ATTAINMENT OF ACADEMIC SKILLS – MATHEMATICS 2S1: ATTAINMENT OF TECHNICAL SKILLS 3S1: SECONDARY SCHOOL COMPLETION 4S1: STUDENT GRADUATION RATES 5S1: SECONDARY PLACEMENT 6S1: NONTRADITIONAL PARTICIPATION 6S2: NONTRADITIONAL COMPLETION

Sec. 113. Accountability POSTSECONDARY 1P1: ATTAINMENT OF TECHNICAL SKILLS 2P1: ATTAINMENT OF CREDENTIAL, CERTIFICATE, OR DIPLOMA 3P1: STUDENT RETENTION OR TRANSFER 4P1: STUDENT PLACEMENT 5P1: NONTRADITIONAL PARTICIPATION 5P2: NONTRADITIONAL COMPLETION

Student Accountability Forms for the Section 113 Core Indicators of Performance (Title I) SECONDARY LEVEL 1S1: ATTAINMENT OF ACADEMIC SKILLS - READING/LANGUAGE ARTS

Sec. 113. Accountability POSTSECONDARY 12/7/2018 16 NATPL Special Workshop NATPL Special Workshop 16

APPROACH FOR ALL PS MEASURES Perkins IV APPROACH FOR ALL PS MEASURES Student cohort is from one year ago (one year lag) Except 5P1 For the 2009 CAR, Use 2007-08 students and find them in the 2008-09 school year ALWAYS exclude high school students Per the Perkins IV law, technical assessments must be used where in place. A list of the current assessments from VTECS has been distributed (light blue handout). 12/7/2018 17 NATPL Special Workshop NATPL Special Workshop 17

OF ALL SECTION 113 MEASURES Perkins IV APPROACH FOR ALL PS MEASURES TECH PREP IS ALWAYS A SUBSET OF ALL SECTION 113 MEASURES Per the Perkins IV law, technical assessments must be used where in place. A list of the current assessments from VTECS has been distributed (light blue handout). 12/7/2018 18 NATPL Special Workshop NATPL Special Workshop 18

How to Approach the Data Collection of Tech Prep Indicators of Performance Section 205. “report on the effectiveness of tech prep programs” Tech Prep Indicators Definitions (Numerators and Denominators) Definitions in the law: Secondary Tech Prep Student: a secondary education student who has enrolled in 2 courses in the secondary education component of a tech prep program. 19 19

How to Approach the Data Collection of Tech Prep Indicators of Performance Tech Prep Indicators Definitions (Numerators and Denominators) Definitions in the law: Postsecondary Tech Prep Student: a student who (A) has completed the secondary education component of a tech prep programs; and (B) has enrolled in the postsecondary education component of a tech prep program at an institution of higher education described in clause (i) or (ii) of section 203 (a)(1)(B). 20 20

Perkins IV - Indicators of Performance (SEC. 203 Perkins IV - Indicators of Performance (SEC. 203. Tech Prep Program, Indicators of Performance and Accountability) The number of secondary education tech prep students and postsecondary education tech prep students served. The number and percent of secondary education tech prep students enrolled in the tech prep program who enroll in postsecondary education; enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level;

Perkins IV - Indicators of Performance (SEC. 203 Perkins IV - Indicators of Performance (SEC. 203. Tech Prep Program, Indicators of Performance and Accountability) (iii) complete a State or industry-recognized certification or licensure; (iv) successfully complete, as a secondary school student, courses that award postsecondary credit at the secondary level; and (v) enroll in remedial mathematics, writing, or reading courses upon entering postsecondary education.

Perkins IV - Indicators of Performance (SEC. 203 Perkins IV - Indicators of Performance (SEC. 203. Tech Prep Program, Indicators of Performance and Accountability) (c) The number and percent of postsecondary education tech prep students who (i) are placed in a related field of employment not later than 12 months after graduation from the tech prep program; (ii) complete a State or industry-recognized certification or licensure; (iii) complete a 2-year degree or certificate program within the normal time for completion of such program; and (iv) complete a baccalaureate degree program within the normal time for completion of such program.

Student Accountability Forms for the Section 203 Indicators of Performance (Title II) SECONDARY LEVEL

Student Accountability Forms for the Section 203 Indicators of Performance (Title II) POSTSECONDARY LEVEL

TO LAG OR NOT TO LAG.. THE TECH PREP QUESTION Do you count the immediate graduates from a few months ago? OR Do you use ONE year ago graduates and take the year to find them? THIS IS THE DECISION!! 12/7/2018 26 NATPL Special Workshop NATPL Special Workshop 26

We must report the number of secondary education tech prep students and postsecondary education tech prep students served. Measurement Definition Number of secondary TP students Number of postsecondary TP students Collect # of secondary TP students as defined in the law # of postsecondary TP students as defined in the law 27

Tech Prep Denominators The denominators are identical for: 1STP1 1STP2 1STP3 The denominator will be the secondary Tech Prep concentrators that you find at your school from one year ago-1 year lag 12/7/2018 28 NATPL Special Workshop NATPL Special Workshop 28

Tech Prep Denominators Use immediate past year information for: 1STP4 (Credits) There is no lag year 1STP5 uses 1STP1 numerator Do not report high school students in any of these measures 12/7/2018 29 NATPL Special Workshop NATPL Special Workshop 29

% of secondary TP students enrolled in PS (1STP1) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. Numerator # of secondary TP students who graduated last year and are enrolled in postsecondary during the current year. Denominator # of secondary TP students who graduated last year Collected & Percent In PS % of secondary TP students enrolled in PS 30 30

# of secondary TP students who graduated last year (1STP1) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. Denominator # of secondary TP students who graduated last year Must know this number/student first Already collected as a part of the state CAR report for Technical Attainment-denominator 31

# of secondary TP students who graduated last year (1STP1) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. Denominator # of secondary TP students who graduated last year Student file utilized could contain just a common identifier such as SSN or Department of Education state student identifier 32

# of secondary TP students who graduated last year (1STP1) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. Denominator # of secondary TP students who graduated last year File could contain common student identifier fields such as: Student name High school name Gender Graduation date/year CTE Program completed 33

# of secondary TP students who graduated last year (1STP1) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. Denominator # of secondary TP students who graduated last year This finds the majority of the students Some “hands on” delineation or sorting is required 34

(1STP1) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. Numerator # of secondary TP students who graduated last year and are enrolled in postsecondary during the current year. Run list of secondary tech prep graduates through the community college enrollment database Utilize National Clearinghouse especially for universities and out of your state enrollees 35

% of secondary TP students enrolled in same field in PS (1STP2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. Numerator # of secondary TP students who graduated last year and are enrolled in postsecondary during the current year in the same major or cluster/pathway as they were in high school. Denominator # of secondary TP students who graduated last year Collected & Percent In PS % of secondary TP students enrolled in same field in PS 36 36

# of secondary TP students who graduated last year (1STP2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. Denominator # of secondary TP students who graduated last year Again-This is the same number as from your CAR report-Technical Attainment denominator Same as the denominator for 1STP1 37

This is a subset of the numerator on 1STP1 (1STP2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. Numerator # of secondary TP students who graduated last year and are enrolled in postsecondary during the current year in the same major or cluster/pathway as they were in high school. This is a subset of the numerator on 1STP1 The subset is now needing JUST those in same major/cluster 38

# of students BY program is reported in the CAR on form 3 (1STP2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. Numerator # of secondary TP students who graduated last year and are enrolled in postsecondary during the current year in the same major or cluster/pathway as they were in high school. Your state MUST be identifying what programs the secondary students are in-by CIP and program name # of students BY program is reported in the CAR on form 3 39

As before-run student list through the college system to find student (1STP2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. Numerator # of secondary TP students who graduated last year and are enrolled in postsecondary during the current year in the same major or cluster/pathway as they were in high school. Student identifier from secondary should have the student’s program as part of the identifier field As before-run student list through the college system to find student 40

METHODS OF DETERMINING MAJOR OR CLUSTER/PATHWAY (1STP2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. METHODS OF DETERMINING MAJOR OR CLUSTER/PATHWAY Must first define Major and Cluster/Pathway for use in your system 41

WHAT DETERMINES A CLUSTER/PATHWAY ? (1STP2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. WHAT DETERMINES A CLUSTER/PATHWAY ? Utilize Classification of Instructional Programs list-CIP CODE Same first two digits of CIP code=Cluster/Pathways? 01.000=Agriculture 51.000=Health 42

WHAT DETERMES A CLUSTER/PATHWAY ? (1STP2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. WHAT DETERMES A CLUSTER/PATHWAY ? Utilize Classification of Instructional Programs list-CIP CODE Student has 7 or more credits in a programmatic area-Business education, welding, computers 43

METHODS OF DETERMINING MAJOR OR CLUSTER/PATHWAY (1STP2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. METHODS OF DETERMINING MAJOR OR CLUSTER/PATHWAY May need Tech Prep consortia directors to utilize a Student Tech Prep “Registration” form Form would include students “major area of interest” = MAJOR 44

METHODS OF DETERMINING MAJOR OR CLUSTER/PATHWAY (1STP2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. METHODS OF DETERMINING MAJOR OR CLUSTER/PATHWAY What if found using clearing house and the student is at a University in OR out of state? If Consortia Director has utilized a Student Registration form indicating career interest - use it 45

METHODS OF DETERMINING MAJOR OR CLUSTER/PATHWAY (1STP2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. METHODS OF DETERMINING MAJOR OR CLUSTER/PATHWAY What if found using clearing house and the student is at a University in OR out of state? Assume if no contradicting information is present and student is continuing to pursue career interest from secondary? 46

% of secondary TP students who obtain a certificate or license (1STP3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iii) complete a State industry-recognized certification or licensure. Numerator # of secondary TP students who graduated last year with a State or industry-recognized certification or licensure. Denominator # of secondary TP students who graduated last year Collected & Percent In Sec. % of secondary TP students who obtain a certificate or license 47 47

# of secondary TP students who graduated last year Same as 1STP1 (1STP3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iii) complete a State industry-recognized certification or licensure. Denominator # of secondary TP students who graduated last year Same as 1STP1 Same as 1STP2 48

(1STP3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iii) complete a State industry-recognized certification or licensure. Numerator # of secondary TP students who graduated last year with a State or industry-recognized certification or licensure. This could be a subset of the new Perkins IV Measure 113 (b)(2)(A)(ii) 2S1 Technical Skill Attainment Subset is part of the NUMERATOR for 2S1 Perkins Measure for Technical Skill Attainment 49

(1STP3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iii) complete a State industry-recognized certification or licensure. Numerator # of secondary TP students who graduated last year with a State or industry-recognized certification or licensure. Your state should already be collecting this data Your Tech Prep concentrators are just a subset Does this include Licensure? 50

% of secondary TP students with PS credit (1STP4) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iv) successfully complete, as a secondary school student, courses that award postsecondary credit at the secondary level. Numerator # of secondary TP students who graduated last year with postsecondary credit Denominator # of secondary TP students who graduated last year Collected & Percent In Sec. % of secondary TP students with PS credit 51 51

# of secondary TP students who graduated last year Same as 1STP1 (1STP4) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iv) successfully complete, as a secondary school student, courses that award postsecondary credit at the secondary level. Denominator # of secondary TP students who graduated last year Same as 1STP1 Same as 1STP2 Same as 1STP3 52

(1STP4 ) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iv) successfully complete, as a secondary school student, courses that award postsecondary credit at the secondary level. Numerator # of secondary TP students who graduated last year with postsecondary credit Once again-this is simply a subset of the Denominators for 1STP1, 1STP2, 1STP3-depending on which cohort year you are using-immediate or lag The subset is defined as the Tech Prep students who GRADUATED secondary WITH postsecondary credits 53

Most states REQUIRE colleges to REPORT: (1STP4) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iv) successfully complete, as a secondary school student, courses that award postsecondary credit at the secondary level. Numerator # of secondary TP students who graduated last year with postsecondary credit Most states REQUIRE colleges to REPORT: DUAL ENROLLMENT CREDITS AWARDED TO SECONDARY STUDENTS 54

(1STP4) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iv) successfully complete, as a secondary school student, courses that award postsecondary credit at the secondary level. Numerator # of secondary TP students who graduated last year with postsecondary credit Many high schools and community colleges already have this report for ALL students receiving credits You need to receive that report and compare (run) your Tech Prep secondary concentrator report against it 55

Banked credits can count (1STP4) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iv) successfully complete, as a secondary school student, courses that award postsecondary credit at the secondary level. Numerator # of secondary TP students who graduated last year with postsecondary credit Primary idea behind this Measure is that ALL Tech Prep articulated programs from secondary to postsecondary SHOULD have a “for CREDIT” component as per the new Perkins IV Law Banked credits can count 56

A student that meets the definition for a Tech Prep SECONDARY student. (1STP4) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iv) successfully complete, as a secondary school student, courses that award postsecondary credit at the secondary level. COHORT IDENTIFIERS A student that meets the definition for a Tech Prep SECONDARY student. The student has graduated from high school The student has received course credit for a postsecondary course any time during their high school career Student will be counted only once even though credit may have been received for multiple courses Student banked credit will be counted 12/7/2018 57 57 NATPL Special Workshop NATPL Special Workshop 57

% of remedial postsecondary TP students (1STP5) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(v) enroll in remedial mathematics, writing, or reading courses upon entering postsecondary education. Numerator # of secondary TP students who graduated last year who enrolled in postsecondary remedial mathematics, writing, or reading courses upon entering PS education. Denominator # of secondary TP students who graduated last year and enrolled in postsecondary education Collected & Percent In PS % of remedial postsecondary TP students 58 58

Same number as the NUMERATOR in 1STP1 (1STP5) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(v) enroll in remedial mathematics, writing, or reading courses upon entering postsecondary education. Denominator # of secondary TP students who graduated last year and enrolled in postsecondary education Same number as the NUMERATOR in 1STP1 59

This is a subset of your Denominator for this measure (1STP5) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(v) enroll in remedial mathematics, writing, or reading courses upon entering postsecondary education. Numerator # of secondary TP students who graduated last year who enrolled in postsecondary remedial mathematics, writing, or reading courses upon entering PS education. This is a subset of your Denominator for this measure Should have electronic access to transcripts at the postsecondary 60

Usually courses in academics below “100” level are considered remedial (1STP5) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(v) enroll in remedial mathematics, writing, or reading courses upon entering postsecondary education. Numerator # of secondary TP students who graduated last year who enrolled in postsecondary remedial mathematics, writing, or reading courses upon entering PS education. Usually courses in academics below “100” level are considered remedial Sometimes the colleges identify the courses as “Remedial Math”, etc If it shows up on the Tech Prep students’ transcripts-then the student is counted in the numerator 61

(1STP5) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(v) enroll in remedial mathematics, writing, or reading courses upon entering postsecondary education. COHORT IDENTIFIERS A student that meets the definition for a Tech Prep student. The student has graduated from high school The student has enrolled in at least 1 remedial course during the reporting year Student will be counted only once even though student may be enrolled in multiple remedial courses 12/7/2018 62 62 NATPL Special Workshop NATPL Special Workshop 62

TECH PREP POSTSECONDARY 12/7/2018 63 63 NATPL Special Workshop NATPL Special Workshop 63

% of PS TP graduates placed within 12 months in related field (1PTP1) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(i) are placed in a related field of employment not later than 12 months after graduation from the tech prep program. Numerator # of postsecondary TP students placed in a related field no later than 12 months after graduation Denominator # of postsecondary TP students who graduated last year Collected & Percent In PS % of PS TP graduates placed within 12 months in related field 64 64

# of postsecondary TP students who graduated last year (1PTP1) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(i) are placed in a related field of employment not later than 12 months after graduation from the tech prep program. Denominator # of postsecondary TP students who graduated last year The Tech Prep Measure Denominator Could be a subset of 4P1 Perkins Measure on Student Placement Denominator There is not a concentrator requirement here 65

The only additional element is “related” employment (1PTP1) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(i) are placed in a related field of employment not later than 12 months after graduation from the tech prep program. Numerator # of postsecondary TP students placed in a related field no later than 12 months after graduation The only additional element is “related” employment Define “related” for your circumstances and give to OVAE

Assume positive-if placed, it is related? (1PTP1) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(i) are placed in a related field of employment not later than 12 months after graduation from the tech prep program. Numerator # of postsecondary TP students placed in a related field no later than 12 months after graduation Possible definitions Assume positive-if placed, it is related? Utilize CIP code with job name Let student tell you if it is related

Possible methods of collection (1PTP1) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(i) are placed in a related field of employment not later than 12 months after graduation from the tech prep program. Numerator # of postsecondary TP students placed in a related field no later than 12 months after graduation Possible methods of collection Unemployment Insurance (UI) data from DOL surveys Student follow-up surveys FEDES

% of PS TP leavers who obtained a certificate or license (1PTP2) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(ii) complete a State or industry-recognized certification or licensure. Numerator # of postsecondary TP students who left postsecondary education this year with a State or industry-recognized certification or licensure. Denominator # of postsecondary TP students who left postsecondary education this year Collected & Percent In PS % of PS TP leavers who obtained a certificate or license 69 69

Does not have a concentrator requirement (1PTP2) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(ii) complete a State or industry-recognized certification or licensure. Denominator # of postsecondary TP students who left postsecondary education this year AGAIN—This Tech Prep Measure Denominator could be a subset of 4P1 Perkins Measure on Student Placement Denominator Does not have a concentrator requirement Also same as 1STP3 EXCEPT for postsecondary 70

Just determine subset “Tech Prep” utilizing Tech Prep identifier (1PTP2) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(ii) complete a State or industry-recognized certification or licensure. Numerator # of postsecondary TP students who left postsecondary education this year with a State or industry-recognized certification or licensure This is a subset of the Perkins Postsecondary Measure 2P1-Credential, Certificate, or diploma Attainment The “Perkins” folks in your state should have already figured this one out Just determine subset “Tech Prep” utilizing Tech Prep identifier 71

(1PTP2) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(ii) complete a State or industry-recognized certification or licensure. Numerator # of postsecondary TP students who left postsecondary education this year with a State or industry-recognized certification or licensure Most colleges have determined and utilize certifications within their degree programs Most colleges have this as a part of their report to the State “Governing Board” 72

(1PTP2) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(ii) complete a State or industry-recognized certification or licensure. Numerator # of postsecondary TP students who left postsecondary education this year with a State or industry-recognized certification or licensure Often the certification and licensure are also reported on the transcripts Often the college has this as a “termination” point for the student’s “alternative” to a degree 73

Sometimes the student will take an industry test (1PTP2) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(ii) complete a State or industry-recognized certification or licensure. Numerator # of postsecondary TP students who left postsecondary education this year with a State or industry-recognized certification or licensure Sometimes the student will take an industry test Utilize a “Tech Prep” agreement with the student to receive the results if your college hasn’t already arranged to receive the results 74

Sometimes the student will take an industry test (1PTP2) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(ii) complete a State or industry-recognized certification or licensure. Numerator # of postsecondary TP students who left postsecondary education this year with a State or industry-recognized certification or licensure Sometimes the student will take an industry test A “Tech Prep” agreement with the student may include some “incentives” for reporting A “Tech Prep” agreement with the student may include the results coming to the college 75

(1PTP3) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(iii) complete a 2-year degree or certificate program within the normal time for completion of such a program. Numerator # of postsecondary TP students who entered postsecondary 3 years ago and who completed a 2-year degree or certificate. Denominator # of postsecondary TP students who entered postsecondary education 3 years ago Collected & Percent In PS % of PS TP students who obtained a 2-year degree or certificate within 3 years of entering postsecondary 76 76

This does not need to be a concentrator (1PTP3) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(iii) complete a 2-year degree or certificate program within the normal time for completion of such a program. Denominator # of postsecondary TP students who entered postsecondary education 3 years ago Again—This Tech Prep Measure Denominator could be a subset of 4P1 Perkins Measure on Student Placement Denominator This does not need to be a concentrator Students could be part of 1PTP1 & 1PTP2 77

(1PTP3) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(iii) complete a 2-year degree or certificate program within the normal time for completion of such a program. Numerator # of postsecondary TP students who entered postsecondary 3 years ago and who completed a 2-year degree or certificate. Could be tagged along with the Perkins Measure of Retention/Transfer 3P1 Utilize the Tech Prep identifier to simply compare graduates or certification completers each year to how long ago they entered the institution 78

Perhaps we need a discussion on (1PTP3) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(iii) complete a 2-year degree or certificate program within the normal time for completion of such a program. Numerator # of postsecondary TP students who entered postsecondary 3 years ago and who completed a 2-year degree or certificate. Perhaps we need a discussion on Is a 3 years time frame “normal” for the community college student to graduate? Your college data can help determine this 79

(1PTP4) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(iv) complete a baccalaureate degree within the normal time for completion of such a program. Numerator # of postsecondary TP students who entered postsecondary 6 years ago and who completed a baccalaureate degree program Denominator # of postsecondary TP students who entered postsecondary education 6 years ago. Collected & Percent In PS % of PS TP students who graduated with a baccalaureate degree within 6 years of entering postsecondary 80 80

There is not a concentrator requirement here (1PTP4) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(iv) complete a baccalaureate degree within the normal time for completion of such a program. Denominator # of postsecondary TP students who entered postsecondary education 6 years ago. Again—This Tech Prep Measure Denominator could be a subset of 4P1 Perkins Measure on Student Placement Denominator There is not a concentrator requirement here Students could be part of 1PTP1, 1PTP2 & 1PTP3 81

Here’s our best thoughts This can be done (1PTP4) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(iv) complete a baccalaureate degree within the normal time for completion of such a program. Numerator # of postsecondary TP students who entered postsecondary 6 years ago and who completed a baccalaureate degree program Here’s our best thoughts This can be done This will be a very low number and percentage We WILL NOT find most of our Tech Prep students 82

Here’s our best thoughts Utilize the National Clearinghouse database (1PTP4) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(iv) complete a baccalaureate degree within the normal time for completion of such a program. Numerator # of postsecondary TP students who entered postsecondary 6 years ago and who completed a baccalaureate degree program Here’s our best thoughts Utilize the National Clearinghouse database Use your state’s University system database Utilize student surveys 83

OUTLINE FOR REPORTING EFFECTIVENESS OF TECH PREP IN THE CAR Report in writing according to the new guidelines in the CAR: Section 205 of Perkins IV requires each eligible agency that receives a tech prep allotment to annually prepare and submit to the Secretary a report on the effectiveness of the tech prep programs that were assisted, including: A description of how grants were awarded in the State during the program year. 12/7/2018 84 84 NATPL Special Workshop NATPL Special Workshop 84

OUTLINE FOR REPORTING EFFECTIVENESS OF TECH PREP IN THE CAR A listing of the consortia and their funding amounts for the year. Review the accountability data submitted by your State’s consortia as described in section 203(e) of Perkins IV. A data summary table is applicable. This should include both Section 113, and 203. 12/7/2018 85 85 NATPL Special Workshop NATPL Special Workshop 85

OUTLINE FOR REPORTING EFFECTIVENESS OF TECH PREP IN THE CAR Indicate the total number of consortia that failed to meet an agreed upon minimum level of performance for any of the indicators of performance. Note any trends in the performance of the consortia such as indicator that were most commonly missed and for how many years they have not met the indicator. 12/7/2018 86 86 NATPL Special Workshop NATPL Special Workshop 86

OUTLINE FOR REPORTING EFFECTIVENESS OF TECH PREP IN THE CAR 2. The CAR reporting of Tech Prep Effectiveness includes Section 113 Performance Measures with Tech Prep as a subset just like it has in the past. 3. Section 203 is the new section for reporting specific Tech Prep Measures. The CAR has specific forms for reporting this data. 12/7/2018 87 87 NATPL Special Workshop NATPL Special Workshop 87

OUTLINE FOR REPORTING EFFECTIVENESS OF TECH PREP IN THE CAR The Tech Prep Evaluation Plan handed out is an evaluation rubric that is suggested by the National Association for Tech Prep Leadership to be used in order to assist your State in Reporting the Effectiveness of Tech Prep. 12/7/2018 88 88 NATPL Special Workshop NATPL Special Workshop 88

OUTLINE FOR REPORTING EFFECTIVENESS OF TECH PREP IN THE CAR Tech Prep Evaluation Plan (Sec. 205) State: __________________________________________ Name of Person Submitting: ________________________________________ Date Submitted: __________________________________________________________ INSTRUCTIONS: For each of the following criterion assess the implementation stage at the secondary and postsecondary education level using the rating scale provided for Tech Prep in your state. Place an X in the appropriate column. Rating Scale: Implementation Stage: 1 – Not begun – Tech Prep has done no work in this area 2 – Planning – Tech Prep is beginning to do some work in this area 3 – Development – Tech Prep has made significant progress in this area 4 – Implementation – Tech Prep has achieved a high level of proficiency with data reporting elements in place 12/7/2018 89 89 NATPL Special Workshop NATPL Special Workshop 89

Criterion* 1 2 3 4 Implementation Stage Secondary Postsecondary 1. Remediation – Tech Prep students possess the professional technical and academic skills required to enter postsecondary education remediation free and/or enter the employment market. 1STP5 2. Related Employment – Tech Prep students obtain employment within their program related career cluster within 12 months of graduation. 1PTP1 3. Persistence (Completion) – Tech Prep students complete a certificate program or a 2-year degree, or a baccalaureate degree within the normal time frame. Definitions, 1STP1, 1PTP3, 1PTP4 4. Return on Investment – (Articulation/Concurrent Enrollment Credit) Tech Prep students are enrolled in postsecondary Tech Prep programs which enable them to apply credits earned at the secondary level to their postsecondary program of study. 1STP1, 1STP4 5. Credential Attainment – Tech Prep students complete a coherent sequence of courses leading to recognized state or national credentials.1STP2, 1STP3, 1PTP2 6. Education Relevance – The curriculum incorporates rigorous academic and technical competencies that integrate contextual and performance based learning. Definitions, 1STP1, 1STP3

OUTLINE FOR REPORTING EFFECTIVENESS OF TECH PREP IN THE CAR Action Plan for Implementation (Sec. 205) Provide a rational for your assessment of the implementation stage at the secondary and postsecondary education levels. Identify an action plan to move all criteria to implementation. Include time line for completion and personnel responsible. 12/7/2018 91 91 NATPL Special Workshop NATPL Special Workshop 91

OUTLINE FOR REPORTING EFFECTIVENESS OF TECH PREP IN THE CAR 1) Provide a rationale for your assessment of implementation at the secondary education level: Criterion 1: Criterion 2: Criterion 3: Criterion 4: Criterion 5: Criterion 6: 12/7/2018 92 92 NATPL Special Workshop NATPL Special Workshop 92

OUTLINE FOR REPORTING EFFECTIVENESS OF TECH PREP IN THE CAR Provide a rationale for your assessment of implementation at the postsecondary education level: Criterion 1: Criterion 2: Criterion 3: Criterion 4: Criterion 5: Criterion 6: 3) Additional Comments and Recommendations: 12/7/2018 93 93 NATPL Special Workshop NATPL Special Workshop 93

Next Steps: Meet with State “data people” to discuss Tech Prep Indicators of Performance Local Tech Prep directors meet with “data people” at community college to discuss next steps Review your Perkins State plan and be familiar with Section 205 requirement “report on the effectiveness of tech prep programs” 94 94

State Tech Prep Director PRESENTER Mr. Dennis Fiscus NATPL Past President Arizona State Tech Prep Director dennis.fiscus@azed.gov 602.542.5356 95 95 NATPL Special Workshop 95