TECH PREP PERFORMANCE MEASURES & PROGRAMS OF STUDY NCPN October 13, 2011

State Tech Prep Director PRESENTER Mr. Dennis Fiscus NATPL Past President Arizona State Tech Prep Director

PROGRAM OF STUDY What does that mean? Is it the Same as RPOS (Rigorous Programs of Study)? What is coming? Measures going to follow??

Rigorous Programs of Study The new “Tech Prep” Provides a “Transitional Link” Longitudinal information needs Will be associated with Performance Measures

Tracking Students Career Path Beginning to Completion TRANSITIONAL LINK Tracking Students Career Path Beginning to Completion What does this mean? NATPL Special Workshop 5

TRANSITIONAL LINK PERHAPS IT MEANS “How do we find and then prove the secondary student that started in a CTE program is transitioning to the postsecondary in CTE and that they are successful?” NATPL Special Workshop 6

Tracking Students Career Path Beginning to Completion TRANSITIONAL LINK Tracking Students Career Path Beginning to Completion The CTE/Tech Prep way: Why How What Where When Who NATPL Special Workshop 7

TRANSITIONAL LINK -WHY- SEC. 122. STATE PLAN (c) Plan Contents (1) describes the career and technical education activities to be assisted that are designed to meet or exceed the State adjusted levels of performance, including a description of— (A) the career and technical programs of study, which may be adopted by local educational agencies and postsecondary institutions to be offered as an option to students (and their parents as appropriate) when planning for and completing future coursework, for career and technical content areas that-- NATPL Special Workshop 8

TRANSITIONAL LINK -WHY- SEC. 122. STATE PLAN 122(c)(1)(A) continued; (i) incorporate secondary education and postsecondary education elements; (ii) include coherent and rigorous content aligned with challenging academic standards and relevant career and technical content in a coordinated, non-duplicative progression of courses that align secondary education with postsecondary education to adequately prepare students to succeed in postsecondary education; NATPL Special Workshop 9

TRANSITIONAL LINK -WHY- 122(c)(1)(A) continued; (iii) may include the opportunity for secondary education students to participate in dual or concurrent enrollment programs or other ways to acquire postsecondary education credits; and NATPL Special Workshop 10

TRANSITIONAL LINK -HOW- 122(c)(1); (B) how the eligible agency, in consultation with eligible recipients, will develop and implement the career and technical programs of study described in subparagraph (A); (C) how the eligible agency will support eligible recipients in developing and implementing articulation agreements between secondary education and postsecondary education institutions; rent enrollment programs or other ways to acquire postsecondary education credits; and NATPL Special Workshop 11

TRANSITIONAL LINK -HOW- (D) how the eligible agency will make available information about career and technical programs of study offered by eligible recipients; (K) how funds will be used effectively to link academic and career and technical education at the secondary level and at the postsecondary level in a manner that increases student academic and career and technical achievement; and NATPL Special Workshop 12

TRANSITIONAL LINK -WHAT- So…just WHAT is the way to get this transitional link in place??? Articulation Agreements that lead to: PROGRAMS OF STUDY OF COURSE!! NATPL Special Workshop 13

TRANSITIONAL LINK -WHAT- SEC. 3. DEFINITIONS. (4) ARTICULATION AGREEMENT (A) that is agreed upon at the State level or approved annually by the lead administrators of-- (i) a secondary institution and a postsecondary educational institution; (B) to a program that is-- (i) designed to provide students with a nonduplicative sequence of progressive achievement leading to technical skill proficiency, a credential, a certificate, or a degree; and (ii) linked through credit transfer agreements between the 2 institutions described 14 NATPL Special Workshop 14

TRANSITIONAL LINK -WHAT- SEC. 135. LOCAL USES OF FUNDS (2) link career and technical education at the secondary level and career and technical education at the postsecondary level, including by offering the relevant elements of not less than 1 career and technical program of study described in section 122(c)(1)(A); 15 NATPL Special Workshop 15

TRANSITIONAL LINK -WHERE- AND JUST WHERE DO YOU FIND THESE ARTICULATION AGREEMENTS AND THIS PROGRAM OF STUDY?? IN TECH PREP!!! 16 NATPL Special Workshop 16

TRANSITIONAL LINK -WHERE- SEC. 203. TECH PREP PROGRAM. (a)(c) Contents of Tech Prep Program- Each tech prep program shall-- (1) be carried out under an articulation agreement between the participants in the consortium; (2) consist of a program of study that-- `(A) combines-- ` (i) a minimum of 2 years of secondary education (as determined under State law); with ` (ii)(I) a minimum of 2 years of postsecondary education in a nonduplicative, sequential course of study; or ` (II) an apprenticeship program of not less than 2 years following secondary education instruction; 17 NATPL Special Workshop 17

TRANSITIONAL LINK -WHERE- (F) leads to placement in high skill or high wage employment, or to further education; and (G) utilizes career and technical education programs of study, to the extent practicable; 18 NATPL Special Workshop 18

TRANSITIONAL LINK -WHEN- AND JUST WHEN DO YOU: FIND OUT THE INFORMATION AND DATA YOU NEED TO PROVE THE TRANSITIONAL LINK FOR THE STUDENTS?? WHEN YOU REPORT IN THE CONSOLIDATED ANNUAL REPORT!! 19

CAR reporting requirements -WHEN- CAR reporting requirements Report participation Report concentrators 9 Tech Prep specific measures (7 will likely be in the next Perkins with RPOS) 20

-WHEN- Collect Measurement Definition In the CAR we already must report the number of secondary education tech prep students and postsecondary education tech prep students served. Collect # of secondary TP students as defined in the law # of postsecondary TP students as defined in the law Measurement Definition Number of secondary TP students PARTICIPANTS ALSO Number of postsecondary TP students PARTICIPANTS ALSO 21

Student Accountability Forms for the Section 203 Indicators of Performance (Title II) SECONDARY LEVEL 22

Student Accountability Forms for the Section 203 Indicators of Performance (Title II) POSTSECONDARY LEVEL 23

TRANSITIONAL LINK -WHO- And just WHO can do all of this PROGRAM OF STUDY work for our TRANSITIONAL LINK?? TECH PREP!! 24 24

This is the first part of a -WHO- Tech Prep Definition in the law: Secondary Tech Prep Student: a secondary education student who has enrolled in 2 courses in the secondary education component of a tech prep program. This is the first part of a PROGRAM OF STUDY 25

This is the SECOND part of a -WHO- Tech Prep Definition in the law: Postsecondary Tech Prep Student: a student who (A) has completed the secondary education component of a tech prep programs; and (B) has enrolled in the postsecondary education component of a tech prep program at an institution of higher education described in clause (i) or (ii) of section 203 (a)(1)(B). This is the SECOND part of a PROGRAM OF STUDY 26 26

Perkins IV - Indicators of Performance (SEC. 203 Perkins IV - Indicators of Performance (SEC. 203. Tech Prep Program, Indicators of Performance and Accountability) The number of secondary education tech prep students and postsecondary education tech prep students served. The number and percent of secondary education tech prep students enrolled in the tech prep program who enroll in postsecondary education; enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level; 27

Perkins IV - Indicators of Performance (SEC. 203 Perkins IV - Indicators of Performance (SEC. 203. Tech Prep Program, Indicators of Performance and Accountability) (iii) complete a State or industry-recognized certification or licensure; (iv) successfully complete, as a secondary school student, courses that award postsecondary credit at the secondary level; and (v) enroll in remedial mathematics, writing, or reading courses upon entering postsecondary education. 28

(c) The number and percent of postsecondary education tech Perkins IV - Indicators of Performance (SEC. 203. Tech Prep Program, Indicators of Performance and Accountability) (c) The number and percent of postsecondary education tech prep students who (i) are placed in a related field of employment not later than 12 months after graduation from the tech prep program; (ii) complete a State or industry-recognized certification or licensure; (iii) complete a 2-year degree or certificate program within the normal time for completion of such program; and (iv) complete a baccalaureate degree program within the normal time for completion of such program. 29

TRANSITIONAL LINK -WHO- TECH PREP IS ALREADY: Dedicating Directors to manage Articulation Agreements and all the essential components Building the Programs of Study through Articulation Agreements Tracking the students in transition Tracking student outcomes from secondary to postsecondary to the workforce Tracking student success along the way 30 NATPL Special Workshop 30

TRANSITIONAL LINK -WHO- TECH PREP IS PROGRAM OF STUDY!!! 31 NATPL Special Workshop 31

National CAR Accountability Data Secondary Indicator All CTE Tech-Prep POS 1S1 Reading YES NO 1S2 Mathematics 2S1 Technical Skill 3S1 Completion 4S1 Graduation Rate 5S1 Placement 6S1 N-T Participation 6S2 N-T Completion Enrolled in Postsecondary Same field or major Certificate or licensure Postsecondary credit Remedial enrollment

National CAR Accountability Data Postsecondary Indicator All CTE Tech-Prep POS 1P1 Technical skills YES NO 2P1 Credential, certificate, diploma 3P1 Retention or transfer 4P1 Placement 5P1 N-T Participation 5P2 N-T Completion Employment after graduation Certificate or licensure 2 year degree or certificate Completes baccalaureate 33

1STP Enroll in Postsecondary Education (1STP1) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. Numerator # of secondary TP students who graduated last year and are enrolled in postsecondary during the current year. Denominator # of secondary TP students who graduated last year Collected & Percent In PS % of secondary TP students enrolled in PS 34 34 NATPL Special Workshop

1STP Enroll in Postsecondary Education (1STP1) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(i) enroll in postsecondary education. NUMERATOR 3288 DENOMINATOR 11426 28.8% One year lag works best 35 NATPL Special Workshop

1STP Enroll in Postsecondary Education How do you use this data? Compare to ALL students that transition Compare to ALL CTE students that transition Compare by program Compare by school or district BETTER OR NOT?? NATPL Special Workshop

1STP2 Enroll in PS &same field (1STP2) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(ii) enroll in postsecondary education in the same field or major as the secondary education tech prep students were enrolled at the secondary level. Numerator # of secondary TP students who graduated last year and are enrolled in postsecondary during the current year in the same major or cluster/pathway as they were in high school. Denominator # of secondary TP students who graduated last year Collected & Percent In PS % of secondary TP students enrolled in same field in PS 37 37 NATPL Special Workshop

1STP2 Enroll in PS &same field NUMERATOR 1658 DENOMINATOR 11426 14.5% One year lag works best 38

1STP2 Enroll in PS &same field How do you use this data? Compare to ALL CTE students by program that transition Compare by program Compare by school or district Compare by consortia What makes the difference? BETTER OR NOT?? 39

1STP3 Completes a Certificate (1STP3) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iii) complete a State industry-recognized certification or licensure. Numerator # of secondary TP students who graduated last year with a State or industry-recognized certification or licensure. Denominator # of secondary TP students who graduated last year Collected & Percent In Secondary % of secondary TP students who obtain a certificate or license 40 NATPL Special Workshop

1STP3 Completes a Certificate Numerator # of secondary TP students who graduated last year with a State or industry-recognized certification or licensure. Your state should already be collecting this data Your Tech Prep concentrators are just a subset NATPL Special Workshop

1STP3 Completes a Certificate NUMERATOR 3579 DENOMINATOR 10733 33.3% Use immediate past year 42

1STP3 Completes a Certificate How do you use this data? Compare to ALL CTE students that received a certification Compare to ALL CTE students by program that received a certification Compare by program Compare by school or district Compare by consortia What makes the difference 43

1STP3 Completes a Certificate This is one of the measures that will not likely be in the new Perkins/RPOS It is a duplicate of 2S1 44

1STP4 Completes courses for PS credit (1STP4) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(iv) successfully complete, as a secondary school student, courses that award postsecondary credit at the secondary level. Numerator # of secondary TP students who graduated last year with postsecondary credit Denominator # of secondary TP students who graduated last year Collected & Percent In Sec./PS % of secondary TP students with PS credit 45 NATPL Special Workshop

1STP4 Completes courses for PS credit NUMERATOR 2673 DENOMINATOR 10733 24.9% Use immediate past year 46

1STP4 Completes courses for PS credit How do you use this data? Compare to ALL students that graduated and received credits Compare with GPA Compare with remediation rate Compare by program Compare by school or district Compare by consortia What makes the difference? USE FOR FUNDING 47

1STP5 Enroll in remedial math, writing, or reading courses (1STP5) The number and percent of secondary education tech prep students enrolled in the tech prep program who- “(v) enroll in remedial mathematics, writing, or reading courses upon entering postsecondary education. Numerator # of secondary TP students who graduated last year who enrolled in postsecondary remedial mathematics, writing, or reading courses upon entering PS education. Denominator # of secondary TP students who graduated last year and enrolled in postsecondary education Collected & Percent In PS % of remedial postsecondary TP students 48 48 NATPL Special Workshop

1STP5 Enroll in remedial math, writing or reading courses NUMERATOR 2004 DENOMINATOR 3288 60.9% Use immediate past year HIGH % is BAD!! 49

1STP5 Enroll in remedial math, writing or reading courses How do you use this data? Compare to ALL students that graduated and needed remediation Compare with GPA Compare to those receiving credits Compare by program Compare by school or district Compare by consortia Were pre-test encouraged or used FOR BETTER OF WORSE? USE FOR FUNDING 50

1PTP1 Employment after graduation (1PTP1) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(i) are placed in a related field of employment not later than 12 months after graduation from the tech prep program. Collected & Percent In PS % of PS TP graduates placed within 12 months in related field (Infers a one year lag) Numerator # of postsecondary TP students placed in a related field no later than 12 months after graduation Denominator # of postsecondary TP students who graduated last year 51 NATPL Special Workshop

1PTP1 Employment after graduation NUMERATOR 258 DENOMINATOR 1210 21.3% A one year lag is best due to the 12 month requirement 52

1PTP1 Employment after graduation How do you use the data? Compare to ALL CTE students that graduated and were placed Compare by program Compare by college Compare by consortia To review the course standards for relevancy USE FOR FUNDING 53

1PTP1 Employment after graduation How do you use this data? Are the students becoming employed in the program they are studying? For your own use compare only those students found/to those in a related field FOR BETTER OF WORSE? USE FOR FUNDING 54

1PTP2 Completes a certificate or licensure (1PTP2) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(ii) complete a State or industry-recognized certification or licensure. Numerator # of postsecondary TP students who left postsecondary education this year with a State or industry-recognized certification or licensure. Denominator # of postsecondary TP students who left postsecondary education this year Collected & Percent In PS % of PS TP leavers who obtained a certificate or license YOU MUST KNOW HOW YOUR STATE REPORTS INDUSTRY RECOGNIZED CERTIFICATION 55 55 NATPL Special Workshop

1PTP2 Completes a certificate or licensure NUMERATOR 120 DENOMINATOR 3137 3.8% A one year lag is best 56

1PTP2 Completes a certificate or licensure How do you use this data? Are these students testing in the program they are studying? Determine why Tech Prep students aren’t testing Add this % to those that graduated if they are different to have a better picture of the leavers For your own use compare these students to those that you found in a related field USE to help determine assessments 57

1PTP2 Completes a certificate or licensure This is one of the measures that will not likely be in the new Perkins/RPOS It is a duplicate of 1P1 58

1PTP3 Completes a 2-year degree or certificate (1PTP3) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(iii) complete a 2-year degree or certificate program within the normal time for completion of such a program. Collected & Percent In PS % of PS TP students who obtained a 2-year degree or certificate within 3 years of entering postsecondary Numerator # of postsecondary TP students who entered postsecondary 3 years ago and who completed a 2-year degree or certificate. Denominator # of postsecondary TP students who entered postsecondary education 3 years ago 59 59 NATPL Special Workshop

1PTP3 Completes a 2-year degree or certificate NUMERATOR 569 DENOMINATOR 3646 15.6% Must go back 3 years 60

1PTP3 Completes a 2-year degree or certificate How do you use this data? Compare to the state and college 3 year average Compare to a national average-from IPEDS? Determine what % of your Tech Prep students are these 1st time, full time students FOR BETTER OF WORSE? 61

1PTP3 Completes a 2-year degree or certificate How do you use this data? Start in secondary with POS to encourage degrees Continue in Community College with the POS Compare to students that received credits Compare to students receiving remediation FOR BETTER OF WORSE? 62

1PTP4 Completes a Baccalaureate degree (1PTP4) The number and percent of postsecondary education tech prep students enrolled in the tech prep program who- “(iv) complete a baccalaureate degree within the normal time for completion of such a program. Numerator # of postsecondary TP students who entered postsecondary 6 years ago and who completed a baccalaureate degree program Denominator # of postsecondary TP students who entered postsecondary education 6 years ago. Collected & Percent In PS % of PS TP students who graduated with a baccalaureate degree within 6 years of entering postsecondary 63 63 NATPL Special Workshop

1PTP4 Completes a Baccalaureate degree NUMERATOR 92 DENOMINATOR 615 15.0% Must go back 6 years 64

1PTP4 Completes a Baccalaureate degree How do you use this data? Compare to the state and college 6 year average Compare to a national average-from IPEDS or Clearinghouse? Determine what % of your Tech Prep students are these 1st time, full time students FOR BETTER OF WORSE? 65

1PTP4 Completes a Baccalaureate degree How do you use this data? Start in secondary with POS to encourage degrees Continue in Community College with the POS Compare to students that received credits Compare to students receiving remediation FOR BETTER OF WORSE? 66

1PTP4 Completes a Baccalaureate degree This MAY not survive in the new Perkins Currently NOT in RPOS Very difficult to track reliably 67

STUDENT ENROLLMENT OF CAREER AND TECHNICAL EDUCATION PARTICIPANTS Student Population Number of Secondary Students Number of Postsecondary Students Number of Adult Students Number of Secondary Tech Prep Students Number of Postsecondary Tech Prep Students Gender Males 4,082,048 2,035,156 78,730 671,638 150,875 Females 3,614,537 2,446,654 78,793 565,972 173,696 Total 7,696,585 4,481,810 157,523 1,237,610 324,571 1977 Race/Ethnic American Indian/Alaskan Native 65,156 29,521 944 9,450 1,773 Asian or Pacific Islander 120,134 81,870 1,991 17,299 5,240 Black (not Hispanic) 1,018,903 379,916 25,547 99,589 32,804 Hispanic 866,583 267,574 16,767 133,033 45,737 White 2,921,507 1,457,964 80,201 401,276 104,003 Unknown 46,611 132,453 2,072 6,551 5,959 5,038,894 2,349,298 127,522 667,198 195,516 1997 Race/Ethnic American Indian /Alaska Native 26,512 26,403 231 8,264 1,224 Asian 185,616 250,481 286 46,505 16,863 Black or African American 324,774 215,852 12,555 53,497 9,524 Hispanic/Latino 726,282 500,284 752 139,859 39,674 N. Hawaiian/Other Pacific Islander 33,356 15,598 29 6,852 1,073 1,312,337 1,108,006 16,485 305,616 52,460 Two or More Races 41,249 9,034 63 11,357 92 245,978 282 11,702 2,650,126 2,371,636 30,683 571,950 132,612

DISAGGREGRATED STUDENT ENROLLMENT OF CAREER AND TECHNICAL EDUCATION PARTICIPANTS Student Population Number of Secondary Students Number of Postsecondary Students Number of Adult Students Number of Secondary Tech Prep Students Number of Postsecondary Tech Prep Students Individuals With Disabilities (ADA) 155,567 8,423 9,961 Disability (ESEA/IDEA) (Secondary) 842,552 121,648 Economically Disadvantaged 2,732,709 1,390,613 58,287 420,777 95,727 Single Parents 38,058 304,119 12,117 5,750 23,467 Displaced Homemakers 1,171 98,517 3,645 247 10,974 Limited English Proficient 484,549 190,190 7,971 74,352 10,847 Migrant Status 75,811 12,225 Nontraditional Enrollees 1,371,199 1,087,299 11,017 226,527 50,543 Total 5,546,049 3,226,305 101,460 861,526 201,519 69

Participation Trend 70

Concentrators as a Percent of Participants Secondary Postsecondary Adult Participants 7,696,585 4,481,810 157,523 Concentrators 3,264,469 1,913,884 123,236 Percent 42.41% 42.70% 78.23% 71

2008-2009 Secondary and Postsecondary Concentrators 72

All CTE Concentrators Placement* *includes duplicate count All Students Secondary, Postsecondary & Adult* Certificates 110,895 Credentials 44,927 Advanced Training 392,296 Employment 680,830 Military 21,375 Apprenticeships 5,910

Improvement at the local education level How do you use the data? Improvement at the local education level Establishment of objectives and goals for the consortia Determine strategies to assist the students for transition and success Determine effectiveness of current strategies in use Assist in longitudinal findings Focus for funding 74 NATPL Special Workshop

RPOS-What’s next?? Think POS but more Think Tech Prep but more Think new measures (or old ones if you have done Tech Prep) Think ALL CTE programs that are FUNDED

RPOS-10 ELEMENTS Legislation & Policies Partnerships Professional Development Accountability & Evaluation Systems College & Career Readiness Standards

RPOS-10 ELEMENTS Course Sequence Credit Transfer Agreements Guidance Counseling & Career Advisement Teaching & Learning Strategies Technical Skill Assessments

THE FUTURE RPOS Standards Coherent Sequences Consortia to do RPOS Do it or no funding? Changes Changes?

State Tech Prep Director PRESENTER Mr. Dennis Fiscus NATPL Past President Arizona State Tech Prep Director dennis.fiscus@azed.gov 602.542.5356 79 79 NATPL Special Workshop 79