1. Perkins Accountability I Secondary and Postsecondary Overview September 15, 2011 JoAnn SimserSusan Carter & Denise Roseland State Director, CTEOffice of the Chancellor System Director, Perkins Grantsusan.carter@so.mnscu.edu joann.simser@so.mnscu.edudenise.roseland@so.mnscu.edu Dan SmithMarlys Bucher Supervisor, Adult and Career Education Center for Postsecondary Success CTE Assessment/Evaluation Perkins Coordinator Center for Postsecondary Success dan.smith@state.mn.usmarlys.bucher@state.mn.us

2. Slide 2  Review the secondary & postsecondary accountability indicators -- definitions -- data sources -- changes from previous year  Discuss the Local Negotiation Process for FY12 and FY13 Goals

3. Slide 3 Secondary Data Sources Student Data Collected Annually Collected using EDEN (MCCC) Data match with the Office of Higher Education and with employment data from Department of Employment and Economic Development (DEED) Technical Skill Assessment results

4. Slide 4 Secondary Definitions Secondary Participant: an individual who has participated in career and technical education courses in one career field for 100 hours or more Secondary Concentrator: an individual who has participated successfully (passing grade) in career and technical education courses in one career field for 240 hours or more Secondary Completer: a secondary concentrator who graduates from high school

5. Slide 5 Postsecondary Data Sources Student data from the system’s Integrated Student Record System (ISRS) Transfer data from the National Student Clearinghouse Employment information from the system Graduate Follow-up process and from DEED Licensing board and Technical Skill Assessment results

6. Slide 6 Postsecondary Data Structure Minnesota is one of a handful of states to use a cohort model. The use of cohorts aligns with other system initiatives and reporting. For example, the FY2009-2011 cohort includes students entering in FY2009 and tracked for three years: 2009, 2010, and 2011

7. Slide 7 Postsecondary Definitions Postsecondary Participant: a student taking a CTE course OR who has a Perkins eligible major Postsecondary Concentrator: a student with a Perkins eligible major who has declared a CTE award (AAS, AS, Certificate, Diploma) and has earned 12 or more credits OR who has received an award in a short term Perkins eligible program (less than 12 credits) Postsecondary Completer: a student who has received an award (AAS, AS, Certificate, Diploma) in a Perkins eligible program

8. Slide 8 Final Agreed Upon Performance Levels (FAUPL) State Negotiated Performance Level – Accountable in Dec. 2011 CAR State Negotiated Performance Level – Accountable in Dec. 2012 CAR  Definitions for Core Indicators  State Negotiated Performance Levels Definitions for Core Indicators Indicator

9. Slide 9 1S1 Academic Attainment – Reading Language Arts 1S2 Academic Attainment – Mathematics Perkins Core Indicators Academic Attainment Secondary None Postsecondary

10. Slide 10 2S1 Technical Skill Attainment Perkins Core Indicators Technical Skill Attainment Secondary Postsecondary 1P1 Technical Skill Attainment For more information on Technical Skills Assessments, visit: http://www.cte.mnscu.edu/programs/mntsa.html

11. Slide 11 Career Pathways Currently Expected to Implement Technical Skill Assessments within courses under Perkins IV: AGRICULTURE, FOOD, & NATURAL RESOURCES  Animal Systems  Plant Systems ARTS, COMMUNICATIONS, & INFORMATION SYSTEMS  Printing Technology  Visual Arts BUSINESS, MANAGEMENT, & ADMINISTRATION  Accounting  Marketing Management  Merchandising  Professional Sales ENGINEERING, MANUFACTURING, & TECHNOLOGY  Engineering and Technology  Facility and Mobile Equipment Maintenance HEALTH SCIENCE TECHNOLOGY  Diagnostic Services  Therapeutic Services HUMAN SERVICES  Early Childhood Education (Early Childhood Development and Services AND Teaching/Training (Birth to Gr 3)  Law Enforcement Services FOUNDATION KNOWLEDGE & SKILLS

12. Slide 12 3S1 School Completion Perkins Core Indicators Completion/Graduation Secondary Postsecondary 2P1 Credential, Certificate or Degree 4S1 Student Graduation Rate (NCLB)

13. Slide 13 None Perkins Core Indicators Student Retention or Transfer Secondary Postsecondary 3P1 Student Retention or Transfer

14. Slide 14 5S1 Placement Perkins Core Indicators Placement Secondary Postsecondary4P1 Student Placement

15. Slide 15 6S1 Nontraditional Participation Perkins Core Indicators Nontraditional Participation Secondary Postsecondary5P1 Nontraditional Participation

16. Slide 16 6S2 Nontraditional Completion Perkins Core Indicators Nontraditional Completion Secondary Postsecondary5P2 Nontraditional Completion

17. Slide 17 Update on Technical Skill Attainment http://www.cte.mnscu.edu/programs/Technical_Skill_Atta.html  Technical Skill Attainment Web Site MDE/MnSCU Position on Technical Skill Assessment Implementations TSA FY10-FY14 Implementation Timeline FY12 Technical Skill Assessments Planning Calendar MnSCU Program Inventory by career fields, clusters and pathway

18. Slide 18 (2S1/1P1) Technical Skill Attainment Agriculture—Animal Systems Health-Diagnostic Services Early Childhood Dev. & Services and Teaching/Training Engineering & Technology Facility & Mobile Equipment Maintenance Network Systems Plant Systems Therapeutic Services FY11 Career Pathways

19. Slide 19 Update on Technical Skill Attainment (cont.) FY12 Career Pathways Administrative Support Construction Emergency & Fire Management Services AND National Security (2) Environmental Services Systems AND Natural Resources Systems (2) Health Informatics Personal Care Services Production AND Manufacturing Production Process Development (2) Restaurants & Food/ Beverage Services Teaching/ Training (K-12) Web & Digital Communications

20. Slide 20 Update on Technical Skill Attainment (cont.) FY13 Career Pathways Agribusiness Systems Audio/Video Technology and Film AND Performing Arts AND Journalism & Broadcasting (3) Banking Services AND Business Finance AND Securities & Investment AND Insurance (4) Biotechnology Research & Development AND Health Support Services (2) Consumer Services Correction Services AND Security & Protective Services (2) Design/ Pre-construction General Management AND Human Resources Management AND Operations Management AND Business Information Management (4) Information Support & Services Maintenance, Installation, and Repair Power, Structural, & Technical Systems Public Management & Administrative Planning AND Revenue & Taxation (2) Quality Assurance Health AND Safety & Environmental Assurance (2) Transportation Operations AND Sales & Services (2)

21. Slide 21 Update on Technical Skill Attainment (cont.) FY14 Career Pathways Education Administration & Administrative Support AND Professional Support Services (2) Family & Consumer Services AND Counseling & Mental Health Services (2) Food Products & Processing Systems Foreign Service AND Governance AND Regulation (3) Legal Services Lodging, Travel, & Tourism AND Recreation, Amusement and Attractions (2) Logistics Planning & Management Services AND Transportation Systems, Infrastructure AND Warehousing & Distribution Center Operations AND Health Safety & Environmental Management (4) Maintenance/Operations Marketing Communications AND Marketing Research (2) Programming & Software Development Telecommunications

22. Slide 22 State and Local Negotiations OVAE/State Negotiations Evaluation of State Performance -- Improvement Plans State/Local Consortia Negotiations Evaluation of Local Performance -- Improvement Plans

23. Slide 23 OVAE/State Negotiation Process for 2012 and 2013 Initial OVAE Proposal for FY2012 and FY2013 March 2011 Deadline for State ResponseMarch 2011 OVAE Review of State Proposed Levels April – June 2011 Final FAUPL (Final Agreed Upon Performance Levels) June 2011 Evaluation of Performance2012 & 2013 CAR

24. Slide 24 State/Local Consortia Negotiation Process for FY2012 Targets Target Date Development of State Proposed Targets September 2011 Distribution of Proposed Targets to Local Consortia October 18, 2011 Accountability Workshop Overview Secondary Postsecondary September 15, 2011 September 22, 2011 September 29, 2011 Consortia Responses DueNovember 16, 2011 Initial State ResponseNovember 29, 2011 Negotiations CompletedDecember 9, 2011 Evaluation of PerformanceJanuary 2013

25. Slide 25 Negotiating Your Targets Review the proposed targets Look at your data – trends/preliminary data if available Discuss the targets with your partners – any changes in policy or practice that may affect performance outcomes? Understand the context and rationale for the proposed targets Expectation of continuous improvement at the state and local level Need for the state to be able to meet state targets negotiated with OVAE

26. Slide 26 Negotiating Your Targets Determine if you will accept the proposed targets or will propose alternatives. If you accept the state proposals-- Return the Negotiated Performance for FY12-13 form Include BOTH secondary and postsecondary signatures If you don’t accept the state proposals-- Notify the state Submit alternative target(s) along with the rationale for the proposed alternative(s).

27. Slide 27 Factors in State Review of Consortia Proposed Targets  Rationale provided by the consortium  Trend data  Impact of proposed alternatives on the ability of the state to meet the state negotiated target

28. Slide 28 Improvement Plans The language in the Act regarding improvement plans and the withholding of funds is very similar for states and local recipients. Section 123(a)(1): State Improvement Plan Section 123(a)(3)(A): Withholding State Funds Section 123(b)(2): Local Improvement Plan Section 123(b)(4)(A): Withholding State Funds StateLocal

29. Slide 29 State Improvement Plan Requirement …fail to meet at least 90 percent of an agreed upon State adjusted level of performance for any of the core indicators… …develop and implement a program improvement plan (with special consideration to performance gaps within subgroups) …during the first program year succeeding the program year for which the state failed to meet the performance level. Section 123(a)(1)–Failure to Meet Agreed Upon State Level of Performance

30. Slide 30 Local Improvement Plan Requirement Section 123(b)(2)–Failure to Meet Agreed Upon Local Level of Performance …fail to meet at least 90 percent of an agreed upon State adjusted level of performance for any of the core indicators… …develop and implement a program improvement plan (with special consideration to performance gaps within subgroups) …during the first program year succeeding the program year for which the local recipient failed to meet the performance level.

31. Slide 31 Withholding of Funds Section 123(a)(3)(A) … the Secretary may withhold all or a portion the state’s administrative and leadership funds if a state …  Fails to implement an improvement plan.  Fails to make any improvement within the first program year of implementation of the improvement plan.  Fails to meet at least 90% of an agreed upon performance level for three consecutive years. Section 123(b)(4)(A) … the State may withhold all or a portion of a local recipients funding if the local recipient…

32. Slide 32 Withholding of Funds–State & Local Sanctions may be waived due to exceptional or uncontrollable circumstances. Withheld funds are to be used to provide technical assistance. Plans are underway to develop statewide technical assistance for all core indicators by consortia.

33. Slide 33 Evaluation of Performance – Local Negotiated Level 90% of Negotiated Level At or above target – No action Below 90% of target – Perkins Law requires an Improvement Plan Below target, but above 90% threshold Report Required

34. Slide 34 Components of a Performance Improvement Plan and Report  Examination of the data— comparison of the target level and actual performance (incl. subgroups)  Context—an explanation of why the target was not met  Identification of general strategies to address performance gaps.  Specific actions to be taken to improve performance and to help the consortium meet negotiated targets in subsequent years. Needed to complete both Improvement reports and improvement plans Needed to complete improvement plans only

35. Slide 35

36. Slide 36 TIME FOR YOUR QUESTIONS! Please take a moment to enter your questions in the Chat field to the right.

37. Slide 37 Upcoming Accountability Webinars  Perkins Accountability II – Secondary Sept. 22, 2011 2:00 p.m. – 3:00 p.m.  Perkins Accountability II – Postsecondary Sept. 29, 2011 2:00 p.m. – 3:00 p.m. To register, go to: www.cte.mnscu.edu/professionaldevelopment

38. Slide 38 Parting comments… Thank you for all your valuable suggestions, diligent efforts and hard work to improve MN career and technical education for students, staff and employers.

39. Slide 39 Thanks for joining us today! We value your feedback about today’s session. Please click on the link in the chat window now to complete the session evaluation form. REMINDER: For secondary participants, Continuing Education Units (CEU’s) will be made available for teachers and administrators for this series of webinars. In order to get the necessary certificates you MUST complete the session evaluation.