1. Perkins Accountability I: Secondary and Postsecondary Overview September 20, 2012

2. Goals Gain an understanding of Secondary and postsecondary core indicators Definitions of participants, concentrators and completers Data sources State and local negotiation process Improvement plans and reports

3. Secondary Data Sources Student Data Collected Annually Collected using EDEN (MCCC) Data match with the Office of Higher Education (OHE) and with employment data from Department of Employment and Economic Development (DEED) Technical Skill Assessment results

4. Secondary Definitions Secondary Participant: 100 hours or more in one career field Secondary Concentrator: 240 hours or more in one career field Secondary Completer: A concentrator who graduates

5. Postsecondary Data Sources Student data from the system’s Integrated Statewide Record System (ISRS) National Student Clearinghouse Employment information from the system Graduate Follow-Up process and from DEED (Department of Employment and Economic Development) Licensing board and Technical Skill Assessment results from third parties

6. Postsecondary Data Structure The FY2011-2012 cohort includes students entering in FY 2010 and tracked for three years: 2010, 2011 and 2012. Minnesota is one of a handful of states to use a cohort model. The use of cohorts aligns with other system initiatives and reporting.

7. Postsecondary Definitions Participant: Student taking a CTE course OR who has a Perkins eligible major. Concentrator: Student with a Perkins eligible major who has declared a CTE award (AAS, AS, Certificate, Diploma) and has earned 12 or more college level credits OR who has received an award in a short term Perkins eligible program (less than 12 credits). Completer: Student who received a CTE award (AAS, AS, Certificate or Diploma) in a Perkins eligible program.

8. Final Agreed Upon Performance Levels (FAUPL) State Negotiated Performance Level – Accountable in Dec. 2011 CAR State Negotiated Performance Level – Accountable in Dec. 2012 CAR  Definitions for Core Indicators  State Negotiated Performance Levels Definitions for Core Indicators Indicator

9. Perkins Core Indicators Academic Attainment 1S1 Academic Attainment – Reading Language Arts 1S2 Academic Attainment – Mathematics Secondary None Postsecondary

10. Perkins Core Indicators Technical Skill Attainment 2S1 Technical Skill Attainment Secondary Postsecondary 1P1 Technical Skill Attainment

11. Career Pathways Currently Expected to Implement Technical Skill Assessments AGRICULTURE, FOOD, & NATURAL RESOURCES Animal Systems Plant Systems Environmental Services Systems Natural Resources Systems ARTS, COMMUNICATIONS, & INFORMATION SYSTEMS Printing Technology Visual Arts BUSINESS, MANAGEMENT, & ADMINISTRATION Accounting Marketing Management Merchandising Professional Sales Administrative Support ENGINEERING, MANUFACTURING, & TECHNOLOGY Engineering and Technology Facility and Mobile Equipment Maintenance Construction Production Manufacturing Production Process Development Web & Digital Communications FOUNDATION KNOWLEDGE & SKILLS HEALTH SCIENCE TECHNOLOGY Diagnostic Services Therapeutic Services Health Informatics More on the next slide….

12. Career Pathways Currently Expected to Implement Technical Skill Assessments HUMAN SERVICES  Early Childhood Education (Early Childhood Development and Services AND Teaching/Training (Birth to Gr 3)  Law Enforcement Services Emergency & Fire Management Services National Security Personal Care Services Restaurants & Food/ Beverage Services Teaching/ Training (K-12)

13. Resources for Technical Skill Attainment  MDE/MnSCU Position on Technical Skill Assessment Implementation  FY10-FY14 Implementation Timeline  FY13 TSA Planning Calendar  MnSCU Program Inventory by College an CIP  2012 Technical Skill Assessment Handbook  List of approved assessments for pathways currently requiring technical skill assessments http://www.cte.mnscu.edu/programs/mntsa.html

14. Perkins Core Indicators Completion/Graduation Secondary Postsecondary 3S1 School Completion 2P1 Credential, Certificate or Degree 4S1 Student Graduation Rate (NCLB)

15. Perkins Core Indicators Student Retention or Transfer Secondary Postsecondary None 3P1 Student Retention or Transfer

16. Perkins Core Indicators Placement Secondary Postsecondary 5S1 Placement 4P1 Student Placement

17. Perkins Core Indicators Nontraditional Participation Secondary Postsecondary 6S1 Nontraditional Participation 5P1 Nontraditional Participation

18. Perkins Core Indicators Nontraditional Completion Secondary Postsecondary 6S2 Nontraditional Completion 5P2 Nontraditional Completion

19. State & Local Negotiations OVAE/State Negotiations Evaluation of State Performance Improvement Plans State/Local Consortia Negotiations Evaluation of Local Performance Improvement Plans

20. OVAE/State Negotiation Process for 2012 and 2013 Initial OVAE Proposal for FY2012 and FY2013 March 2011 Deadline for State Response March 2011 OVAE Review of State Proposed Levels April – June 2011 Final FAUPL (Final Agreed Upon Performance Levels) June 2011 Evaluation of Performance 2012 & 2013 CAR

21. State/Local Negotiation Process for FY 2013 Targets Target Date Development of State Proposed Targets September/October 2012 Accountability Workshops: Overview Secondary Postsecondary September 20, 2012 September 26, 2012 September 27, 2012 Distribute Proposed Targets to Consortia Mid to Late October 2012 Fall Coordinators Meeting— Breakout session on negotiations November 14, 2012 Consortia Responses Due Late November, 2012 Initial State Response Early December 2012 Negotiations Completed Mid December 2012 Evaluation of Performance January 2014

22. Negotiating Your Targets Review the proposed targets Look at your data – trends/preliminary data if available Discuss the targets with your partners – any changes in policy or practice that may affect performance outcomes? Understand the context and rationale for the proposed targets Expectation of continuous improvement at the state and local level Need for the state to be able to meet state targets negotiated with OVAE

23. Negotiating Your Targets Determine if you will accept the proposed targets or will propose alternatives. If you accept the state proposals-- Return the Negotiated Performance for FY13- 14 form Include BOTH secondary and postsecondary signatures If you don’t accept the state proposals-- Notify the state Submit alternative target(s) along with the rationale for the proposed alternative(s).

24. Negotiating Your Targets: Factors in State Review of Consortia Proposals  Rationale provided by the consortium  Trend data  Impact of proposed alternatives on the ability of the state to meet the state negotiated target

25. Requirements for State and Local Improvement Plans The language in the Act regarding improvement plans and the withholding of funds is very similar for states and local recipients. …fail to meet at least 90 percent of an agreed upon State adjusted level of performance for any of the core indicators… …develop and implement a program improvement plan (with special consideration to performance gaps within subgroups) …

26. Withholding Funds Applies to State and Local Recipients … the Secretary may withhold all or a portion the state’s administrative and leadership funds if a state …  Fails to implement an improvement plan.  Fails to make any improvement within the first program year of implementation of the improvement plan.  Fails to meet at least 90% of an agreed upon performance level for three consecutive years. … the State may withhold all or a portion of a local recipients funding if the local recipient…

27. Withholding Funds  Sanctions may be waived due to exceptional or uncontrollable circumstances.  Withheld funds are to be used to provide technical assistance.  Development of statewide technical assistance for core indicators.

28. Evaluation of Local Performance Negotiated Level 90% of Negotiated Level No action At or above target Improvement Plan Below 90% of target Report Required Between 90% and 99%

29. Improvement Plans and Reports  Examination of the data—comparison of the target level and actual performance (incl. subgroups)  Identification of general strategies to address performance gaps.  Context—an explanation of why the target was not met (optional for reports)  Data and contextual factors for sub- populations or groups where gaps exist.  Specific actions to be taken to improve performance and to help the consortium meet negotiated targets in subsequent years. Improvement Reports and Plans Improvement Plans

30. Resources for Improvement Plans and Reports http://www.cte.mnscu.edu/directories/portal.html  Template and Overview  MN Guide to Improvement Planning

31. Please take a moment to enter your questions in the “Chat” field … or unmute yourself and ask your questions. Time for Your Questions!

32. Other Upcoming Accountability Webinars Perkins Accountability II - Secondary September 26, 2012 10:00 - 11:00 a.m. Perkins Accountability II - Postsecondary September 27, 2012 10:00 – 11:00 a.m. http://www.cte.mnscu.edu/professionaldevelopment/index.html

33. Perkins Fiscal Webinars Annual Fall Perkins Contacts and Coordinators Meeting November 14, 2012 Minnesota Department of Education, Roseville, MN Career Technical Education Fall Conference CTE: Learning that Works for Minnesota November 15, 2012 Crowne Plaza Minneapolis West, Plymouth, MN http://www.cte.mnscu.edu/professionaldevelopment/index.html Tuesday, October 9, 2012 Overview: Perkins Fiscal Training Part I Perkins Law Monday, October 15, 2012 Overview: Perkins Fiscal Training Part II Requirements to Receive Funds Wednesday, October 17, 2012 Perkins Postsecondary Fiscal Procedures and Requirements-Treatment of Money Wednesday, October 24, 2012 Perkins Secondary Fiscal Procedures and Requirements-Treatment of Money Other Upcoming Webinars and Events

34. MDE Website http:// education.state.mn.us/MDE/Academic_Excellence/Career_Technical_Education/Forms_Resources/index.html http:// education.state.mn.us/MDE/Academic_Excellence/Career_Technical_Education/Forms_Resources/index.html MnSCU Website http://www.cte.mnscu.edu/ Important Websites

35. Today’s presenters Marlys J. Bucher, Ph.D. Secondary Perkins Coordinator CTE Assessment and Evaluation Specialist Minnesota Department of Education marlys.bucher@state.mn.us JoAnn Simser State Director, Career and Technical Education Minnesota State Colleges and Universities joann.simser@so.mnscu.edu Susan Carter Associate Director for Research Minnesota State Colleges and Universities susan.carter@so.mnscu.edu Dan Smith Supervisor, Adult and Career Education Center for Postsecondary Success Minnesota Department of Education dan.smith@state.mn.us

36. Thanks for joining us today! We value your feedback about today’s session. Please click on the link here or in the chat window now to complete the Session Evaluation Form.Session Evaluation Form REMINDER: For secondary participants, Continuing Education Units (CEU’s) will be made available for teachers for this series of webinars. In order to get the necessary certificates you MUST complete the session evaluation.