1. Perkins IV Secondary Accountability Data Michelle Kamenov Kari-Ann Ediger “Leading for educational excellence and equity. Every day for every one.”

2. Review student definitions, reporting categories & special populations Discuss the secondary accountability indicators & how they impact district results Examine current targets and performance Timeline: negotiating targets Timeline: data submission for the P-file Goals education.state.mn.us 2

3. Secondary Consortium Data Reports 1S1 Academic Attainment in Reading/Language Arts (GRAD) 1S2 Academic Attainment in Mathematics (GRAD) 2S1 Technical Skill Attainment (TSA) 3S1 School Completion 4S1 Student Graduation Rates (MN 4-year Graduation Rate, prior year) 5S1 Placement (MOHE Match) 6S1 Nontraditional Participation 6S2 Nontraditional Completion education.state.mn.us 3

4. Other Reports (current year) –Career Cluster Report (1 page)  by the 16 career clusters  Includes unduplicated counts –Program Report (3 pages)  6 digit program codes  Only reported for approved programs –Course Report (42 pages)  6 + 2 digit course codes  Provides overall duplicated counts and unduplicated total Duplicated and Unduplicated Data are specified in each report Data by school, district, consortium, state education.state.mn.us 4 Reports

5. All data reported out by: –Gender (MARSS, Female/Male) –Ethnicity (7 codes as of 2011 data) 1) American Indian or Alaskan Native, 2) Asian, 3) Hispanic, 4) Black, Non-Hispanic, 5) White, Non-Hispanic, 6) Hawaiian/ Pacific Islander, 7) Multiracial –Special Populations 1.Individuals with Disabilities (MARSS, SEES codes: 4, 6, 9) 2.Economically Disadvantaged (MARSS, Econ codes: 1, 2) 3.Nontraditional Enrollees (from P-file) 4.Single Parents (self-reported) 5.Displaced Homemakers (Federal definition, self-reported) 6.Limited English Proficiency (MARSS: Y/N) 7.Migrant (MARSS until 2013-14; different department this SY2014-15) Reporting Categories education.state.mn.us 5

6. DATA ELEMENT LENGTH POSITION VALID DATA FILL/JUSTIFICATION School Year2 1 – 2 NumericRight Justify, leading zero fill School District4 3 – 6 Numeric Right Justify, leading zero fill District Type2 7 – 8 NumericRight Justify, leading zero fill School Number3 9 – 11 Numeric Right Justify, leading zero fill MARSS ID Number 13 12 – 24 Numeric Right Justify, leading zero fill Program Code6 25 – 30 Numeric Right Justify, leading zero fill Course Code2 31 – 32 Numeric Right Justify, leading zero fill Course Length in Minutes 5 33 – 37 Numeric Right Justify, leading zero fill Grade Received1 38P or NProficient/Non-Proficient Teen (single) Parent1 39Y / NDefault to N Displaced Homemaker1 40 Y / N Is a TSA Given1 41Y / NState Approved TSA given in class Student Proficiency1 42P / NIF Line 41=Y then student P or N Last Name 40 43 – 82 Alpha Left justify, fill with spaces to end First Name 40 83 - 122 Alpha Left justify, fill with spaces to end Middle Name 40 123 - 162 Alpha Left justify, fill with spaces to end Suffix 04 163 - 166 Alpha/Left justify, fill with spaces to end Numeric Gender 01 167 M or F Date of Birth 08 168 - 175 Numeric yyyymmdd Data Record Example: 1428530104000000000000001407101504840PNNYPLASTNAME FIRSTNAME MIDDLENAME SUFXGYYYYMMDD Carl D. Perkins Record Layout 2014 education.state.mn.us 6

7. Participant  100 hours or more in one career field Concentrator  240 hours or more in one career field Secondary Completer  A concentrator who graduates Definitions education.state.mn.us 7

8. 1S1 Academic Attainment in Reading/ Language Arts* education.state.mn.us 8 Numerator __________________________________________ Denominator Number of CTE Concentrators who have met the proficient or advanced level on the Statewide high school reading/language arts assessment administered by the State under Section 1111(b)(3) of the Elementary and Secondary Education Act (ESEA) as amended by the No Child Left Behind Act based on the scores that were included in the State’s computation of adequate yearly progress (AYP) and who, in the reporting year, left secondary education. Number of CTE Concentrators who took the ESEA assessment in reading/language arts whose scores were included in the State’s computation of AYP and who, in the reporting year, left secondary education. *Based on the GRAD

9. 1S2 Academic Attainment in Mathematics * education.state.mn.us 9 ___________________________________________ Numerator Denominator Number of CTE Concentrators who have met the proficient or advanced level on the Statewide high school mathematics assessment administered by the State under Section 1111(b)(3) of the (ESEA) as amended by the No Child Left Behind Act based on the scores that were included in the State’s computation of adequate yearly progress (AYP) and who, in the reporting year, left secondary education. Number of CTE Concentrators who took the ESEA assessment in mathematics whose scores were included in the State’s computation of AYP and who, in the reporting year, have left secondary education. *Based on the GRAD

10. GRAD Testing: 1S1 & 1S2 reports education.state.mn.us 10 REPORT: DEC 2017 REPORT: DEC 2016 REPORT: DEC 2015 REPORT: DEC 2014 --- SCHOOL YEAR 2016-17 SCHOOL YEAR 2015-16 SCHOOL YEAR 2014-15 SCHOOL YEAR 2013-14 SCHOOL YEAR 2012-13 SCHOOL YEAR 2011-12 SCHOOL YEAR 2010-11 SCHOOL YEAR 2016-17 12 th graders have taken Reading & Math GRAD 11 th grade Math GRAD 10 th grade Reading GRAD 9 th 8 th Dec 2015 is the last year of using the GRAD assessment to report 1S1 & 2S1

11. GRAD Testing: 1S1 & 1S2 reports education.state.mn.us 11 REPORT: DEC 2017 REPORT: DEC 2016 REPORT: DEC 2015 REPORT: DEC 2014 --- SCHOOL YEAR 2016-17 SCHOOL YEAR 2015-16 SCHOOL YEAR 2014-15 SCHOOL YEAR 2013-14 SCHOOL YEAR 2012-13 SCHOOL YEAR 2011-12 SCHOOL YEAR 2010-11 SCHOOL YEAR 2016-17 12 th graders have taken Reading & Math GRAD 11 th grade Math GRAD 10 th grade Reading GRAD 9 th 8 th 12 th graders have taken Reading & Math GRAD 11 th grade Math GRAD 10 th grade Reading GRAD 9 th 8 th 7 th 12 th 11 th ACT plus Writing 10 th 9 th 8 th 7 th 6 th Dec 2015 is the last year of using the GRAD assessment to report 1S1 & 2S1

12. GRAD Testing: 1S1 & 1S2 reports education.state.mn.us 12 REPORT: DEC 2017 REPORT: DEC 2016 REPORT: DEC 2015 REPORT: DEC 2014 --- SCHOOL YEAR 2016-17 SCHOOL YEAR 2015-16 SCHOOL YEAR 2014-15 SCHOOL YEAR 2013-14 SCHOOL YEAR 2012-13 SCHOOL YEAR 2011-12 SCHOOL YEAR 2010-11 SCHOOL YEAR 2016-17 12 th graders have taken Reading & Math GRAD 11 th grade Math GRAD 10 th grade Reading GRAD 9 th 8 th 12 th graders have taken Reading & Math GRAD 11 th grade Math GRAD 10 th grade Reading GRAD 9 th 8 th 7 th 12 th 11 th ACT plus Writing 10 th 9 th 8 th 7 th 6 th 12 th 11 th ACT plus Writing 10 th ACT Plan and possibly Compass 9 th 8 th ACT Explore (where available) 7 th 6 th 5 th 11 th ACT plus Writing 10 th ACT Plan and possibly Compass 9 th 8 th ACT Explore (where available) 7 th 6 th 5 th 4 th Dec 2015 is the last year of using the GRAD assessment to report 1S1 & 2S1

13. 2S1 Technical Skills Attainment* education.state.mn.us 13 Numerator __________________________________________ Denominator Number of Secondary CTE Concentrators within Programs of Study selected by the state for which state-approved technical skill assessment instruments have been identified who pass any of those identified technical skill assessment instruments pertinent to the Program of Study in which concentrator status is obtained. Number of Secondary CTE Concentrators within Programs of Study selected by the state for which state-approved technical skill assessment instruments have been identified who attempt any of those identified technical skill assessment instruments pertinent to the Program of Study in which Concentrator status is obtained.  * FY11 was the first year of reporting TSA outcomes for Secondary. (Prior to FY11, the number of concentrators passing 2 credits within one career field was reported.)  Assessments have been added each subsequent year. State-Approved Technical Skill Assessments have now been identified in 60 of the 79 career pathways.  Assessments are also identified for career clusters and career fields for programs that focus on career exploration.

14. 3S1 School Completion education.state.mn.us 14 ___________________________________________ Number of CTE Concentrators who earned a regular secondary school diploma during the reporting year. Number of CTE Concentrators who left secondary education during the reporting year. Numerator Denominator

15. Number of CTE Concentrators who, in the reporting year, were included as graduated in the State’s computation of its graduation rate as described in Section 1111(b)(2)(C)(vi) of the ESEA. Number of CTE Concentrators who, in the reporting year, were included in the State’s computation of its graduation rate as defined in the State’s Consolidated Accountability Plan pursuant to Section 1111(b)(2)(C)(vi) of the ESEA. Includes: 1) graduates, 2) dropouts, 3) *unknowns, and 4) *continuing *Beginning in 2012-13, the CTE calculation was adjusted to reflect the same definition as the calculation used by the state for 4-year graduation rate. All four categories of students are now included in the denominator, including the 1) unknown, and 2) continuing students. 4S1 Student Graduation Rates 4-year Cohort from grade 9 *Prior Year Data* education.state.mn.us 15 ___________________________________________ Numerator Denominator

16. 4-year Graduation Rate All Students education.state.mn.us 16 *Beginning in 2012-13, the CTE calculation was adjusted to reflect the same definition as the calculation used by the state for 4-year graduation rate. All four categories of students are now included in the denominator, including the 1) unknown, and, 2) continuing students.

17. 4-year Graduation Rate All Students education.state.mn.us 17 *Beginning in 2012-13, the CTE calculation was adjusted to reflect the same definition as the calculation used by the state for 4-year graduation rate. All four categories of students are now included in the denominator, including the 1) unknown, and, 2) continuing students.

18. 4-year Graduation Rate Special Education education.state.mn.us 18 *Beginning in 2012-13, the CTE calculation was adjusted to reflect the same definition as the calculation used by the state for 4-year graduation rate. All four categories of students are now included in the denominator, including the 1) unknown, and, 2) continuing students.

19. 4-year Graduation Rate Special Education education.state.mn.us 19 *Beginning in 2012-13, the CTE calculation was adjusted to reflect the same definition as the calculation used by the state for 4-year graduation rate. All four categories of students are now included in the denominator, including the 1) unknown, and, 2) continuing students.

20. 4-year Graduation Rate All Students & Special Education education.state.mn.us 20 *Beginning in 2012-13, the CTE calculation was adjusted to reflect the same definition as the calculation used by the state for 4-year graduation rate. All four categories of students are now included in the denominator, including the 1) unknown, and, 2) continuing students.

21. 5S1 Placement (Prior year data) education.state.mn.us 21 ___________________________________________ Number of Secondary CTE Completers who register as participating in higher education in a data match through the Minnesota Office of Higher Education Number of Secondary CTE Completers. * Note second quarter enrollment following graduation (October-December). So for the December 2014 CAR report we will be reporting on students who graduated at the end of the SY2012-13 Numerator Denominator

22. 6S1 Nontraditional Participation education.state.mn.us 22 ___________________________________________ Numerator: Number of CTE participants from underrepresented gender groups who participated in a program that leads to employment in nontraditional fields during the reporting year. Denominator: Number of CTE participants who participated in a program that leads to employment in nontraditional fields during the reporting year. Numerator Denominator

23. 6S2 Nontraditional Completion education.state.mn.us 23 ___________________________________________ Number of CTE concentrators from underrepresented gender groups who completed a program that leads to employment in nontraditional fields during the reporting year. Number of CTE concentrators who completed a program that leads to employment in nontraditional fields during the reporting year. Numerator Denominator

24. Core IndicatorOCTAE STATE 1S1 Reading71.50% 76.99% 1S2 Mathematics44.00%53.20% 2S1 Technical Skill 53.00%54.76% 3S1 Completion*98.50%98.44% (>88.65%) 4S1 4-year Graduation**96.50%88.03% (>86.85%) 5S1 Placement** 50.00%89.87% 6S1 NT Participation50.00%26.49% (>45.00%) 6S2 NT Completion34.50%12.02% (>31.10%) *Prior Year students (SY2013-14), **Prior year students, graduated SY2012-13 Red = Did not make the negotiated targets Purple = Did not make the negotiated target, but, are within 90% of the target, so, it does not count against us Negotiated State Target vs. Actual State Performance for SY12-13 education.state.mn.us 24

25. Core Indicator SY2013-14SY2014-15 1S1 Reading (GRAD) 72.00% 73.00% 1S2 Mathematics (GRAD) 56.00% 56.00% 2S1 Technical Skill 53.00% 54.00% 3S1 Completion* 98.50% 98.50% 4S1 4-year Graduation** 89.00% 89.00% 5S1 Placement** 54.00% 54.00% 6S1 NT Participation 27.00% 27.00% 6S2 NT Completion 12.00% 12.00% *Prior Year (SY2013-14) **Students from SY2012-13 MOHE Data via SLEDS (Statewide Longitudinal Data System) Purple – Renegotiated with OCTAE March 2013 (one year) Negotiated State Target for SY2013-14 and SY2014-15 education.state.mn.us 25

26. March – April (Spring) –MDE submits any changes to the Minnesota Certified Software Vendors for character layout –Table C – Table of Career and Technical Education Programs and Licenses updated and posted –Web changes completed May – June (Summer) –District CTE personnel (teacher, counselor, local designated CTE contact) should ensure that all data are available for the P-file submission (appropriate programs/courses, course length in minutes, proficiency status for the courses, TSA identifier, and TSA proficiency –MDE web submission site is opened Data Submissions for the P-File education.state.mn.us 26

27. Middle of May through the middle of September –P-files submitted to MDE via the web based submission (*Written directions are provided to all identified district personnel who download the data file, 1 per district) –MARSS errors are reported back to as soon as the district downloads their file –Beginning in August, MDE sends out reminders of data download status to all identified district personnel and 26 Perkins secondary consortium coordinators –September MDE phones all districts who have yet to complete the data submission –October 10, 2014: WEB SITE NOW CLOSED FOR SY2013-14 CARL PERKINS DATA SUBMISSION Data Submissions for the P-File (continued…) education.state.mn.us 27

28. October: Updates for the FY12 MARSS data are due to MDE November: Initial data is examined for accuracy December: Data is due to OCTAE via EDEN January: *Data Reports available for district download. Consortia directors should ask the local district personnel for copies of the district reports. (*Written directions are provided to all identified district personnel who download the data file - 1 per district) February: plan for changes for next fiscal year Data Submissions for the P-File (continued…) education.state.mn.us 28

29. Career and Technical Program Administration http://education.state.mn.us/MDE/SchSup/CareerEdAdmin/index.html –Perkins IV –Program Approvals –Transition-Disabled Programs Carl Perkins http://education.state.mn.us/MDE/SchSup/DataSubLogin/CarlPerkins/ind ex.htmlhttp://education.state.mn.us/MDE/SchSup/DataSubLogin/CarlPerkins/ind ex.html –Enter System for data downloads and report retrieval –Step-by-Step directions –Carl Perkins Record Layout Go to this website for a list of Technical Skills Assessments by pathway, http://www.cte.mnscu.edu/programs/mntsa.html http://www.cte.mnscu.edu/programs/mntsa.html CTE/Perkins Web Site Resources education.state.mn.us 29

30. education.state.mn.us 30 Questions and Comments can be sent to: Kari-Ann.Ediger@state.mn.us Direct#: 651-582-8269

31. http://www.cte.mnscu.edu/events/index.html Annual Perkins Consortium Coordinators Meeting November 12, 2014 Normandale Community College –Bloomington Fall Career & Technical Education Conference CTE Works! Learning that Works for Minnesota November 13, 2014 Crowne Plaza West, Plymouth, MN Upcoming Professional Development Events education.state.mn.us 31

32. REMINDER: For secondary participants, Continuing Education Units (CEU’s) will be made available for teachers for this series of webinars. In order to get the necessary certificates you must complete the session evaluation. Teachers can get certificates (1 hour) within two weeks of completing the session evaluation for today’s webinar. A note about CEU’s… education.state.mn.us 32

33. We value your feedback about today’s session. Please click on the link in the chat window now to complete the Webinar Evaluation. Thanks for joining us today! education.state.mn.us 33