NACTEI PORTLAND MAY 16, 2012 HELEN BOOTSMA CAREER AND TECHNICAL EDUCATION ARIZONA DEPARTMENT OF EDUCATION CTE Data Works for Arizona Arizona Department of Education Career and Technical Education

Why Collect Data? U.S. Secretary of Education, Arne Duncan Our goal here is not data, our goal is to change behavior and get better outcomes. Students First, CEO Michelle Rhee We've gotten to a point where states are collecting this data, but are they using it? Kentucky Commissioner of Education, Terry Holliday If you don't turn the data into action, it won't matter. Data Quality Campaign National Data Summit January 18, 2012 Arizona Department of Education Career and Technical Education

Overview  Districts Use Online PM Reports  District level of performance  High school by CTE program  Student subgroups  State Uses PM Data  Districts Use CTE Assessment System Reports  Student results  CTE teachers  Reports to District Administrators  State Data Reports  Federal Data Reports Arizona Department of Education Career and Technical Education

Data is Valuable Arizona Department of Education Career and Technical Education Accurate Comparable TimelyTransparent Actionable

Accurate SAIS Numbers Challenges with SAIS Dependency District SIS staff and District Registrar ensure CTE student SAIS records are correct for 2012 CTE Participants and Concentrators Arizona Department of Education Career and Technical Education

Add new student record:  Choose the program, then add the student’s SAIS ID and birthdate. Click on Next.  All student demographic data is pulled into PM from SAIS. Arizona Department of Education Career and Technical Education Obtain Student Data From SAIS

Internet Data Submission Application

Concentrator PM data CTE Assessment System SAIS Links Arizona Department of Education Career and Technical Education

District Level of Performance Arizona Department of Education Career and Technical Education

High School Program Performance Arizona Department of Education Career and Technical Education

PM Graph by District/School/Program Tec

PM Results for All Student Groups

District Monitoring Reports Use PM Data  Calculate and compare Access for all student groups including SP categories  Districts use Concentrator Reports to determine success for all student groups  Monitoring Document requires districts define the problem and benchmark the solution Arizona Department of Education Career and Technical Education

Performance Measures Improvement Plan for The core indicator(s) of performance for which the district failed to meet the 90 percent threshold: Improvement Plans Use PM Data Performance Measure Circle # of Consecutive Years Failed to Meet this Measure District Level of Performance Arizona State Level of Performance (SALP) 90% of the SALP District Target to Reduce Gap between District Level of Performance and SALP in S %67.00%60.30%6.70% Action Steps Responsible Person(s) Timeline for Completion Mid-Year Status Make teachers aware of this disparity through data review. Focus instruction on attaining these skills. Respective CTE Teacher & CTE Counselor May, 2012On going Identify students through AIMS data who need training in test-taking skills and strategies. Respective CTE Teachers & CTE Counselor May, 2012On going In study skills class, the aforementioned students will participate in a semester long study skills class. These students will be given items to develop test-taking skills and improve their performance. CHS Counselors and CTE Teaching staff May, 2012On going During CHS ‘7 th hour’ (students needing interventions) test-taking strategies are being taught w/ student practice on general test items. CHS StaffMay, 2012On going

Basic Grant Objectives Use PM Data Secondary Perkins Addendum for Performance Measures PM Program/Site (all or list Applicable) Measureable Objective SMART, Objective=Specific, Measurable, Attainable, Results-Oriented, & Timely Expenditure Item (Provide details on application budget pages) USFR Expenditure Category Estimated Expenditure Amount Justification 2S1Culinary Arts Auto Tech By March 1, 2012, these CTE teachers will use the Standards and Measurement Criteria Report for each fall test taker as a diagnostic tool to improve individual skill attainment as evidenced by personalized measurable goals and benchmarks. Teacher Participation in Summer CTE Conference and other CTE professional development activities to strengthen and improve their CTE programs in all areas of SALP 2200/ / / /6200 $7,500 5, $1, $ Teachers will analyze individual student data in order to revise teaching strategies and lesson plans to improve assessment scores for 2S1. Substitutes for CTE teachers while out for professional development of $1,500 plus benefits at 8%

Other Uses for PM Data  Submit to EDEN/EdFacts for CAR  Provide to external requests  Time article by Joe Klein Arizona Department of Education Career and Technical Education

CTE Assessment System  State Mandate  Arizona Joint Technological District (JTED) 2006 legislation required that CTE programs lead to industry certification by Spring  Carl D. Perkins Act of 2006 legislation  CTE programs at secondary and postsecondary levels lead to industry certification.  Business and Industry demands  Skilled workforce  In Partnership with University of Arizona Arizona Department of Education in partnership with University of Arizona

AZ Skill Standards Assessment System Provides  Online Practice and Final end-of-program assessments  Based on Industry-validated technical knowledge/skills  Evidence of t echnical skill attainment  Certification/documentation Arizona Department of Education in partnership with University of Arizona

Decision Making Bodies for Assessment System  Arizona Skill Standards Commission  Stakeholders Committee  Industry Associations  Validation Committees  Item Development Committees Arizona Department of Education in partnership with University of Arizona

Student Count 3,153 8,40915,11415,80717,505 Spring ‘08 Spring ‘09 Spring ‘10 Spring ‘11 Spring ‘12 Increasing Student Participation in CTE Assessments Arizona Department of Education in partnership with University of Arizona

Teachers receive an with Student Test Results upon completion of assessments. Students can print or test results immediately following completion of an assessments. Districts and ADE utilize student data and reports. CTE Assessment Data

Data Reports to CTE Students Practice Test Results  Print/ Send to address  Use for guided study prior to Final Test Final Test Results  Print / Send to address  Students receive Certificate and Transcript as documentation of industry skill attainment Arizona Department of Education in partnership with University of Arizona

What would you like to do with this report? Send to My address is Send This Report To Print: Click here to Print Attending Alpine High School – Date of Test 2/16/2010 EDUCATION PROFESSIONS - SAMPLE Standard 1.0-EXAMINE THE ROLE OF THE EDUCATION INDUSTRY IN THE ECONOMY CorrectIncorrect% Correct 1.1 Explain the role of education in the economy: local, state, national, and international 10100% 1.2 Recognize the factors that contribute to an effective school 10100% 1.3 Compare/contrast the financial advantages/ disadvantages of public, charter, and private educational institutions 1150% Standard 2.0-RECONGIZE THE FINANCIAL POLICIES AND PROCEDURES OF A SHOOL DISTRICT 2.1 Identify business and financial functions of an educational institution 20100% 2.2 Explain how taxes impact the school district’s ability to meet objectives and state and federal mandates 1150% Total:6266%

Arizona Department of Education in partnership with University of Arizona CTE Student ANY HIGH SCHOOL FIRE SERVICE Spring 2012

Registration Data Fields  SAIS number  Birth Date  School of Residence and School of Attendance  Gender and Special Populations  Grade Level  Program Assessment  Program Completion Status  CTE Teacher Arizona Department of Education in partnership with University of Arizona

Teachers Use Data Reports  Provide individual one-on-one guidance and instruction  Diagnose curriculum and instructional needs  Fosters collaboration  Recognize and celebrate success  Track longitudinal progress Arizona Department of Education in partnership with University of Arizona

Classroom Analysis by Gender/Male Measurement Criteria Arizona Department of Education in partnership with University of Arizona

Classroom Analysis by Gender/Female Measurement Criteria Arizona Department of Education in partnership with University of Arizona

Classroom Analysis by Scores Total Results Report SAIS IDCIP Points Correct Points Possible School of Residence CTDSGender Special Population Status Grade Level Program Completion Status FNO12Final MHA12Final MEC12Final FNO11Final MNO12Final FLEP12Final FNO12Final MNO12Final MNO12Final FNO11Final Arizona Department of Education in partnership with University of Arizona

District Administrators Use Data Reports  Program analyses  Teacher and school site data  Disaggregated groups  CTE delivery systems  Curriculum materials  Instructional methodology  Mentor assignment  Recognition Arizona Department of Education in partnership with University of Arizona

JTED Reports to AZ Legislature  JLBC (Joint Legislative Budget Committee)  Student participation in assessments percentage by JTED  Number of students passing assessment by program  Number and percentage of students passing by JTED Arizona Department of Education Career and Technical Education

Future Data System Development  New Arizona Workplace Employability Skills  Formative CTE assessments to address teacher evaluation Arizona Department of Education in partnership with University of Arizona

Contact  Arizona Department of Education Mark HamiltonHelen Bootsma Deputy Associate Superintendent andCTE Development and Innovation Director Career & Technical EducationArizona Department of Education Arizona Department of Education1535 W Jefferson Street 1535 W Jefferson StreetPhoenix AZ Phoenix AZ  University of Arizona Margaret A. Mangini, Ed.D. Executive Director Workforce Education Development Office University of Arizona 714 E Van Burean Phoenix AZ Arizona Department of Education in partnership with University of Arizona

CTE DATA WORKS FOR ARIZONA Arizona Department of Education Career and Technical Education