1. NACTEI PORTLAND MAY 16, 2012 HELEN BOOTSMA CAREER AND TECHNICAL EDUCATION ARIZONA DEPARTMENT OF EDUCATION CTE Data Works for Arizona Arizona Department of Education Career and Technical Education

2. Why Collect Data? U.S. Secretary of Education, Arne Duncan Our goal here is not data, our goal is to change behavior and get better outcomes. Students First, CEO Michelle Rhee We've gotten to a point where states are collecting this data, but are they using it? Kentucky Commissioner of Education, Terry Holliday If you don't turn the data into action, it won't matter. Data Quality Campaign National Data Summit January 18, 2012 Arizona Department of Education Career and Technical Education

3. Overview  Districts Use Online PM Reports  District level of performance  High school by CTE program  Student subgroups  State Uses PM Data  Districts Use CTE Assessment System Reports  Student results  CTE teachers  Reports to District Administrators  State Data Reports  Federal Data Reports Arizona Department of Education Career and Technical Education

4. Data is Valuable Arizona Department of Education Career and Technical Education Accurate Comparable TimelyTransparent Actionable

5. Accurate SAIS Numbers Challenges with SAIS Dependency District SIS staff and District Registrar ensure CTE student SAIS records are correct for 2012 CTE Participants and Concentrators Arizona Department of Education Career and Technical Education

6. Add new student record:  Choose the program, then add the student’s SAIS ID and birthdate. Click on Next.  All student demographic data is pulled into PM from SAIS. Arizona Department of Education Career and Technical Education Obtain Student Data From SAIS

7. Internet Data Submission Application

8. Concentrator PM data CTE Assessment System SAIS Links Arizona Department of Education Career and Technical Education

9. District Level of Performance Arizona Department of Education Career and Technical Education

10. High School Program Performance Arizona Department of Education Career and Technical Education

11. PM Graph by District/School/Program Tec

12. PM Results for All Student Groups

13. District Monitoring Reports Use PM Data  Calculate and compare Access for all student groups including SP categories  Districts use Concentrator Reports to determine success for all student groups  Monitoring Document requires districts define the problem and benchmark the solution Arizona Department of Education Career and Technical Education

14. Performance Measures Improvement Plan for 2011-12 The core indicator(s) of performance for which the district failed to meet the 90 percent threshold: Improvement Plans Use PM Data Performance Measure Circle # of Consecutive Years Failed to Meet this Measure 2010-11 District Level of Performance 2010-11 Arizona State Level of Performance (SALP) 90% of the 2010-11 SALP District Target to Reduce Gap between District Level of Performance and SALP in 2011-12 2S11 2 350.00%67.00%60.30%6.70% Action Steps Responsible Person(s) Timeline for Completion Mid-Year Status Make teachers aware of this disparity through data review. Focus instruction on attaining these skills. Respective CTE Teacher & CTE Counselor May, 2012On going Identify students through AIMS data who need training in test-taking skills and strategies. Respective CTE Teachers & CTE Counselor May, 2012On going In study skills class, the aforementioned students will participate in a semester long study skills class. These students will be given items to develop test-taking skills and improve their performance. CHS Counselors and CTE Teaching staff May, 2012On going During CHS ‘7 th hour’ (students needing interventions) test-taking strategies are being taught w/ student practice on general test items. CHS StaffMay, 2012On going

15. Basic Grant Objectives Use PM Data Secondary Perkins Addendum for Performance Measures PM Program/Site (all or list Applicable) Measureable Objective SMART, Objective=Specific, Measurable, Attainable, Results-Oriented, & Timely Expenditure Item (Provide details on application budget pages) USFR Expenditure Category Estimated Expenditure Amount Justification 2S1Culinary Arts Auto Tech By March 1, 2012, these CTE teachers will use the Standards and Measurement Criteria Report for each fall test taker as a diagnostic tool to improve individual skill attainment as evidenced by personalized measurable goals and benchmarks. Teacher Participation in Summer CTE Conference and other CTE professional development activities to strengthen and improve their CTE programs in all areas of SALP 2200/6300 2200/6500 1000/6100 1000/6200 $7,500 5,981.43 $1,500.00 $120.00 Teachers will analyze individual student data in order to revise teaching strategies and lesson plans to improve assessment scores for 2S1. Substitutes for CTE teachers while out for professional development of $1,500 plus benefits at 8%

16. Other Uses for PM Data  Submit to EDEN/EdFacts for CAR  Provide to external requests  Time article by Joe Klein http://www.time.com/time/magazine/article/0,9171,2113794,00.html Arizona Department of Education Career and Technical Education

17. CTE Assessment System  State Mandate  Arizona Joint Technological District (JTED) 2006 legislation required that CTE programs lead to industry certification by Spring 2008.  Carl D. Perkins Act of 2006 legislation  CTE programs at secondary and postsecondary levels lead to industry certification.  Business and Industry demands  Skilled workforce  In Partnership with University of Arizona Arizona Department of Education in partnership with University of Arizona

18. AZ Skill Standards Assessment System Provides  Online Practice and Final end-of-program assessments  Based on Industry-validated technical knowledge/skills  Evidence of t echnical skill attainment  Certification/documentation Arizona Department of Education in partnership with University of Arizona

19. Decision Making Bodies for Assessment System  Arizona Skill Standards Commission  Stakeholders Committee  Industry Associations  Validation Committees  Item Development Committees Arizona Department of Education in partnership with University of Arizona

20. Student Count 3,153 8,40915,11415,80717,505 Spring ‘08 Spring ‘09 Spring ‘10 Spring ‘11 Spring ‘12 Increasing Student Participation in CTE Assessments Arizona Department of Education in partnership with University of Arizona

21. Teachers receive an email with Student Test Results upon completion of assessments. Students can print or email test results immediately following completion of an assessments. Districts and ADE utilize student data and reports. CTE Assessment Data

22. Data Reports to CTE Students Practice Test Results  Print/ Send to email address  Use for guided study prior to Final Test Final Test Results  Print / Send to email address  Students receive Certificate and Transcript as documentation of industry skill attainment Arizona Department of Education in partnership with University of Arizona

23. What would you like to do with this report? Send to Email: My email address is Send This Report To Email Print: Click here to Print Attending Alpine High School – Date of Test 2/16/2010 EDUCATION PROFESSIONS - SAMPLE Standard 1.0-EXAMINE THE ROLE OF THE EDUCATION INDUSTRY IN THE ECONOMY CorrectIncorrect% Correct 1.1 Explain the role of education in the economy: local, state, national, and international 10100% 1.2 Recognize the factors that contribute to an effective school 10100% 1.3 Compare/contrast the financial advantages/ disadvantages of public, charter, and private educational institutions 1150% Standard 2.0-RECONGIZE THE FINANCIAL POLICIES AND PROCEDURES OF A SHOOL DISTRICT 2.1 Identify business and financial functions of an educational institution 20100% 2.2 Explain how taxes impact the school district’s ability to meet objectives and state and federal mandates 1150% Total:6266%

24. Arizona Department of Education in partnership with University of Arizona CTE Student ANY HIGH SCHOOL FIRE SERVICE Spring 2012

25. Registration Data Fields  SAIS number  Birth Date  School of Residence and School of Attendance  Gender and Special Populations  Grade Level  Program Assessment  Program Completion Status  CTE Teacher email Arizona Department of Education in partnership with University of Arizona

26. Teachers Use Data Reports  Provide individual one-on-one guidance and instruction  Diagnose curriculum and instructional needs  Fosters collaboration  Recognize and celebrate success  Track longitudinal progress Arizona Department of Education in partnership with University of Arizona

27. Classroom Analysis by Gender/Male Measurement Criteria Arizona Department of Education in partnership with University of Arizona

28. Classroom Analysis by Gender/Female Measurement Criteria Arizona Department of Education in partnership with University of Arizona

29. Classroom Analysis by Scores Total Results Report SAIS IDCIP Points Correct Points Possible School of Residence CTDSGender Special Population Status Grade Level Program Completion Status 52.0300.08110970211262FNO12Final 52.0300.07910970211262MHA12Final 52.0300.07510970211262MEC12Final 52.0300.06610970211262FNO11Final 52.0300.06010970211262MNO12Final 52.0300.05910970211263FLEP12Final 52.0300.05610970211262FNO12Final 52.0300.04510970211262MNO12Final 52.0300.02810970211262MNO12Final 52.0300.02610970211262FNO11Final Arizona Department of Education in partnership with University of Arizona

30. District Administrators Use Data Reports  Program analyses  Teacher and school site data  Disaggregated groups  CTE delivery systems  Curriculum materials  Instructional methodology  Mentor assignment  Recognition Arizona Department of Education in partnership with University of Arizona

31. JTED Reports to AZ Legislature  JLBC (Joint Legislative Budget Committee)  Student participation in assessments percentage by JTED  Number of students passing assessment by program  Number and percentage of students passing by JTED Arizona Department of Education Career and Technical Education

32. Future Data System Development  New Arizona Workplace Employability Skills  Formative CTE assessments to address teacher evaluation Arizona Department of Education in partnership with University of Arizona

33. Contact  Arizona Department of Education Mark HamiltonHelen Bootsma Deputy Associate Superintendent andCTE Development and Innovation Director Career & Technical EducationArizona Department of Education Arizona Department of Education1535 W Jefferson Street 1535 W Jefferson StreetPhoenix AZ 85007 Phoenix AZ 85007602-542-5963 602-542-3437Helen.Bootsma@azed.gov Mark.Hamilton@azed.gov  University of Arizona Margaret A. Mangini, Ed.D. Executive Director Workforce Education Development Office University of Arizona 714 E Van Burean Phoenix AZ 85004-2191 602-827-2332 MaggieMangini@email.arizona.edu Arizona Department of Education in partnership with University of Arizona

34. CTE DATA WORKS FOR ARIZONA Arizona Department of Education Career and Technical Education