1. MN CTEDDI Data Driven Improvement MN CTE Professional Development 2011-12

2. What is CTEDDI? A professional development model for CTE educators.

3. Why CTEDDI? Goal: Increase knowledge and skills for faculty & teachers in the use and interpretation of data. Intended Outcome: Teachers & Faculty make informed instructional improvements that enhance student success.

4. Instructional Improvement Cycle 5 Steps Collect Data Analyze Data Verify & Triangulate Design Action Plans To improve Learning & Instruction Implement Plan & Review Outcomes Ongoing

5. MN CTEDDI Partners Minnesota State Colleges and Universities Minnesota Department of Education National Research Center for Career Technical Education National Occupational Competency Testing Institute (NOCTI)

6. MN CTEDDI Project Part of on-going process for implementing and sustaining the use of technical skill assessments (TSA) Strive to influence continued improvement and systemic change in Minnesota’s secondary and postsecondary CTE programs.

7. MN Team Leaders Debra Hsu, Lead Facilitator Michael Mitchell, Facilitator Denise Roseland, Assessment Coordinator

8. TSA Implementation process Year 1: Identify core common competencies & state approved assessments by pathway Year 2: Implement TSA’s in approved programs of study begin MN CTEDDI Project Year 3: Implement TSA’s in pathways and continue MN CTEDDI Year 4 & Year 5: Continue implementation of TSA’s in pathways. Review, Revise & Assess CTE programs using data driven improvement model.

9. Phase I Project Timeline October/Nov - Consortium Leaders Training Face-to-Face at Consortium Sites Oct - Consortia leaders identify pathways and prepare teachers/faculty Oct/Nov- Teachers/Faculty administer technical skills assessment tests November 29, 2011 Data Driven Improvement Training Seminar for Leaders, Teachers/Faculty – MN CTE & NRCCTE North Metro Location TBD December-April - Monthly Webinars with Leaders, Teachers/ Faculty – May - Final Report of MN CTEDDI Project with NRCCTE

10. State Team Responsibilities Provide skill-building training and technical assistance to local leaders and participants Purchase NOCTI pre-tests for participating consortia Foster virtual and face-to-face collaboration that encourages on-going professional learning for participants Collect and report participant data for national research project Local Responsibilities Participate in training and on- going professional development Support and facilitate processes for teachers and faculty to gain access to necessary data other than assessment results Implement TSAs in pathways/classrooms selected Develop and implement consortium-wide learning improvement plan based on CTEDDI processes Participate in national research project data collection

11. Team Leader To Do List Initial 3 hour organization meeting (that’s today!) Identify Faculty/Teachers & Pathways Become a NOCTI client and order NOCTI pretests or select and order other appropriate technical skill assessments Support teachers/faculty as they administer tests to students & work to gain access to other data Complete & collect Pre-workshop Information Form Join Online Learning Community

12. Team Leader To Do List Attend November 29 Large Group Workshop provided by Pat Kelly, NRCCTE; John Foster, NOCTI & MN CTEDDI Leaders Complete & collect Post-workshop Feedback form Attend monthly webinars Dec-April Complete & collect Mid-Project Feedback Form Complete & collect Final Feedback Form

13. Faculty/Teacher To Do List Administer tests to students Gather other relevant data Complete Pre-workshop Information Form Attend November 29 Large Group Workshop provided by Pat Kelly, NRCCTE; John Foster, NOCTI & MN CTEDDI Leaders Complete Post-workshop Feedback form Begin using CTEDDI skills in classroom

14. Faculty/Teacher To Do List Join Online Learning Community Attend monthly webinars Dec-April Complete Mid-Project Feedback Form Complete Final Feedback Form

15. MORE ABOUT THE ROLE OF DATA…

16. School/campus Program Teacher Understanding Your Data Class Student Standards National State District/System

17. What are the sources of data currently available to teachers/faculty in this consortium? Let’s list some… –

18. Achievement gaps Differences between subgroups Trends Progress What the Data Reveal

19. Given the available data, what kinds of improvements might teachers/faculty be able to make? Given the available data, what kinds of data are missing that would allow them to make more powerful changes?

20. ARE NOCTI TESTS REQUIRED?

21. Carpentry Pretest Areas Pretest % Correct Student 1 Posttest % Correct Student 1 Safety 54.6 -- Tools and Accessories 30.0 -- Blueprint Reading and Estimation 41.1 -- Foundations, Forms, and Concrete 36.4 -- Rough Framing 53.8 -- Exterior Finish 36.4 -- Interior Systems Installation 40.0 -- Interior Finish 27.3 -- Carpentry Related Mathematics 35.9 -- Total 40.0 Using Data from Similar Tests National Nurse Aide Assessment Activities of Daily Living Basic Nursing Skills Restorative Skills Emotional and Mental Health Spiritual and Cultural Needs Communication Needs Client Rights Legal and Ethical Behavior Member of HealthCare Team NOCTI Nursing Assisting Test Basic Nursing Assisting Skills Infection Control Communication Skills Personal Care Skills Mental Health and Social Service Needs Client’s Rights Basic Restorative Devices Employability Skills

22. Carpentry Pretest Areas Pretest % Correct Student 1 Posttest % Correct Student 1 Safety 54.6 -- Tools and Accessories 30.0 -- Blueprint Reading and Estimation 41.1 -- Foundations, Forms, and Concrete 36.4 -- Rough Framing 53.8 -- Exterior Finish 36.4 -- Interior Systems Installation 40.0 -- Interior Finish 27.3 -- Carpentry Related Mathematics 35.9 -- Total 40.0 Using Data from Similar Tests Both tests align to a national standard (e.g., NOCTI; or industry standard, e.g., NIMS, National Nurse Aide Assessment Program) Reports include subpart scores for major categories (competencies) within the occupation The blueprints have several content areas in common

23. ANY ASSESSMENT USED FOR THIS PROJECT MUST PROVIDE A TEACHER OR FACULTY MEMBER WITH COMPETENCY-BASED RESULTS FOR EACH STUDENT

24. Example from a Carpentry Test Safety Tools and Accessories Blueprint Reading and Estimation Foundations, Forms and Concrete Rough Framing Exterior Finish Interior Systems Installation Interior Finish Carpentry Related Mathematics

25. Carpentry Pre-test Areas Pre-test % Correct Student 1 Post-test % Correct Student 1 Safety 54.6 -- Tools and Accessories 30.0 -- Blueprint Reading and Estimation 41.1 -- Foundations, Forms, and Concrete 36.4 -- Rough Framing 53.8 -- Exterior Finish 36.4 -- Interior Systems Installation 40.0 -- Interior Finish 27.3 -- Carpentry Related Mathematics 35.9 -- Total 40.0 Individual Carpentry Pre-Test

26. Carpentry Pre-test Areas Student 1 % Correct Student 2 % Correct Student 3 % Correct Student 4 % Correct Student 5 % Correct Student 6 % Correct Class Average % Correct Safety 54.645.536.427.3 54.540.9 Tools and Accessories 30.020.010.020.010.030.020.0 Blueprint Reading and Estimation 41.117.623.5 29.435.328.4 Foundations, Forms, and Concrete 36.454.545.5 36.454.545.5 Rough Framing 53.838.530.838.530.853.841.0 Exterior Finish 36.4 27.336.4 45.536.4 Interior Systems Installation 40.060.040.060.0 80.056.7 Interior Finish 27.39.118.227.39.127.319.7 Carpentry Related Mathematics 35.945.527.336.4 54.539.4 Total 40.034.028.033.029.046.035.0 Carpentry Class Pre-Test

27. So does it become “teaching to the test”? Given that technical skill assessments are aligned with national standards and/or employer-expected competencies, an assessment is ONE WAY to provide assurance that program instruction is preparing students for workplace demands. When an assessment is combined with other relevant data that examine multiple facets of student performance, confidence that students are prepared improves dramatically.

28. Alignment with other Improvement efforts CTEDDI is not designed to be another stand- alone effort to improve instruction It has been designed to fit within other improvement efforts or strategic efforts (i.e. school reform initiatives, HLC accreditation, etc.)

29. MORE ABOUT THE ONLINE COMMUNITY

31. Main Screen