IT State Conference Update Eau Claire, March 1, 2012 Hal Zenisek WIDS Learning Design System WTCS Foundation, Waunakee, WI

Today’s Topics… Overview Technical Skill Attainment Review WTCS process and procedures Update on Business & IT division TSA Panel discussion on TSA assessment Prepare for next steps for IT TSAs Review resources available Answer questions and hear concerns

Carl Perkins IV Technical Skills Attainment An assessment that objectively measures a student's attainment of industry recognized skills.

System Level Guiding Principles The “System” has been assessing student performance for 100 years TSA formalizes the assessment and creates a common and shared reporting process Used to meet the federal Carl D Perkins Grant 2006 reporting requirement At some point, a college’s funding status could be effected by their engagement in TSA reporting

Guiding Principles (cont.) Minimally, each aid code 10, 31, 32 and 50 program will use “course completion” as their measure of students’ Technical Skill Attainment –this has been done for many years Over time the number of programs that move to using WTCS Assessment (TSA) or a 3 rd Party assessment should increase Demonstrate a shift to measuring evidence of direct student learning with WTCS approved assessment

I NDIRECT A SSESSMENT S TANDARDS ( COURSE C OMPLETION **) E XTERNAL (3 RD PARTY ) A SSESSMENT S TANDARDS * WTCS A SSESSMENT STANDARDS External Assessment WTCS Assessment **Some programs will continue to use Course Completion, and never move to another type of assessment *3 rd party assessment is hard to implement; a limited # of programs will use this

WTCS Three Phase Approach Colleges with the same program collaborate to: Identify common core program outcomes Identify the type of TSA Assessment In consultation with WIDS, submits documents to System Office System Office Reviews, advises or approves All participating colleges notified of approval, and "invited" to move to phase II. Planning Phase I: Planning Local Colleges complete and submit Phase II documents to System Office System Office Reviews, advises or approves Final documents are posted to Curriculum Bank Local Colleges implement their assessment plan Implementation Phase II: Implementation Local Colleges collect TSA data internally Local Colleges report TSA data via Client System Office uses client data to prepare federal Consolidated Annual Report Reporting Phase III: Reporting

Phase I Recap The Goal is to identify: – Common Program Outcomes to be assessed on a summative basis validated by business & industry –Common Type of Assessment that will be used WTCS Assessment and/or 3 rd Party –Common Assessment Criteria (i.e., rubric) –Artifacts used for assessment at colleges For programs at more than 1 college: –Work is done collaboratively with all colleges holding State Board Program Approval For Unique programs: –Work is done by the college holding State Board Program Approval

Program Outcomes are Valid

Sample

Program Outcome s Related rating criteria

Program Outcomes Threaded

Phase I Approval Request Form Posted on WTCS CurriculumBank when the project is complete Sent to the State Office by the Lead district (in collaboration w/WIDS) Reviewed for approval by the WTCS Education Director and Assoc. Vice President

Phase I: Planning ISA reps for all participating colleges notified by WTCS of Phase I approval (via letter) “Invited" to move to phase II Documents moved on WTCS curriculum bank from WIP to TSA Assessment.

Phase II Recap Planning for the use of common program outcomes, assessment criteria & assessment type developed under phase I Each college creates a TSA Local Implementation Plan 1.Link between Program Outcomes, Program Curriculum & Assessment Criteria 2.Assessment strategy* that will be done –portfolio, skill demonstration, capstone course project, licensure exam … –mechanism to complete the assessment Who does it –Faculty, an Assessment Committee, etc. When it happens –1 st semester, throughout the program, end of program, etc. How it happens –Part of an existing course, a stand alone “course”, etc. The exact process to get student level assessment data (i.e., passed, not passed, not assessed) into the college’s course management system. 3.Phase 2 plan submitting to WTCS & approved *Note: Identification of Assessment Strategy is applicable for WTCS Assessment Type only. The Assessment Strategy for 3 rd Party is identified by the 3 rd party.

Phase II: Implementation Phase 1 complete Final documents now available under the TSA Assessment tab on CurriculumBank Organized by Career Clusters

Phase II: Implementation Download Phase II Document s

Phase II: Implementation Each College Completes TSA Phase II Request Form as applicable to their own district (use the Completion Guide to help you) View Samples

Phase II: Implementation Your College’s Plan for Implementing the TSA

Phase II Plan Show how the program outcomes link to the courses in your program Complete the Analyzer report in WIDS or provide documentation referencing the exit learning outcomes with the program courses

WIDS Analyzer Report Courses Program Outcomes

Phase II Plan What’s your strategy? Each college may define its own How will you use the rubric?

Assessment Strategies –Portfolio –Capstone –Internship Rubric with program outcomes and criteria –Reflective paper in course xx –Outcomes/performance standards with each formative assessment –Align outcomes assessment to external standards

Phase II: Implementation Colleges complete the Phase II form Colleges submit the form through as a SINGLE DOCUMENT (attach all files) Routed thru the WTCS approval process –Review –Complete Checklist –Make Recommendation

Phase III Recap With approved Phase II assessment Colleges begin reporting student data –1 = Assessed, passed –2= Assessed, not passed –9= Not assessed »Client Guide

TSA Reporting Once Phase II is approved by the state the program will begin reporting TSA on all program students In the Phase II documentation you will identify when you will start the TSA, until then all students will be reported as “not assessed” or 9 in client reporting Projected dates are estimates, if colleges have data to report earlier, they can

TSA Current Status-Next Steps 69 programs have received Phase I approval –Duplicated count = 421 programs 10 programs have received Phase II approval 2012 Goals : –Significantly increase –Significantly increase the number of programs achieving Phase II approval –Continue to support programs entering Phase I

Business & IT Division Phase I Complete Business Management Accounting Paralegal Marketing Administrative Professional Office Assistant IT-CSS & IT-NS (in process)

Business & IT Division Phase II Accounting – NATC, MSTC, BTC, NWTC Curriculum Bank: p=show p=show Resources for TSA –Overview, Resources, Sample College Plans –Scoring Guides, Program Outcomes, Criteria –WIDS files and documents

Phase 1 – IT Computer Support Non-aligned, multi-college program under Common program outcomes, criteria, scoring standard, and scoring guide Individual college Phase 2 Under review: one-year and two-year related diploma programs

Phase 1 – IT Computer Support Scoring Guide Review (Team Reps) –Program Outcomes –Outcome Criteria –Scoring Scale –Scoring Standard –Common assessment for AAS degree programs

Phase 1 – IT Computer Support

Phase 1 – IT Network Specialist Non-aligned, multi-college program under Common agreed upon program outcomes, criteria, scoring standard, and scoring guide Individual college Phase 2 External standards identified Under consideration: & others

Phase 1 – IT Network Specialist Scoring Guide Review (Team Reps) –Program Outcomes –Outcome Criteria –Scoring Scale –Scoring Standard –Reference to External Standards –Common assessment for AAS degree programs

Phase 1 – IT Network Specialist

IT TSA Next Steps - Current Projects Dean review webinar (CSS and NS) –March 2012 Final review webinar –April 2012 TSA documentation finalized and submitted to WTCS –May/June 2012 Phase 1 approval – summer 2012 Phase 2 plans from colleges to WTCS -fall/spring Phase 2 assessment – new student cohorts in 2013 who complete programs 2-3 years ( ) Phase 3 reporting - December 2016

IT Phase 1 Questions & Comments

IT Related TSA Opportunities IT-Computer Support Specialist ( ) –Work on Phase 2 local plans IT-Network Specialist ( ) –Work on Phase 2 local plans Identify other 150, 152, 154 associate degrees –Consider Phase 1 planning efforts Identify other IT 1- and 2-year diploma programs –Consider Phase 1 planning 25+ IT state-approved programs (Phase 1)

Future TSA Strategies Coordinate plans with Ed Director Adapt the phase 1 process for your college and/or other colleges with the same IT program –IT-Security (BTC and MILW)? –IT-Network Systems Administration (WTC and FVTC)? Others? Checklists for Phase 1 and Phase 2 WIDS staff can help

TSA in Review

Phase II: Implementation

Where are my programs?

Thank-you! Hal Zenisek WIDS Learning Design Consultant (800)