Reinventing Program and Services Review at Chaffey College Marie Boyd Giovanni Sosa Tom Vitzelio

Presentation Overview SETTING THE STAGE SETTING THE STAGE THE PROCESS THE PROCESS PROBLEMS PROBLEMS THE RESULTS THE RESULTS REWARDS REWARDS FUTURE GOALS FUTURE GOALS

SETTING THE STAGE Chaffey completed a program review (PSR) every year. The Problems: The Problems: Labor intensive process Labor intensive process Undefined process = No real substantive comments Undefined process = No real substantive comments Evolved into a budgeting focused process Evolved into a budgeting focused process Discontent with the decision making process Discontent with the decision making process Slow SLO process Slow SLO process Confusion regarding the definition of a program Confusion regarding the definition of a program

SETTING THE STAGE Dr. Sherrie Guerrero decided that a new PSR was to be launched. Dr. Sherrie Guerrero decided that a new PSR was to be launched. Summer of 2008: revising the PSR templates in Curricunet Summer of 2008: revising the PSR templates in Curricunet Fall 2008: fine tuning new model and dialoging with the PSR committee. Fall 2008: fine tuning new model and dialoging with the PSR committee. Spring 2009: reading and critiquing the SLO portion of PSR was now established under the SLO Committee Spring 2009: reading and critiquing the SLO portion of PSR was now established under the SLO Committee February to March 2009: development of resources and training for both the PSR writer and the SLO Committee Readers February to March 2009: development of resources and training for both the PSR writer and the SLO Committee Readers

THE PROCESS The SLO Committee was divided into reading teams The SLO Committee was divided into reading teams AUOs (administrative unit outcomes) AUOs (administrative unit outcomes) Administrators and non-instructional staff members Administrators and non-instructional staff members SLOs SLOs Faculty and staff from instructional programs Faculty and staff from instructional programs Hybrid programs Hybrid programs either an AUO team or SLO team. either an AUO team or SLO team. The SLO Committee: The SLO Committee: Decide the desired progress of the program SLOs/AUOs Decide the desired progress of the program SLOs/AUOs

THE PROCESS A consistent set of comments A consistent set of comments 5 phases of the assessment cycle 5 phases of the assessment cycle Goal: consistency among teams of readers Goal: consistency among teams of readers Institutional Research online evaluation form Institutional Research online evaluation form Electronically submitted to IR Electronically submitted to IR Copy for programs being evaluated Copy for programs being evaluated

Chaffey PSR Screen Shots: Program Mission and Overview

Chaffey PSR Screen Shots: Program Goals and Outcomes Assessment

Chaffey PSR Screen Shots: Program Curriculum Mapping Matrix

Chaffey PSR Screen Shots: SLO Committee Comments

Chaffey PSR Screen Shots: Institutional Research Summary E-Form

PROBLEMS New Curricunet design did not norm to the 5 phase of the assessment cycle exactly New Curricunet design did not norm to the 5 phase of the assessment cycle exactly Catching up after the SLO process had gone cold Catching up after the SLO process had gone cold 5 phases of the SLO process, and a common language 5 phases of the SLO process, and a common language Tight time frame for the SLO readers Tight time frame for the SLO readers training on the new tools, training on the new tools, establishing a common understanding of the task, and the evaluation establishing a common understanding of the task, and the evaluation The SLO Committee readers had two weeks to read 127 program reviews (Over 600 AUOs and SLOs) and provide feedback to the PSR Committee The SLO Committee readers had two weeks to read 127 program reviews (Over 600 AUOs and SLOs) and provide feedback to the PSR Committee Alignment with IR online evaluation form and Curricunet SLO/AUO section of PSR Alignment with IR online evaluation form and Curricunet SLO/AUO section of PSR Technical glitches with the online evaluation form Technical glitches with the online evaluation form

THE RESULTS Different GOALS Different GOALS Evaluation of student-centered Evaluation of student-centered Differences in writing outcome statements and benchmarks. Differences in writing outcome statements and benchmarks. Consistent comments = all program SLO/AUOs were graded with the same rubric. Consistent comments = all program SLO/AUOs were graded with the same rubric.

THE RESULTS Programs with difficult selected forms of assessments. Programs with difficult selected forms of assessments. Many did not know about the unique and exciting possibilities of assessment format Many did not know about the unique and exciting possibilities of assessment format Heavy reliance on pre/post test. Heavy reliance on pre/post test. Widespread confusion regarding reflective dialogue Widespread confusion regarding reflective dialogue

REWARDS Program goals are student-centered Program goals are student-centered Chaffey has an actual count – a complete picture – of the status of program AUOs and SLOs for the first time ever. Chaffey has an actual count – a complete picture – of the status of program AUOs and SLOs for the first time ever. All programs have a consistent set of recommendations to follow to jump start the SLO process which had gone cold All programs have a consistent set of recommendations to follow to jump start the SLO process which had gone cold

REWARDS The SLO Co-coordinators know exactly the sorts of interventions and advice to offer to specific program SLOs The SLO Co-coordinators know exactly the sorts of interventions and advice to offer to specific program SLOs Suggestions for more interesting, engaging, and AUTHENTIC forms of assessment Suggestions for more interesting, engaging, and AUTHENTIC forms of assessment Noticeably more involvement and positive dialogue regarding the outcomes assessment process at Chaffey among faculty, staff and administrators Noticeably more involvement and positive dialogue regarding the outcomes assessment process at Chaffey among faculty, staff and administrators

NEW FOCUS: FUTURE GOALS Modify the Curricunet SLO screens Modify the Curricunet SLO screens Streamline the IR electronic survey Streamline the IR electronic survey Improve the ability to search the database Improve the ability to search the database Reword comments/recommendations for clarification Reword comments/recommendations for clarification Continue to create an authentic link between SLO PSR process and the planning/budgeting process Continue to create an authentic link between SLO PSR process and the planning/budgeting process Include students in the overall SLO process Include students in the overall SLO process Improve the communication and dialogue between the SLO Committee and the PSR Committee Improve the communication and dialogue between the SLO Committee and the PSR Committee