PROGRAM REVIEW FOR ADMINISTRATIVE AND BUSINESS SERVICES WHY??

Program review is required for administrative and business services with the expectation that these reviews will: Assess and evaluate the program’s impact on student learning Inform long and short term planning Inform budget recommendations Collect and analyze information that will be useful in the accreditation process, academic program review deliberation, and college-wide assessment

It’s a lot of work… Therefore, Keep It Simple! Borrow from others Make it fit your school Share the pain – get many people involved in small parts

ADMINISTRATIVE PROGRAM REVIEW CONTENT Introduction A brief description of the unit under review Relationship of the unit to the college mission and strategic plan

ADMINISTRATIVE PROGRAM REVIEW CONTENT Description of the unit Programs, services, activities, special accomplishments Key constituents Dissemination activities Relationship to or support for other programs Including areas of cooperation & collaboration Personnel Resources Financial Resources Facilities/Equipment Influencing Factors (Categorical funding/legal mandates) (Use a good visual/organizational chart. Saves writing a lot of words.)

ADMINISTRATIVE PROGRAM REVIEW CONTENT Goals and Outcomes Identify goals of the unit Identify measurable objectives or outcomes for each goal (Remember – the more goals, the more outcomes, the more measuring, so stay broad.)

Administrative Unit Outcomes Template Anticipated Administrative Unit Outcomes (AUO): Assessment Methods: Timeframe:Targets/Bench marks: Use of Results: What are you trying to do, or what AUO are you planning to assess? NO MORE THAN 2 What assessment methods do you plan to use? When Will Assessment Be Conducted and Reviewed? What is the minimum result, target, or value that represents success at achieving this outcome? How do you anticipate using the results from the assessment?

Self-Study Assessment Assessing the quality of the unit Programs and services as reported in evaluations provided by clients/constituents (Tie this to the goals and outcomes you have identified for the unit.) Procedures and effectiveness as reported in evaluations provided by staff and managers (Tie this to the goals and outcomes you have identified for the unit.)

Assessment Continued… Assessing the demand for the unit Demand for programs and services from clients or constituents Demand for programs and services from other units Unmet needs

Which leads you conveniently to $$$$ Financial Resources Current use of financial resources Adequacy of financial resources Unmet needs Facilities Equipment/supplies/technology Personnel

Making a case for $$ Need/O bjective Link to Academic or Student Service Program Review Requests Office/Perso n Responsible for Completion New Budget Needed for Completion Anticipated Completion/ Measure of Success* Result /Date (Fill in when complete) NoYes/E st. $ Unit’s needs and objectives contained in the annual Instructional or Student Service Program Reviews that could potentially impact your unit:

Making a case for $$ ActivitiesLink to Mission, District or Campus Strategic Initiatives, or SLO/AUO Office/Person Responsible for Completion New Budget Needed for Completion Anticipated Completion/ Measure of Success* Result /Date (Fill in when complete) NoYes/E st. $ Unit’s other major activities for year exclusive of those linked to instructional Or student service program reviews:

Making a case for Staffing Staff Position TitleBrief RationaleAnnual TCP* for each Employee Staff Positions Needed for Academic Year by title in rank order: * TCP = “Total Cost of Position” for one year is the cost of an average salary plus benefits for an individual. New positions (not replacement positions) also require space and equipment.

Making a case for Facilities or Equipment Equipment or Equipment Repair Brief RationaleAnnual TCO* Cost per item Number Requested Total Cost of Request Equipment or Equipment Repair Needed for Academic Year for unit on its campus in rank order: * TCO = “Total Cost of Ownership” for one year is the average cost for one year. Facilities NeedsBrief RationaleAnnual TCO* Facilities Needs NOT covered by current building or remodeling Projects:

Making a case for Professional Development Professional Development Needs Brief Rationale (in response to AUO findings or needed to update skills) Annual TCO* Cost per item Number Requested Total Cost of Request Professional Development Needs not covered by current budget: Use data and findings from Administrative Unit Outcomes Research to justify Professional Development needs.

Rubric for Evaluating AUOs ItemCriteriaDoes not Meet Criteria Meets Criteria Mission and Goals  the objective is tied to the college mission and the unit goals Adapted from Mt Sac APPENDIX D: AUO CHECKLIST

Rubric for Evaluating AUOs ItemCriteriaDoes not Meet Criteria Meets Criteria Intended Objectives  is current  aligns with department goals  is reasonable given the scope of the experience  states that the unit will provide, improve, decrease or that the clients will understand, be satisfied with or receive specific service  is measurable (can be observed or tested)  is central to the unit Adapted from Mt Sac APPENDIX D: AUO CHECKLIST

Rubric for Evaluating AUOs ItemCriteriaDoes not Meet Criteria Meets Criteria Means of Assessment  identifies specific assessment method category (focus group, survey, etc.) for the objective  details the assessment method used to measure the objective Adapted from Mt Sac APPENDIX D: AUO CHECKLIST

Rubric for Evaluating AUOs Item Criteria Does not Meet Criteria Meets Criteria Targets and Benchmarks: Criteria for Success  establishes minimum expected score for success at achieving objective  quantifies (%, fraction or actual number) of clients who are expected to meet minimum score  indicates consideration of alternate data (previous AUO assessment effort(s), external reports), if available (optional) Adapted from Mt Sac APPENDIX D: AUO CHECKLIST

Rubric for Evaluating AUOs Item Criteria Does not Meet Criteria Meets Criteria Time Frame  specifies the time frame in which objective will be assessed  specifies who will administer the assessment Evaluation  identifies evaluator(s)  specifies evaluation process  attach relevant document(s), if applicable Adapted from Mt Sac APPENDIX D: AUO CHECKLIST

Rubric for Evaluating AUOs Item Criteria Does not Meet Criteria Meets Criteria Summary of Data  addresses the means of assessment and criteria for success  reports the actual results and compare with the number (%, fraction, actual number) originally expected to meet the minimum score  includes additional data for sub- category  highlights key findings from the data, if applicable Adapted from Mt Sac APPENDIX D: AUO CHECKLIST

Rubric for Evaluating AUOs Item Criteria Does not Meet Criteria Meets Criteria Use of Results  reports what the department/unit members have done or are doing as a result of the findings  identifies who has made or is making the changes  indicates the time frame for the changes Adapted from Mt Sac APPENDIX D: AUO CHECKLIST

Useful Resources Riverside Community College Foothill College Mt. San Jacinto Community College Saddleback Community College Western Nevada College Florida Keys Community College University of Central Florida

Presenters Yolanda Bellisimo – SLO Facilitator, College of Marin Sara McKinnon – Academic Senate President, College of Marin