Assessment Professional Development January 31-February 1, 2018

The Challenge Recommendation 1 CS 3.3.1.2 (Institutional Effectiveness, administration, support services) The Committee recommends that the institution identify expected outcomes, assesses the extent to which it achieves these outcomes, and provides evidence of improvement based on analysis of the results in administrative support services.

THE PROPOSED IE STANDARDS. . . The institution identifies expected outcomes, assesses the extent to which it achieves these outcomes and provides evidence of seeking improvement based on analysis of results in academic and student services that support student success. (Section 8 -- 2C) The institution identifies expected outcomes of its administrative support services and demonstrates the extent to which the outcomes are achieved. (Section 7 -- 3)

THE USP FLU. . . Symptoms: We will continue to monitor. The committee approved this same plan last year. The objective was met. . .why do I need an improvement or use of results? My objective was not met due to the budget, so I am just going to request funds again. I just want to hire another person.

“A WEIGHED PIG NEVER FATTENS. . .” Any and all pig references can be attributed to: Fulcher, K.H., Good, M.R., Coleman, C.C., & Smith, K.L. (2014). A simple model for learning improvement: Weigh pig, feed pig, weigh pig. NILOA Occasional Paper #23, www.learningoutcomesassessment.org.

ASSESSMENT MADE SIMPLE Intervene Re-assess

ASSESSMENT REDUCED TO A CLEVER METAPHOR WEIGH THE PIG WEIGH THE PIG FEED THE PIG

PITFALLS IN THE MODEL. . .

WEIGH THE PIG FEED THE PIG

ASSESS, INTERVENE, DO NOT ASSESS AGAIN Library surveys students as requirement for a periodic review Based on results, program adopts new front desk procedures Program review was not done the next year, so survey was not replicated

STRATEGIES TO AVOID PITFALL Choose sustainable assessments like short, targeted surveys that address specific areas/changes.  Require units to complete objectives for following year at the same time they submit final report for current year. Use of results becomes “steps to meet objective” in next plan. Assessment methods are considered for next year while process is still fresh in minds.

ASSESS, INTERVENE, ASSESS AGAIN Library surveys students as requirement for a periodic review Based on results, program adopts new front desk procedures Brief survey conducted next year asking for feedback specific to front desk procedures

WEIGH THE PIG WEIGH THE PIG

ASSESS, DON’T INTERVENE, ASSESS AGAIN IE office conducts satisfaction survey of services Results reviewed, weaknesses found, but disregarded for number of reasons IE office conducts same survey following year

STRATEGIES TO AVOID PITFALL Enhance lines of communication between administration and plan supervisors Help plan supervisors find value in reports/data to increase accountability Look deeper into the results Encourage tougher benchmarks (or any benchmarks) Pose hypothetical results and ask “now what?” Analyze the results to identify examples of improvements  Realize that small changes are acceptable

IE office conducts satisfaction survey of services ASSESS, INTERVENE, ASSESS AGAIN IE office conducts satisfaction survey of services Results reviewed, weaknesses identified and small changes made to content of website IE office conducts same survey following year to see if weakness has improved

FEED THE PIG WEIGH THE PIG

DON’T ASSESS, INTERVENE, ASSESS AGAIN Program starts a new concentration with the hopes of increasing enrollment by 10 students Enrollment numbers are tracked and the new academic concentration had 10 students enrolled the first year

STRATEGIES TO AVOID PITFALL Provide evidence of the “Why” - What’s the rationale for the objective/intervention? When this happens, the objective is often synonymous with intervention Emphasize including any prior rationale for change in report Complete objectives for following year at the same time they submit final report for current year. Use of results becomes “steps to meet objective” in next plan. Assessment methods are considered for next year while process is still fresh in minds.

ASSESS, INTERVENE, ASSESS AGAIN Program surveyed employers about needed skills. Lack of skilled workers identified. Program starts a new concentration with the hopes of increasing enrollment by 10 students to meet employer needs Enrollment numbers are tracked and the new academic concentration had 10 students enrolled the first year

QUESTIONS?