Bystander Intervention Training: Assessment IN ACTION

Case Study Program overview Creating Student Learning Outcomes Creating an assessment plan Collecting and analyzing data Restarting the cycle

Office of Student Life – New Program Early 2016 started planning for new program to be launched September 2016. 3 hour training program for Bystander Intervention lead by student facilitators. New program allowed for easy integration of Student Learning Outcomes and an assessment plan. Created and measured 5 SLOs – we’ll look at 2

Understanding our goals and audiences for the program. Using our project planning/proposal documents. Intended goals and audiences stated very clearly.

Aligning the goals of your program with the overall UVic CAS Standards No matter the size and scope of your program, does it align with the institutional learning outcomes

SLO 1: Students who complete the Bystander Intervention Training Workshop will be able to list at least 4 examples of inappropriate sexual behaviours (on the continuum of behaviours presented in the workshop) as demonstrated by an online quiz completed one week after the workshop. Humanitarianism and Civic Engagement | Social Responsibility

SLO 2: Students who complete the Bystander Intervention Facilitator 3-day training session will be able to meet or exceed expected workshop facilitation skills as demonstrated by a rubric implemented by observation during training sessions 3 times throughout the year. Interpersonal Competence | Effective leadership

The Assessment Plan Create an assessment plan for each SLO, and use the SLO as the foundational block. Important to take all details into consideration.

Collecting Data 2 different assessment methods Quiz questions In-person rubric It’s one thing to make an assessment plan, it’s a whole other thing to follow through with it

Collecting Data - Quiz questions Included at the BEGINNING of our operational effectiveness survey Simple questions that can be skipped Explain why they are being asked

Collecting Data – Facilitator Rubric Very time consuming to collect information but very valuable information. 2 – 3 staff attended a session at the beginning and end of the year for every facilitator (6 sessions in total). First provided baseline, 2nd showed facilitator improvement

Collecting Data – Rubric Creation Determine the dimensions Engagement Knowledge & sensitivity on topic Preparedness and organization Flexibility and responsiveness Describe the dimensions – the more detailed, the easier it is to fill out

Collecting Data - Filling out the Rubric Observed workshop, ticked the marks as workshop progressed. Made sure to not come to conclusions until we finished observing. Made additional notes along the way.

Analyzing Data – Quiz Questions Quiz questions – determined what the answers are before we started analyzing. Interpreted each answer – it might not exactly fit, but have they demonstrated what they are supposed to have learned?

What did we find? How does it inform? Students who complete the Bystander Intervention Training Workshop will be able to list at least 4 examples of inappropriate sexual behaviours (on the continuum of behaviours presented in the workshop) as demonstrated by an online quiz completed one week after the workshop. How many students could list 4 correct examples of inappropriate behaviours 96% of students could list at least 3 correct examples

What did we find? How does it inform? Students who complete the Bystander Intervention Facilitator 3-day training session will be able to meet or exceed expected workshop facilitation skills as demonstrated by a rubric implemented by observation during training sessions 3 times throughout the year. Workshop Facilitation Skills Rubric 3 = Exceed expectations | 2 = Met expectations | 1 = Did not meet expectations All facilitators demonstrated an improvement in facilitation skills between their first assessment (A1) and their second assessment (A2).

End of Cycle and Next Steps Our data confirmed the outcomes for 4/5 of our SLO’s 1 SLO demonstrated that a majority of students were not achieving the intended outcomes – review that module of the program Revisit all statements Run the same assessment Modify Move on to new goal

Questions Dustin Meredith Advisor & Project Lead Office of Student Life oslprojects@uvic.ca