WatCV research study

Study parameters Conducted Fall 2016 and Winter 2017 22 UWaterloo courses 45 instructors and teaching assistant/ markers Across all 6 academic Faculties 1st to 4th year students Small studio classes (20 students) to large lecture classes (350 students)

Study method Two student groups: Experimental and Control Experimental “(WatCV” group) did 3 WatCV assignments Control (“non-WatCV) did not Experimental group made up of 1682 students; Control, 1716 3998 experimental and control group students sent out survey six months after course completion Tested whether students could answer 2 randomized BBI questions in STAR format

Study findings Both WatCV and non-WatCV co-op students articulate skills better overall than non-co- op students in both groups. WatCV group co-op students articulate their ability to transfer skills better than non- WatCV co-op students. WatCV group students match the skills question with a correct skill example more successfully than non-WatCV group students. All students struggle to articulate how to transfer skills.

How did researchers assess ‘articulation’ of professional skills? Researchers hand coded 673 x 3 part-STAR answers (x 2 questions) = 1881 answers Used WatCV rubric to assess whether students could: Sharpen: identify (situation, skill, actions, results, new situation) Deepen: provide details (about situation, skill, actions, results, new situation) Transfer: connect details (about situation, skill, actions, results) to bridge to new/ future situations

WatCV Rubric https://watcv.uwaterloo.ca/rubricdemo/