Connecting Outcome Data with Demographics Using Canvas Reno Giovannetti and Lisa Sayles College of the Redwoods

The ACCJC Standard 1.B.6 “The institution disaggregates and analyzes learning outcomes and achievement for subpopulations of students.”

Assessment Concerns Costs for dedicated software Consuming a lot of IT resources Overtaxing faculty

What challenges do instructors face related to the assessment of student learning outcomes?

Assessment and Instruction Feels like busy work Constitutes extra work/paperwork Issue with storage of artifacts Coordination with other instructors Disconnected from ongoing assessment

Additional Benefits Better integrate formal assessment with ongoing assessment Streamline data collection and storage Easier coordination and distribution of labor

Canvas Assessment Process Setting up outcomes at the account level Importing outcomes into a Canvas course Configuring assessments Connecting assessments to outcomes

Assessment at CR WebAdvisor system student data Independent system to track SLOs Collects aggregate data by course Use Canvas to: Gather the data by student Be a repository for outcome artifacts

Why Not Just Use Canvas? Not a complete SLO system Canvas tools not all a good fit No way to collect dialog and close loop data Limited reporting options Assessment data (# of students who..)

Outcome Data and Students To integrate Canvas process into existing system we need: List of official outcomes Student assignments (assessments and artifacts) in Canvas Connection between the outcome results and the student.

Assignments and Rubrics, and Outcomes Use any assignment, discussion, or quiz Attach rubric (simple or complex) Associate outcomes with an assignment (rubric) Collect data using SpeedGrader

Instructor’s Process Something contained in a graded Canvas Assignment, Discussion or Quiz. Whole assignment or any part of it Part of the regular grading process. Student Canvas submissions are convenient but not essential

The Basic Process Setup outcomes in your Canvas account Import and attach outcomes to a rubric Use SpeedGrader to assess the outcome Canvas reports for the course or account

Import course Outcomes Import outcomes into your course from the account level

Import course Outcomes Use account standards folder structure to locate the outcome

Import course Outcomes

Add Outcomes to a Rubric Edit the rubric and find the outcome Do not use free-form comments

Add Outcomes to a Rubric Select the outcome to add Uncheck the scoring option

Use Speedgrader Use the rubric to select an outcome score No impact on rubric score

Get your results Use the Learning Mastery Gradebook Learning Mastery is activated in settings

Get your results

What To Watch Out For Keep in mind outcomes are visible to students you will need to set expectations Uncheck the criterion for scoring box You can’t use outcomes and freeform comments in the same rubric. Check what is in the reports before you start

Suggestions for Assessment Process COMM 1: Public Speaking Example Provide clear instructions for using Canvas for SLO assessment Collect qualitative data while grading student work. Create a process that accommodates both Canvas users and non-Canvas users

Using Canvas for Assessment Summary Currently we can: Use the existing Canvas functions Collect outcome data and artifacts for our SLOs and individual students Use Canvas data with any outcome system Canvas is working on this process …

Questions?

Works Cited Photo Credits Pg. 1. Target. CC0. https://pixabay.com/p-1180236/?no_redirect