Sulis Usage Snapshots of Evaluation Angelica Risquez T&T CoP Showcase Day March 16th 2011

Background Adopted in 2006 as institutional choice of learning management system (LMS) Voluntary adoption (sites unpublished by default) ~2,400 module sites published so far (currently ~ 30% of all modules, plus hundreds of sites creating manually) Over 2.5 million visits registered

Number of staff/research postgraduates* Background (2) Number of staff/research postgraduates* * No data is available for 2007.

Number of students/taught postgraduates* Background (3) Number of students/taught postgraduates* * No data is available for 2007.

Evaluation Student evaluation (ULREC No. 08/43), anonymous online survey* 2008: n=483 2011: n=977 LMS review process (end 2009) Online survey to UL teaching community Personal narratives by members of taskforce * Built in collaboration for national study on LMS in Ireland, Cosgrave et al. (2009): Uptake and Usage of Virtual Learning Environments: Findings from a multi institutional student usage survey. AISHE,

Results: Student Feedback Year of study 2008 The profile of students replying to the survey was similar in both years, with first year students overrepresented 2011

Results: Student Feedback How often do you use Sulis? 2008 The pattern of use has increased in frequency, students are much more reliant on the LMS 2011

Results: Student Feedback Where do you access Sulis? 2008 Accessibility has improved as more students access the LMS from home and from laptops, use of mobile devices has increased a bit and while access in computer labs has decreased 2011

Results: Student Feedback How many of your modules are in Sulis? 2008 The pattern of use has increased in frequency, students are much more reliant on the LMS 2011

Results: Student Feedback 2008

Results: Student Feedback 2011 Increased satisfaction with the system overall

Results: Student Feedback What are the benefits of using Sulis to you? 2008 No significant change on the use of the LMS, seems to point to a widespread use of the LMS as a content repository over interactive features, with coincides with findings at national level and from international literature. When asked about the use of each of the tools we get a similar picture, with Resources being the most commonly used. 2011

Results: Student Feedback 2008 2011 Next we present some interesting variables

Results: Student Feedback 2008 2011

Results: Student Feedback 2008 2011

Results: Student Feedback 2008 2011

Results: Student Feedback 2008 2011

Results: Student Feedback 2008 2011

Results: Student Feedback What is the most effective way to get help with Sulis? 2008 2011

Results: Faculty Survey (1) Online survey to UL teaching community September-October 2009 146 respondents: 54.6% of respondents are Sulis users (representing ~50% of all current Sulis users) 27% of respondents are SharePoint (previously public folders) users 19% of respondents are Moodle users

Results: Faculty Survey (2) N=125

Results: Faculty Survey (4) N=133

Results: Faculty Survey (5) N=96

What next? LMS taskforce continues review, no immediate migrations foreseen Strategic direction to come through the new e-Learning Taskforce