1. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Findings from UM.CourseTools Satisfaction Survey Fall 2001

2. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Introduction 2,000 UMCT users responded to surveys –1,137 undergraduate students –653 graduate students –15 instructors, 41 GSIs –162 faculty Two surveys created in UM.Lessons –links posted from My Courses, My Workspace, News & Info, and faculty email 12% response rate –given over 20,000 registered users

3. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Overall findings Students/faculty both fairly satisfied –Mean satisfaction 4 of 5 Students want more… –UMCT sites for their courses –Direct communication with class through UMCT Faculty want more… –efficiencies in class and site administration –time to learn about features they don’t use

4. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Some findings on faculty Faculty satisfaction is associated with –time-on-task –usefulness of online help –ability to find answers to CourseTools questions –improved student-instructor interaction

5. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Some findings on students Student satisfaction is associated with –Length of use –Frequency of use –Usefulness of online help –Keeping informed about the class –Availability of class resources –Frequency of problems using CourseTools

6. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Length of use

7. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Number of students in class

8. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Frequency of use

9. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Feature use - Schedule 25% don’t use it Some reasons why: –11%: doesn’t meet a course need or fit teaching style –9%: didn’t know about it –5%: doesn’t do what I want

10. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Feature use - Announcements 7% don’t use it Some reasons why: –5%: doesn’t meet a course need or fit teaching style –2%: doesn’t do what I want

11. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Feature use - Assignments 24% don’t use it Some reasons why: –19%: doesn’t fit my teaching style or meet a course need –5%: didn’t know about it

12. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Feature use - Resources 5% don’t use it Most used feature Not used because: –2%: didn’t know about it –1%: too difficult –1%: too slow –1%: doesn’t fit my teaching style or meet a course need

13. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Feature use - Participant Profiles 45% don’t use Least used feature Some reasons why: –25%: didn’t know about it –20%: doesn’t fit my teaching style or meet a course need

14. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Feature use - Discussion 41% don’t use it Second least used Some reasons why: –30%: doesn’t fit my teaching style or meet a course need –5% too difficult

15. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Feature use - Help 21% don’t use it Some reasons why: –6%: didn’t know about it –4%: doesn’t fit my teaching style or meet a course need –2%: doesn’t do what I want

16. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Support for teaching goals

17. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Help use & help-seeking behavior

18. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Major things faculty like best Convenient place to post everything Easy interface, standard across courses Record of student coursework No need to learn to maintain a website No need to carry paper around Saves time and money on copies, coursepacks “No excuse” for students not getting work done

19. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Major things faculty like least Time-intensive to set up Inflexible site look and organization Hard to find answers in online help Bugs in registering students for site access Difficult to grade and set up schedule Difficult to connect courses/sections Slow access off-campus Hard to transfer materials across semesters Cumbersome, buried features

20. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Major things faculty want to do Set up email groups and automatic emails Put Resources in any order Keep electronic gradebook Fast multimedia support for video files More student content and group work Anonymous feedback box or surveys Access for users outside the University Batch actions like uploading Resources or grades

21. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Major things students like best Convenient, easy, user-friendly, accessible, fun graphics for holidays Electronic resources save time, paper, and money Personalized display of courses Turning in assignments online Getting lecture notes before class Many course websites in one place

22. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Major things students like least Not all their faculty use it Web address hard to remember Slow access off-campus Can’t easily find updated content Limited printing, formatting problems Login and timeout problems Assignments, Discussion difficult to use Faculty don’t use it uniformly

23. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Major things students want to do Get email when site is updated Access all their courses Chat, instant messaging, easy access to email students and faculty Link to electronic reserve materials Discussion area students create and control Submit assignments online View sites for courses they’re not enrolled in

24. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Limitations Representative quality of sample unclear –Response rate relatively low –majority of faculty respondents new users Qualitative responses not sorted by frequencies Need to mine further for details –Break apart “doesn’t meet a course need or fit my teaching style”

25. Findings from Fall 2001 UM.CourseTools Survey Michelle Bejian, UM Media Union Discussion of next steps Prioritize –user interface development –usability or user needs evaluation –training and support Continuing evaluation of satisfaction –using this data as a benchmark –Data available on UM.WorkTools site