Evaluating the use of a virtual learning environment for teaching aspects of HCI Peter Chalk, University of North London (London Metropolitan University after 1 Aug)

Aims zVLE support for HCI topics: usability evaluation interaction design data privacy on-line communication zVLE features: on-line assessment integrate learning resources zTracking student interactions zStudent feedback & evaluation

VLE interface

Group presentation area

Tracking student interactions

Continuous assessment zTracking flexible attendance zWeekly assessed exercises (& recording) zAssignments (& plagiarism) zMultiple choice quizzes (regular, random) zMissed assignments (& technical bugs) zTracking communication, documents & group work

VLE features zCommunication, e.g. whiteboard/chat zPresentation, e.g. home page & group zOrganisation, e.g. calendar zAssessment, e.g. MCQ & essay/program zPublic/ private, e.g. presentation area zGroup/ individual, e.g. discussion topic zSynchronous/ asynchronous, e.g. diagram

Student home page

Asynchronous discussion forum

Chatting in the drawing room...

Evaluation zSurvey generally positive zRecorded discussion grounded analysis - coding +/- comments (incomplete) zStudent comments open questions, positive response zComparative metric data (new)

Some survey results z6 I find WebCT helpful for working with tools like the JavaScript Tutor. zAGREE 19 STRONGLY AGREE 7 (84%) z8 I find the WebCT discussion forum helpful for keeping me informed of important issues. zAGREE 13 STRONGLY AGREE 8 (68%) z9 I find the WebCT facility helpful for communicating. zAGREE 13 NOT SURE 9 z12 Using WebCT on-line assignment submission is a good idea. zAGREE 14 STRONGLY AGREE 12 (84%) z13 Using WebCT on-line assignment submission is a good example of the future direction of education. zAGREE 15 STRONGLY AGREE 10 (81%)

Example from the chat room zScripting: zLD>>I think we may be allowed to use flash script to do the programming zLD>>rather than javascript zDT>>ok that's good zDT>>that's more of HCI zLD>>i do not know how to write scripts using flash script z... zLD>>yeah UB and N are experts at flash script zDT>>he got 90 right? zDT>>ok that nice to hear

Negotiating meaning… zLD>>ok here is the format of the feedback form zUB>>thats a big bug in the program... zLD>>the user should be able to select only one check box for each question though zUB>>then they should be radio buttons then zLD>>i will send u a text file of what it should look like give me a minute zUB>>cool

Student comments (sample)  ‘WebCT has helped me get around the module as I seem to know where I am going and therefore am not following links that are I am not interested in’.  'This module fills in the gaps left by other modules in the course, with respect to the interface between the user and the programs they are running. I wish this module or a prerequisite of it, was an option for the first year'.  ‘First time users of WebCT will find it confusing... However, once the user is familiar with the layout and is use [sic] to the web site, it is very informative and useful as well as being a useful way to learn about human computer interaction’.

Conclusions zVLE particularly appropriate for HCI, also other subjects zVLE features can support teaching & learning strategy, eg continuous assessment zStudent evaluation very positive zVLE tracking can supply evidence of learning for research & assessment