Morae: Digital Solution for Usability Studies Information Experience Laboratory Borchuluun Yadamsuren & Paul Turner School of Information Science & Learning Technologies University of Missouri-Columbia LIDA conference Dubrovnik, 2007

Overview  What is usability? IE Lab SetupIE Lab Setup  MORAE components  Demonstration of usability session with Morae

What is a usability? LearnabilityLearnability Efficiency of UseEfficiency of Use MemorabilityMemorability Minimum errors in UseMinimum errors in Use Subjective Satisfaction (Jacob Nielsen, 1993)Subjective Satisfaction (Jacob Nielsen, 1993)

Usability testing Measures usability by giving a close-up look at an individual user’s experience while navigating a site or software application, right down to the user’s verbal and facial expressions.

Usability Testing with Morae Think aloud Task analysis Interview Focus group Expert review

IE Lab Setup Established in 2003Established in 2003 Includes the Information Experience Room (data collection) and the Control Room (research & analysis)Includes the Information Experience Room (data collection) and the Control Room (research & analysis) Experience Room is set up with five collection stationsExperience Room is set up with five collection stations Remote data collection via laptopRemote data collection via laptop

Information Experience Lab ResearchResearch ConsultingConsulting TeachingTeaching

Experience Room

Control Room

Morae Old technology v. New technology All software solution Truly portable Easy to use

Rich Recording Technology

Portable Lab

Morae Process Three components RecorderRecorder ObserverObserver ManagerManager

Recording the User Test

Morae features Instantly calculate and graph standard usability measurements Instantly calculate and graph standard usability measurements Focus on understanding results Focus on understanding results Visualize important results in meaningful waysVisualize important results in meaningful ways Present results persuasively and professionallyPresent results persuasively and professionally

Testing Process

Morae Recorder Defining study name, configuration, and capture options Defining markers and tasks Defining surveys (SUS and user satisfaction surveys)

Capture options CameraCamera MicrophoneMicrophone KeystrokesKeystrokes Screen textsScreen texts Mouse clicks (cursor, right, left and middle buttons)

Markers Color Type Description

Use of Markers User actionsUser actions User comments and questionsUser comments and questions Observations about how the user performs a taskObservations about how the user performs a task Interesting comments or actions to include in highlight videosInteresting comments or actions to include in highlight videos

Logging the user test

Morae Observer features Connect to Recorder via Network.Connect to Recorder via Network. Remotely start and stop Recorder from an Observer station.Remotely start and stop Recorder from an Observer station. View Recorder's screen video, picture-in- picture (PIP) and audio of the user.View Recorder's screen video, picture-in- picture (PIP) and audio of the user.

Morae Observer features Log the test session markers and text notesLog the test session markers and text notes Record a digital video file (WMV) of the session in Observer for immediate playback and sharing of the test session.Record a digital video file (WMV) of the session in Observer for immediate playback and sharing of the test session. Connect multiple Observers simultaneously to Recorder.Connect multiple Observers simultaneously to Recorder.

Multiple Researchers

Morae Manager Synchronized review of test recordingsSynchronized review of test recordings Video and audio indexed with interaction eventsVideo and audio indexed with interaction events Quickly calculate time-based and frequency metricsQuickly calculate time-based and frequency metrics Easily create and share highlight videosEasily create and share highlight videos ANALYZERPRESENTER

Morae Analysis Features Review screen video automatically synchronized with user video and audio.Review screen video automatically synchronized with user video and audio. View log marks and text notes entered through Remote Viewer(s) synchronized with the video recording.View log marks and text notes entered through Remote Viewer(s) synchronized with the video recording. Automatically break recordings into tasks based on markers.Automatically break recordings into tasks based on markers. Calculate usability metrics, including time on task, click path, and user success rate.Calculate usability metrics, including time on task, click path, and user success rate.

Search Mouse clicksMouse clicks Web page changesWeb page changes KeystrokesKeystrokes Screen textScreen text TasksTasks Window dialog eventsWindow dialog events Export search results to a comma-delimited file that can be used in other applications (Excel, SPSS etc)

Task analysis

Task Analysis

Data Analysis

Morae Presentation features Edit and create highlight videos and title clipsEdit and create highlight videos and title clips Create multiple highlight videos within a single project.Create multiple highlight videos within a single project. Easily add transitions.Easily add transitions. Add audio voice-overs.Add audio voice-overs.

Presentation of results Import videos not recorded with Morae and include them in the highlight video.Import videos not recorded with Morae and include them in the highlight video. Position, resize and adjust the PIP image for each clip.Position, resize and adjust the PIP image for each clip. Produce individual clips for Power Point PresentationsProduce individual clips for Power Point Presentations

Demonstration Object of the study: MU Libraries websiteObject of the study: MU Libraries website Method: Think Aloud and Task AnalysisMethod: Think Aloud and Task Analysis User will perform tasksUser will perform tasks Observation of the sessionObservation of the session Basic AnalysisBasic Analysis Data presentationData presentation

Resources Information about MoraeInformation about Morae Case study of MU Usability StudyCase study of MU Usability Study Other case studies of Morae useOther case studies of Morae use

Contact Us Dr.Sanda Erdelez: Erdelez: Borchuluun Yadamsuren: Yadamsuren: Paul Turner: Turner: Information Experience Laboratory: School of Information Science & Learning Technologies: