Chapter 23 Deciding how to collect data

Slides:



Advertisements
Similar presentations
Evaluation of User Interface Design
Advertisements

Fact Finding Techniques
Human Computer Interaction
Interview Guide By Annie Reid. How to choose your sample Firstly, the interviewer must realise that in order to save time and conduct efficient interviews,
Web E’s goal is for you to understand how to create an initial interaction design and how to evaluate that design by studying a sample. Web F’s goal is.
Deciding How to Measure Usability How to conduct successful user requirements activity?
PLANNING QUESTIONNAIRE RESEARCH Mr. Toth Patten, Mildred L. (2001). Questionnaire Research: A Practical Guide. 2nd ed. Los Angeles, California: Pyrczak.
Observing Users Paul Bogen, LaShon Johnson, Jehoon Park.
Chapter 14: Usability testing and field studies. Usability Testing Emphasizes the property of being usable Key Components –User Pre-Test –User Test –User.
Collecting Quantitative Data
©N. Hari Narayanan Computer Science & Software Engineering Auburn University 1 COMP 7620 Evaluation Chapter 9.
Empirical Methods in Human- Computer Interaction.
Think-aloud usability experiments or concurrent verbal accounts Judy Kay CHAI: Computer human adapted interaction research group School of Information.
1 Overview of Usability Testing CSSE 376, Software Quality Assurance Rose-Hulman Institute of Technology April 19, 2007.
Evaluation of usability tests. Why evaluate? 1. choose the most suitable data- collection techniques 2. identify methodological strength and weaknesses.
Evaluation Methodologies
Part 4: Evaluation Chapter 20: Why evaluate? Chapter 21: Deciding on what to evaluate: the strategy Chapter 22: Planning who, what, where, and when Chapter.
Chapter 12 Collecting Qualitative Data. NARRATIVE INTERVIEWING Establishing Data Collection Procedures for Narrative Interviewing Establishing Data Collection.
Chapter 10 Collecting Quantitative Data. SURVEY QUESTIONNAIRES Establishing Procedures to Collect Survey Data Recording Survey Data Establishing the Reliability.
Testing and Modeling Users Kristina Winbladh & Ramzi Nasr.
Chapter 14: Usability testing and field studies
Kirstin Dougan Music and Performing Arts Librarian Music and Performing Arts Library University of Illinois at Urbana-Champaign Music Library Association.
User Interface Evaluation Usability Inquiry Methods
Chapter 23 How to collect data. This chapter is about the tools/techniques used to collect data Hang on, let’s review: what are we collecting? What’s.
Online, Remote Usability Testing  Use web to carry out usability evaluations  Two main approaches agent-based evaluation (e.g., WebCritera)  model automatically.
Evaluation Techniques Material from Authors of Human Computer Interaction Alan Dix, et al.
Gathering User Data IS 588 Dr. Dania Bilal Spring 2008.
Human Computer Interaction
Class Usability Experience User slides are in BLUE.
COMP5047 Pervasive Computing: 2012 Think-aloud usability experiments or concurrent verbal accounts Judy Kay CHAI: Computer human adapted interaction research.
Usability Assessment Methods beyond Testing Chapter 7 Evaluating without users.
Ways of Collecting Information Interviews Questionnaires Ethnography Books and leaflets in the organization Joint Application Design Prototyping.
Welcome to the Usability Center Tour Since 1995, the Usability Center has been a learning environment that supports and educates in the process of usability.
LInfoVis Winter 2011 Chris Culy Evaluation of visualizations.
Creating User Interfaces Review midterm. Work on User Observation studies Homework: Spring break! Use opportunity to work on user observation study!
Usability Evaluation, part 2. REVIEW: A Test Plan Checklist, 1 Goal of the test? Specific questions you want to answer? Who will be the experimenter?
QUALITATIVE RESEARCH METHODS
Chapter 23 Deciding how to collect data. UIDE Chapter 23 Introduction: Preparing to Collect Evaluation Data Timing and Logging Actions –Automatic Logging.
Chapter 27 Variations and more complex evaluations.
Steps in Planning a Usability Test Determine Who We Want To Test Determine What We Want to Test Determine Our Test Metrics Write or Choose our Scenario.
Chapter 24 Final preparations for the evaluation.
Observational Methods Think Aloud Cooperative evaluation Protocol analysis Automated analysis Post-task walkthroughs.
Chapter 2 Research Methods Please fill in your slides as we proceed.
School of Engineering and Information and Communication Technology KIT305/607 Mobile Application Development Week 7: Usability (think-alouds) Dr. Rainer.
Day 8 Usability testing.
Research in Sociology  Like all scientists, sociologists gain knowledge by doing research. They ask “how” and “why” and then they form a hypothesis 
Human Computer Interaction
SIE 515 Design Evaluation Lecture 7.
Evaluation through user participation
Interviews Focus Groups
Usability Evaluation, part 2
Usability Evaluation.
Market Research.
Chapter 20 Why evaluate the usability of user interface designs?
How do you know if someone is lying?
Observing users.
Chapter 19 Case study on requirements, design, and evaluation: NATS
Chapter 22 Planning who, what, when, and where
4.12 Understand data-collection methods to evaluate their appropriateness for the research problem/issue.
Chapter 24 Final preparations for the evaluation
From Controlled to Natural Settings
Evaluation.
HCI Evaluation Techniques
Evaluation tools training
Evaluation Techniques
Unit 6 Research and data collection techniques
Experimental Evaluation
Empirical Evaluation Data Collection: Techniques, methods, tricks Objective data IRB Clarification All research done outside the class (i.e., with non-class.
Human-Computer Interaction: Overview of User Studies
Cognitive Walkthrough
Presentation transcript:

Chapter 23 Deciding how to collect data

Introduction: Preparing to Collect Evaluation Data Timing and Logging Actions Automatic Logging of Keystrokes and Mouse Clicks Specialist Logging Software for Usability Evaluations Choosing a Logging Product UIDE Chapter 23

Think-Aloud and Offering Help Using Cognitive Walkthrough Questions “Is there anything there that tells you what to do next?” “Is there a choice on the screen that lines up with what you want to do? If so, which one?” “Now that you’ve tried ti, has it done what you wanted it to do?” UIDE Chapter 23

Taking Notes When Observing Users UIDE Chapter 23

Conducting Post-Session Discussions Retrospective protocol Post-session interview / debrief UIDE Chapter 23

Questionnaires Advantages Disadvantages Can’t forget to ask a question All participants see the same questions Ability to collect quantitative data Disadvantages Difficult to design Must predict topics the users will need Closed questions don’t give reasons why the users answered the way that they have. UIDE Chapter 23

Using Technologies to Help with Recording Video and Audio Recording Eye-Tracking Equipment Practitioner’s Choice of Technology What to Do If a Participant Does Not Agree to Be Recorded The Global Warming Choices for Data Collection UIDE Chapter 23