User Interface Lab. ISIE Jeong, Seok-Hyun Using the experience sampling method to evaluate ubicomp applications.

Slides:

Advertisements

Similar presentations

©2011 1www.id-book.com An evaluation framework Chapter 13.

Advertisements

Chapter 13: An evaluation framework

Designing and Evaluating Mobile Interaction: Challenges and Trends Authors: Marco de Sa and Luis Carrico.

Imran Hussain University of Management and Technology (UMT)

Extended Project Research Skills 1 st Feb Aims of this session  Developing a clear focus of what you are trying to achieve in your Extended Project.

Usability Evaluation Evaluation should occur continually through the design and implementation process. Evaluation methods are applied as the interface.

Chapter 14: Usability testing and field studies. Usability Testing Emphasizes the property of being usable Key Components –User Pre-Test –User Test –User.

My Experience Jon Froehlich CSE490f, October 17, 2006 A Context-Aware Tool for In Situ Data Collection.

1 Overview of Usability Testing CSSE 376, Software Quality Assurance Rose-Hulman Institute of Technology April 19, 2007.

Selecting Research Participant 1. Sample & Population A population is the entire set of individuals of interest to a researcher. A sample is a set of.

Part 4: Evaluation Chapter 20: Why evaluate? Chapter 21: Deciding on what to evaluate: the strategy Chapter 22: Planning who, what, where, and when Chapter.

Part 2: Requirements Days 7, 9, 11, 13 Chapter 2: How to Gather Requirements: Some Techniques to Use Chapter 3: Finding Out about the Users and the Domain.

Chapter 3 Preparing and Evaluating a Research Plan Gay and Airasian

O'Leary, Z. (2004) The Essential Guide to Doing Research. London: Sage Chapter Seven1 Methodological Design What’s the best way to design my study?

Sabine Mendes Lima Moura Issues in Research Methodology PUC – November 2014.

Objectives for Session Nine Observation Techniques Participatory Methods in Tanzania Hand back memos.

CASIE Workshop Psychology

Methods of Psychology Hypothesis: A tentative statement about how or why something happens. e.g. non experienced teachers use corporal punishment more.

Chapter 14: Usability testing and field studies

Introduction to SDLC: System Development Life Cycle Dr. Dania Bilal IS 582 Spring 2009.

Research Methods in Psychology (Pp 1-31). Research Studies Pay particular attention to research studies cited throughout your textbook(s) as you prepare.

Prepared for: GEOG 4020, Geographic Research Methodology University of Denver, Department of Geography.

CHAPTER 8 Estimating with Confidence

MAC Fall Symposium: Learning What You Want to Know and Implementing Change Elizabeth Yakel, Ph.D. October 22, 2010.

Usability Evaluation June 8, Why do we need to do usability evaluation?

Evaluation Paradigms & Techniques IS 588 Spring 2008 Dr. D. Bilal.

Copyright © 2008 Pearson Education, Inc. Publishing as Pearson Addison-Wesley The Resonant Interface HCI Foundations for Interaction Design First Edition.

Qualitative versus Quantitative Research (Source: W.G. Zikmund, “Business Research Methods,” 7th Edition, US, Thomson, South-Western, 2003)

UBICOMP ‘01 A Hybrid Evaluation Approach for Ubiquitous Computing Environments Mark Burnett, Chris Rainsford DSTO, Australia.

LOOKING FOR EVIDENCE? A CASE FOR THE CASE STUDY DR. GURU NAGARAJAN DR. SARA BHATTACHARJI.

Identify a Health Problem Qualitative Quantitative Develop Program -theory -objectives -format -content Determine Evaluation -design -sampling -measures.

© An Evaluation Framework Chapter 13.

Chapter 8 Usability Specification Techniques Hix & Hartson.

Advanced Higher Modern Studies Research Methods Research Methods.

Unit 8 Populations and Samples. What is a Sample? Sample = small subset of a population. Populations are the things that possess specific attributes –

Chapter 2 Doing Sociological Research Key Terms. scientific method Involves several steps in research process, including observation, hypothesis testing,

Reliability of one cognitive process

Sociological Research Methods. Survey Research - Interview - Questionnaire - Closed- end Questions - Open- ended Questions.

Chapter 2 Doing Sociological Research. Chapter Outline The Research Process The Tools of Sociological Research Prediction, Sampling and Statistical Analysis.

June 5, 2007Mohamad Eid Usability Testing Chapter 8.

You are going to see a patient diagnosed with schizophrenia. Observe him carefully and note down his behaviour as it happens.

Day 10 Analysing usability test results. Objectives  To learn more about how to understand and report quantitative test results  To learn about some.

Oct 211 The next two weeks Oct 21 & 23: Lectures on user interface evaluation Oct 28: Lecture by Dr. Maurice Masliah No office hours (out of town) Oct.

There’s an Assessment for That! MACUL 2012 Mitch Fowler – Calhoun ISD.

Evaluation and Assessment of Instructional Design Module #4 Designing Effective Instructional Design Research Tools Part 2: Data-Collection Techniques.

Creating User Interfaces User Observation assignment. Classwork / Homework: get started.

Picture #ObservationInference

KQ: How can I state the strengths and weaknesses of different types of research methods? L.O-To be able to explain what research methods means. To be able.

Chapter 13: An evaluation framework. The aims are: To discuss the conceptual, practical and ethical issues involved in evaluation. To introduce and explain.

HW Page 23 Have HW out to be checked.

Assess Plan Do Review Resource 1: Types of Evaluation – which type of approach should I use? There are a number of different types of evaluation, the most.

Asking questions: Interviews, Wednesday 14th December 2016

Research Methods: Observation

Research Designs Social Sciences.

Selecting Research Participant

الأستاذ المساعد بقسم المناهج وطرق التدريس

Human computer interaction-com 402

Evaluation Paradigms & Techniques

Interviews and Questionnaires

Observations & Case Studies

Weighted Interval Scheduling

Planning and Conducting Data Collection – Structured Observations

Weighted Interval Scheduling

CS 594: Empirical Methods in HCC Sensor Data Streams in HCI Research

Qualitative/Quantitative Methodologies

Debate issues Sabine Mendes Lima Moura Issues in Research Methodology

Observations in Psychology

Presentation transcript:

User Interface Lab. ISIE Jeong, Seok-Hyun Using the experience sampling method to evaluate ubicomp applications

User Interface Lab. ISIE The evaluation process is critical - For successful deploying new technologies - To help learn whether your applications meet the needs of your users - If not meeting, evaluations can help identify the reasons The terms of evaluation technique - Accommodate many participants in several environments - Take place in several settings and explore those different tasks - Collect both qualitative and quantitative data

User Interface Lab. ISIE Experience Sampling Method(ESM) - Time sampling, beeper study, ecological momentaty assessment - ESM does not require participants to recall - ESM reduces biases associated with participants being observed - ESM can involve much participants - ESM can collect structured data and unstructured data Considerations - Alerting - Delivering - Captureing - Device for ESM

User Interface Lab. ISIE Experiences - PDA-based ESM - 31 Subjects - Seven days, paricipants received 10randomly scheduled alerts per day(72 minute intervals), one alert occurred randomly Results