A Comparison of Map vs. Text Directions for a Handheld Device in a Campus Setting: A Pilot Study Liz Atwater Department of Psychology George Mason University.

Slides:



Advertisements
Similar presentations
Human Computer Interaction
Advertisements

Alina Pommeranz, MSc in Interactive System Engineering supervised by Dr. ir. Pascal Wiggers and Prof. Dr. Catholijn M. Jonker.
There are two statistical tests for mean: 1) z test – Used for large samples (n ≥ 30) 1) t test – Used for small samples (n < 30)
Differences in Navigational Ability and Memory in Males and Females A Focus on Road Map usage versus Landmark Map usage in Navigation.
Analysis of Variance The contents in this chapter are from Chapter 15 and Chapter 16 of the textbook. One-Way Analysis of Variance Multiple Comparisons.
Research Methods for Counselors COUN 597 University of Saint Joseph Class # 8 Copyright © 2015 by R. Halstead. All rights reserved.
Design of icons for use by Chinese in Mainland China Interacting with computers 9(1998) Yee-Yin Choong, Gavriel Salvendy Report: Yang Kun, Ou.
Department of Industrial Management Engineering 1.Introduction ○Usability evaluation primarily summative ○Informal intuitive evaluations by designers even.
International Journal of Industrial Ergonomics 35 (2005) 939–953 Situation awareness and workload in driving while using adaptive cruise control and a.
AirMessages interactive density exploration Steven Strachan Hamilton Institute Roderick Murray-Smith University of Glasgow and Hamilton Institute
User responses to GPS positioning information on a 2D digital map Will Seager, Department of Computer Science, University College London, UK Danae Stanton.
Nanja Smets Evaluation in Virtual Environmen 21 May 2008.
User Testing & Experiments. Objectives Explain the process of running a user testing or experiment session. Describe evaluation scripts and pilot tests.
The art and science of measuring people l Reliability l Validity l Operationalizing.
Visualizing Directions and Schedules on Handheld Devices A Pilot Study of Maps vs. Text and Color vs. Monochrome Pankaj Thakkar Irina Ceaparu Cemal Yilmaz.
Using Statistics in Research Psych 231: Research Methods in Psychology.
Social Presence in Web Surveys by Mick P. Couper, Roger Tourangeau, Darby M. Steiger presented by Neal Audenaert.
1 of 13 May 26, 2000 Comparing Web Applications with Desktop Applications: An Empirical Study Paul Pop Department of Computer and Information.
Jesper Kjeldskov & Jan Stage Department of Computer Science Aalborg University Denmark New Techniques for Usability Evaluation of Mobile Systems.
Chapters 8 & 9 Advanced Experimental Design. Experimental Designs Between-subject designs  Simple randomized design  Multilevel randomized design Factorial.
Single Item Search on PDAs: Effects of Font Size & Menu Style By Ketan Babaria, Sasha Giacoppo, Ugur Kuter.
Complex Design. Two group Designs One independent variable with 2 levels: – IV: color of walls Two levels: white walls vs. baby blue – DV: anxiety White.
Today Concepts underlying inferential statistics
Project Topic Ideas PSY Fall Remembering Locations 1) Is location memory more accurate for important items than for less important items?
Repeated Measures ANOVA Used when the research design contains one factor on which participants are measured more than twice (dependent, or within- groups.
Alexandru Dancu 1 Zlatko Franjcic 2,1 Morten Fjeld 1 1 t2i lab, Chalmers University of Technology, Gothenburg, Sweden2 Qualisys AB Smart Flashlight Map.
Research Report Writing Presentation How to write a complete research report Part 3: Methodology.
Empowering Student Learning in the Geologic Sciences with Three Dimensional Interactive Animation and Low Cost Virtual Reality Laura Marie Leventhal, Computer.
Basic Statistics Michael Hylin. Scientific Method Start w/ a question Gather information and resources (observe) Form hypothesis Perform experiment and.
T tests comparing two means t tests comparing two means.
Lecturer’s desk INTEGRATED LEARNING CENTER ILC 120 Screen Row A Row B Row C Row D Row E Row F Row G Row.
Statistical Fundamentals: Using Microsoft Excel for Univariate and Bivariate Analysis Alfred P. Rovai Hypothesis Testing PowerPoint Prepared by Alfred.
Evaluation Techniques Material from Authors of Human Computer Interaction Alan Dix, et al.
Chapter 11 HYPOTHESIS TESTING USING THE ONE-WAY ANALYSIS OF VARIANCE.
Effects on driving behavior of congestion information and of scale of in-vehicle navigation systems Author: Shiaw-Tsyr Uang, Sheue-Ling Hwang Transportation.
Jane Reid, AMSc IRIC, QMUL, 16/10/01 1 Evaluation of IR systems Jane Reid
===!"§ Deutsche Telekom Laboratories Target Acquisition with Camera Phones when used as Magic Lenses CHI 2008, Florence, Italy, April 9, 2008 Michael Rohs.
Psychology 301 Chapters & Differences Between Two Means Introduction to Analysis of Variance Multiple Comparisons.
Seungwon Yang, Haeyong Chung, Chris North, and Edward A. Fox Virginia Tech, Blacksburg, VA USA 1ETD 2010, June 16-18, Austin, TX.
Forming the Method Subjects Instruments or apparatus Procedures Design and analysis The Method section explains how the study was conducted and should.
Evaluation Techniques Evaluation –tests usability and functionality of system –occurs in laboratory, field and/or in collaboration with users –evaluates.
CS 580 chapter 9 evaluation techniques. Evaluation Tests usability and functionality of system Occurs in laboratory, field and/or in collaboration with.
IT 와 인간의 만남 KAIST 지식서비스공학과 Experimental Research KSE966/986 Seminar Uichin Lee Sept. 21, 2012.
1 SY DE 542 Navigation and Organization Prototyping Basics Feb 28, 2005 R. Chow
Chapter 9 Three Tests of Significance Winston Jackson and Norine Verberg Methods: Doing Social Research, 4e.
Chapter 9 Introduction to the t Statistic. 9.1 Review Hypothesis Testing with z-Scores Sample mean (M) estimates (& approximates) population mean (μ)
1 Interaction of hypertext forms and global versus sequential learning styles. Dünser, A., Jirasco, M. (2005). Interaction of hypertext forms and global.
Assignment 1 February 15, 2008Slides by Mark Hancock.
©2010 John Wiley and Sons Chapter 2 Research Methods in Human-Computer Interaction Chapter 2- Experimental Research.
Mixed ANOVA Models combining between and within. Mixed ANOVA models We have examined One-way and Factorial designs that use: We have examined One-way.
Meghna Krishnan Rahul Nair Kedar A. Shiroor Dispatcher’s Rescue.
Usability Evaluation, part 2. REVIEW: A Test Plan Checklist, 1 Goal of the test? Specific questions you want to answer? Who will be the experimenter?
6 Making Sense of Statistical Significance.
Lecturer’s desk INTEGRATED LEARNING CENTER ILC 120 Screen Row A Row B Row C Row D Row E Row F Row G Row.
Finishing up: Statistics & Developmental designs Psych 231: Research Methods in Psychology.
Social Science Research Design and Statistics, 2/e Alfred P. Rovai, Jason D. Baker, and Michael K. Ponton Between Subjects Analysis of Variance PowerPoint.
Copyright c 2001 The McGraw-Hill Companies, Inc.1 Chapter 11 Testing for Differences Differences betweens groups or categories of the independent variable.
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 11 Testing for Differences Differences betweens groups or categories of the independent.
The Process of Developing a Mobile Device for Communication in a Safety-Critical Domain Jesper Kjeldskov and Jan Stage Mobile HCI Research Group Department.
Experimental Design. Talking While Driving: Are Cell Phone Conversations Different from Passenger Conversations? Research Problems Talking on a cellphone.
Qualitative vs. Quantitative
Understanding Results
Viewing Distance & Visual Discomfort While Using Handheld Displays
Introduction to Statistics for the Social Sciences SBS200 - Lecture Section 001, Spring 2018 Room 150 Harvill Building 9:00 - 9:50 Mondays, Wednesdays.
Psych 231: Research Methods in Psychology
HCI Evaluation Techniques
Psych 231: Research Methods in Psychology
Evaluation Techniques
Embry-Riddle Aeronautical University, College of Aviation
Presentation transcript:

A Comparison of Map vs. Text Directions for a Handheld Device in a Campus Setting: A Pilot Study Liz Atwater Department of Psychology George Mason University Jason Burke Institute for Systems Research University of Maryland Andrea Kirk Department of Computer Science University of Maryland December 2001

Which one is more effective? –Less time, less errors Does route complexity have an effect? Use by pedestrians instead of drivers –Lack of landmarks –No street names, etc. Map vs. Text Directions

Context-aware, location-aware –Location awareness via GPS, RF, IR, etc. Provides information depending on: –User profile –Device profile –Location –Context Useful in many domains –Tourism –Commerce Rover

Williams studies (1999) – pilots finding nearest airport using maps or text –Maps are faster and more accurate –ERF tasks had better results with track-up –WRF tasks had better results with north-up Aretz,1991 – ERF vs. WRF –Ego-centered frame  track-up –World-centered frame  north-up Butz, 2001 – landmarks at key decision points Background Research

Experiment – Hypotheses Hypotheses: –Null: There is no statistical difference between completion time, consultation time and number of errors between text and map directions, regardless of route complexity. –H 1 : Users will complete the tasks faster using map directions. –H 2 :Users will make fewer errors using map directions. –H 3 : Users will need less consultation time using text directions. –H 4 : Completion time will rise with increasing route complexity.

IVs & Treatments –Direction type: map vs. text –Route complexity: low, medium, high Low: 3 decision points, 893 ft Medium: 5 decision points, 897 ft High: 7 decision points, 883 ft DVs –Completion time –Consulting time –Errors Experiment – Variables

Subjects –7 male, 5 female –Undergrad & grad UMCP students Other materials –Pre & post-task questionnaires –VZ-2 Experiment – Materials

Navigate 3 routes using directions Within-subjects for routes Between-subjects for direction type 2 stopwatches Route permutations: Experiment – Tasks

Screen Shots Text ImplementationMap Implementation

Main effect for route: significant Main effect for direction: ns Interaction effect: ns Results – Completion Time

Main effect for route: significant Main effect for direction: ns Interaction effect: ns Results – Consultation Time

Main effect for route: significant Main effect for direction: ns Interaction effect: ns Results – Errors

Observations Learning seemed to have a significant effect on the results Most errors occurred at non-dead ends People are different –Huge variance in user performance in both map and text implementations –Difficulty judging distances in text version –Rotate map for track-up bearings –Looking ahead caused problems

Conclusions Need many more subjects Text directions are difficult to describe in college campus environment Feedback from “real” context-aware equipment could improve performance Track-up display for map could decrease orientation time Hybrid to accommodate variations in user cognitive strengths