Human Needs and Mobile Devices: Small, Fast & Fun Ben Shneiderman Founding Director ( ), Human-Computer Interaction Lab Professor, Department of Computer Science Member, Institutes for Advanced Computer Studies & Systems Research University of Maryland College Park, MD 20742

Human-Computer Interaction Laboratory Interdisciplinary research community - Computer Science & Psychology - Information Studies & Education (

User Interface Design Goals Cognitively comprehensible: Consistent, predictable & controllable Affectively acceptable: Mastery, satisfaction & responsibility NOT: Adaptive, autonomous & anthropomorphic

Scientific Approach (beyond user friendly) Specify users and tasks Predict and measure  time to learn  speed of performance  rate of human errors  human retention over time Assess subjective satisfaction (Questionnaire for User Interface Satisfaction) Accommodate individual differences Consider social, organizational & cultural context

Design Issues Input devices & strategies  Keyboards, pointing devices, voice  Direct manipulation  Menus, forms, commands Output devices & formats  Screens, windows, color, sound  Text, tables, graphics  Instructions, messages, help Collaboration & communities Manuals, tutorials, training hcibib.org useit.com

Library of Congress Scholars, Journalists, Citizens Teachers, Students

Visible Human Explorer (NLM) Doctors Surgeons Researchers Students

NASA Environmental Data Scientists Farmers Land planners Students

Bureau of Census Economists, Policy makers, Journalists Teachers, Students

NSF Digital Government Initiative Find what you need Understand what you Find Census, NCHS, BLS, EIA, NASS, SSA

International Children’s Digital Libary

Zooming User Interfaces

ZUI: Pocket PhotoMesa

Leonardo’s Laptop The old computing is about what computers can do, The New Computing is about what people can do mitpress.mit.edu/leonardoslaptop

An Inspirational Muse: Leonardo da Vinci ( ) Renaissance Man Combined science & art Integrated engineering & esthetics Balanced technology advances & human values Merged visionary & practical

Health & Wellness Devices More people are familiar with technologies Low cost makes them widely available ?Social shift? to take greater responsibility for personal health care, fitness & wellness  Personal health & wellness devices However: Lack of common interface inhibits growth Lack of common file format prevents collaboration Surveys: Class Projects:

Health & Wellness Devices Monitoring chronic conditions  Asthma, diabetes, obesity, high blood pressure  Depression, anxiety, sleep disorders Aging in place  Cognitive & memory aids, monitoring, social interaction Sports & training  Pedometers, body fat meters, bathroom scales Family history & personal health records  Genetic history, vaccinations, medications, allergies  Emergency treatment info, medical contacts

Blood Glucose

Blood Pressure & Pulse Rate

Heart Rate & Thermometer

Body Fat

Standardize & Improve Health & Wellness Devices Issues Ease of use Accuracy of device in use Logging to common file format Save/Send to health providers Annotation by patient & physician Interpretation of results Visualize to spot patterns

HCI Theories Beneficial theories: - Descriptive - Explanatory - Predictive - Prescriptive but the big step forward will be - Generative Theories to guide our invention of new technologies

Human Needs What makes a mobile device different from a Desktop/Laptop?

Human Needs What makes a mobile device different from a Desktop/Laptop? What sensors do you want?

Human Needs What makes a mobile device different from a Desktop/Laptop? What sensors do you want? What do you want to store?

Human Needs What makes a mobile device different from a Desktop/Laptop? What sensors do you want? What do you want to store? What messages do you want to get? Send?

Human Needs What makes a mobile device different from a Desktop/Laptop? What sensors do you want? What do you want to store? What messages do you want to get? Send? Do you see a pattern yet?

Mobile Device User Interface Taxonomy (DUIT) (1) capture info from a location share info to a location (2) monitor info stream output alert when info stream changes (3) locate objects (nearest cafe or hotspot) identify objects (name of a person or flower) (4) gather messages from many people spread message to many people (5) participate as individual in a group relate to individual in a group

Relationships Self: working on your own Family & Friends: 2-50 close intimates Colleagues & Neighbors: acquaintances Citizens & Markets: 5000 and more Human Needs for Relationships

Activities Collect: Information Relate: Communication Create: Innovation Donate: Dissemination Human Needs for Activities

Activities and Relationship Table (ART) Relationships Self Family & Friends Colleagues & Neighbors Citizenry & Markets Activities Collect Relate Create Donate Skeptics corner - Are relationships more complex? - Are these useful activities?

Activities and Relationship Table (ART) Relationships Self Family & Friends Colleagues & Neighbors Citizenry & Markets Activities Collect Relate Create Donate IdenticamPhotoDiary PhotoFinder PhotoMesa Album sharing StoryStarterFamily photo history PhotoFinder Kiosk PhotoWall PhotoFinder Webstarter PhotoQuiltPhoto sharing

Activities and Relationship Table (ART) Activities Collect Relate Create Donate Medical logDiary Find-a- Friend MusicListsFamily vacation history InfoDoors Gather Send-a-Link WebBushes WorldWide Med Million person communities Medical diagnosis Tourist sharing Relationships Self Family & Friends Colleagues & Neighbors Citizenry & Markets

Takeaway Messages Mobile devices are huge opportunity  Small, fast & fun  Low-cost, easy-to-use, specific service Focusing on human needs will guide you to more successful product designs  Device User Interface Taxonomy (DUIT)  Activities & Relationship Table (ART)

Human-Computer Interaction Laboratory The old computing is about what computers can do, The New Computing is about what people can do

Takeaway Messages Design functions to serve human needs Usability + reliability to prevent frustration Engage users with fun  Alluring metaphors  Compelling content  Attractive graphics  Appealing animations  Satisfying sounds

Photo Annotation Annotating & repurposing photos in the Semantic Web context Retrieve by personal attributes:  name, date, topic?  age, country, organization??  weight, necksize, hair color????? Retrieve by mediated attributes:  numbers of papers/citations in WWW  other conferences they attended  names of students they supervised

Goals of Public Access Enable full participation by every citizen  Voting, social security services, passports, licenses, registrations, permits, recreation, state-county-city government services Offer services to many residents & visitors  Visa applications, tourism info, employment, healthcare, police, fire, education, training, museums, parks, libraries

Universal Usability Challenges Technology variety  Fast & slow modems, small & large displays  Diverse platforms, multiple versions User diversity  Novice & expert, old & young  Users with disabilities, poor literacy, or low motivation Bridge the gap between what users know and what they need to know  Multi-layer interfaces  Help vs. ShowMe!

Technology variety 1 to 100 range in processor speeds Pentium 1 to 100 range in screen sizes Palm devices Laptops Large Desktop or Wall Display 30, ,000 3,840,000 pixels Software Versions Compatibility File conversion Multiple platforms Device Independence Input: keyboard, speech,... Output: visual, auditory,... Conversion 1 to 100 range in network bandwidth 9.6K 56K 10,000Kbps

User diversity: Accommodate all users Skills Computer newbie to hacker Knowledge Domain novice to expert Age Young to old Gender Male or Female Income Impoverished to wealhy Disabilities Visual, auditory, motoric, cognitive Disabling conditions Mobility, injury, noise, sunlight

Race Ethnicity Religion National Origin Literacy Fluent to illiterate Multiple languages Culture Western, Eastern, developing... Personality Introvert vs extravert Thinking vs feeling Risk aversion Locus of control Planful vs playful User diversity: Accommodate all users

Online help Context sensitive, tables of contents, Indexes, Keyword search, FAQs, answer gardens Gaps in User Knowledge-Strategies Bridge the gap between what users know and what they need to know Design Multi-Layered Task-oriented Training Fade-able scaffolding Training wheels Minimalist Online Learning (evolutionary, phased) Introductory tutorials Getting started manuals, Cue cards Walkthroughs/Demos Minimalist/Active

Community Newsgroups, online communities Chat rooms Customer service Phone Help desks Gaps in User Knowledge-Strategies Bridge the gap between what users know and what they need to know Supplements Online manuals, paper Audio, video, Live lecture, peer training, personal trainer

Public Access & Universal Usability Our Project Resources Government Access Guidelines

Designing the User Interface: 4 th Edition I: Introduction 1 Usability of Interactive Systems 2 Guidelines, Principles, and Theories II: Development Processes 3 Managing Design Processes 4 Evaluating Interface Designs 5 Software Tools III: Interaction Styles 6 Direct Manipulation and Virtual Environments 7 Menu Selection, Form Fillin, and Dialog Boxes 8 Command and Natural Languages 9 Interaction Devices 10 Collaboration IV: Design Issues 11 Quality of Service 12 Balancing Function and Fashion 13 User Manuals, Online Help, and Tutorials 14 Information Search and Visualization

Treemap – Monitoring

Treemap – Gene Ontology

Dynamometers & Inclinometers

Information Visualization The eye… the window of the soul, is the principal means by which the central sense can most completely and abundantly appreciate the infinite works of nature. Leonardo da Vinci ( )

PhotoMesa

LifeLines

Treemap: Stock market, industry clustered

Treemap – Product catalogs

Personal Medical Anxiety & Depression Asthma