1. Human Needs and Mobile Devices: Small, Fast & Fun Ben Shneiderman ben@cs.umd.edu Founding Director (1983-2000), Human-Computer Interaction Lab Professor, Department of Computer Science Member, Institutes for Advanced Computer Studies & Systems Research University of Maryland College Park, MD 20742

2. Human-Computer Interaction Laboratory Interdisciplinary research community - Computer Science & Psychology - Information Studies & Education (www.cs.umd.edu/hcil)

3. User Interface Design Goals Cognitively comprehensible: Consistent, predictable & controllable Affectively acceptable: Mastery, satisfaction & responsibility NOT: Adaptive, autonomous & anthropomorphic

4. Scientific Approach (beyond user friendly) Specify users and tasks Predict and measure  time to learn  speed of performance  rate of human errors  human retention over time Assess subjective satisfaction (Questionnaire for User Interface Satisfaction) Accommodate individual differences Consider social, organizational & cultural context

5. Design Issues Input devices & strategies  Keyboards, pointing devices, voice  Direct manipulation  Menus, forms, commands Output devices & formats  Screens, windows, color, sound  Text, tables, graphics  Instructions, messages, help Collaboration & communities Manuals, tutorials, training www.awl.com/DTUI hcibib.org useit.com

6. Library of Congress Scholars, Journalists, Citizens Teachers, Students

7. Visible Human Explorer (NLM) Doctors Surgeons Researchers Students

8. NASA Environmental Data Scientists Farmers Land planners Students

9. Bureau of Census Economists, Policy makers, Journalists Teachers, Students

10. NSF Digital Government Initiative Find what you need Understand what you Find www.ils.unc.edu/govstat/ Census, NCHS, BLS, EIA, NASS, SSA

11. International Children’s Digital Libary

12. Zooming User Interfaces www.cs.umd.edu/hcil/jazzwww.cs.umd.edu/hcil/datelens

13. ZUI: Pocket PhotoMesa www.windsorinterfaces.com

14. Leonardo’s Laptop The old computing is about what computers can do, The New Computing is about what people can do mitpress.mit.edu/leonardoslaptop www.cs.umd.edu/hcil/newcomputing

15. An Inspirational Muse: Leonardo da Vinci (1452-1519) Renaissance Man Combined science & art Integrated engineering & esthetics Balanced technology advances & human values Merged visionary & practical

16. Health & Wellness Devices More people are familiar with technologies Low cost makes them widely available ?Social shift? to take greater responsibility for personal health care, fitness & wellness  Personal health & wellness devices However: Lack of common interface inhibits growth Lack of common file format prevents collaboration Surveys: www.cs.umd.edu/hcil/iHealth/ Class Projects: www.cs.umd.edu/class/spring2004/cmsc434/

17. Health & Wellness Devices Monitoring chronic conditions  Asthma, diabetes, obesity, high blood pressure  Depression, anxiety, sleep disorders Aging in place  Cognitive & memory aids, monitoring, social interaction Sports & training  Pedometers, body fat meters, bathroom scales Family history & personal health records  Genetic history, vaccinations, medications, allergies  Emergency treatment info, medical contacts www.marketresearch.com/map/prod/924670.html

18. Blood Glucose www.homediagnosticsinc.com/

22. Blood Pressure & Pulse Rate www.promedproducts.com

23. Heart Rate & Thermometer

24. Body Fat www.linear-software.com/digitalcalipers.html

25. Standardize & Improve Health & Wellness Devices Issues Ease of use Accuracy of device in use Logging to common file format Save/Send to health providers Annotation by patient & physician Interpretation of results Visualize to spot patterns

26. HCI Theories Beneficial theories: - Descriptive - Explanatory - Predictive - Prescriptive but the big step forward will be - Generative Theories to guide our invention of new technologies

27. Human Needs What makes a mobile device different from a Desktop/Laptop?

28. Human Needs What makes a mobile device different from a Desktop/Laptop? What sensors do you want?

29. Human Needs What makes a mobile device different from a Desktop/Laptop? What sensors do you want? What do you want to store?

30. Human Needs What makes a mobile device different from a Desktop/Laptop? What sensors do you want? What do you want to store? What messages do you want to get? Send?

31. Human Needs What makes a mobile device different from a Desktop/Laptop? What sensors do you want? What do you want to store? What messages do you want to get? Send? Do you see a pattern yet?

32. Mobile Device User Interface Taxonomy (DUIT) (1) capture info from a location share info to a location (2) monitor info stream output alert when info stream changes (3) locate objects (nearest cafe or hotspot) identify objects (name of a person or flower) (4) gather messages from many people spread message to many people (5) participate as individual in a group relate to individual in a group

33. Relationships Self: working on your own Family & Friends: 2-50 close intimates Colleagues & Neighbors: 50-5000 acquaintances Citizens & Markets: 5000 and more Human Needs for Relationships

34. Activities Collect: Information Relate: Communication Create: Innovation Donate: Dissemination Human Needs for Activities

35. Activities and Relationship Table (ART) Relationships Self Family & Friends Colleagues & Neighbors Citizenry & Markets Activities Collect Relate Create Donate Skeptics corner - Are relationships more complex? - Are these useful activities?

36. Activities and Relationship Table (ART) Relationships Self Family & Friends Colleagues & Neighbors Citizenry & Markets Activities Collect Relate Create Donate IdenticamPhotoDiary PhotoFinder PhotoMesa Album sharing StoryStarterFamily photo history PhotoFinder Kiosk PhotoWall PhotoFinder Webstarter PhotoQuiltPhoto sharing

37. Activities and Relationship Table (ART) Activities Collect Relate Create Donate Medical logDiary Find-a- Friend MusicListsFamily vacation history InfoDoors GatherEmail Send-a-Link WebBushes WorldWide Med Million person communities Medical diagnosis Tourist sharing Relationships Self Family & Friends Colleagues & Neighbors Citizenry & Markets

38. Takeaway Messages Mobile devices are huge opportunity  Small, fast & fun  Low-cost, easy-to-use, specific service Focusing on human needs will guide you to more successful product designs  Device User Interface Taxonomy (DUIT)  Activities & Relationship Table (ART)

39. Human-Computer Interaction Laboratory www.cs.umd.edu/hcil The old computing is about what computers can do, The New Computing is about what people can do

40. Takeaway Messages Design functions to serve human needs Usability + reliability to prevent frustration Engage users with fun  Alluring metaphors  Compelling content  Attractive graphics  Appealing animations  Satisfying sounds

41. Photo Annotation Annotating & repurposing photos in the Semantic Web context Retrieve by personal attributes:  name, date, topic?  age, country, organization??  weight, necksize, hair color????? Retrieve by mediated attributes:  numbers of papers/citations in WWW  other conferences they attended  names of students they supervised

42. Goals of Public Access Enable full participation by every citizen  Voting, social security services, passports, licenses, registrations, permits, recreation, state-county-city government services Offer services to many residents & visitors  Visa applications, tourism info, employment, healthcare, police, fire, education, training, museums, parks, libraries

43. Universal Usability Challenges Technology variety  Fast & slow modems, small & large displays  Diverse platforms, multiple versions User diversity  Novice & expert, old & young  Users with disabilities, poor literacy, or low motivation Bridge the gap between what users know and what they need to know  Multi-layer interfaces  Help vs. ShowMe!

44. Technology variety 1 to 100 range in processor speeds 286 486 Pentium 1 to 100 range in screen sizes Palm devices Laptops Large Desktop or Wall Display 30,000 480,000 3,840,000 pixels Software Versions Compatibility File conversion Multiple platforms Device Independence Input: keyboard, speech,... Output: visual, auditory,... Conversion 1 to 100 range in network bandwidth 9.6K 56K 10,000Kbps

45. User diversity: Accommodate all users Skills Computer newbie to hacker Knowledge Domain novice to expert Age Young to old Gender Male or Female Income Impoverished to wealhy Disabilities Visual, auditory, motoric, cognitive Disabling conditions Mobility, injury, noise, sunlight

46. Race Ethnicity Religion National Origin Literacy Fluent to illiterate Multiple languages Culture Western, Eastern, developing... Personality Introvert vs extravert Thinking vs feeling Risk aversion Locus of control Planful vs playful User diversity: Accommodate all users

47. Online help Context sensitive, tables of contents, Indexes, Keyword search, FAQs, answer gardens Gaps in User Knowledge-Strategies Bridge the gap between what users know and what they need to know Design Multi-Layered Task-oriented Training Fade-able scaffolding Training wheels Minimalist Online Learning (evolutionary, phased) Introductory tutorials Getting started manuals, Cue cards Walkthroughs/Demos Minimalist/Active

48. Community Newsgroups, online communities Chat rooms Customer service Email Phone Help desks Gaps in User Knowledge-Strategies Bridge the gap between what users know and what they need to know Supplements Online manuals, paper Audio, video, Live lecture, peer training, personal trainer

49. Public Access & Universal Usability Our Project Resources www.ils.unc.edu/govstat www.cs.umd.edu/hcil/newcomputing www.universalusability.org www.otal.umd.edu/uupractice Government Access www.usability.gov www.firstgov.gov www.fedstats.gov Guidelines www.usability.gov/pdfs/guidelines.html www.access-board.gov/sec508/status.htm

50. Designing the User Interface: 4 th Edition I: Introduction 1 Usability of Interactive Systems 2 Guidelines, Principles, and Theories II: Development Processes 3 Managing Design Processes 4 Evaluating Interface Designs 5 Software Tools III: Interaction Styles 6 Direct Manipulation and Virtual Environments 7 Menu Selection, Form Fillin, and Dialog Boxes 8 Command and Natural Languages 9 Interaction Devices 10 Collaboration IV: Design Issues 11 Quality of Service 12 Balancing Function and Fashion 13 User Manuals, Online Help, and Tutorials 14 Information Search and Visualization

51. Treemap – Monitoring www.hivegroup.com

52. Treemap – Gene Ontology www.cs.umd.edu/hcil/treemap/

53. Dynamometers & Inclinometers

54. Information Visualization The eye… the window of the soul, is the principal means by which the central sense can most completely and abundantly appreciate the infinite works of nature. Leonardo da Vinci (1452 - 1519)

55. PhotoMesa www.cs.umd.edu/hcil/photomesa

56. LifeLines www.cs.umd.edu/hcil/lifelines/

58. Treemap: Stock market, industry clustered

59. www.hivegroup.com Treemap – Product catalogs

60. Personal Medical Anxiety & Depression Asthma