Leonardo's Laptop: Human Needs and the New Computing Ben Shneiderman Founding Director ( ), Human-Computer Interaction Laboratory Professor, Department of Computer Science Member, Institutes for Advanced Computer Studies & Systems Research University of Maryland

Human-Computer Interaction Laboratory Interdisciplinary research community - Computer Science & Psychology - Information Studies & Education (

Scientific Approach (beyond user friendly) Z Specify users and tasks Z Predict and measure ] time to learn ] speed of performance ] rate of human errors human retention over time human retention over time Z Assess subjective satisfaction (Questionnaire for User Interface Satisfaction) Z Accommodate individual differences Z Consider social, organizational & cultural context

Design Issues Z Z Input devices & strategies ] ] Keyboards, pointing devices, voice ] ] Direct manipulation ] ] Menus, forms, commands Z Z Output devices & formats ] ] Screens, windows, color, sound ] ] Text, tables, graphics ] ] Instructions, messages, help Z Z Collaboration & communities Z Z Manuals, tutorials, training usableweb.com hcibib.org useit.com

Library of Congress Z Scholars, Journalists, Citizens Z Teachers, Students

Visible Human Explorer (NLM) Z Doctors Z Surgeons Z Researchers Z Students

NASA Environmental Data Z Scientists Z Farmers Z Land planners Z Students

Bureau of Census Z Economists, Policy makers, Journalists Z Teachers, Students

Leonardo da Vinci ( ) Renaissance Man Z Painter Z Inventor Z Visionary Z Mathematician Z Philosopher Z Engineer

Mona Lisa

Lady with Ermine & Leda with Swan

Last Supper Fresco

Remarkable Drawing Skill

Faces of Old Men

Anatomical Drawings

Machine Gun and Giant Crossbow

Why Leonardo Inspires Us He integrated - Scientific outlook - Practical technology - Artistic skill

Leonardo: An Inspirational Muse Three lessons: 1) Human needs drive innovation 2) Universal usability 3) Creativity support tools

Z Jefferson: Life, Liberty & the Pursuit of Happiness Z Roosevelt: Freedom of speech & expression, religion, from want, from fear Z Maslow: Hierarchy of human needs Physiological Safety Love Esteem Self-Actualization Covey: Living, Loving, Learning & Leaving a legacy 1) Human needs drive innovation

Spectrum of relationships Family & Friends (2-20 close intimates) Colleagues & Neighbors ( regular encounters) Members & Residents (1000-1,000,000 professionals or city residents ) Citizenry & Markets (larger communities)

Range of Activities Collect: Information Relate: Communication Create: Innovation Donate: Dissemination

Periodic table Relationships: Family & Friends Colleagues & Neighbors Members & Residents Citizenry & Markets Activities: Collect Relate Create Donate

Periodic table Relationships: Family & Friends Colleagues & Neighbors Members & Residents Citizenry & Markets Activities: Collect Relate Create Donate Skeptics corner - Arent relationships more complex - Are these useful activities?

Examples: Collecting information Relationships: Family & Friends Colleagues & Neighbors Members & Residents Citizenry & Markets Activities: Collect Relate Create Donate LifeLines InfoDoor InfoWall InfoWall WebBush WebBush

Examples: Relating to others Relationships: Family & Friends Colleagues & Neighbors Members & Residents Citizenry & Markets Activities: Collect Relate Create Donate Empathic support Neighbor.com Negotiated expectations Million person community

Examples: Creating a future Relationships: Family & Friends Colleagues & Neighbors Members & Residents Citizenry & Markets Activities: Collect Relate Create Donate Vacation plan Business strategy Urban renewal Policy manifesto

Examples: Disseminating & Leading Relationships: Family & Friends Colleagues & Neighbors Members & Residents Citizenry & Markets Activities: Collect Relate Create Donate Tell stories Teach kids Record events Train novices Report decisions Mentorship Preserve history Leadership

Human needs drive innovation Relationships: Family & Friends Colleagues & Neighbors Members & Residents Citizenry & Markets Activities: Collect Relate Create Donate Photo Finder ICQ Gather- round.com XXX.LANL Photo Quilt GlassEye Ebay Nasdaq Napster

2) Universal Usability 2) Universal Usability Z Z Problem: Confusion, frustration, and remorse dominate user experiences ] ] Survey of 6000 users finds 5.1 hours/week wasted ] ] Incompatible files, interfaces, networks, hardware ] ] Poorly designed websites lacking accessibility policy Z Z Solutions: ] ] Raise user expectations ] ] Conduct research ] ] Provide practical tools & methods

2) Universal Usability 2) Universal Usability Z Z Problem: Confusion, frustration, and remorse dominate user experiences ] ] Survey of 6000 users finds 5.1 hours/week wasted ] ] Incompatible files, interfaces, networks, hardware ] ] Poorly designed websites lacking accessibility policy Z Z Solutions: ] ] Raise user expectations ] ] Conduct research ] ] Provide practical tools & methods Skeptics corner - Dumbing down - Lowest common denominator

2) Universal Usability Z Z Problem: Confusion, frustration, and remorse dominate user experiences ] ] Survey of 6000 users finds 5.1 hours/week wasted ] ] Incompatible files, interfaces, networks, hardware ] ] Poorly designed websites lacking accessibility policy Z Z Solutions: ] ] Raise user expectations ] ] Conduct research ] ] Provide practical tools & methods

ACM Code of Ethics In a fair society, all individuals would have equal opportunity to participate in, or benefit from, the use of computer resources regardless of race, sex, religion, age, disability, national origin or other such similar factors.

Internet Use by Education Z Percent of U.S. Households Using the Internet Total U.S., Rural, Urban, and Central City Areas Falling Through the Net: Defining the Digital Divide

Internet Use by Income Z Percent of U.S. Households Using the Internet Total U.S., Rural, Urban, and Central City Areas Falling Through the Net: Defining the Digital Divide

Research Agenda Z Z Technology variety: Support broad range of hardware, software, and network access Z Z User diversity: Accommodate users with different skills, knowledge, age, gender, disabilities, disabling conditions (mobility, injury, noise, sunlight), literacy, culture, income, etc. Z Z Gaps in user knowledge: Bridge the gap between what users know and what they need to know Communications of the ACM, May 2000

Technology variety: Support broad range of hardware, software, and network access 1 to 100 range in processor speeds Pentium 1 to 100 range in screen sizes Palm devices Laptops Large Desktop or Wall Display 30, ,000 3,840,000 pixels Software Versions Compatibility File conversion Multiple platforms Device Independence Input: keyboard, speech,... Output: visual, auditory,... Conversion: Text-speech Speech-text,... 1 to 100 range in network bandwidth 9.6K 56K 10,000Kbps

Language & Culture Western, Eastern, developing... Personality Introvert vs extravert Thinking vs feeling Risk aversion Locus of control Planful vs playful User diversity: Accommodate different users Skills Computer newbie to hacker Knowledge Domain novice to expert Age Young to old Gender Male or Female Income Impoverished to wealthy Disabilities Visual, auditory, motoric, cognitive Disabling conditions Mobility, injury, noise, sunlight

Online help Context sensitive, tables of contents, Indexes, Keyword search, FAQs, Newsgroups, Chat rooms Online communities Gaps in User Knowledge - Strategies Bridge the gap between what users know and what they need to know Design Layered Level-structured Task-oriented Training Fade-able scaffolding Training wheels Minimalist Online Learning (evolutionary, phased) Introductory tutorials Getting started manuals, Cue cards Walkthroughs/Demos Minimalist/Active Customer service Phone Help desks

3) Creativity Support Tools 3) Creativity Support Tools Z More people, more creative, more of the time ] Revolutionary breakthroughs, paradigm shifts, H-creativity ] Evolutionary, normal science, music & art, creative knowledge work ] Impromptu everyday creativity

Eight Activities Z Z 1) Searching & browsing digital libraries Z Z 2) Consulting with peers & mentors Z Z 3) Visualizing data & processes Z Z 4) Thinking by free associations Z Z 5) Exploring solutions - What if tools Z Z 6) Composing artifacts & performances Z Z 7) Reviewing & replaying session histories 8) Disseminating results

Eight Activities Z Z 1) Searching & browsing digital libraries Z Z 2) Consulting with peers & mentors Z Z 3) Visualizing data & processes Z Z 4) Thinking by free associations Z Z 5) Exploring solutions - What if tools Z Z 6) Composing artifacts & performances Z Z 7) Reviewing & replaying session histories 8) Disseminating results Skeptics corner - Tools can limit imagination - Not everyone wants to be creative - Creativity can be malicious

3) Visualizing data & processes The eye… the window of the soul, is the principal means by which the central sense can most completely and abundantly appreciate the infinite works of nature. Leonardo da Vinci ( )

Information Visualization: Using Vision to Think Z Z Visual bandwidth is enormous ] ] Human perceptual skills are remarkable X X Trend, cluster, gap, outlier... X X Color, size, shape, proximity... ] ] Human image storage is fast and vast Z Z Opportunities ] ] Spatial layouts & coordination ] ] Information visualization ] ] Scientific visualization & simulation ] ] Telepresence & augmented reality ] ] Virtual environments

Information Visualization: Mantra Z Z Overview, zoom & filter, details-on-demand

Information Visualization: Data Types Z Z 1-D Linear Document Lens, SeeSoft, Info Mural, Value Bars Z Z 2-D Map GIS, ArcView, PageMaker, Medical imagery Z Z 3-D World CAD, Medical, Molecules, Architecture Z Z Multi-Dim Parallel Coordinates, Spotfire, XGobi, Visage, Influence Explorer, TableLens, DEVise Z Z Temporal Perspective Wall, LifeLines, Lifestreams, Project Managers, DataSpiral Z Z Tree Cone/Cam/Hyperbolic, TreeBrowser, Treemap Z Z Network Netmap, netViz, SeeNet, Butterfly, Multi-trees (Online Library of Information Visualization Environments) otal.umd.edu/Olive

Customer Histories

LifeLines

Treemap - view large trees 4 Space filling 4 Space limited 4 Color coding 4 Size coding - Requires learning (Shneiderman, ACM Trans. on Graphics, 1992) TreeViz (Mac, Johnson, 1992) NBA-Tree(Sun, Turo, 1993) Winsurfer (Teittinen, 1996) Diskmapper (Windows, Micrologic) Treemap97 (Windows, UMd)

Treemap - Stock market, clustered by industry

Leonardo da Vinci ( ) Three lessons: 1) Human needs drive innovation 2) Universal usability 3) Creativity support tools

ACM Conference on Universal Usability Washington, DC November 16-17,

Human-Computer Interaction Laboratory

For More Information Visit the HCIL website for 200 papers & info on videos ( Visit the HCIL website for 200 papers & info on videos ( See Chapter 15 on Info Visualization Shneiderman, B., Designing the User Interface: Strategies for Effective Human-Computer Interaction: Third Edition (1998) ( See Chapter 15 on Info Visualization Shneiderman, B., Designing the User Interface: Strategies for Effective Human-Computer Interaction: Third Edition (1998) ( Z January 1999 book of readings: Card, S., Mackinlay, J., and Shneiderman, B. Information Visualization: Using Vision to Think