The Eyes Have It! User Interfaces for Information Visualization Ben Shneiderman Founding Director ( ), Human-Computer Interaction Lab Professor, Department of Computer Science Member, Institutes for Advanced Computer Studies & Systems Research University of Maryland College Park, MD 20742

Human-Computer Interaction Laboratory Interdisciplinary research community - Computer Science & Psychology - Information Studies & Education (

User Interface Design Goals Cognitively comprehensible: Consistent, predictable & controllable Affectively acceptable: Mastery, satisfaction & responsibility NOT: Adaptive, autonomous & anthropomorphic

Scientific Approach (beyond user friendly) Specify users and tasks Predict and measure time to learn speed of performance rate of human errors human retention over time Assess subjective satisfaction (Questionnaire for User Interface Satisfaction) Accommodate individual differences Consider social, organizational & cultural context

Design Issues Input devices & strategies Keyboards, pointing devices, voice Direct manipulation Menus, forms, commands Output devices & formats Screens, windows, color, sound Text, tables, graphics Instructions, messages, help Collaboration & communities Manuals, tutorials, training hcibib.org useit.com

U.S. Library of Congress Scholars, Journalists, Citizens Teachers, Students

Visible Human Explorer (NLM) Doctors Surgeons Researchers Students

NASA Environmental Data Scientists Farmers Land planners Students

Bureau of the Census Economists, Policy makers, Journalists Teachers, Students

NSF Digital Government Initiative Find what you need Understand what you Find Census, NCHS, BLS, EIA, NASS, SSA

International Children’s Digital Libary

Zooming User Interfaces

Zooming User Interfaces: DateLens

Information Visualization The eye… the window of the soul, is the principal means by which the central sense can most completely and abundantly appreciate the infinite works of nature. Leonardo da Vinci ( )

Using Vision to Think Visual bandwidth is enormous Human perceptual skills are remarkable Trend, cluster, gap, outlier... Color, size, shape, proximity... Human image storage is fast and vast Opportunities Spatial layouts & coordination Information visualization Scientific visualization & simulation Telepresence & augmented reality Virtual environments

Information Visualization: Definition Compact graphical presentation AND user interface for manipulating large numbers of items ( ), possibly extracted from far larger datasets. Enables users to make discoveries, decisions, or explanations about patterns (trend, cluster, gap, outlier...), groups of items, or individual items.

Information Visualization: US Research Centers Xerox PARC 3-D cone trees, perspective wall, spiral calendar table lens, hyperbolic trees, document lens Univ. of Maryland dynamic queries, range sliders, starfields, treemaps, timeboxes, zoombars tight coupling, dynamic pruning, lifelines IBM, Microsoft, AT&T Georgia Tech, MIT Media Lab Univ. of Wisconsin, Minnesota, Calif-Berkeley Pacific Northwest National Labs

Treemap: Stock market, industry clustered

Treemap: Product catalogs

Treemap: Monitoring

Treemap: Gene Ontology

LifeLines

PhotoMesa

Leonardo’s Laptop The old computing is about what computers can do, The New Computing is about what people can do mitpress.mit.edu/leonardoslaptop

An Inspirational Muse: Leonardo da Vinci ( ) Renaissance Man Combined science & art Integrated engineering & esthetics Balanced technology advances & human values Merged visionary & practical

ZUI: Pocket PhotoMesa

Information Visualization: Design Guidelines Direct manipulation strategies Visual presentation of query components Visual presentation of results Rapid, incremental and reversible actions Selection by pointing (not typing) Immediate and continuous feedback Reduces errors Encourages exploration

Visualization Toolkits

Information Visualization: Mantra Overview, zoom & filter, details-on-demand

Information Visualization: Data Types 1-D Linear Document Lens, SeeSoft, Info Mural, Value Bars 2-D Map GIS, ArcView, PageMaker, Medical imagery 3-D World CAD, Medical, Molecules, Architecture Multi-Dim Parallel Coordinates, Spotfire, XGobi, Visage, Influence Explorer, TableLens, DEVise Temporal Perspective Wall, LifeLines, Lifestreams, Project Managers, DataSpiral Tree Cone/Cam/Hyperbolic, TreeBrowser, Treemap Network Netmap, netViz, SeeNet, Butterfly, Multi-trees (Online Library of Information Visualization Environments) otal.umd.edu/Olive

LifeLines: Patient Histories

LifeLines: Customer Histories Temporal data visualization Medical patient histories Customer relationship management Legal case histories

Temporal Data: TimeSearcher 1.3 Time series Stocks Weather Genes User-specified patterns Rapid search

Temporal Data: TimeSearcher 2.0 Long Time series (>10,000 time points) Multiple variables Controlled precision in match (Linear, offset, noise, amplitude)

Hyperbolic Tree

Treemap: view large trees with node values + Space filling + Space limited + Color coding + Size coding - Requires learning (Shneiderman, ACM Trans. on Graphics, 1992) TreeViz (Mac, Johnson, 1992) NBA-Tree(Sun, Turo, 1993) Winsurfer (Teittinen, 1996) Diskmapper (Windows, Micrologic) Treemap3 (Windows, UMd, 2001)

Treemap: Stock market, clustered by industry

Treemap: Product catalogs

Treemap: Monitoring

Treemap: Newsmap

Treemap: Gene Ontology

Treemap: Daily Production Reports 691 wells grouped by Asset team. Size = barrels of oil produced per day Color = “lost” oil (difference between actual and expected)

Projects grouped by owner and type. Size = gross budget Color = funds above or below budget Treemap: Project Management

Spacetree + Familiar & animated + Space limited + Focuses attention - Requires some learning

Hierarchical Clustering Explorer

Information Visualization: Tasks Overview Gain an overview of the entire collection Zoom Zoom in on items of interest Filter Filter out uninteresting items Details-on-demand Select an item or group and get details when needed Relate View relationships among items History Keep a history of actions to support undo, replay, and progressive refinement Extract Allow extraction of sub-collections and of the query parameters

Leonardo da Vinci ( ) Renaissance Man Painter Inventor Visionary Mathematician Philosopher Engineer MIT Press, 2003

Upcoming Events October 10-12, 2004 IEEE Information Visualization Symposium Austin, TX Information Visualization Contest

Upcoming Events July th International Conference on Information Visualisation - London January 17-18, 2005 SPIE Visual Data Analysis Symposium San Jose, CA Asia Pacific Information Visualization www/

AudioMap: Sonification Motivation: improve vision-impaired users’ access to geo-referenced statistical data Approach: interactive sonification Tie spatial sound to areas to create a virtual map Data-to-sound mapping: Piano pitch -> value. Can be followed by short string pitch -> vertical position Interactions for auditory information seeking Gist (overview): spatial sweeping Navigation: state-by-state exploration Details-on-demand: name & value spoken on request Pilot user study (9 sighted subjects) Users can recognize some geographical patterns Users preferred spatial audio map over table

For More Information Visit the HCIL website for 350 papers & info on videos Conferences & resources: See Chapter 14 on Info Visualization Shneiderman, B. and Plaisant, C., Designing the User Interface: Strategies for Effective Human-Computer Interaction: Fourth Edition (April 2004) Edited Collections: Card, S., Mackinlay, J., and Shneiderman, B. (1999) Readings in Information Visualization: Using Vision to Think Bederson, B. and Shneiderman, B. (2003) The Craft of Information Visualization: Readings and Reflections

For More Information Treemaps HiveGroup: Smartmoney: HCIL Treemap 4.0: Spotfire: TimeSearcher: Hierarchical Clustering Explorer: