Large Scale Visualization Environment and Decision-Centered Visualization Cdr. Robert Barton Naval Undersea Warfare Center Newport, Rhode Island USA L. Miguel Encarnação and David Zeltzer Fraunhofer Center for Research in Computer Graphics, Inc. Providence, Rhode Island USA

SONAR SDC Visualization Multi-Dimensional, Low Signal-to-Noise Data Space -Range, Bearing, Frequency,Time Many Sensors  Data Overload Since End of Cold War, Naval Operations inVery Noisy Littoral Waters Is There a Better Way to Visualize SONAR Data?

1. Rapid Scan for Volumes of Interest 2. Select Volumes of Interest for Abstract Broadband Visualization LSVE USW Visualization 5. Select Another Volume of Interest 3. Multimodal and Multimedia for Detailed Analysis of Abstract Data GIST Harmonogram 4. Apply Visualization Tools & “Grams” to Examine Actual Data

Interactively Rotate and Zoom Visualize Volume of Interest

Spatially Probe with Sonification

Interactively View and Manipulate Actual Data

3D Interaction Technology Virtual Table Shutter glasses Transparent pad ‘Virtual Table’ Magnetic trackers Pen Projected pad Projected pen Projected object © 2002 Fraunhofer Center for Research in Computer Graphics, Inc.

Decision-Centered Visualization Fraunhofer Center for Research in Computer Graphics

Background Environmental Complexity, Fog of War -Littoral environments – sea, land, air -Friendly, hostile & neutral forces; air/surface/water craft Operational Restrictions – ROE Speed of Change -High speed weapons -Rapid, coordinated force deployment High Volume Data from Multiple Sources and Sensors Result — Information Overload!

Take-Away Message Information Overload? Can’t Just Push More Pixels at People Use Agents and Knowledge to Anticipate What People Need to Know Build Integrated, Intuitive Displays

Warfare Domain Knowledge Task & Decision Knowledge Real Time Data Anticipate Mission Info Area of Ops Info Friendlies Threats Agents Warn & Alert Missing Data Uncertain Data Time-Critical Data Mission-Critical Data “Behind” the Screen Display DCV Concept © 2002 Fraunhofer Center for Research in Computer Graphics, Inc.

Decision Focus Incoming Data Domain Abstractions Decision Requirements Domain Ontology Agents Monitor & Alert Automatic Tailoring Narrative Theory Presentation Manager Interaction Cycle View Control Interactive Commands & Queries Task Level Multimodal HMI Interaction Dialog Classify, Prioritize, Associate Incoming Data Association Engine Multimedia Displays DCV Architecture NUWC/CRCG LSVE © 2002 Fraunhofer Center for Research in Computer Graphics, Inc.

Warfare Domain Ontology What Are the Things and Actions in the World? How Do They Relate to Each Other? Decision Focus Domain Abstractions Decision Requirements Domain Ontology Agents Monitor & Alert Classify, Prioritize, Associate Incoming Data Association Engine Incoming Data

Domain Abstractions Application-Specific Instances of Ontology Concepts Decision Focus Domain Abstractions Decision Requirements Domain Ontology Agents Monitor & Alert Classify, Prioritize, Associate Incoming Data Association Engine Incoming Data

Doctrinal Task Organization Brigade Division Battalion Company Platoon Squad Unit type Home base Current location Readiness Resources Capabilities Strength Logistic support Combat support Weapons Equipment Infantry SA Domain Abstractions

Decision Requirements For a Given Decision, Information Needed to Make a Sound Decision Decision Focus Domain Abstractions Decision Requirements Domain Ontology Agents Monitor & Alert Classify, Prioritize, Associate Incoming Data Association Engine Incoming Data

Decision Focus Computer Inference of Intentions from Behavior Remains “Grand Challenge” For DCV, Decision Maker Explicitly Specifies Current Mission Event(s),Task(s) & Decision(s) Decision Focus Domain Abstractions Decision Requirements Domain Ontology Agents Monitor & Alert Classify, Prioritize, Associate Incoming Data Association Engine Incoming Data

Decision Centered Visualization Tasks Destroy Barricade Route Planning > Cross River > Cross Mine Field > Avoid Snipers NEXT No Objects Loaded! Mission About Prototype Decision Focus GUI Banja Luka, Bosnia

! ! Street Road condition: Good Nearest Enemy: Snipers Enemy Equip.:Assault rifles, Sub-mach. guns Bridge Bridge condition: Repositioned (15-20 min delay) Nearest Enemy: Snipers Enemy Equip.: Assault rifles, Sub-mach. guns Human Proposes Route DCV Suggests & Alerts Information Push/Pull “Smart Maps” for Infantry SA

Thank You!