LBNL Visualization Group Research Snapshot Wes Bethel Lawrence Berkeley National Laboratory Berkeley, CA 24 Feb 2004.

Slides:



Advertisements
Similar presentations
-Grids and the OptIPuter Software Architecture Andrew A. Chien Director, Center for Networked Systems SAIC Chair Professor, Computer Science and Engineering.
Advertisements

Current Testbed : 100 GE 2 sites (NERSC, ANL) with 3 nodes each. Each node with 4 x 10 GE NICs Measure various overheads from protocols and file sizes.
Presentation at WebEx Meeting June 15,  Context  Challenge  Anticipated Outcomes  Framework  Timeline & Guidance  Comment and Questions.
Science-Driven Visualization Research Challenges 9 Nov 2004 SC2004 – Pittsburgh PA Wes Bethel with help from Friends at Lawrence Berkeley National Laboratory.
© University of Strathclyde Assessing Aesthetic Quality Martin Fitchie University of Strathclyde.
Xingfu Wu Xingfu Wu and Valerie Taylor Department of Computer Science Texas A&M University iGrid 2005, Calit2, UCSD, Sep. 29,
1 Cyberinfrastructure Framework for 21st Century Science & Engineering (CF21) IRNC Kick-Off Workshop July 13,
To Err is Human Computational Limits to Human Thinking : Implications for the Design of Human Centered Interfaces Raj Reddy Carnegie Mellon University.
Thin Servers with Smart Pipes: Designing SoC Accelerators for Memcached Bohua Kou Jing gao.
May 17, Capabilities Description of a Rapid Prototyping Capability for Earth-Sun System Sciences RPC Project Team Mississippi State University.
SWE Introduction to Software Engineering
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
1 NERSC User Group Business Meeting, June 3, 2002 High Performance Computing Research Juan Meza Department Head High Performance Computing Research.
Virtual Workbenches Richard Anthony The University of Greenwich
Tools and Services for the Long Term Preservation and Access of Digital Archives Joseph JaJa, Mike Smorul, and Sangchul Song Institute for Advanced Computer.
Grand Challenges Robert Moorhead Mississippi State University Mississippi State, MS 39762
Panel Summary Andrew Hanushevsky Stanford Linear Accelerator Center Stanford University XLDB 23-October-07.
Connecting Networks © 2004 Cisco Systems, Inc. All rights reserved. Exploring How TCP/IP Works INTRO v2.0—4-1.
CASE Tools And Their Effect On Software Quality Peter Geddis – pxg07u.
1 Building National Cyberinfrastructure Alan Blatecky Office of Cyberinfrastructure EPSCoR Meeting May 21,
NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE Discovery Environments Susan L. Graham Chief Computer Scientist Peter.
Software Product Line Testing Part I : Introduction
Texas A&M University Page 1 9/16/ :22:47 PM Wei Zhao Texas A&M University Is Computer Stuff Science, Engineering, or Something else?
Parallel Processing CS453 Lecture 2.  The role of parallelism in accelerating computing speeds has been recognized for several decades.  Its role in.
Visualization Group March 8 th, Visualization Group Permanent staff: –Wes Bethel (group leader) –John Shalf, Cristina Siegerist, Raquel Romano Collaborations:
Scalable Analysis of Distributed Workflow Traces Daniel K. Gunter and Brian Tierney Distributed Systems Department Lawrence Berkeley National Laboratory.
1 Computer Programming (ECGD2102 ) Using MATLAB Instructor: Eng. Eman Al.Swaity Lecture (1): Introduction.
N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER 1 NERSC Visualization Greenbook Workshop Report June 2002 Wes Bethel LBNL.
SCIRun and SPA integration status Steven G. Parker Ayla Khan Oscar Barney.
The Electronic Virtual University in Your Future Council of Scientific Society Presidents Douglas Van Houweling President & CEO -- UCAID.
CLUSTER COMPUTING TECHNOLOGY BY-1.SACHIN YADAV 2.MADHAV SHINDE SECTION-3.
Futures Lab: Biology Greenhouse gasses. Carbon-neutral fuels. Cleaning Waste Sites. All of these problems have possible solutions originating in the biology.
Framework for MDO Studies Amitay Isaacs Center for Aerospace System Design and Engineering IIT Bombay.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou
ICCS WSES BOF Discussion. Possible Topics Scientific workflows and Grid infrastructure Utilization of computing resources in scientific workflows; Virtual.
ESFRI & e-Infrastructure Collaborations, EGEE’09 Krzysztof Wrona September 21 st, 2009 European XFEL.
CSE 102 Introduction to Computer Engineering What is Computer Engineering?
Information Technology in the Natural Sciences Biology – Chemistry – Physics.
VAPoR: A Discovery Environment for Terascale Scientific Data Sets Alan Norton & John Clyne National Center for Atmospheric Research Scientific Computing.
Marv Adams Chief Information Officer November 29, 2001.
Computational Science & Engineering meeting national needs Steven F. Ashby SIAG-CSE Chair March 24, 2003.
1 1 Office of Science Jean-Luc Vay Accelerator Technology & Applied Physics Division Lawrence Berkeley National Laboratory HEP Software Foundation Workshop,
1 OFFICE OF ADVANCED SCIENTIFIC COMPUTING RESEARCH The NERSC Center --From A DOE Program Manager’s Perspective-- A Presentation to the NERSC Users Group.
1 Flexible, High-Speed Intrusion Detection Using Bro Vern Paxson Computational Research Division Lawrence Berkeley National Laboratory and ICSI Center.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.
VisPortal Project developer’s experience C.E.Siegerist, J. Shalf, E.W. Bethel NERSC/LBNL Visualization Group T.J. Jankun-Kelley, O. Kreylos, K.L. Ma CIPIC/UC.
Experiences with the QWEST/SCinet Bandwidth Challenge John Shalf, Wes Bethel LBNL.
ComPASS Summary, Budgets & Discussion Panagiotis Spentzouris, Fermilab ComPASS PI.
Lawrence H. Landweber National Science Foundation SC2003 November 20, 2003
National Energy Research Scientific Computing Center (NERSC) Visportal : interface to grid enabled NERC resources Cristina Siegerist NERSC Center Division,
Packet Size optimization for Supporting Coarse-Grained Pipelined Parallelism Wei Du Gagan Agrawal Ohio State University.
Tackling I/O Issues 1 David Race 16 March 2010.
Fault Tolerant Routing in Mobile Ad hoc Networks Yuan Xue and Klara Nahrstedt Computer Science Department University of Illinois.
O. Giustolisi, L. Berardi, D. Laucelli Technical University of Bari, Bari (Italy)
Resource Optimization for Publisher/Subscriber-based Avionics Systems Institute for Software Integrated Systems Vanderbilt University Nashville, Tennessee.
1 Nicholas Vidovich Software Developer Battelle Memorial Institute Intuitive, Interactive Data Visualization Applications Not for distribution or publication.
Internet2 Applications & Engineering Ted Hanss Director, Applications Development.
1 Supporting a Volume Rendering Application on a Grid-Middleware For Streaming Data Liang Chen Gagan Agrawal Computer Science & Engineering Ohio State.
1 Visual Computing Institute | Prof. Dr. Torsten W. Kuhlen Virtual Reality & Immersive Visualization Till Petersen-Krauß | GUI Testing | GUI.
VisIt Project Overview
Architecture and Algorithms for an IEEE 802
CCP4 6.1 and beyond: Tools for Macromolecular Crystallography
Brian Matthews STFC EOSCpilot Brian Matthews STFC
Resource Allocation in a Middleware for Streaming Data
Resource Allocation for Distributed Streaming Applications
Defining the Grid Fabrizio Gagliardi EMEA Director Technical Computing
Overview of Networking
Computer Services Business challenge
Presentation transcript:

LBNL Visualization Group Research Snapshot Wes Bethel Lawrence Berkeley National Laboratory Berkeley, CA 24 Feb 2004

Outline Overview: —Group Profile —What is Scientific Visualization? Why is it significant in the scientific process? Case Studies: —Geosciences —Computational Biochemistry —Remote and Distributed Visualization Challenges and Future Directions

Profile Group formed in 1990 to help accelerate science at LBNL (Stellar GS-1000, Ardent Titan). —Earth Sciences focus, Virtual Reality and interactive techniques. Arrival of NERSC in 1996 added production visualization to activity portfolio. —Increased focus on remote and distributed visualization. —Acute challenges of very large scientific data. Personnel —Three to five full-time staff. —Two UC Davis faculty with appointments. —Rotating herd of four to six students.

Role of Visualization in Science Visualization provides the means to “see” data in order to create the opportunity for scientific insight. Data is often abstract, dimensionless, and unfamiliar. Rapid exploration of large and complex data sets. Find “interesting things,” serendipitous browsing, “Ah-Ha!” and “Uh, what’s that?” discoveries. Communicate findings to colleagues, funders and the public. Something doesn’t “look right” in this picture – what happened? Data Visualization Display

Case Study: Earth Sciences Project: Interactive visualization of simulation results (UTCHEM), coupled with Virtual Reality tools. (Movie) (Movie) Objective: reduce time-to-solution (understanding) through a combination of human-in-the-loop and interactive technologies. Spinoff projects: Advanced Computational Technology Initiative (ACTI), LDRD (Pruess, et. al, visualization of simulation results; geohydrodynmics and reactive chemistry).

Case Studies: Computational Biochemistry Protein Folding Problem: what is the minimal-energy structure of a sequence of amino acids? Solution: Nature knows, but computing an answer is NP-hard (not solvable). Approach: Human-guided setup, computer-aided energy optimization and minimization. Conf: Pred: HHHHHHHCCCEEEEEEECCCEEEEEEEECCCCCCC AA: FKQYANDNGVDGVWTYDDATKTFTVTEMVTEVPVA

Computational Biochemisty, ctd. Given: an amino acid sequence, Find: an optimal protein conformation.

Computational Biochemistry, ctd.

Optimization and computational steering Initial configurations used as “seed points” for optimization. Intermediate results – the “search tree” – is displayed for inspection. A human may intervene in the optimization.

Computational Biochemistry, ctd. Visualization of Energy During Optimization Movie

High Performance Remote and Distributed Visualization: Visapult Motivation: remote and interactive visualization of large scientific data over a wide area network. Framework and application for remote direct volume visualization of large structured mesh data. Interactive performance on desktop completely divorced from network bandwidth via Image Based Rendering techniques. Architecture: Source Volume O(n**3) O(n**2) Data Visualization Display

Visapult – Wins SC Bandwidth Challenge Three Years in a Row – Undefeated Champion! SC00 – Dallas TX. 1.54Gbps peak rate. 582Mbps sustained. Single OC/48 line (2.48Gbps). 1.5Gbps “bottleneck” over Qwest. 100% peak efficiency. 33% sustained efficiency.

Visapult, SC2001 Redesign to use UDP – connectionless 3.3Gbps sustained. OC48 (2.48Gbps) + 2x OC12 (1.48 Mbps) 83% sustained efficiency.

Visapult, SC2002 Tuning the connectionless protocol for better efficiency. Improvements in visualization capabilities. Large, multinational team: US, Netherlands, Czech Republic. 2x OC-192 (10Gbps), 1x OC-48 (2.48Gbps).

Visapult SC2002, ctd Gbps sustained. 75% efficiency Didn’t have enough remote resources to fill all available network pipes.

Visapult Discussion UDP vs. TCP: UDP is “lossy,” while TCP guarantees delivery of packets. How does “lossiness” combined with our progressive update algorithm affect usability?

Visapult Discussion, ctd. Technically, Visapult was a success: —High performance remote visualization of large scientific data with a novel latency tolerant algorithm. Practically, there are some issues: —Manual launching of multiple components. —Diagnosing and repairing network problems. —Not a practical end-user tool.

Future Directions Visportal: simplifies user access to distributed, component-based tools. Optimizing dynamic placement of components in the visualization pipeline. Integration of disparate visualization resources: —Interface definitions —Data model standards Effective remote and distributed visualization: —Workflow analysis. —Visualization algorithms. —Data management issues.

Challenges Given: User needs: (1) easy to use software, (2) that is free, (3) that is supported (and actually works), (4) institutional support for visualization, (5) new visualization capabilities, (6) support for remote and distributed operations, etc. Challenges: For many modern computational science projects, there exists no “canned” visualization solution. Tools must be created. Such efforts require expertise in a wide range of specialties: computer science, software engineering, cognitive science, people skills, etc. Creating such tools requires close and ongoing effort between researchers of many disciplines. Few, if any, “standards” to help provide a stable environment for visualization.

The End