National Computational Science Alliance Bringing Science to the Grid Keynote Talk at the High Performance Distributed Computing Conference in Chicago, IL. July 29,1998

National Computational Science Alliance The Emerging Concept of a National Scale Information Power Grid

National Computational Science Alliance The Grid Links People with Distributed Resources on a National Scale

National Computational Science Alliance The National Technology Grid Will Integrate the Alliance What is a Grid? –Nodes (Computers, People, Instruments) –Links (Local to Global Networks) –Data (Text, Datasets, Images, Video, etc.) –Software (OS, WWW, Middleware, Applications) –Human Interface (Screens to CAVEs) Many Grid Projects Underway –NSF PACI –NASA Information Power Grids –DOE Data and Visualization Corridors

National Computational Science Alliance The Grid: Blueprint for a New Computing Infrastructure Ian Foster, Carl Kesselman (Eds), Morgan Kaufmann, 1999 Available July 1998; ISBN chapters by expert authors including: –Andrew Chien, –Jack Dongarra, –Tom DeFanti, –Andrew Grimshaw, –Roch Guerin, –Ken Kennedy, –Paul Messina, –Cliff Neuman, –Jon Postel, –Larry Smarr, –Rick Stevens, –and many others “A source book for the history of the future” -- Vint Cerf

National Computational Science Alliance NSF vBNS and PACI - Mutually Interdependent NPACI NCSA Alliance Both NCSA Alliance and NPACI Other High Performance Connection sites Current vBNS “Backbone” sites

National Computational Science Alliance FY99 Qwest Nationwide Network - Backbone for Internet2 Abilene - More Links Source: Randy Butler, NCSA Qwest Partnering with Cisco and Nortel

National Computational Science Alliance Technologies Scientists Need In the Grid Middleware Multimedia Integration Collaboration Frameworks Digital Libraries Web / Object Universal User Interface Distributed Object Environments for Programs & Data Scalable I/O Distributed Parallel Shared Memory Computers Portable Programming Models for Same Remote Visual Steering of Computers & Instruments Tele-Immersion

National Computational Science Alliance Globus Ubiquitous Supercomputing Testbed (GUSTO) PACI Middleware for the Grid GII Next Generation Winner SF Express--NPACI/Alliance DoD Mod. Demonstration –Largest Distributed Interactive Simulation Ever Performed NASA IPG Most Recent Funding Addition

National Computational Science Alliance Globus Wins the Next Generation GII Award Carl Kesselman and Ian Foster in Tux Accepting the GII Next Generation Award

National Computational Science Alliance Integrating Digital Video With the Grid Digital Video Server Internet, vBNS Application Teams Create Digital Video Animation Concurrently with Supercomputing Interactive Virtual Environments Individual Desktops Desktop Video Conferencing

National Computational Science Alliance Grid Enabled Workshop and Training Facilities Being Deployed Across the Alliance Jason Leigh and Tom DeFanti, EVL; Rick Stevens, ANL

National Computational Science Alliance Distance Education - Using JAVA Plug-ins to Web Browsers Source: Geoffrey Fox, NPAC/Syracuse; DoD Army CEWES

National Computational Science Alliance ARPANETInternetInterspace SERVICES Distributed Files Global Hypermedia Distributed Objects Global Semantics FUNCTIONAccessOrganization Analysis UNITSPacketsFilesLinksObjectsConcepts Distributed Paths Categories PROTOCOLSIPFTP HTTP CORBACP SMP The Third Wave of Net Evolution Bruce Schatz (

National Computational Science Alliance The NSF PACI Program - Using Scientific Applications To Drive the Grid

National Computational Science Alliance How Application Teams Drive the Grid Development Multidiscipline Domains Multiscale Interactions Complex Geometries Full-up Virtual Prototyping Large Scale Optimization Bioinformatics –Web Based Workbench Cosmology –Metacomputing Nanomaterials –Distributed Objects Scientific Instruments –Remote Supertelescopes Chemical Engineering –Linking Sensors with Models Environmental Hydrology –Tele-Immersion

National Computational Science Alliance User Web Browser Output to User User Input Format Translator, Query Engine and Program Driver Workbench Server Results to User User Instructions and queries Application Programs (May have varying interfaces and be written in different languages) Results Instructions Information Sources (May be of varying formats) Information Queries NCSA Computational Biology Group The NCSA Information Workbench - An Architecture for Web-Based Computing

National Computational Science Alliance The NCSA Biology Workbench - Web Computing with Distributed Datasets Powered by SGI Origin Supercomputer

National Computational Science Alliance Using the Grid to Create a National-Scale Metacomputer Source: John Dubinski, Norman, M.L., Beckman, P., Bryan, G., Dubinski, J., Gannon, D., Hernquist, L., Keahey, K., Ostriker, J.P., Shalf, J, Welling, J, & Yang, S. 1996, International Journal of Supercomputing Applications NCSA: TMC CM-5 / SGI Power Challenge PSC: Cray C90/T3D CTC: IBM SP-2 I-WAY ‘95 Multi-Expert Multi-Institutional Team

National Computational Science Alliance Quantum Simulations Using WebFlow - a High Level Visual Interface for Globus E. Akarsu, G. Fox, W. Furmanski, T.Haupt (NPAC, Syracuse U), L. Mitas (NCSA) Now Co-Funded by Sun Microsystems

National Computational Science Alliance The Grid Links Remote Sensors With Supercomputers, Controls, & Digital Archives Starburst Galaxy M82 Creating Remote Super Instruments –Radio Astronomy and Biomedicine –Collaborative Web Interface –Real Time Control and Steering Alliance Scientific Instrument Applications Team

National Computational Science Alliance ProcessData ProcessModel Plant-wide Control Measurements and Experimental Design Parameter Estimation Process ControlSignals Using the Grid to Optimize Chemical Plant Operations Grid Coupling: Sensors Networks Data HPC Models Controls Alliance Chemical Engineering Applications Team

National Computational Science Alliance Goal-Create Collaborative Interface to Link Multiple Investigators With the Grid ReactorSimulationReactorSimulation InteractiveDiscussionInteractiveDiscussion DetailedVisualizationDetailedVisualization Current parameters in solution Current Status of Simulation Simulation Ken Bishop, U Kansas Using NCSA Habanero

National Computational Science Alliance Mesh Data HDF 5 Parallel I/O Fast Access Other Sci. Data Efficient Storage ASCI applications Other Scientific applications ASCI Red Blue Pacific Blue Mountain Other Platforms Need for Scalable I/O and Data Portability Scientific Data Management

National Computational Science Alliance The Evolution of Shared Memory Parallel & Distributed Computing Vector SMPs to Microprocessor SMPs to Clustered Microprocessor SMPs to Microprocessor DSMs to Clustered Microprocessor DSMs

National Computational Science Alliance From Single DSM to Clusters of DSMs By 1999: NCSA will have 6 x x 64 processors But Los Alamos ASCI Blue Mountain Will Have 48 x 128!

National Computational Science Alliance Portable Computing Models Data Parallel –CM Fortran, HPF, HPC++ –Advantage: Portability –Disadvantage: Incomplete & Non-Uniform Grids Distributed Memory Programming –PVM and MPI –Advantages: Portable, Data Locality, Good Scaling –Disadvantage: Complexity of Programming Shared Memory Programming –Compiler & Explicit Parallel Directives, OpenMP –Advantage: Programming Simplicity –Disadvantage: Data Placement and Poor Scaling Hybrids of MPI and OpenMP

National Computational Science Alliance Limitations of Uniform Grids for Complex Scientific and Engineering Problems Source: Greg Bryan, Mike Norman, NCSA 512x512x512 Run on 512-node CM-5 Gravitation Causes Continuous Increase in Density Until There is a Large Mass in a Single Grid Zone

National Computational Science Alliance Use of Shared Memory Adaptive Grids To Achieve Dynamic Load Balancing Source: Greg Bryan, Mike Norman, John Shalf, NCSA 64x64x64 Run with Seven Levels of Adaption on SGI Power Challenge, Locally Equivalent to 8192x8192x8192 Resolution

National Computational Science Alliance 192 Hewlett Packard 300 MHz 64 Compaq 333 MHz Andrew Chien, CS UIUC-->UCSD Rob Pennington, NCSA Myrinet Network, HPVM, Fast Messages Microsoft NT OS, MPI API “Supercomputer performance at mail-order prices”-- Jim Gray, Microsoft Racks of PCs - Beowulf, NOW, NT Superclusters

National Computational Science Alliance Solving 2D Navier-Stokes Kernel - Performance of Scalable Systems Source: Danesh Tafti, NCSA Preconditioned Conjugate Gradient Method With Multi-level Additive Schwarz Richardson Pre-conditioner (2D 1024x1024)

National Computational Science Alliance Near Perfect Scaling of Cactus - 3D Dynamic Solver for the Einstein GR Equations Ratio of GFLOPs Origin = 2.5x NT SC Paul Walker, John Shalf, Rob Pennington, Andrew Chien NCSA Cactus was Developed by Paul Walker, MPI-Potsdam UIUC, NCSA

National Computational Science Alliance NEC SX-5 –32 x 16 vector processor SMP –512 Processors –8 Gigaflop Peak Processor IBM SP –256 x 16 RISC Processor SMP –4096 Processors –1 Gigaflop Peak Processor SGI Origin Follow-on –32 x 128 RISC Processor DSM –4096 Processors –1 Gigaflop Peak Processor High-End Architecture Scalable Clusters of Shared Memory Modules Each is 4 Teraflops Peak

National Computational Science Alliance The Killer Application for the Grid - Collaborative Tele-Immersion CAVE ImmersaDesk Image courtesy: Electronic Visualization Laboratory, UIUC Different Physical Implementations of the Alliance CAVE Software Libraries

National Computational Science Alliance Using Intranet Technologies to Form Alliance Electronic Communities CAVE and ImmersaDesk Systems Hypernews Forums User Lists Application Galleries Shared Programs

National Computational Science Alliance 3-D 2-D Source: The Grid Enables Remote Visual Supercomputing - Coupling an ImmersaDesk with a Remote Supercomputer Source: Ed Seidel, MPI-Potsdam, NCSA

National Computational Science Alliance Remote Visual Steering of Supercomputing Example Combustion C-SAFE SCIRun Network Chris Johnson, SCI, Univ. of Utah

National Computational Science Alliance Quantitative Visual Analysis - Using CRUMBS on Human Spine CAT Scan LBL: Tom Budinger, Thomas Schoenemann, Jonathan Maltz NCSA: Rachael Brady, Clint Potter Alliance Scientific Instrument Team

National Computational Science Alliance Global Collaboration and Tele-Immersion Enabled by EVL CAVERNsoft Supercomputing ’97 NICE Persistent Simulation Avatars Doing Hokey Pokey 17 sites Source: Jason Leigh, Andy Johnson, EVL, Tom Coffin, NCSA

National Computational Science Alliance Goal-Analyze and Record Complex Data sets Using Interactive Virtual Environments Donna Cox, Robert Patterson, Stuart Levy, Marcus Thiebaux, Virtual Director Team Glenn Wheless, Cathy Lascara, Old Dominion Univ. Cave5d Enables Interactive Visualizations of Time-Varying, 3-Dimensional Vis5d Data Sets in CAVE Environments

National Computational Science Alliance Avatars Show Head & Hand Pointing in Shared Virtual Space Donna Cox, Robert Patterson, Stuart Levy

National Computational Science Alliance Goal-Create Shared Virtual Environment CVD -- Collaborative Virtual Director ImmersaDesk CAVEPower WallDesktop Donna Cox, Robert Patterson, Stuart Levy, NCSAVirtual Director Team Glenn Wheless, Old Dominion Univ.

National Computational Science Alliance Java 3D API HPC Application: VisAD Environ. Hydrology Team, (Bill Hibbard, Wisconsin) Steve Pietrowicz, NCSA Java Team Standalone or CAVE-to-Laptop-Collaborative Goal-Linking the CAVE to the Desktop: Collaborative Java3D NASA IPG is Adding Funding To Collaborative Java3D

National Computational Science Alliance A Working Model-Caterpillar’s Collaborative Virtual Prototyping Environment Data courtesy of Valerie Lehner, NCSA Real Time Linked VR and Audio-Video Between NCSA and Germany Using SGI Indy/Onyx and HP Workstations