National Computational Science Alliance A Review of User Projects at the Alliance Leading Edge Site Opening Talk to the Alliance Allocation Board Hosted by the Maui High Performance Computing Center, Maui, Hawaii, December 5, 1998.

National Computational Science Alliance The National PACI Program - Partners and Supercomputer Users 850 Projects in 280 Universities 60 Partner Universities

National Computational Science Alliance PITAC Draft Refinement of High-End Acquisition Recommendation Fund the Acquisition of the Most Powerful High-End Computing Systems to Support Long Term Basic Research in Science and Engineering Access for (Highest Priority): –ALL Academic Researchers –ALL Disciplines –ALL Universities Access for (Second Priority): –Government Researchers –Industrial Researchers

National Computational Science Alliance Emerging Multi-Agency Effort to Create a Persistent National Technology Grid NSF Establishes PACI Program DOE Raises the Bar –ASCI and SSP –Data and Visualization Corridors DoE Discussing with NSF: –How to Get Highest-End Capacity –PACI ET and AT Teams Linking to ASCI, SSP NASA and NSF on Information Power Grid DoD Mod. PET Innovating Infrastructure NIH Seen As Critical Partner

National Computational Science Alliance Deputy Director Bordogna on NSF Leadership in Information Technologies Three Important Priorities for NSF in the Area of IT for the Future: –The First Area Is Fundamental and High-Risk IT Research and Advanced Computation Research. –The Second Priority Area for NSF Is Competitive Access and Use of High-end Computing and Networking. –The Third Priority Is Investing in IT Education at All Levels. Congressional Testimony 10/6/98

National Computational Science Alliance NCSA is Combining Shared Memory Programming with Massive Parallelism Doubling Every Nine Months! Challenge Power Challenge Origin SN1

National Computational Science Alliance The Rapid Increase in High End Capacity at NCSA Millions of NUs Used at NCSA FY93 to FY98

National Computational Science Alliance NCSA Users by System - SGI Origin Takes Off! Sep94 Nov94Jan95 Mar95 May95 Jul95 Sep95 Nov95Jan96 Mar96 May96 Jul96 Sep96 Nov96Jan97 Mar97 May97 Jul97 Sep97 Nov97Jan98 Mar98 May98 Jul98 Sep98 Number of Users SGI Power Challenge Array CM5 Convex C3880 Convex Exemplar Cray Y-MP Origin SPP-2000 C3880 (retired 10/95) SPP-1200 Y-MP (retired 12/94) Origin SPP-2000 CM-5 (retired 1/97) PCA (retired 7/98) (retired 5/98)

National Computational Science Alliance Distribution of Project Size at NCSA in FY98 Super Medium Large Small Tiny AAB SAC NRAC

National Computational Science Alliance NCSA Has Greatly Increased High-End Capacity

National Computational Science Alliance Little Percentage Change in Shares Over Five Years

National Computational Science Alliance Migration of NCSA User Distribution Toward the High End +400% +350% +114% -27% -79% Number of Projects

National Computational Science Alliance Let’s Blow This Up! The Growth Rate of the National Capacity is Slowing Down Again Source: Quantum Research

National Computational Science Alliance Major Gap Has Developed in National Usage at NSF Supercomputer Centers Projection

National Computational Science Alliance Fastest Machine in Top500 vs. Fastest Machine in NSF Supercomputer Centers Source: ACIR, NSF

National Computational Science Alliance Alliance Efforts to Increase Capacity and Capability Alliance LES –Took Early Delivery of 5th and 6th 128p Origin in June ‘98 –Just Ordered 256 SSI Origin to Complete 1024p –Goal is Production by March ‘99 –Hardening the 256p NT Supercluster for Selected Users –May Upgrade HP Exemplar to HPUX V-Series –Sun E10000 Data Mining Server? Alliance PACS –Allocating up to 1 Million SUs in FY99 –LES/PACS Discussions on: –Linux Intel Superclusters at Maui –Combining HPs at U Kentucky –Linux/NT Compaq (DEC) Alpha SMP Cluster at BU –Grid Alpha/Beta Testbed in CIC

National Computational Science Alliance The Transformation of an Industry in Five Years- TOP500 Systems by Vendor TOP500 Reports:

National Computational Science Alliance Cycles Used by NSF Community at the NSF Supercomputer Centers by Vendor SGI SN1 is the Natural Upgrade for 84% of Cycles! June 1, 1997 through May 31, 1998 CTC, NCSA, PSC, SDSC 1019 Projects Using 100% of the Cycles T3D/E Origin/PC C/T90

National Computational Science Alliance Clustered Shared Memory Architecture –Will Dominate for 5-10 Years –Builds on Market Supported Segments Scalability Has Acquired Two Dimensions –Parallelism of Shared Memory Nodes –Number of Shared Nodes in Cluster New Challenges for Supercomputing Users –Memory Hierarchies –Fault Tolerance –Hybrid Programming Models Capability Computing Will Be Done on Scalable Clusters of Shared Memory Modules

National Computational Science Alliance Most Capacity in High End Computing Will Be Local The Emerging Wintel Supercomputer Linux, NT Scalable Clusters Condor, Symera LANs of Workstations Harvesting the Web

National Computational Science Alliance 128 Hewlett Packard 300 MHz 64 Compaq 333 MHz Andrew Chien, CS UIUC-->UCSD Rob Pennington, NCSA Reagan Moore, SDSC Plan to Link UCSD & UIUC Clusters “Supercomputer performance at mail-order prices”-- Jim Gray, Microsoft PACI Fostering Commodity Computing Various Applications Sustain 7 GF on 128 Processors

National Computational Science Alliance Solving 2D Navier-Stokes Kernel - Performance of Scalable Systems Preconditioned Conjugate Gradient Method With Multi-level Additive Schwarz Richardson Pre-conditioner (2D 1024x1024) Danesh Tafti, Rob Pennington, NCSA; Andrew Chien (UIUC, UCSD) Various Applications Sustaining 7 GF on 128 Processors NT Supercluster

National Computational Science Alliance QCD Performance on Various High End Computers Doug Toussaint and Kostas Orginos, University of Arizona Conjugate Gradient Calculation of Quark Propagators in QCD With Kogut-Susskind Quarks

National Computational Science Alliance User Web Browser Output to User User Input Format Translator, Query Engine and Program Driver Workbench Server Results to User User Instructions and queries Application Programs (May have varying interfaces and be written in different languages) Results Instructions Information Sources (May be of varying formats) Information Queries NCSA Computational Biology Group The NCSA Information Workbench - An Architecture for Web-Based Computing

National Computational Science Alliance Structure & Function Pathways & Physiology Populations & Evolution Ecosystems Genomes Gene Products Using a Web Browser to Run Programs and Analyze Data Worldwide NCSA Biology Workbench Has Over 10,000 Users From Over 25 Countries