Cross Council ICT Conference May High Performance Computing Ron Perrott Chairman High End Computing Strategy Committee Queen’s University Belfast

Cross Council ICT Conference May A high performance computer is a hardware and software system that provides close to the maximum performance that can currently be achieved. => parallelism => state of the art technology => pushing the limits What is a high performance computer? Why do we need them? Computational fluid dynamics, protein folding, climate modeling, national security, in particular for cryptanalysis and for simulation, etc. Economy, security, health and well-being of the country. => Scientific discovery => Social impact => Commercial potential

Cross Council ICT Conference May HPC – UK Important to research in many scientific disciplines Increasing breadth of science involved High UK HPC international activities Contributions to and benefits for UK industry

Cross Council ICT Conference May UK projects Atomic, Molecular & Optical Physics Computational Biology Computational Radiation Biology and Therapy Computational Chemistry Computational Engineering - Fluid Dynamics Environmental Modelling Cosmology Particle Physics Fusion & Plasma Microturbulence Accelerator Modelling Nanoscience Disaster Simulation => computation has become as important as theory and experiment in the conduct of research

Cross Council ICT Conference May Whole systems Electronic Structure - from atoms to matter Computational Biology - from molecules to cells and beyond Fluid Dynamics - from eddies to aircraft Environmental Modelling - from oceans to the earth From the earth to the solar system ? ……And on to the Universe

Cross Council ICT Conference May Technology Trends: Microprocessor Capacity 2X transistors/Chip Every 1.5 years Called “Moore’s Law ” Microprocessors have become smaller, denser, and more powerful. Not just processors, bandwidth, storage, etc. 2X memory and processor speed and ½ size, cost, & power every 18 months. Gordon Moore, co- founder of Intel 1965 Number of devices/chip doubles every 18 months

Cross Council ICT Conference May J. Dongarra - Listing of the 500 most powerful Computers in the World - Yardstick: LINPACK Ax=b, dense problem - Updated twice a year SC‘xy in the States in November Meeting in Mannheim, Germany in June - All data available from

Cross Council ICT Conference May Scalar Super Scalar Vector Parallel Super Scalar/Vector/Parallel Moore’s Law (Floating Point operations / second, Flop/s) ,000 (1 KiloFlop/s, KFlop/s) , , ,000,000 (1 MegaFlop/s, MFlop/s) ,000, ,000, ,000,000,000 (1 GigaFlop/s, GFlop/s) ,000,000, ,000,000, ,000,000,000,000 (1 TeraFlop/s, TFlop/s) ,000,000,000, ,000,000,000,000 (35 TFlop/s) (10 3 ) (10 6 ) (10 9 ) (10 12 ) (10 15 )

Cross Council ICT Conference May TOP500 – Performance - Nov 2003 Laptop (10 15 ) (10 12 ) (10 9 )

Cross Council ICT Conference May Earth Simulator Homogeneous, Centralized, Proprietary, Expensive! Target Application: CFD-Weather, Climate, Earthquakes 640 NEC SX/6 Nodes (mod) –5120 CPUs which have vector ops –Each CPU 8 Gflop/s Peak 40 TFlop/s (peak) ~ 1/2 Billion £ for machine, software, & building Footprint of 4 tennis courts 7 MWatts –Say 10 cent/KWhr - $16.8K/day = $6M/year! Expect to be on top of Top500 until TFlop ASCI machine arrives From the Top500 (November 2003)

Cross Council ICT Conference May HPC Trends Over the last 10 years the range for the Top500 has increased greater than Moore’s Law 1993: –#1 = 59.7 GFlop/s –#500 = 422 MFlop/s 2003: –#1 = 35.8 TFlop/s –#500 = 403 GFlop/s

Cross Council ICT Conference May November 2003 ManufacturerComputer Rmax Tflop/s Installation SiteYear# Proc Rpeak Tflop/s 1 NECEarth-Simulator35.8 Earth Simulator Center Earth Simulator Center Yokohama Hewlett- Packard ASCI Q - AlphaServer SC ES45/1.25 GHz 13.9 Los Alamos National Laboratory Los Alamos National Laboratory Los Alamos Self Apple G5 Power PC w/Infiniband 4X 10.3 Virginia Tech Blacksburg, VA Dell PowerEdge 1750 P4 Xeon 3.6 Ghz w/Myrinet 9.82 University of Illinois U/C Urbana/Champaign Hewlett- Packard rx2600 Itanium2 1 GHz Cluster – w/Quadrics 8.63 Pacific Northwest National Laboratory Pacific Northwest National Laboratory Richland Linux NetworX Opteron 2 GHz, w/Myrinet 8.05 Lawrence Livermore National Laboratory Lawrence Livermore National Laboratory Livermore Linux NetworX MCR Linux Cluster Xeon 2.4 GHz – w/Quadrics 7.63 Lawrence Livermore National Laboratory Lawrence Livermore National Laboratory Livermore IBMASCI White, Sp Power3 375 MHz7.30 Lawrence Livermore National Laboratory Lawrence Livermore National Laboratory Livermore IBMSP Power3 375 MHz 16 way7.30NERSC/LBNL NERSC/LBNL Berkeley IBM xSeries Cluster Xeon 2.4 GHz – w/Quadrics 6.59 Lawrence Livermore National Laboratory Lawrence Livermore National Laboratory Livermore % of top500 performance in top 9 machines; 131 system > 1 TFlop/s; 210 machines are clusters

Cross Council ICT Conference May Performance Extrapolation TFlop/s To enter the list PFlop/s Computer Blue Gene 130,000 proc ASCI P 12,544 proc

Cross Council ICT Conference May Taxonomy Special purpose processors and interconnect High Bandwidth, low latency communication Designed for scientific computing Relatively few machines will be sold High price Commodity processors and switch Processors design point for web servers & home pc’s Leverage millions of processors Price point appears attractive for scientific computing Capability ComputingCluster Computing

Cross Council ICT Conference May UK Facilities Main centres in Manchester Edinburgh and Daresbury Smaller centres around UK

Cross Council ICT Conference May HPCx Edinburgh and CCLRC IBM 1280 processor POWER4 Currently 3.5 Tflop/s to 6.0 Tflop/s, July October 2006 up to 12.0 Tflop/s

Cross Council ICT Conference May CSAR University of Manchester/Computer Sciences Corporation 256 Itanium2 processor SGI Altix (Newton) - Jun 2006; peak performance of 5.2 Gflop/s 512 processor Origin3800 ( Green)- Jun 2006

Cross Council ICT Conference May Hector – High End Computing Terascale Resource Scientific Case Business case Peak performance of 50 to 100 Tflop/s by 2006, doubling to 100 to 200 Tflop/s after 2 years, and doubling again to 200 to 400 Tflop/s 2 years after that. Oak Ridge National Laboratory 100 Tflop/s in Tflop/s in 2007

Cross Council ICT Conference May ANL UK US – Teragrid HPC-Grid Experiment TeraGyroid: Lattice-Boltzmann simulations of defect dynamics in amphiphilic liquid crystals

Cross Council ICT Conference May TeraGyroid - Project Partners Teragrid sites at: –ANL Visualization, Networking –NCSA Compute –PSC Compute, Visualization –SDSC Compute Reality Grid partners: –University College London Compute, Visualization, Networking –University of Manchester Compute, Visualization, Networking –Edinburgh Parallel Computing Centre Compute –Tufts University Compute UK High-End Computing Services –HPCx -University of Edinburgh and CCLRC Daresbury Laboratory Compute, Networking, Coordination –CSAR -Manchester and CSC Compute and Visualization

Cross Council ICT Conference May TeraGyroid - Results Linking these resources allowed computation of the largest set of lattice-Boltzmann (LB) simulations ever performed, involving lattices of over one billion sites Won SC03 HPC Challenge for “Most Innovative Data-Intensive Application” Demonstrated extensive use of the US UK infrastructure