Page : 1 SC2004 Pittsburgh, November 12, 2004 DEISA : integrating HPC infrastructures in Europe DEISA : integrating HPC infrastructures in Europe Victor Alessandrini IDRIS – CNRS

Page : 2 SC2004 Pittsburgh, November 12, 2004 Distributed European Infrastructure for Supercomputing Applications Consortium of leading national supercomputing centres:

Page : 3 SC2004 Pittsburgh, November 12, 2004 DEISA Technology Partners GEANT – DANTE (European Research Network) RENATER (French National Research Network) DFN (German National Research Network) GARR (Italian National Research Network) IBM (wide area network GPFS) UNICORE Consortium …

Page : 4 SC2004 Pittsburgh, November 12, 2004 DEISA : objectives To deploy and operate a persistent, production quality, distributed supercomputing environment with continental scope To enable scientific discovery across a broad spectrum of science and technology. Scientific impact (enabling new science) is the only criterion for success. DEISA contributes to a significant enhancement of capabilities and capacities of high performance computing (HPC) in Europe, by the integration of leading national supercomputing infrastructures. DEISA provides to scientific users transparent access to an European pool of computing resources. The coordinated operation of this environment is tailored to provide enhanced computing power and resources to users, and to enable new, ground breaking applications in computational sciences.

Page : 5 SC2004 Pittsburgh, November 12, 2004 Requirements and strategies for the Research Infrastructure Fast deployment of a persistent, production quality, grid empowered supercomputing infrastructure with continental scope. European supercomputing service built on top of existing national services (reliability, non disruptive behavior) User transparency, application transparency Top-bottom approach: technology choices follow from the business and operational models of virtual organizations. DEISA technology choices are fully open. Two level operation: Deep integration and highly coupled operation of homogeneous platforms: promoting cluster software to super-cluster middleware Looser federation of heterogeneous platforms: heterogeneous grid of supercomputers and super-clusters.

Page : 6 SC2004 Pittsburgh, November 12, 2004 GEANT IBM AIX distributed super-cluster Vector systems (NEC, …) Linux systems (SGI, IBM, …)

Page : 7 SC2004 Pittsburgh, November 12, 2004 Global File Systems Sophisticated software environment, needed to provide single system image of a clustered computing platform They provide global data management. Data in the GFS is « symmetric » with respect to all computing nodes GPFS encapsulates complex distributed computing technologies Applications do not need to be modified to benefit from GPFS services.

Page : 8 SC2004 Pittsburgh, November 12, 2004 The AIX DEISA super-cluster (phase 1) VPN connecting computing platforms on NRENs – GEANT infrastructures. Global, high performance, distributed file system with continental scope (GPFS). Dynamic pool of resources processors, 24 Teraflops of integrated computing power

Page : 9 SC2004 Pittsburgh, November 12, 2004 DEISA – Phases 1 (Q1 2005) and 2 (Q ) Phase 1: AIX Super-Cluster: 4000 processors (5 to 8 Gf per processor) 24 Teraflops integrated peak performance 125 cabinets spread over 3 countries (Germany, France, Italy) IBM systems : 690, 690+, 655+ Diversified configurations Phase 2 ( Q3 2005): Incorporation of other sites (CSC, SARA) and other partners. heterogeneous extension (SARA Linux ALTIX SGI platform to start, vector platforms, …) Higher VPN bandwidth (10 Gb or more across platforms). The Geant2 infrastructure is critical for DEISA.

Page : 10 SC2004 Pittsburgh, November 12, 2004 Operation of AIX super-cluster « The speed of light is not bigh enough » (Tom DeFanti, GGF8). MPI communication latencies between Paris and Helsinki are in the milisecond range (instead of a few microseconds). These latencies are not acceptable for demanding, tightly coupled massive parallel aplications which require high performance. Job migration is a bandwidth issue. DEISA uses job migration in the AIX super- cluster to manage workload at a European scale and release significant resources for one application in one site. Co-scheduling and metacomputing will onbly be used in some selected cases of weakly coupled multi-physics applications.

Page : 11 SC2004 Pittsburgh, November 12, 2004 Heterogeneous Supercomputing Grid Workflow management: UNICORE plus further extensions and services coming from DEISA’s JRA7 and other projects (UniGrids, …) Global data management: a detailed architecture is being defined, based partly on extended global file systems on heterogeneous systems, partly on OGSA base services. Scheduling: some reliable and stable implementation of advanced reservation or co-scheduling is needed for Grid aplications running on the heterogeneous environment. Science Gateways and portals: specific Internet interfaces to hide complex supercomputing environments from end users, and facilitate the access of new, non traditional, scientific communities.

Page : 12 SC2004 Pittsburgh, November 12, 2004 New scientific challenges Besides “early users”, DEISA will try very hard to promote “exceptional users”. DEISA intends to enable a portfolio of new, “flagship” scientific applications. These are huge, ground breaking applications in computational physics that could not operate without the DEISA environment, and that will benefit from exceptional computational resources from the Consortium. A European call for proposals in in preparation.

Page : 13 SC2004 Pittsburgh, November 12, 2004 Conclusions DEISA adopts Grid technologies to integrate national supercomputing infrastructures, and to provide an European Supercomputing Service. This includes service activities supported by the coordinated action of the national center's staffs. DEISA operates as a virtual European supercomputing centre. The big challenge ahead is to enable new, first class computational science. Using Grid technologies to integrate and interface IT systems is the way to go to create a new research dimension in Europe.