NIIF HPC services for research and education GPU Day 2015 Wigner Research Centre 2015.05.20-21. Dr. Tamás Máray NIIF Institute

Content - The NIIF Institute HPC infrastructure HPC services Access to the resources PRACE

The NIIF Institute NIIF stands for the National Information Infrastructure Development Institute of Hungary NIIF Institute is a not-for-profit public organization It is the Hungarian NREN, running the Hungarnet network NIIF was founded in 1986, thus it is one of the oldest NRENs in Europe It is a founding member of DANTE and TERENA (currently GEANT Association) The user community of NIIF: All universities and higher education institutes All the academic research institutes Nearly all the public collections (libraries, museums, archives) All schools of Hungary The number of client organizations is more than 5000

The NIIF Institute NIIF designed, developed and operates a dark fiber based, DWDM backbone network covering the whole country 67 DWDM nodes, 80 lambdas/connection, 100Gbps/lambda max. speed NIIF put into operation the very first 100 Gbps NREN service in Europe (for the CERN-Wigner datacenter) NIIF has 3 datacenters and 6 supercomputers NIIF provides 27 advanced services for the user organizations, among them: cloud, storage, HPC, multimedia, AAI, etc. NIIF is a partner in many European R+D projects, including Geant, PRACE, EGI, Byte, etc. The number of employees is about 100

The NIIF network

History of HPC at NIIF 2001 Sun E10k 60 Gflop/s SMP architecture 96 UltraSparc processors 48 GB memory Listed at TOP500 (rank 428.) Upgrades in several steps (last in 2009) Sun F15k ~900 Gflop/s 216 processor cores 400 GB memory

Today Several supercomputers Different architectures Distributed setup (4 locations) CPU + coprocessors Several hundred Tflop/s total capacity Storage in Pbyte range

Locations NIIF Institute, Budapest NIIF @ University of Debrecen NIIF @ University of Pécs NIIF @ University of Szeged

NIIF supercomputing services High utilization ~200 user projects Application areas: chemistry, physics, biology, astrophysics, geology, information technology, mathematics, geophysics, engineering, hydrology, medical research, life sciences, meteorology, agro sciences, economics, etc.

Budapest 1. HP CP4000SL Fat node cluster architecture AMD Opteron Magny-Cours processors 5 Tflop/s 768 cores (2.2 GHz) 24 core/node Redundant Infiniband QDR interconnect 2 TB of memory 50 TB disk (Ibrix parallel FS) Linux, RHEL Water cooled racks

Budapest 2. HP SL250s Cluster architecture Intel Xeon E5-2680 v2 @ 2.80GHz 32 Tflop/s 14 nodes, 2 CPU + 2 GPU / node 28 Nvidia K20X GPUs 20 core/node Infiniband FDR interconnect 900 GB of memory 300 TB of disk (Lustre FS) Linux, RHEL Nvidia Quadro K5000 based visualization Water cooled racks

Pécs SGI UltraViolet 1000 (UV) ccNUMA („SMP”) architecture Intel Xeon Nehalem-EX processors 10.5 Tflop/s 1152 cores (2.66 GHz) Numalink 5 interconnect 6 TB of memory 500 TB of disk Linux, SLES11 Water cooled racks Nvidia Quadro FX5800 based visualization

Szeged HP CP4000BL Fat node cluster architecture AMD Opteron Magny-Cours processors 15 + 8 Tflop/s 2112 CPU cores (2.2 GHz) 48 cores/node (SMP node-ok) 12 Nvidia M2070 GPU boards Redundant Infiniband QDR interconnect (mesh) 5 TB of memory 240 TB of disk (Ibrix parallel FS) Linux, RHEL Nvidia Quadro FX5800 based visualization

Debrecen 1. SGI Altix ICE 8400 Cluster architecture Intel Westmere-EP processors 18 Tflop/s 1536 CPU cores (3.33 GHz) Redundant Infiniband QDR interconnect 6 TB of memory 500 TB of disk Linux, SLES11 Water cooled racks Nvidia Quadro FX5800 based visualization

Debrecen 2. HP SL250s Cluster architecture Intel Xeon E5-2650 v2 @ 2.60GHz 202 Tflop/s (listed on TOP500) 84 nodes, 2 CPU + 2 GPU /node 1344 CPU cores 168 x Nvidia K20X GPUs Infiniband FDR interconnect 10 TB of memory 300 TB of disk (Lustre FS) Linux, SLES11 Water cooled racks Nvidia Quadro K6000 based visualization

NIIF HPC services Aggregated computing capacity: ~290 Tflop/s Dedicated Nx10Gbps optical interconnection between the locations NIIF storage service: 7 PBytes Commercial application licenses (Matlab, Gaussian, Maple, Intel compilers, etc.) User support PRACE integration

Access to the resources Open only for the NIIF community members (5000 organizations!) Entirely dedicated to research and education Only for non-commercial usage Free of charge Preliminary review of the subscriptions (project proposals) Users must report periodically

PRACE Strategic program supported by the European Commission Part of the European eInfrastructure

PRACE

PRACE European HPC cooperation A whole ecosystem of HPC resources and services, including education and training PRACE research projects (1IP, 2IP, 3IP, 4IP) Hierarchical infrastructure World class resources 6 Tier-0 centres, and 23 Tier-1 centres

PRACE hierarchy

Thank you! Dr. Tamás Máray NIIF Institute