1. NIIF HPC services for research and education
GPU Day 2015
Wigner Research Centre
Dr. Tamás Máray
NIIF Institute

2. Content
- The NIIF Institute
HPC infrastructure
HPC services
Access to the resources
PRACE

3. The NIIF Institute
NIIF stands for the National Information Infrastructure Development Institute of Hungary
NIIF Institute is a not-for-profit public organization
It is the Hungarian NREN, running the Hungarnet network
NIIF was founded in 1986, thus it is one of the oldest NRENs in Europe
It is a founding member of DANTE and TERENA (currently GEANT Association)
The user community of NIIF:
All universities and higher education institutes
All the academic research institutes
Nearly all the public collections (libraries, museums, archives)
All schools of Hungary
The number of client organizations is more than 5000

4. The NIIF Institute
NIIF designed, developed and operates a dark fiber based, DWDM backbone network covering the whole country
67 DWDM nodes, 80 lambdas/connection, 100Gbps/lambda max. speed
NIIF put into operation the very first 100 Gbps NREN service in Europe (for the CERN-Wigner datacenter)
NIIF has 3 datacenters and 6 supercomputers
NIIF provides 27 advanced services for the user organizations, among them: cloud, storage, HPC, multimedia, AAI, etc.
NIIF is a partner in many European R+D projects, including Geant, PRACE, EGI, Byte, etc.
The number of employees is about 100

5. The NIIF network

6. History of HPC at NIIF 2001 Sun E10k
60 Gflop/s
SMP architecture
96 UltraSparc processors
48 GB memory
Listed at TOP500 (rank 428.)
Upgrades in several steps (last in 2009)
Sun F15k
~900 Gflop/s
216 processor cores
400 GB memory

7. Today
Several supercomputers
Different architectures
Distributed setup (4 locations)
CPU + coprocessors
Several hundred Tflop/s total capacity
Storage in Pbyte range

8. Locations NIIF Institute, Budapest NIIF @ University of Debrecen
University of Pécs
University of Szeged

9. NIIF supercomputing services
High utilization
~200 user projects
Application areas:
chemistry, physics, biology, astrophysics, geology, information technology, mathematics, geophysics, engineering, hydrology, medical research, life sciences, meteorology, agro sciences, economics, etc.

10. Budapest 1. HP CP4000SL Fat node cluster architecture
AMD Opteron Magny-Cours processors
5 Tflop/s
768 cores (2.2 GHz)
24 core/node
Redundant Infiniband QDR interconnect
2 TB of memory
50 TB disk (Ibrix parallel FS)
Linux, RHEL
Water cooled racks

11. Budapest 2. HP SL250s Cluster architecture
Intel Xeon E GHz
32 Tflop/s
14 nodes, 2 CPU + 2 GPU / node
28 Nvidia K20X GPUs
20 core/node
Infiniband FDR interconnect
900 GB of memory
300 TB of disk (Lustre FS)
Linux, RHEL
Nvidia Quadro K5000 based visualization
Water cooled racks

12. Pécs SGI UltraViolet 1000 (UV) ccNUMA („SMP”) architecture
Intel Xeon Nehalem-EX processors
10.5 Tflop/s
1152 cores (2.66 GHz)
Numalink 5 interconnect
6 TB of memory
500 TB of disk
Linux, SLES11
Water cooled racks
Nvidia Quadro FX5800 based visualization

13. Szeged HP CP4000BL Fat node cluster architecture
AMD Opteron Magny-Cours processors
Tflop/s
2112 CPU cores (2.2 GHz)
48 cores/node (SMP node-ok)
12 Nvidia M2070 GPU boards
Redundant Infiniband QDR interconnect (mesh)
5 TB of memory
240 TB of disk (Ibrix parallel FS)
Linux, RHEL
Nvidia Quadro FX5800 based visualization

14. Debrecen 1. SGI Altix ICE 8400 Cluster architecture
Intel Westmere-EP processors
18 Tflop/s
1536 CPU cores (3.33 GHz)
Redundant Infiniband QDR interconnect
6 TB of memory
500 TB of disk
Linux, SLES11
Water cooled racks
Nvidia Quadro FX5800 based visualization

15. Debrecen 2. HP SL250s Cluster architecture
Intel Xeon E GHz
202 Tflop/s (listed on TOP500)
84 nodes, 2 CPU + 2 GPU /node
1344 CPU cores
168 x Nvidia K20X GPUs
Infiniband FDR interconnect
10 TB of memory
300 TB of disk (Lustre FS)
Linux, SLES11
Water cooled racks
Nvidia Quadro K6000 based visualization

16. NIIF HPC services Aggregated computing capacity: ~290 Tflop/s
Dedicated Nx10Gbps optical interconnection between the locations
NIIF storage service: 7 PBytes
Commercial application licenses (Matlab, Gaussian, Maple, Intel compilers, etc.)
User support
PRACE integration

17. Access to the resources
Open only for the NIIF community members (5000 organizations!)
Entirely dedicated to research and education
Only for non-commercial usage
Free of charge
Preliminary review of the subscriptions (project proposals)
Users must report periodically

18. PRACE Strategic program supported by the European Commission
Part of the European eInfrastructure

19. PRACE

20. PRACE
European HPC cooperation
A whole ecosystem of HPC resources and services, including education and training
PRACE research projects (1IP, 2IP, 3IP, 4IP)
Hierarchical infrastructure
World class resources
6 Tier-0 centres, and 23 Tier-1 centres

21. PRACE hierarchy

22. Thank you!
Dr. Tamás Máray
NIIF Institute