HPC at IISER Pune Neet Deo System Administrator

About IISER The Indian Institute of Science Education and Research Pune is a premier indian institute dedicated to research and teaching in the basic sciences. Established in As a unique initiative in science education in India, IISER aims to be a Science University of the highest caliber devoted to both teaching and research in a totally integrated manner, with state-of-the-art research and high quality education, thus nurturing both curiosity and creativity.

IISER The computing facility and IT infrastructure at IISER Pune caters to all the faculty, students and staff. The institute has a good number of server and workstation class computers for various system administration services. This is apart from the large number of PCs and workstations that serve the personal computing requirements

High Performance Cluster IISER Pune has a 6 Tera FLOP high-performance computing cluster primarily used by faculty and research students This system has 512 cores spread over 64 nodes with 18 GB RAM per node and Infiniband interconnect In addition, there 3 mini-clusters with number of cores ranging from 60 to 100

HPC - details  64 nodes – each with quad core 2 * Intel(R) Xeon(R) CPU 2.93GHz 18 GB RAM  OS – RHEL 5.5  10 TB raw storage. RAID 5, Gluster, over NFS  CMS – ROCKS  Scheduler – PBS  Interconnect – IB DDR

HPC – challenges  initially it was ext4 FS over NFS – installed glusterfs  number of users increased from 30  high memory requirement  GPU users – 2 such users  raw power requirement  data backup  Less manpower to manage infrastructure

Expansion Plans IISER Pune has plans to expand its HPC to 4000 cores. The plan is under discussion We are in the process for developing specs so as to satisfy computing needs and also address the problems that we face in current setup Major design aspects under discussion are  4GB per core memory or 8GB  Parallel file system  Accelerators - GPU / Mic / both  Interconnect speed  System sizing – fat memory nodes, SMP node  Aggregating current resources  Opensource vs commercial software

Thank you!! Questions?