National Energy Research Scientific Computing Center (NERSC) HEPiX PDSF Site Report Cary Whitney NERSC Center Division, LBNL Oct 11, 2005
Changes Moved from LSF to SGE now running 6.0 release 4. Starting to look at SL4, what has been others experience. Shane Canon, PDSF Lead, has accepted a job at Oak Ridge. Cary Whitney, taking over the lead. CHOS, still a using and Shane’s still supporting, working on 2.6 version. On ESnet Bay Area MAN, 10Gb connection On ScienceNet 10Gb connection
Changes Continue USB serial console sFlow network monitoring Jumbo network One-time-passwords
Filesystems Installed Lustre 1.2.4 in two volumes. Just started moving to GPFS, one volume currently. TsiaLun – the center-wide filesystem also running GPFS, thus synergy there. NERSC, SDSC and HPSS consortium working on HSM support in GPFS. Positives: Aggregate bandwidth a plus. No NFS Negative: GPFS: Cost. But LSF costs where comparable. Lustre: Still a little green.
New Systems Jaquard DaVinci Accepted it. 360 node dual Opterons IB connected (Mellanox) PBSpro DDN Storage 30TB GPFS filesystem (Local and TsiaLun) DaVinci 32 cpu Altix GPFS mount from TsiaLun.
Fun Stuff Power outages Unplanned Planned Planned again City of Oakland Planned Support for the coming system (.5MW extra) Planned again For the system to come (approach capacity of feed ~5MW) No planned unplanned power outages at this time!