HPSS Update Jason Hick Mass Storage Group NERSC User Group Meeting September 17, 2007.

Slides:



Advertisements
Similar presentations
Jens G Jensen Atlas Petabyte store Supporting Multiple Interfaces to Mass Storage Providing Tape and Mass Storage to Diverse Scientific Communities.
Advertisements

Mainframe Replication and Disaster Recovery Services.
Applying Data Grids to Support Distributed Data Management Storage Resource Broker Reagan W. Moore Ian Fisk Bing Zhu University of California, San Diego.
File Transfer and Use of Clear Text Passwords Update NERSC Users Group Meeting Stephen Lau NERSC June 21, 2015.
What is it? Hierarchical storage software developed in collaboration with five US department of Energy Labs since 1992 Allows storage management of 100s.
Cloud Backup. Current Backup failures  Bad media (tapes have limited lifespan, HDD’s can fail)  Backup software fault  Operating system fault  Human.
1 Andrew Hanushevsky - HEPiX, October 6-8, 1999 Mass Storage For BaBar at SLAC Andrew Hanushevsky Stanford.
PetaByte Storage Facility at RHIC Razvan Popescu - Brookhaven National Laboratory.
Data Preservation Best Practices for preserving your research data for future reuse The goal of data preservation is to ensure that your data is in a sustainable.
Page 1 CITS Active Directory Implementation UMass Dartmouth.
Moving to Win 7 Considerations Dean Steichen A2CAT 2010.
Mass RHIC Computing Facility Razvan Popescu - Brookhaven National Laboratory.
Data Deduplication in Virtualized Environments Marc Crespi, ExaGrid Systems
HEPIX 3 November 2000 Current Mass Storage Status/Plans at CERN 1 HEPIX 3 November 2000 H.Renshall PDP/IT.
Security The Kingsway School. Accidental Data Loss Data can be lost or damaged by: Hardware failure such as a failed disk drive Operator error e.g. accidental.
1 A Basic R&D for an Analysis Framework Distributed on Wide Area Network Hiroshi Sakamoto International Center for Elementary Particle Physics (ICEPP),
DMF Configuration for JCU HPC Dr. Wayne Mallett Systems Manager James Cook University.
CC - IN2P3 Site Report Hepix Fall meeting 2009 – Berkeley
Virtualization in the NCAR Mass Storage System Gene Harano National Center for Atmospheric Research Scientific Computing Division High Performance Systems.
Information Collection, Storage and Sharing. The use of computers have made it easier than before, to collect, store and share large amounts of information.
Demystifying Deduplication. Global SMB Event Marketing 2 APPROACH: What is deduplication? Eliminate redundant data Start with the backup environment as.
Viruses, Computer Security & Ethical Issues Digital Communication Systems Ms. Powers.
Preventing Common Causes of loss. Common Causes of Loss of Data Accidental Erasure – close a file and don’t save it, – write over the original file when.
Lower Storage projects Alexander Moibenko 02/19/2003.
GStore: GSI Mass Storage ITEE-Palaver GSI Horst Göringer, Matthias Feyerabend, Sergei Sedykh
20-22 September 1999 HPSS User Forum, Santa Fe CERN IT/PDP 1 History  Test system HPSS 3.2 installation in Oct 1997 IBM AIX machines with IBM 3590 drives.
Agenda and NDGF status Olli Tourunen HIP-NDGF meeting CSC, May 7 th 2007.
TRC Mini-Grant 2002 Dell PowerEdge 2500 Server. Project Goals Provide CS students with exposure to Linux (Unix) computing environment in CS courses Provide.
Tape logging- SAM perspective Doug Benjamin (for the CDF Offline data handling group)
SLAC Site Report Chuck Boeheim Assistant Director, SLAC Computing Services.
Fermi National Accelerator Laboratory SC2006 Fermilab Data Movement & Storage Multi-Petabyte tertiary automated tape store for world- wide HEP and other.
LCG Phase 2 Planning Meeting - Friday July 30th, 2004 Jean-Yves Nief CC-IN2P3, Lyon An example of a data access model in a Tier 1.
HPSS for Archival Storage Tom Sherwin Storage Group Leader, SDSC
Jefferson Lab Site Report Sandy Philpott Thomas Jefferson National Accelerator Facility Newport News, Virginia USA
O AK R IDGE N ATIONAL L ABORATORY U.S. D EPARTMENT OF E NERGY Facilities and How They Are Used ORNL/Probe Randy Burris Dan Million – facility administrator.
CLASS Information Management Presented at NOAATECH Conference 2006 Presented by Pat Schafer (CLASS-WV Development Lead)
Jefferson Lab Site Report Sandy Philpott Thomas Jefferson National Accelerator Facility (formerly CEBAF - The Continuous Electron Beam Accelerator Facility)
Test Results of the EuroStore Mass Storage System Ingo Augustin CERNIT-PDP/DM Padova.
Private and Personal Cloud Examining the options of private and personal cloud SharePoint Saturday Calgary Presented Jun Version 1.1.
UK Tier 1 Centre Glenn Patrick LHCb Software Week, 28 April 2006.
December 26, 2015 RHIC/USATLAS Grid Computing Facility Overview Dantong Yu Brookhaven National Lab.
Storage Why is storage an issue? Space requirements Persistence Accessibility Needs depend on purpose of storage Capture/encoding Access/delivery Preservation.
Randy MelenApril 14, Stanford Linear Accelerator Center Site Report April 1999 Randy Melen SLAC Computing Services/Systems HPC Team Leader.
RHIC/US ATLAS Tier 1 Computing Facility Site Report Christopher Hollowell Physics Department Brookhaven National Laboratory HEPiX Upton,
January 30, 2016 RHIC/USATLAS Computing Facility Overview Dantong Yu Brookhaven National Lab.
Trials and Tribulations of a Small Archive Presented at the THIC Conference, NCAR, Boulder CO June 30, 2004 Presented at the THIC Meeting at the National.
S AN D IEGO S UPERCOMPUTER C ENTER N ATIONAL P ARTNERSHIP FOR A DVANCED C OMPUTATIONAL I NFRASTRUCTURE 6 TB SSA Disk StorageTek Tape Libraries 830 GB MaxStrat.
Mass Storage at SARA Peter Michielse (NCF) Mark van de Sanden, Ron Trompert (SARA) GDB – CERN – January 12, 2005.
What was done for AR4. Software developed for ESG was modified for CMIP3 (IPCC AR4) Prerelease ESG version 1.0 Modified data search Advance search Pydap.
BNL dCache Status and Plan CHEP07: September 2-7, 2007 Zhenping (Jane) Liu for the BNL RACF Storage Group.
1 5/4/05 Fermilab Mass Storage Enstore, dCache and SRM Michael Zalokar Fermilab.
ETERE A Cloud Archive System. Cloud Goals Create a distributed repository of AV content Allows distributed users to access.
Patrick Gartung 1 CMS 101 Mar 2007 Introduction to the User Analysis Facility (UAF) Patrick Gartung - Fermilab.
Jefferson Lab Site Report Kelvin Edwards Thomas Jefferson National Accelerator Facility Newport News, Virginia USA
ORNL is managed by UT-Battelle for the US Department of Energy OLCF HPSS Performance Then and Now Jason Hill HPC Operations Storage Team Lead
BACKUP AND RESTORE. The main area to be consider when designing a backup strategy Which information should be backed up Which technology should be backed.
High Performance Storage System (HPSS) Jason Hick Mass Storage Group HEPiX October 26-30, 2009.
STORAGE DEVICES Towards the end of this unit you will be able to identify the type of storage devices and their storage capacity.
PC Farms & Central Data Recording
CC - IN2P3 Site Report Hepix Spring meeting 2011 Darmstadt May 3rd
Demystifying Deduplication
SAM at CCIN2P3 configuration issues
Test C : IBM Enterprise Storage Technical Support V5
STORAGE DEVICES Towards the end of this unit you will be able to identify the type of storage devices and their storage capacity.
STORAGE DEVICES Towards the end of this unit you will be able to identify the type of storage devices and their storage capacity.
NERSC Reliability Data
San Diego Supercomputer Center
National Energy Research Scientific Computing Center (NERSC)
LTO Cartridge native (uncompressed) capacity, Interchangeability and Maximum tape drive native data transfer speeds Tape Drive Operation Generation 1 cartridge.
DriveHQ Online Backup Easy, secure, automatic
Presentation transcript:

HPSS Update Jason Hick Mass Storage Group NERSC User Group Meeting September 17, 2007

NERSC User Group Meeting, September 17, HPSS Overview 8 x 9310 STK Powderhorns Backup HPSS –15 x 9840 tape drives –12 x 9940B tape drives –16 x T10K tape drives –24 TB of disk User HPSS –24 x 9840 tape drives –26 x 9940B tape drives –27 TB of disk User transfers go to disk

NERSC User Group Meeting, September 17, Hardware upgrades - bandwidth & capacity improvements HPSS Backup/Regent system –16ea 4Gb T10K drives 500 GB/cart, 120 MB/s –4Gb DDN TB, 380 MB/s HPSS User/Archive system –4Gb DDN TB, 380 MB/s Both systems –upgraded several mover machines –upgrading HPSS metadata disk

NERSC User Group Meeting, September 17, Software upgrades - availability improvements NGF-HPSS integration is still in development and several years away from production Upgrading HPSS from version 5.1 to 6.2 –eliminates our dependence on DCE –reduces need to take frequent planned outages –new HPSS account/password management process no more ssh to auth.nersc.gov working to integrate with NIM continue to allow regular ftp access with encrypted string in.netrc file password expiration –non-HPSS specific password, but would expire –HPSS specific password, would not have to expire or contact NERSC user services if HPSS password expiration would present significant challenges to you/your