Jisc Tiered Storage Overview Tiered Storage Requirements 19/07/2018 Jisc Tiered Storage Overview

Tiered Storage Requirements Status 19/07/2018 Initial interest for storage expressed by SDC-North tenants Concept explored with SDC-North tenants – workshop April Leeds forecast they will require 46 Petabytes of data storage within 10 years - with an assumption that storage will 'move to the right' Manchester will require 8Petabytes within the next 3-5 years (600 TB last year) Informal discussions with NEI PDG, RDM, etc. Informal vendor discussions Formed Jisc POG (Project Oversite Group) Draft Jisc Business Case Requirements Workshop – November 2016 Working Group – Feb 2017

Tiered Storage Proposal Customer Infrastructure (e.g. VMWare Vsphere) Applications Customer Applications RDM Share Services iSCSI SMB CIF NFS S3 https Swift ceph … Jisc Tiered Storage Service HSM Appliance HSM Data Policy Pool Prioritisation Replication Snapshots SLAs (e.g. retention, availability, security) Distributed Storage Pool Cloud Storage Pool Archival Storage Pool Amazon Glacier Arkivum AWS Google Cloud9

Tiered Storage - Proposal Pool Overview Class Copies Recovery Time Objective Recovery Point Objective Distributed Storage Pool Data stored near sites (based on SDC1, SDC2 and other locations e.g. national research e-infrastructure centres, other NRENs) to give onsite\nearsite recovery times Use of erasure-encoding to give equivalence of 2 copies with ~1.6 times storage capacity Reference model or “boxed solution” for campuses Lever Janet backbone to deliver Onsite equivalence Equivalent to 2 Copies including offsite Onsite\near site equivalent <1 Hour Cloud Storage Pool Managing data copies across multiple cloud providers Archive < 1 Hour 1-24 Hour Archival Storage Pool Managing data copies across multiple cloud “vault” providers (i.e. 99% or 100% guaranteed data recovery) Vault Guaranteed recovery N/A

Matthew Dovey Jisc Technologies 02030 006 6016 Matthew.dovey@jisc.ac.uk