STANFORD UNIVERSITY INFORMATION TECHNOLOGY SERVICES IT Services Storage And Backup Low Cost Central Storage (LCCS) January 9,

STANFORD UNIVERSITY INFORMATION TECHNOLOGY SERVICES What will we cover today?  Some definition and history of “Low Cost Central Storage” service… or LCCS  How do you “get it”  Compare it to external services (Amazon S3)  A Discussion on some “use cases” (how it would be used here at Stanford… and a demo on how Dan and Tilak use it)  Q&A (with some discussion about future directions and enhancements) page 2

STANFORD UNIVERSITY INFORMATION TECHNOLOGY SERVICES What is “LCCS”: (where does it fit in the offerings for storage services)  IT Services offers Disk Storage in 3 tiers of Performance and Availability on SAN & NAS Tier 1 is High Performance and availability, designed for mission critical and highly transactional data bases. ($3.60/GB per month ) Tier 2 is Medium Performance, designed for highly transactional databases (often used as the Dev/Test for Tier 1). ($1.27/GB per month ) Tier 3 is “Low Cost Central Storage”, designed for File shares and unstructured data storage. ($.35/GB per month )  Also offered as services by IT Services are: Backup and Archive for data protection and (off site) disaster recovery Storage System Hosting for SAN and NAS storage Systems page 3

STANFORD UNIVERSITY INFORMATION TECHNOLOGY SERVICES LCCS is available through multiple “protocols”:  CIFS – Common Internet File Service  Emulates a Windows file server (works with Windows, MAC, UNIX, Linux)  AFS - Andrews File System  1 GB is free to faculty Staff and Students and un-funded research (by request)  Feature enhancements are planned (file drawers, etc…)  iSCSI (available this spring) page 4

STANFORD UNIVERSITY INFORMATION TECHNOLOGY SERVICES How does it compare to external services:  Amazon S3 Possibly Good for archive Need an interface (web interface oriented), not good for apps to run from… fee for “transfer” is where they make the money at 24 “reads” per year (twice a month) the costs are equal to LCCS page 5 From Amazon S3 Pricing on 1/6/09http://aws.amazon.com/s3/#pricing Storage $0.150 per GB – first 50 TB / month of storage used $0.140 per GB – next 50 TB / month of storage used $0.130 per GB – next 400 TB /month of storage used $0.120 per GB – storage used / month over 500 TB Data Transfer $0.100 per GB – all data transfer in $0.170 per GB – first 10 TB / month data transfer out $0.130 per GB – next 40 TB / month data transfer out $0.110 per GB – next 100 TB / month data transfer out $0.100 per GB – data transfer out / month over 150 TB Requests $0.01 per 1,000 PUT, COPY, POST, or LIST requests $0.01 per 10,000 GET and all other requests* * No charge for delete requests

STANFORD UNIVERSITY INFORMATION TECHNOLOGY SERVICES Amazon S3 Versus LCCS – Backup Service (30TB, 15% Daily Change, Weekly Full Backup) Amazon S3 versus LCCS – File Service (10GB, 2 Reads/Month) How does it compare to external services: page 6 Amazon S3$67,200 IT Services TSM Service$63,488 IT Services LCCS$48, 384 Amazon S3$43.30 IT Services LCCS$42.20

STANFORD UNIVERSITY INFORMATION TECHNOLOGY SERVICES Things to remember about data “Backup”  Data Protection is more than a “second copy” at another location Version Protection against “logical failures” Against human error (delete or change) Data Corruption (unplanned or malicious) And… Disaster Recovery (off site) Typical Data protection scheme Full Backup weekly, incremental through the week. page 7

STANFORD UNIVERSITY INFORMATION TECHNOLOGY SERVICES Ordering CIFS Storage: CIFS Storage can be ordered via the IT Services OrderIT process. The information required to process the order include the following: Name: Department, Project, Workgroup, or Individual name. Quantity: Amount of storage required. Typical requirements should be multiples of 10G. Access: Who should have access to the data? Department / Project / Workgroup – Name of Workgroup from ( Individual access please include Name & SUNetId Billing Information: PTA Number. Backup: This is an optional service at additional charge. Please refer to the IT Services rate sheet for current charges. You will be notified when the services is ready for access. The notification will include the Server Name & Share Name. page 8

STANFORD UNIVERSITY INFORMATION TECHNOLOGY SERVICES What are some good uses for LCCS?  Home directory  Department share  Data protection ??? What other ideas do you have ??? page 9

STANFORD UNIVERSITY INFORMATION TECHNOLOGY SERVICES Things we are looking at for the Future  Sub $1.00 /GB per year for “protected” storage On and off site replication for DR This will be feasible if we achieve “Petabytes” of capacity)  Encryption at various levels CIFS shared central storage Secure transport between server and storage Off Site copies  Leveraging external services San Diego Super Computing (tape services) Amazon S3, Nirvanix, etc… (cloud storage services) page 10

STANFORD UNIVERSITY INFORMATION TECHNOLOGY SERVICES Questions? Handouts and Supplemental Information  LCCS service description and FAQ  Storage and Backup Team Service Descriptions For more information: page 11

STANFORD UNIVERSITY INFORMATION TECHNOLOGY SERVICES From Gartner: “ A look at Amazon’s S3 Cloud ” 20 November ID Number: G Recommendations Amazon S3 should not be considered for workloads that:  Require recovery from logical failures  Have high-I/O, low-latency or bandwidth requirements across the Internet  Have longer regulatory retention periods  Require guaranteed data erasure  Require data availability or performance guarantees Amazon S3 should, where data transfer times permit, be considered for:  A target for off-site backups  Off-site archiving  A tertiary copy of the data  Non-mission-critical workloads that are not I/O intensive (unless the I/O is limited to Amazon's Elastic Cloud [EC2]), do not have high security requirements and do not require recovery from logical failures  Enterprises should require operational and architectural descriptions of the services provided to evaluate the S3 offerings from others.  Guarantees should be easy to invoke, set deadlines for correcting problems, and provide remedies that are meaningful (for example, leave the user whole).  Availability, performance, privacy and data ownership requirements should all be specified in the contract and be reviewed with legal counsel.  Clients considering S3 should be sure to study their storage bandwidth patterns and usage by including network managers and application owners (development and end users) in the discussions to ensure that adequate bandwidth is available, and that variable S3 bandwidth costs and considerations are estimated and understood.  Clients must add backup/recovery costs in as well to get a better page 12