1. IT Matters Data Storage 2014

2. Topics Current Storage Infrastructure Backup and Restore Handy Information and Techniques Storage Future University of Adelaide2

3. Current Storage Infrastructure Mainly consists of NetApp Storage (www.netapp.com)www.netapp.com – FAS 6240’s Home/Shared Folders (U:\ and S:\) Staff Email (Exchange Mailboxes) TRIM Records Management MyMedia Streaming Data Majority Server Storage Uptime is vital! – FAS 3250’s Databases (Peoplesoft/Access Adelaide/MyUni) Uptime is vital! – FAS 2240’s Lower Cost Storage University of Adelaide3

4. Current Storage Infrastructure FAS 6240 University of Adelaide4

5. Current Storage Infrastructure FAS 3250 University of Adelaide5

6. Current Storage Infrastructure FAS 2240 University of Adelaide6

7. Current Storage Infrastructure How much data? – Total Capacity: 1000TB+ usable. – Data Transfer Rates: 880MB/s. – Usage Numbers: 20TB of Email (Staff) – 128,368,337 emails. 49TB of Home Folders – 84,763,414 files and folders. 26TB of Shared – 39,266,782 files and folders. University of Adelaide7

8. Current Storage Infrastructure Enterprise Support – 24/7 – Substantial Cost – Proactive Maintenance Guaranteed Compatibility – The storage system is guaranteed to integrate effectively with other components of our IT infrastructure. University of Adelaide8

9. Current Storage Infrastructure Data Efficiencies (Cost Benefits!) – Deduplication University of Adelaide9 Duplication Enabled U:\ Drive Storage

10. Current Storage Infrastructure Data Efficiencies (Cost Benefits!) – Thin Provisioning University of Adelaide10 Storage Admin Users Wow, so much storage! :D Only going to buy enough storage to store actual data! This should do: Saved Data Money Saved! Saved Data CRAP!

11. Current Storage Infrastructure Data Efficiencies (Cost Benefits!) – Thin Provisioning – Capacity on Demand (COD) University of Adelaide11 Storage Admin Users Wow, so much storage! :D Only going to buy enough storage to store actual data! This should do: Saved Data Crisis Averted! Lets save all the data! Data increasing.. Stress rising! Better enable COD.

12. Current Storage Infrastructure Data Protection – Has a whole topic coming next! High Reliability – Hardware Redundancy (two of everything) Plus many more.. – Performance – Manageability (Provisioning/Monitoring/Reporting) University of Adelaide12

13. Backup and Restore What is a Backup? A second copy of data! Main purpose: Recover data from large scale corruption, equipment failure or disaster scenarios... University of Adelaide13

14. Backup and Restore Disasters won’t happen to us? Think again! University of Adelaide14

15. Backup and Restore Any other uses?! Alternate usage: Recover individual emails or files from particular points of time in the past. Alternate usage, but most common. University of Adelaide15

16. Backup and Restore - Tape Backup-To-Tape: – Long term retention. – Slow to restore data. University of Adelaide16

17. Backup and Restore - Tape Backup-To-Tape: – Long term retention. – Slow to restore data. University of Adelaide17 U:\ Drive S:\ Drive Email Tape Library Geographically Remote Data Centre 1 Data Centre 2 Aged 8 weeks

18. Backup and Restore – “Local” Disk Backup-To-Disk: – Reduced disk cost and smart software making this possible. – Fast to access! – We utilise backup-to-disk in a couple ways, Local and Remote backups. “Local” Backups: Backup on the same storage device as your ‘Active’ Data. Uses ‘Snapshot’ concept. Storage without Snapshots University of Adelaide18 Time (Days) 10101011010101011 110 101010111 110011 101010010 10100100 10101010100 10101001 10011 10101 “Bugger”

19. Backup and Restore – “Local” Disk Backup-To-Disk: – Reduced disk cost and smart software making this possible. – Fast to access! – We utilise backup-to-disk in a couple ways, Local and Remote backups. “Local” Backups: Backup on the same storage device as your ‘Active’ Data. Uses ‘Snapshot’ concept. Storage with Snapshots University of Adelaide19 Time (Days) 10101011010101011 110 101010111 110011 101010010 10100100 10101010100 10101001 10011 10101 Snapshot 1 Snapshot 2 Snapshot 3Snapshot 4 Snapshot 5 Snapshots protect the data! “Bugger” “Snapshots!”

20. Backup and Restore – “Remote” Disk #1 “Remote” Disk Backups: Quick Disaster Recovery! Backup which is physically located some distance from Active Data, on a storage device in a secondary data centre. University of Adelaide20 U:\ Drive Primary Data Centre S:\ Drive Active Connections FAS 6240 U:\ Drive Secondary Data Centre S:\ Drive FAS 6240 Changes made to Data are copied to Secondary Data Centre (Twice a day) Active Connections Data is a maximum of 24 hours out of date.

21. Backup and Restore – “Remote” Disk #2 “Remote” Disk Backups: Making File and Email Restores easy! Backup which is physically located some distance from Active Data, on a storage device in a secondary data centre. University of Adelaide21 U:\ Drive Primary Data Centre Active Connections FAS 6240 U:\ Drive Secondary Data Centre FAS 2240 Email Changes made to data, copied to Secondary Data Centre (Once a day) Manual Connections Efficient Backup Software Email Admin

22. Backup and Restore Important: – Missing Data? Call Service Desk as soon as possible. – Never delete required data, assuming it’ll just get restored from backup. – Local Computer Hard Disc, not backed up! University of Adelaide22

23. Handy Information and Techniques Secure Data Transfers and Remote File Access – AARnet CloudStor ( https://cloudstor.aarnet.edu.au/sender/) https://cloudstor.aarnet.edu.au/sender/ Secure data transfer to anyone with an email address. – University Virtual Private Network ( https://vpn.adelaide.edu.au/) https://vpn.adelaide.edu.au/ Secure data access to R:\, S:\ and U:\ drives for all UofA affiliated users. University of Adelaide23

24. Handy Information and Techniques Big Datasets – AARnet CloudStor+ (https://cloudstor.aarnet.edu.au/plus )https://cloudstor.aarnet.edu.au/plus – eResearchSA (http://www.ersa.edu.au/data)http://www.ersa.edu.au/data Data Collaboration – AARnet CloudStor+ – Shared Data Drive (S:\) – Low Cost Storage (R:\) More information on research data management: http://libguides.adelaide.edu.au/researchdata University of Adelaide24

25. Handy Information and Techniques What about Cloud Storage? Would the Cloud provider tell you if they were hacked and your data was stolen? Is your data being backed up? Is your data being shared with advertising companies? What happens if the Cloud provider goes bankrupt or is taken over? Are employees of the Cloud provider allowed to view and share your data? University of Adelaide25

26. Handy Information and Techniques What about Cloud Storage? Some privacy policies: “When you upload or otherwise submit content to our Services, you give Google (and those we work with) a worldwide license to use, host, store, reproduce, modify, create derivative works … communicate, publish, publicly perform, publicly display and distribute such content.” – Google, April 2014 “In the event of a reorganization, merger, or sale we may transfer any and all personal information we collect to the relevant third party.” – Apple, March 2014 “If we are involved in a reorganization, merger, acquisition or sale of our assets, your information may be transferred as part of that deal. We will notify you (for example, via a message to the email address associated with your account) of any such deal and outline your choices in that event.” – DropBox, March 2014 More information about keeping data secure: http://www.adelaide.edu.au/technology/secureit/data/ University of Adelaide26

27. Storage Future What’s on the horizon. – Bigger S:\ drive allocations – Smarter Archiving – Cloud Integration for Data Storage Ability to access your files any device, any time, any way. Ease of collaboration. – Research Data Reforms (via eResearch Strategy) Associate Director Research IT Strategy (David Munro) – Identify-Classify-Protect! (Data Classification Campaign - Secure IT) University of Adelaide27

28. Questions? IT Matters – 2014 Storage

29. IT Matters THANKS FOR LISTENING!