Sunday, May 24, 2015 Data Minimisation Managing Data Growth While Containing Cost and Carbon Footprint Ken Hall, Dimension Data.

Slides:



Advertisements
Similar presentations
MoFo and Disaster Recovery August 24, 2004 Bruce Friedman Infrastructure Manager
Advertisements

Tag line, tag line Protection Manager 4.0 Customer Strategic Presentation March 2010.
© 2006 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice Enigma Data’s SmartMove.
RETHINK BACKUP & ARCHIVE. 2 Backup and Archive are Top IT Priorities Which of the following would you consider to be your org’s most important IT priorities.
Tag line, tag line Provisioning Manager 4.0 Customer Strategic Presentation March 2010.
Real-World Customer Deployments of StorSimple and Microsoft Azure
Centres of excellence and first choice for healthcare providers Digital Archival Program Neville Pinto Team Leader - Server & Storage Services.
© 2008 Waterford Technologies, Inc. All Rights Reserved & File Archiver Benefits Understand Primary Storage Usage Optimise Primary Storage Control.
“At the Forefront of World Class Information Technology in Healthcare” Building a 21 st Century Virtualized Enterprise Architecture Dr. Zafar Chaudry,
1 Vladimir Knežević Microsoft Software d.o.o.. 80% Održavanje 80% Održavanje 20% New Cost Reduction Keep Business Up & Running End User Productivity End.
1 © Copyright 2013 EMC Corporation. All rights reserved. EMC CLOUD TIERING APPLIANCE.
11© 2011 Hitachi Data Systems. All rights reserved. HITACHI DATA DISCOVERY FOR MICROSOFT® SHAREPOINT ® SOLUTION SCALING YOUR SHAREPOINT ENVIRONMENT PRESENTER.
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP StoreOnce How to win.
Windows Azure Conference 2014 Hybrid Cloud Storage: StorSimple and Windows Azure.
Barracuda Backup Service Data Backup and Disaster Recovery.
Insert Partner Name & Global Storage Managed Services - A New Approach to Backup & Disaster Recovery INSERT PARTNER LOGO HERE.
Microsoft hybrid cloud backup: … differentiated … cost effective … for private/public cloud deployments 123.
1© Copyright 2014 EMC Corporation. All rights reserved. CUSTOMER REFERENCES.
Agenda Symantec Enterprise Vault 1 Today’s Management Challenges 1 Why Management? 2 The Solution: Symantec Enterprise Vault 3 Benefits & Closing.
DNS Arrow Virtualisation and the business opportunity it presents. Steve Pearce Managing Director.
“At the Forefront of World Class Information Technology in Healthcare” Building a 21 st Century Consolidated, Virtualized Enterprise IT Infrastructure.
© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice HP StorageWorks LeftHand update Marcus.
1 © Copyright 2010 EMC Corporation. All rights reserved. Data Protection Solutions August 12, 2010 Eric G. Harmon Technology Consultant EMC Backup and.
1 1© 2011 Hitachi Data Systems. All rights reserved. FILE ARCHIVING SOLUTION WITH ARKIVIO® AUTOSTOR® PRESENTER NAME DATE FILE ARCHIVING SOLUTION WITH ARKIVIO®
Barracuda Networks Confidential1 Barracuda Backup Service Integrated Local & Offsite Data Backup.
1© Copyright 2013 EMC Corporation. All rights reserved. EMC AVAMAR FOR NAS ENVIRONMENTS Backup, recovery, and disaster recovery for network-attached storage.
Exchange 2010 Project Presentation/Discussion August 12, 2015 Project Team: Mark Dougherty – Design John Ditto – Project Manager Joel Eussen – Project.
© 2010 IBM Corporation Kelly Beavers Director, IBM Storage Software Changing the Economics of Storage.
IBM TotalStorage ® IBM logo must not be moved, added to, or altered in any way. © 2007 IBM Corporation Break through with IBM TotalStorage Business Continuity.
1© Copyright 2011 EMC Corporation. All rights reserved. EMC Data Domain and F5 Networks Seamlessly Integrating Deduplicated Storage into a Tiered Storage.
1 © Copyright 2009 EMC Corporation. All rights reserved. Agenda Storing More Efficiently  Storage Consolidation  Tiered Storage  Storing More Intelligently.
Data Deduplication in Virtualized Environments Marc Crespi, ExaGrid Systems
Global Capabilities Archiving – Designing from Top to Bottom Gary Brown Dimension Data.
Cloud Tiering The recovery of primary storage by tiering inactive data.
Presents Presented by John Sawyer and Brad Rice SecureAgent Software August 10 th, 2011.
1 EMC CONFIDENTIAL—INTERNAL USE ONLY EMC’s End-to-End Capabilities for Microsoft EMC helps you successfully plan, design, deploy and manage your Microsoft.
STEALTH Content Store for SharePoint using Caringo CAStor  Boosting your SharePoint to the MAX! "Optimizing your Business behind the scenes"
NetApp Accelerates and Unifies Archive & Compliance Thomas Savage Solution Marketing Manager Data Retention, Archive and Compliance.
Meeting the Data Protection Demands of a 24x7 Economy Steve Morihiro VP, Programs & Technology Quantum Storage Solutions Group
Archiving Where did I put that mail?. Business criticity Importance to manage : –Authenticity –Integrity –Perennity –Compliance High TCO of mail.
Wayne Hogan National Storage Manager Sun Microsystems of Canada, Inc.
1 © 2010 Overland Storage, Inc. © 2012 Overland Storage, Inc. Overland Storage The Storage Conundrum Neil Cogger Pre-Sales Manager.
Quantum Overview A proven global expert in data protection and big data management.
DATA DEDUPLICATION By: Lily Contreras April 15, 2010.
Chapter 9 Section 2 : Storage Networking Technologies and Virtualization.
Demystifying Deduplication. Global SMB Event Marketing 2 APPROACH: What is deduplication? Eliminate redundant data Start with the backup environment as.
FlashSystem family 2014 © 2014 IBM Corporation IBM® FlashSystem™ V840 Product Overview.
Oracle Advanced Compression – Reduce Storage, Reduce Costs, Increase Performance Session: S Gregg Christman -- Senior Product Manager Vineet Marwah.
Mark A. Magumba Storage Management. What is storage An electronic place where computer may store data and instructions for retrieval The objective of.
Storage Trends: DoITT Enterprise Storage Gregory Neuhaus – Assistant Commissioner: Enterprise Systems Matthew Sims – Director of Critical Infrastructure.
Microsoft Azure Storage. Networking Compute Storage Virtual Machine Operating System Applications Data & Access Runtime Provision.
1 IBM TIVOLI Business Continuance Seminar Training Document.
BACKUP/MASTER: Strategies for Archiving Dianne McAdam Senior Analyst and Partner Data Mobility Group.
Data Reduction & Storage Management Transformation Vishal Maheshwari Country Manager, Tivoli Storage IBM India South Asia.
The Power of Aligning Backup, Recovery, and Archive Bob Madaio Sr. Manager; Backup, Recovery and Archive Marketing EMC Corporation.
IBM Systems and Technology Group © 2009 IBM Corporation IBM System Storage – Tape Part 1 This document is for IBM and IBM Business Partner use only. It.
1 © Copyright 2009 EMC Corporation. All rights reserved. Backup Challenges in VMware Environments.
Considerations and Benefits for Archive and Compliance Deploying Enterprise Vault on NetApp Storage 1.
IBM Systems and Technology Group © 2009 IBM Corporation IBM System Storage Product Overview Part 1 This document is for IBM and IBM Business Partner use.
1 F5 and NetApp Partnership Applications and Users NAS and File Servers Transparent Data Migration F5 is a NetApp Advantage Alliace Partner with continuous.
The Economics of Notes and Domino 8.5: How to Decrease Cost & Increase Productivity by Optimizing your Infrastructure.
iSCSI Storage Area Network
Demystifying Deduplication
Optimize Storage with BMC TrueSight Capacity Optimization
Storage Trends: DoITT Enterprise Storage
Hybrid Storage Competitive Sales Guide INTERNAL ONLY
Using the Cloud for Backup, Archiving & Disaster Recovery
Presentation transcript:

Sunday, May 24, 2015 Data Minimisation Managing Data Growth While Containing Cost and Carbon Footprint Ken Hall, Dimension Data

Agenda Introductions Today’s data management challenges Energy efficiency in the data centre What is Data Minimisation? Online Active Archiving Backup Data De-Duplication Data Minimisation effects Developing the business case Questions & Answers

Dimension Data - ‘Data Centre & Storage Solutions’ Network Integration Microsoft Solutions Infrastructure Microsoft Solutions Application Integration Security Managed Services Customer Interactive Solutions Data Centre & Storage Solutions – Availability, Compliance & Optimisation Storage Solutions – SAN, NAS, CAS Virtualisation Solutions – DR, Server & Desktop Consolidation Backup, Recovery & Archiving Solutions Data Centre Environmental’s – Power, Cooling & Rack Solutions Key Technology Partners APC, Cisco, EMC, HDS, HP, IBM, Microsoft, NetApp, Quantum, Symantec, Sun

The Digital Universe is Rapidly Expanding Source: IDC White Paper, "The Diverse and Exploding Digital Universe," March 2008 Ten-fold growth in five years! 1,773 exabytes 173 exabytes Exabytes ,000 1,200 1,400 1,600 1, Amount of Digital Information Created and Replicated Each Year

Typical DD Customer – Exponential Data Growth Annual Compound Data Growth of 65% Daily Incremental and Weekly Full 2 Week Retention on Disk (3 Full’s - 10 Incr) 4 Week Retention on Tape 12 Monthly’s on Tape kept indefinitely Having to squeeze more into Backup Window B2D Requirement Growing Rapidly Backup Media Server/s Under Pressure Network Bandwidth Constraints Tape Infrastructure &Handling Costs Increasing

Coping with Information Growth in Today’s Economy *“Global purchases of IT goods and services… will equal $1.66 trillion in 2009, declining by 3 percent after an 8 percent rise in 2008.” Global IT Market Outlook: 2009, Forrester Research, January 12, 2009 In 2009, IT budgets are flat or declining*  Escalating costs for primary storage  Difficulty meeting backup and recovery windows  Ensuring high availability of information  Providing timely access to historical information

Data Center Energy Use is Doubling  IT energy use has doubled since 2000 and will likely double again by 2011  Energy operating costs will soon exceed the cost of purchase for servers  Existing conservation technologies can reduce consumption to 2002 levels Comparison of Projected Electricity Use, 2007 to 2011 Source: EPA report to Congress, Annual Electricity Use (billion kWh/year State of the art scenario Historical energy use

Available Capabilities for Energy Efficiency Improve Efficiency – Reduce Energy Consumption INCREASE UTILIZATION REDUCE CAPACITY Storage tiering Virtual LUNS File and tiering Storage virtualisation Large-capacity drives Replication across storage tiers Snaps Clones Compression De-duplication Archiving Server virtualisation Data migration Storage consolidation Virtual Provisioning Flash drives Optimisation algorithms Automated discovery Document management

How can we... Implement a Data Minimisation Strategy Manage exponential data growth, while... Improving access to organisational data Containing data management and infrastructure costs Reducing the data centre’s carbon footprint... Online archiving of and file systems Backup with data de-duplication

Data Minimisation Elements  Retention and compliance  Data reduction  Universal access  Simplify management  Tier backup infrastructure  Optimise media: B2D, VTL, de-dupe and tape  Address security issues  Simplify management Identify candidates for archiving Classify and move Establish SLAs based on information class New Technologies and Services are Enablers Primary Storage Backup Archive

Data Minimisation – How it works 1. Archive the inactive data before you perform the backup process  Identify Inactive Data based on polices  Automate the movement of the data to a lower cost storage tier or dedicated archive platform leaving stubs behind  Items are retrieved from the online archive on user demand  Backup up the archive infrequently or never 2. Backup the remaining data using resource efficient data de-duplication  Rapid ‘Full Backups’ - only the ‘sub-file’ changes are sent and stored on disk  Minimal Bandwidth – only a fraction of the typical 200% is sent over the wire  Minimal Storage Consumption – only unique ‘sub-file’ blocks are stored  Protect more, with less for longer

Today: Energy-Efficient Storage Design 1 TB Data on Different Capacity/Performance Drives 787 kWh/yr 1,434 kWh/yr 3,048 kWh/yr 94% 87% 73% 50% 393 kWh/yr CONSUME LESS ENERGY BY CAPACITY 15K 73 GB 15K 146 GB 10K 300 GB 7.2K 500 GB 7.2K 1 TB 6,096 kWh/yr 73 GB Flash drive 3,790 kWh/yr 30x IOPS 38% Less Energy

24 May 2015 File System Archiving  Extract inactive, final-form data to an archive  Enhance performance of production applications  Reduce size of backup datasets  Free up expensive Tier 1 disk  Store archived data on high density low cost energy efficient storage 10 TB Extract Always available Before Backup full, 10 TB After Back up 4 TB, active data only Active archive Primary storage 4 TB 6 TB Secondary storage Inactive data Reclaimed storage Production Active data Active data

Archiving Message Server Archive Server Space saved on server is typically 60–80% Shortcut User’s Inbox Message 1 Jan. 1, 2008 To: RickSubject: Question Attached: Message 2 Jan. 1, 2008 To: RonSubject: Update Attached: Message 3 Feb. 1, 2008 To: Bill Subject: Training Message 1 Jan. 1, 2008 To: RickSubject: Question Attached: Message 2 Jan. 1, 2008 To: RonSubject: Update Attached: Message 3 Feb. 1, 2008 To: Bill Subject: Training Shortcut Mail Archival automatically create shortcuts to archived messages / attachments…and deletes the original attachments from the server Archive Message 1 Jan. 1, 2008 To: RickSubject: Question Attached: Message 2 Jan. 1, 2008 To: RonSubject: Update Attached: Message 3 Feb. 1, 2008 To: Bill Subject: Training Message 1 Jan. 1, 2008 To: RickSubject: Question Attached: Message 2 Jan. 1, 2008 To: RonSubject: Update Attached: Message 3 Feb. 1, 2008 To: Bill Subject: Training

Definition of De-duplication “The process of detecting and identifying the unique data segments within a given set of information, enabling the elimination of redundancy when stored or moved.” Before: total segments = 39After: Unique segments = 6 Data Set 3 Data Set 2 Data Set 1 De-duplication

Data De-duplication: How it Works ABCD Unique data stored on disk, available for immediate recovery Only unique data segments are backed up A B C D Data already backed up, so only a unique ID pointer is stored (20 bytes) E E New data segment identified and backed up  First Instance  Duplicate Instance  Modified Instance AB CD AB CD B CD E May 2007 June 2008

Key Point – Data Minimisation requires a platform that doesn’t need to be backed up! WORM DISK Tier 3 Disk Active Archiving WORM delivers unique features for online archives  Location independence  Self-healing and management  Guaranteed authenticity  Single-instancing Online Archiving Tier 3 Disk with SATA and NAS with ATA Offline Archiving Tape is best suited for offline archives Tape Customer Archival Requirements Management Efficiency Archiving Functionality

Data Minimisation Strategy - How it all fits together Tier 1 Primary Storage Tier 2 Secondary Storage Tier 3 Archive long term Retention on disk 80% of data Tier 5 Legacy long Term retention On tape Optional 20% Tier 4 Backup to disk (De-Dupe) Quick recovery Optional 20% Daily data backups OH De-duped Data Automated movement relative to age Data backup Static Data growth Static Data growth Tier 3 Data Growth No management required

Quantified Results – Reduce Tier 1/2 with Archiving Major reduction in expensive Tier1/2 Storage Tier 3 Archive storage minimised due to single instancing & compression 73% reduction in power and cooling requirements for archived data

Quantified Results – The Data Minimisation Leverage Good Tier 4 Savings with Archiving or De-Duplication Excellent results by combining Archiving & Backup Data De-Duplication 6 x reduction in power and cooling requirements for B2D storage

Quantified Results – Less Tape Infrastructure Associated reduction in Tape Library Slots, Drives, Management & Handling Power of combining Archiving & De-Duplication – 560 Less LTO4 Tapes in Year3 Tape could be removed altogether – Offsite Replication & Disk Spin-Down

Data management cost comparison – Data Minimisation Significant Reduction of Backup Infrastructure and Tape Management Tape Drive, Tape Licences, Slots, Library, Backup Server, Tape Media, Offsite Storage & Recall Costs, Admin Costs 24 May 2015© Copyright Dimension Data

Data Minimisation Assessment – Business Case Current backup minimisation methods give you better efficient backups However it doesn't fix the cause of the problem which is data growth A combination of data archival, backup de-duplication and compression represents the most effective manner to contain data within your environment Helps quantify business case for archiving (or other appropriate solution) Workshop to identify costs/issues 24 May © Copyright Dimension Data

Data Minimisation – Input Variables 24 May © Copyright Dimension Data

Data Minimisation – Graphical View 24 May © Copyright Dimension Data

Data Minimisation – Graphical View (Cont.) 24 May © Copyright Dimension Data

Data minimisation strategy achieved by...  Archiving over 70% of data to a protected environment which removed the need for that data to be backed up via archiving  Minimised the impact of data backup via de-duplication and compression (reduction in data volume and backup data by 80%)  Minimised the impact of VMware on the environment through de-duplication  Contained Tier 1 disk growth and spend  Provided the most storage efficient backup method possible today  Estimated savings to be over 5 Million dollars in 5 years. My initial Sync took 12 hours now I backup in 50 mins’ – Dimension Data Customer $ $ $ $

Sunday, May 24, 2015 Questions & Answers