Storage and Backup Overview 15 February 2016TCS Internal.

Slides:



Advertisements
Similar presentations
Archive Task Team (ATT) Disk Storage Stuart Doescher, USGS (Ken Gacke) WGISS-18 September 2004 Beijing, China.
Advertisements

Data Storage Solutions Module 1.2. Data Storage Solutions Upon completion of this module, you will be able to: List the common storage media and solutions.
Proposed Storage Area Network Facilities For Discussion.
NAS vs. SAN 10/2010 Palestinian Land Authority IT Department By Nahreen Ameen 1.
“Redundant Array of Inexpensive Disks”. CONTENTS Storage devices. Optical drives. Floppy disk. Hard disk. Components of Hard disks. RAID technology. Levels.
Enhanced Availability With RAID CC5493/7493. RAID Redundant Array of Independent Disks RAID is implemented to improve: –IO throughput (speed) and –Availability.
11 BACKING UP AND RESTORING DATA Chapter 4. Chapter 4: BACKING UP AND RESTORING DATA2 CHAPTER OVERVIEW Describe the various types of hardware used to.
REDUNDANT ARRAY OF INEXPENSIVE DISCS RAID. What is RAID ? RAID is an acronym for Redundant Array of Independent Drives (or Disks), also known as Redundant.
Understand Database Backups and Restore Database Administration Fundamentals LESSON 5.2.
Vorlesung Speichernetzwerke Teil 2 Dipl. – Ing. (BA) Ingo Fuchs 2003.
Storage area Network(SANs) Topics of presentation
1 Recap (RAID and Storage Architectures). 2 RAID To increase the availability and the performance (bandwidth) of a storage system, instead of a single.
Modern Distributed Systems Design – Security and High Availability 1.Measuring Availability 2.Highly Available Data Management 3.Redundant System Design.
Fibre Channel Erin Keith CPE 401 Spring, Fibre Channel Storage Area Networks Overview Functionality Format Applications References.
© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice HP StorageWorks LeftHand update Marcus.
Storage Area Network (SAN)
Storage Networking Technologies and Virtualization Section 2 DAS and Introduction to SCSI1.
© 2009 IBM Corporation Statements of IBM future plans and directions are provided for information purposes only. Plans and direction are subject to change.
Storage Networking. Storage Trends Storage growth Need for storage flexibility Simplify and automate management Continuous availability is required.
Session 3 Windows Platform Dina Alkhoudari. Learning Objectives Understanding Server Storage Technologies Direct Attached Storage DAS Network-Attached.
Data Storage Willis Kim 14 May Types of storages Direct Attached Storage – storage hardware that connects to a single server Direct Attached Storage.
Amin Kazempour Long Yunyan XU
BACKUP/MASTER: Immediate Relief with Disk Backup Presented by W. Curtis Preston VP, Service Development GlassHouse Technologies, Inc.
Storage Area Networks The Basics. Storage Area Networks SANS are designed to give you: More disk space Multiple server access to a single disk pool Better.
November 2009 Network Disaster Recovery October 2014.
Managing Storage Lesson 3.
Module 10 Configuring and Managing Storage Technologies.
LAN / WAN Business Proposal. What is a LAN or WAN? A LAN is a Local Area Network it usually connects all computers in one building or several building.
Data Storage CPTE 433 John Beckett. The Paradox “If I can go to a computer store and buy 1000 gigabytes for $50, why does it cost more in your server.
Chapter 8 Implementing Disaster Recovery and High Availability Hands-On Virtual Computing.
Chapter 5 Section 2 : Storage Networking Technologies and Virtualization.
Module – 4 Intelligent storage system
©2006 Merge eMed. All Rights Reserved. Energize Your Workflow 2006 User Group Meeting May 7-9, 2006 Disaster Recovery Michael Leonard.
Mark A. Magumba Storage Management. What is storage An electronic place where computer may store data and instructions for retrieval The objective of.
Storage Trends: DoITT Enterprise Storage Gregory Neuhaus – Assistant Commissioner: Enterprise Systems Matthew Sims – Director of Critical Infrastructure.
1 U.S. Department of the Interior U.S. Geological Survey Contractor for the USGS at the EROS Data Center EDC CR1 Storage Architecture August 2003 Ken Gacke.
1 Week #10Business Continuity Backing Up Data Configuring Shadow Copies Providing Server and Service Availability.
"1"1 Introduction to Managing Data " Describe problems associated with managing large numbers of disks " List requirements for easily managing large amounts.
Using NAS as a Gateway to SAN Dave Rosenberg Hewlett-Packard Company th Street SW Loveland, CO 80537
© 2009 IBM Corporation Statements of IBM future plans and directions are provided for information purposes only. Plans and direction are subject to change.
VMware vSphere Configuration and Management v6
Local Area Networks School of Business Eastern Illinois University © Abdou Illia, Spring 2007 (Week 8, Tuesday 2/27/2007)
 The End to the Means › (According to IBM ) › 03.ibm.com/innovation/us/thesmartercity/in dex_flash.html?cmp=blank&cm=v&csr=chap ter_edu&cr=youtube&ct=usbrv111&cn=agus.
Lec 5 part2 Disk Storage, Basic File Structures, and Hashing.
STORAGE ARCHITECTURE/ MASTER): Where IP and FC Storage Fit in Your Enterprise Randy Kerns Senior Partner The Evaluator Group.
Storage Networking. Storage Trends Storage grows %/year, gets more complicated It’s necessary to pool storage for flexibility Intelligent storage.
1 CEG 2400 Fall 2012 Network Servers. 2 Network Servers Critical Network servers – Contain redundant components Power supplies Fans Memory CPU Hard Drives.
Hands-On Microsoft Windows Server 2008 Chapter 7 Configuring and Managing Data Storage.
© 2007 EMC Corporation. All rights reserved. Internet Protocol Storage Area Networks (IP SAN) Module 3.4.
What is raid? RAID is the term used to describe a storage systems' resilience to disk failure through the use of multiple disks and by the use of data.
Network-Attached Storage. Network-attached storage devices Attached to a local area network, generally an Ethernet-based network environment.
CDP Technology Comparison CONFIDENTIAL DO NOT REDISTRIBUTE.
BACKUP AND RESTORE. The main area to be consider when designing a backup strategy Which information should be backed up Which technology should be backed.
Open-E Data Storage Software (DSS V6)
Ryan Leonard Storage and Solutions Architect
Storage Area Networks The Basics.
Integrating Disk into Backup for Faster Restores
Video Security Design Workshop:
Direct Attached Storage and Introduction to SCSI
Storage Networking.
Introduction to Networks
Storage Virtualization
Direct Attached Storage and Introduction to SCSI
Huawei HCNA-Storage 3.0 H ENU Questions Killtest
Storage Networking.
Storage Networks and Storage Devices
Storage Trends: DoITT Enterprise Storage
UNIT IV RAID.
Using the Cloud for Backup, Archiving & Disaster Recovery
Improving performance
Presentation transcript:

Storage and Backup Overview 15 February 2016TCS Internal

15 February 2016 RAID TECHNOLOGY TCS Internal 2

15 February 2016 RAID 0  Block level striping.  Does not have fault-tolerance.  Minimum disk requirement is 2. TCS Internal 3

15 February 2016 RAID 0 TCS Internal 4

15 February 2016 RAID 1  Mirroring of data takes place.  Controller can perform two concurrent seperate read per mirrored pair.  100% redundancy for data. So there is no need to rebuild data in case of disk failure.  Minimum disk requirement is 2. TCS Internal 5

15 February 2016 RAID 1 TCS Internal 6

15 February 2016 RAID 5  Block level striping with distributed parity.  If a block of data is updated on a single disk, then the unchanged data in the other disks also has to be read back to generate a new parity. Thus it requires 4 IO’s for write operation.  Distribution of parity is done by the RAID controller. TCS Internal 7

15 February 2016 RAID 6  Block level striping with distributed double parity.  It provides high fault tolerance and can sustain multiple simultaneous disk failure.  Here the controller design is complex.  Write operation is slower compared to RAID 5.  More suitable for small and medium sized databases. TCS Internal 8

15 February 2016 Storage – DAS. NAS & SAN TCS Internal 9

15 February 2016 Direct Attached Storage TCS Internal 10

15 February 2016 Direct Attached Storage BENEFITS 1. Installation can be as easy as plugging in a storage device to a server and installing software quickly. 2. Lower pricing and high capacity. ISSUES 1. Resource Sharing 2. Backup Complexity 3. Hardware Proliferation TCS Internal 11

15 February 2016 Network Attached Storage TCS Internal 12

15 February 2016 BENEFITS 1. Able to use existing networks 2. Allows file sharing among heterogeneous servers ISSUE 1. Usage of Network goes high Network Attached Storage TCS Internal 13

15 February 2016 Storage Area Network TCS Internal 14

15 February 2016 TCS Internal 15 Storage Area Network

15 February 2016 BENEFITS 1. Increased disk utilization 2. Decreased workload 3. Improved DR capabilities 4. Improved overall availability 5. Support server clustering ISSUE: 1.Difficult heterogeneous connectivity Storage Area Network TCS Internal 16

15 February 2016 Difference between DAS,SAN and NAS TCS Internal 17

15 February 2016 BENEFITS OF SAN  Centralized management.  Storage consolidation and shared infrastructure.  High availability and disaster recovery.  High bandwidth.  Scalability  Shared data. TCS Internal 18

15 February 2016 SECURITY IN SAN TCS Internal 19

15 February 2016 There are two levels of security in SAN  Switch level security (zoning) Soft zoning Hard zoning  SAN box level security (LUN masking) SECURITY IN SAN TCS Internal 20

15 February 2016 ZONING  Finer segmentation of switched fabric.  Used to isolate different environment within a fabric. Only the members of the same zone can able to communicate within that zone and all others are rejected.  Mostly used to separate a test environment from production environment within an enterprise. TCS Internal 21

15 February 2016 HARDWARE ZONING  Here zoning is done using port number.  Members of the zone are physical ports of the fabric switch.  A single port can be included in multiple zone.  Provides highest level of security.  The disadvantage here is the whole zoning configuration becomes unusable, once the device is connected to another port. TCS Internal 22

15 February 2016 SOFTWARE ZONING  Implemented by fabric OS within fabric switch by a combination of name server and fibre channel protocol.  Members of the zone can be defined using their world wide name (WWN).  Here also a member can belong to multiple zones.  Multiple zone sets can be created, but a single set of zone can be activated at a time. TCS Internal 23

15 February 2016 LUN MASKING Storage devices offers its resources to the host in the form of LUN. Here the user defines which host can access which LUN by means of device control program. Whenever the host access a particular LUN, the storage devices check the access lists for the particular LUN and allows or rejects that host based on that. TCS Internal 24

15 February 2016 Interface Options Serial attached SCSI (SAS) iSCSI Fibre Channel (FC) 25

15 February 2016 SAS Basics and Benefits SAS – Serial Attached SCSI A serial communication protocol designed for transfer of SCSI commands and data to and from devices over point-to-point interconnections Key Benefits New roadmap with industry-wide acceptance Significant performance enhancements Cost equivalent to parallel SCSI Freedom from 15 drive maximum per SCSI channel 26

15 February 2016 iSCSI Basics and Benefits iSCSI - internet Small Computer System Interface A network protocol that enables transmission of SCSI commands and data over an IP-based network usually via an Ethernet interface Key Benefits: Low cost Less complexity Extensive knowledge base – expertise in every IT organization Flexible configuration topologies Extensive reach with no distance limitations Future performance 1Gb/s today with roadmap for 10Gb/s and beyond 27

15 February 2016 FC Basics and Benefits FC – Fibre Channel A serial networking interface that supports the transmission of upper level protocols – including SCSI command sets and data – over fiber optic or copper cables Key Benefits Scalable – supports up to 16 million addresses. Distance – 10,000 meters maximum cabling length High bandwidth – low latency and high IOPs Congestion free with credit-based flow control delivering data buffer is able to receive it. 28

15 February 2016 Backups and Restoration 29

15 February 2016 Why Data Backup is Required ? Data is the heart of any enterprise, and hence it’s important for us to protect it. To protect the data it is important to implement a data backup and restoration plan. Backing up files can protect against –Accidental loss of data –Database corruption –Hardware failures –Natural disaster It’s our job as an administrator to make sure that backups are performed and that backup tapes are stored in a secure location. 30

15 February 2016 Backup and Recovery Plan Important files are accidentally deleted all the time. Mission-critical data can become corrupt. Natural disasters can leave your office in ruin. With a solid backup and recovery plan, you can recover from any of these files Without one, you're left with nothing to fall back on. 31

15 February 2016 Figuring Out a Backup Plan You'll need to figure out what data needs to be backed up, how often the data should be backed up, and more. To help you create a plan, consider the following: How important is the data on your systems What type of information does the data contain How often does the data change How quickly do you need to recover the data Do you have the equipment to perform backups 32

15 February 2016 Figuring Out a Backup Plan ……Contd Who will be responsible for the backup and recovery plan What is the best time to schedule backups Do you need to store backups off-site 33

15 February 2016 Basic Types of Backup There are many techniques for backing up files. The techniques you use will depend on the type of data you're backing up, how convenient you want the recovery process to be. –Normal/full backups –Differential backups –Incremental backups In our backup plans we probably take the full backup on weekly basis and incremental backup on daily basis. 34

15 February 2016 Basic Types of Backup 35 TypeDefinitionBenefitsDrawbacks Full Backup: A complete backup of everything you want to backup. Restoration is fast, since you only need one set of backup data. The backing up process is slow. High storage requirements. Differential Backup The backup software looks at which files have changed since you last did a full backup. Then creates copies of all the files that are different from the ones in the full backup. If you do a differential backup more than once, it will copy all the files, or parts of files that have changed since the last full backup, even if you already have identical copies of those files in a previous differential backup. For restoring all the data, you will only need the the last full backup, and the last differential backup. Faster to create than a full backup. Restoration is faster than using incremental backup. Not as much storage needed as in a full backup. Restoration is slower than using a full backup. Creating a differential backup is slower than creating an incremental backup. Incremental Backup: The backup software creates copies of all the files, or parts of files that have changed since previous backups of any type (full, differential or incremental). For example if you did a full backup on Sunday. An incremental backup made on Monday, would only contain files changed since Sunday, and an incremental backup on Tuesday, would only contain files changed since Monday, and so on. This method is the fastest when creating a backup. The least storage space is needed. Restoring from incremental backups is the slowest because it may require several sets of data to fully restore all the data. For example if you had a full backup and six incremental backups. To restore the data would require you to process the full backup and all six incremental backups.

15 February 2016 Differential and Incremental Backups Day of Week Weekly Full Backup with Daily Differential Backup Weekly Full Backup with Daily Incremental Backup SundayA full backup is performed. Monday A differential backup contains all changes since Sunday. An incremental backup contains changes since Sunday. Tuesday A differential backup contains all changes since Sunday. An incremental backup contains changes since Monday. Wednesday A differential backup contains all changes since Sunday. An incremental backup contains changes since Tuesday. Thursday A differential backup contains all changes since Sunday. An incremental backup contains changes since Wednesday. Friday A differential backup contains all changes since Sunday. An incremental backup contains changes since Thursday. SaturdayA differential backup contains all changes since Sunday. An incremental backup contains changes since Friday. 36

15 February 2016 Selecting Backup Devices and Media Many tools are available for backing up data. Some are fast and expensive. Others are slow but very reliable. The backup solution that's right for your organization depends on many factors, including –Capacity –Reliability –Extensibility –Speed –Cost 37

15 February 2016 Buying and Using Tapes Selecting a backup device is an important step toward implementing a backup and recovery plan. But you also need to purchase the tapes or disks, or both, that will allow you to implement your plan. The number of tapes you need depends on how much data you'll be backing up, how often you'll be backing up the data, and how long you'll need to keep additional data sets. 38

15 February 2016 Data Archiving Solutions 39

15 February 2016 Definition of Archiving Backup is for recovery from hardware failure and/or recent data corruption Archive is for space management and long term retention Archiving is an intelligent process for managing inactive or infrequently accessed data, that still has value, while providing the ability to preserve, search and retrieve the information during a specified retention period. 40

15 February 2016 The Two Faces of Archiving Space Management –Move old, inactive files to less expensive storage, resulting in reduced backup windows and reduced storage costs. Data Retention –Protect your data for the long term with non erasable, non rewritable (NENR) storage solutions and demonstrate compliance to regulations. 41

15 February 2016 Different Backup Utilities 42 Veritas Netbackup Acronis True Image NovaBackup Professional

TCS Internal Thank You 15 February 2016TCS Internal