SQL Server, Storage And You Part 2: SAN, NAS and IP Storage.

Slides:



Advertisements
Similar presentations
Archive Task Team (ATT) Disk Storage Stuart Doescher, USGS (Ken Gacke) WGISS-18 September 2004 Beijing, China.
Advertisements

Data Storage Solutions Module 1.2. Data Storage Solutions Upon completion of this module, you will be able to: List the common storage media and solutions.
© 2006 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice HP Simply StorageWorks Roadshow.
Introduction to Storage Area Network (SAN) Jie Feng Winter 2001.
2 June 2015 © Enterprise Storage Group, Inc. 1 The Case for File Server Consolidation using NAS Nancy Marrone Senior Analyst The Enterprise Storage Group,
Vorlesung Speichernetzwerke Teil 2 Dipl. – Ing. (BA) Ingo Fuchs 2003.
Storage area Network(SANs) Topics of presentation
1 Recap (RAID and Storage Architectures). 2 RAID To increase the availability and the performance (bandwidth) of a storage system, instead of a single.
Fibre Channel Erin Keith CPE 401 Spring, Fibre Channel Storage Area Networks Overview Functionality Format Applications References.
An Active Networking Testbed for Storage Presenter Mel Tsai People Mel Tsai Anshi Liang Paul Huang Perry Dong and Tal Lavian.
ISCSI Performance Experiments Li Yin EECS Department U.C.Berkeley.
5/8/2006 Nicole SAN Protocols 1 Storage Networking Protocols Nicole Opferman CS 526.
SAN Design Considerations Hylton Leigh Senior Consultant Novell Consulting, UK Stuart Thompson Senior Consultant Novell Consulting, UK.
Storage Area Network (SAN)
Storage Networking Technologies and Virtualization Section 2 DAS and Introduction to SCSI1.
Module – 7 network-attached storage (NAS)
Implementing Failover Clustering with Hyper-V
Storage Networking. Storage Trends Storage growth Need for storage flexibility Simplify and automate management Continuous availability is required.
Session 3 Windows Platform Dina Alkhoudari. Learning Objectives Understanding Server Storage Technologies Direct Attached Storage DAS Network-Attached.
Data Storage Willis Kim 14 May Types of storages Direct Attached Storage – storage hardware that connects to a single server Direct Attached Storage.
Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.
Amin Kazempour Long Yunyan XU
Storage Cheap or Fast, Pick One. Storage Great--you can do a lot of computation. But this often generates a lot of data. Where are you going to put it?
11 Capacity Planning Methodologies / Reporting for Storage Space and SAN Port Usage Bob Davis EMC Technical Consultant.
Storage Area Networks The Basics. Storage Area Networks SANS are designed to give you: More disk space Multiple server access to a single disk pool Better.
Storage Survey and Recent Acquisition at LAL Michel Jouvin LAL / IN2P3
© 2006 EQUALLOGIC, INC. │ ALL RIGHTS RESERVED 1 The Marriage of Virtual Systems with Virtual Storage.
Managing Storage Lesson 3.
Yury Kissin Infrastructure Consultant Storage improvements Dynamic Memory Hyper-V Replica VM Mobility New and Improved Networking Capabilities.
Module 10 Configuring and Managing Storage Technologies.
GeoVision Solutions Storage Management & Backup. ๏ RAID - Redundant Array of Independent (or Inexpensive) Disks ๏ Combines multiple disk drives into a.
Database Storage Considerations Adam Backman White Star Software DB-05:
Hardware (The part you can kick). Overview  Selection Process  Equipment Categories  Processors  Memory  Storage  Support.
ISCSI Storage Dennis Martin Demartek May 2007 RMWTUG Meetings.
© 2009 IBM Corporation IBM Systems & Technology Group System x and BladeCenter® Why BladeCenter S SAN is the Right Choice Lowest cost, lowest complexity,
Introducing Snap Server™ 700i Series. 2 Introducing the Snap Server 700i series Hardware −iSCSI storage appliances with mid-market features −1U 19” rack-mount.
Hosted by iSCSI: The New Storage Interconnect on the “Block”? Sean P. Derrington Consultant, Enterprise Storage and Servers Appergy, Inc
Hosted by Case Study - Storage Consolidation Steve Curry Yahoo Inc.
Best Practices for Backup in SAN/NAS Environments Jeff Wells.
IT Infrastructure Chap 1: Definition
Trends In Network Industry - Exploring Possibilities for IPAC Network Steven Lo.
Virtualization for Storage Efficiency and Centralized Management Genevieve Sullivan Hewlett-Packard
The NE010 iWARP Adapter Gary Montry Senior Scientist
11/05/07 1TDC TDC 564 Local Area Networks Lecture 8 IP-based Storage Area Network.
1 U.S. Department of the Interior U.S. Geological Survey Contractor for the USGS at the EROS Data Center EDC CR1 Storage Architecture August 2003 Ken Gacke.
Storage Networking Evolution Jim Morin VP Strategic Planning June 2001.
Microsoft Virtual Academy Module 8 Managing the Infrastructure with VMM.
Using NAS as a Gateway to SAN Dave Rosenberg Hewlett-Packard Company th Street SW Loveland, CO 80537
Hosted by Minimizing the Impact of Storage on Your Network W. Curtis Preston President The Storage Group.
 The End to the Means › (According to IBM ) › 03.ibm.com/innovation/us/thesmartercity/in dex_flash.html?cmp=blank&cm=v&csr=chap ter_edu&cr=youtube&ct=usbrv111&cn=agus.
CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,
Internet Protocol Storage Area Networks (IP SAN)
Storage Networking. Storage Trends Storage grows %/year, gets more complicated It’s necessary to pool storage for flexibility Intelligent storage.
SAN 2001 Session 201 The Future of Storage Area Networks Milan Merhar Chief Scientist, Pirus Networks
© 2007 EMC Corporation. All rights reserved. Internet Protocol Storage Area Networks (IP SAN) Module 3.4.
Infrastructure for the DBA: An Introduction Peter Shore SQL Saturday Chicago 2016.
July 30, 2009opsarea meeting, IETF Stockholm1 Operational Deployment and Management of Storage over the Internet David L. Black, EMC IETF opsarea meeting.
Ryan Leonard Storage and Solutions Architect
Storage Area Networks The Basics.
Video Security Design Workshop:
Storage Networking.
Introduction to Networks
Introduction to Networks
Module – 7 network-attached storage (NAS)
Storage Networking.
Module – 6 IP san and fcOe Module 6: IP SAN and FCoE 1
Storage Networks and Storage Devices
Storage Networking Protocols
Cost Effective Network Storage Solutions
CS 295: Modern Systems Organizing Storage Devices
Presentation transcript:

SQL Server, Storage And You Part 2: SAN, NAS and IP Storage

What we are going to learn What makes up a Storage Area Network Network Attached Storage, sharing files IP Storage, blurring the lines

In The Beginning… Islands of disks – Disjointed – Over utilization – Under utilization Unreliable – Difficult to make highly available – Limited disaster recovery options – Hard to manage

A Network By Any Other Name

Network Behind Your Servers SAN makeup – Dedicated Network Switches, routers, directors oh my! Consolidation Utilization Server-less backups Speed * – SAN != Fibre Channel FC copper Infiniband

More Than Disks Tape Systems Drives Autoloaders Libraries Chameleon storage – Expose as NAS – Expose as iSCSI

More Than Hardware Storage Processors – Dedicated – Redundant Software – Disk management JOBD RAID – Replication Block level LAN/WAN

Serving Files Network Style Commodity Servers – X86/X64 – Dense Standard Networking – TCP/IP Stack Ease Of Implementation – Lower Management Overhead

Server Message Block Meant to live on top of TCP/IP – Build initially by IBM Offer abstraction – File shares – Printers – IPC Not supported for SQL Server prior to 2008 R2

The Similar But Different Redundant – Both use RAID May be twists on a theme – Both have replication Block Vs. File – Both use a “network” One built specifically One uses protocol layers on IP !Danger! – Not completely safe for SQL Server *

Storage Behind, Network In Front

iSCSI, Building Bridges Built on TCP/IP – Bundles SCSI commands – Common network infrastructure – != SAN Block level storage abstraction – Direct attached storage stand alone server acts as storage head – Network attached storage NAS can still serve SMB/NFS – Storage Area Network iSCSI being built into bridge heads or directly into storage head Support for MPIO and other SAN features

SAN Pitfalls High utilization – Servers outside your control effect your performance Poor Configuration – Striping data “wide and thin” – Over subscribing single disks “hot spots” – Fabric misconfiguration – SAN replication over large distance Expensive to scale – SAN disk can be 10x DAS/NAS – Multiple FC HBA’s needed for high throughput – Dedicated network infrastructure

NAS Pitfalls Meant to serve files – Generally, block level storage – Higher latency than SAN/DAS May not honor “no cache” flags – Puts data at risk Limited disk configurations – Almost always “wide and thin” VLAN != separate network – Often share traffic with other apps – QoS doesn’t fix this

iSCSI Pitfalls Hides back end storage – Are you on a fibre SAN or NAS? – NAS vendors offering iSCSI calling it SAN Easy to setup, hard to get it right – Should have dedicated network – Should have ToE or initiator HBA’s Back end may not honor “no cache” flags – Puts data at risk

SAN General Configuration Always ask for IO’s not gigabytes – Space is cheap – SQL Server eats IO Dedicated drives – Request LUN’s dedicated to data files – Request LUN’s dedicated to log files – Request LUN’s dedicated to tempdb Multiple FC ports – Separate IO traffic – Provide redundancy

Network Attached Storage Verify back end storage – Is it a DAS or SAN? Request drive pool separation – Pool data together – Separate logs from data Request multiple NIC ports – Provides load balancing – Provides redundancy – Separate IO workloads – Configure for jumbo frames – Separate client requests

iSCSI General Recommendations Separate network – VLAN isn’t separate – Reduce routing – Configure for jumbo frames Require ToE/Initiator HBA’s – Reduces server load – Can speed up IO Request 10 gigabit – MUCH larger pipe 125MB/sec Vs. 1250MB/sec Request multiple ports – MPIO – Separate IO workloads

Monitoring IO Health Very few vendor neutral tools – Wait stats Page io latch – Virtual file stats Odd spikes Creeping latencies

Questions? Blog: