Hardware (The part you can kick). Overview  Selection Process  Equipment Categories  Processors  Memory  Storage  Support.

Slides:



Advertisements
Similar presentations
Archive Task Team (ATT) Disk Storage Stuart Doescher, USGS (Ken Gacke) WGISS-18 September 2004 Beijing, China.
Advertisements

Data Storage Solutions Module 1.2. Data Storage Solutions Upon completion of this module, you will be able to: List the common storage media and solutions.
Princess Sumaya Univ. Computer Engineering Dept. Chapter 6:
Virtualisation From the Bottom Up From storage to application.
1 CSC 486/586 Network Storage. 2 Objectives Familiarization with network data storage technologies Understanding of RAID concepts and RAID levels Discuss.
1 Magnetic Disks 1956: IBM (RAMAC) first disk drive 5 Mb – Mb/in $/year 9 Kb/sec 1980: SEAGATE first 5.25’’ disk drive 5 Mb – 1.96 Mb/in2 625.
R.A.I.D. Copyright © 2005 by James Hug Redundant Array of Independent (or Inexpensive) Disks.
Chapter 5: Server Hardware and Availability. Hardware Reliability and LAN The more reliable a component, the more expensive it is. Server hardware is.
This courseware is copyrighted © 2011 gtslearning. No part of this courseware or any training material supplied by gtslearning International Limited to.
RAID CS147 Dr. Sin-Min Lee By Kenneth Chen. History Norman Ken Ouchi at IBM was awarded U.S. Patent 4,092,732 titled "System for recovering data stored.
RAID TECHNOLOGY. MAGNETIC DISK STORAGE  Before we can fully understand RAID, we must first understand the inner workings of a magnetic hard disk, and.
Denny Cherry Manager of Information Systems MVP, MCSA, MCDBA, MCTS, MCITP.
Novell Server Linux vs. windows server 2008 By: Gabe Miller.
SQL Server, Storage And You Part 2: SAN, NAS and IP Storage.
1 Recap (RAID and Storage Architectures). 2 RAID To increase the availability and the performance (bandwidth) of a storage system, instead of a single.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Chapter 12: Mass-Storage Systems.
Secondary Storage CSCI 444/544 Operating Systems Fall 2008.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition Mass-Storage Systems Revised Tao Yang.
12: IO Systems1 Jerry Breecher OPERATING SYSTEMS IO SYSTEMS.
Storage Area Network (SAN)
Storage Networking. Storage Trends Storage growth Need for storage flexibility Simplify and automate management Continuous availability is required.
Session 3 Windows Platform Dina Alkhoudari. Learning Objectives Understanding Server Storage Technologies Direct Attached Storage DAS Network-Attached.
2 © 2004, Cisco Systems, Inc. All rights reserved. IT Essentials I v. 3 Module 9 Advanced Hardware Fundamentals for Servers.
Data Storage Willis Kim 14 May Types of storages Direct Attached Storage – storage hardware that connects to a single server Direct Attached Storage.
Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.
12.1 Silberschatz, Galvin and Gagne ©2009 Operating System Concepts with Java – 8 th Edition Chapter 12: Mass-Storage Systems.
Secondary Storage Unit 013: Systems Architecture Workbook: Secondary Storage 1G.
Tales from the Trenches About
Storage Area Networks The Basics. Storage Area Networks SANS are designed to give you: More disk space Multiple server access to a single disk pool Better.
Sponsored by: PASS Summit 2010 Preview Storage for the DBA Denny Cherry MVP, MCSA, MCDBA, MCTS, MCITP.
ICOM 6005 – Database Management Systems Design Dr. Manuel Rodríguez-Martínez Electrical and Computer Engineering Department Lecture 6 – RAID ©Manuel Rodriguez.
Windows Server MIS 424 Professor Sandvig. Overview Role of servers Performance Requirements Server Hardware Software Windows Server IIS.
Managing Storage Lesson 3.
1 Storage Refinement. Outline Disk failures To attack Intermittent failures To attack Media Decay and Write failure –Checksum To attack Disk crash –RAID.
RAID: High-Performance, Reliable Secondary Storage Mei Qing & Chaoxia Liao Nov. 20, 2003.
GeoVision Solutions Storage Management & Backup. ๏ RAID - Redundant Array of Independent (or Inexpensive) Disks ๏ Combines multiple disk drives into a.
Introducing Snap Server™ 700i Series. 2 Introducing the Snap Server 700i series Hardware −iSCSI storage appliances with mid-market features −1U 19” rack-mount.
N-Tier Client/Server Architectures Chapter 4 Server - RAID Copyright 2002, Dr. Ken Hoganson All rights reserved. OS Kernel Concept RAID – Redundant Array.
I/O – Chapter 8 Introduction Disk Storage and Dependability – 8.2 Buses and other connectors – 8.4 I/O performance measures – 8.6.
Disk Access. DISK STRUCTURE Sector: Smallest unit of data transfer from/to disk; 512B 2/4/8 adjacent sectors transferred together: Blocks Read/write heads.
RAID REDUNDANT ARRAY OF INEXPENSIVE DISKS. Why RAID?
Chapter 12: Mass-Storage Systems Silberschatz, Galvin and Gagne ©2005 Operating System Concepts Chapter 12: Mass-Storage Systems Overview of Mass.
Module 9: Configuring Storage
RAID SECTION (2.3.5) ASHLEY BAILEY SEYEDFARAZ YASROBI GOKUL SHANKAR.
Chapter 12 – Mass Storage Structures (Pgs )
 The End to the Means › (According to IBM ) › 03.ibm.com/innovation/us/thesmartercity/in dex_flash.html?cmp=blank&cm=v&csr=chap ter_edu&cr=youtube&ct=usbrv111&cn=agus.
STORAGE ARCHITECTURE/ MASTER): Disk Storage: What Are Your Options? Randy Kerns Senior Partner The Evaluator Group.
Chap 5: Hard Drives. Chap 5: Magnetic HD Chap 5: Solid State Drives.
Storage Networking. Storage Trends Storage grows %/year, gets more complicated It’s necessary to pool storage for flexibility Intelligent storage.
1 CEG 2400 Fall 2012 Network Servers. 2 Network Servers Critical Network servers – Contain redundant components Power supplies Fans Memory CPU Hard Drives.
Hands-On Microsoft Windows Server 2008 Chapter 7 Configuring and Managing Data Storage.
This courseware is copyrighted © 2016 gtslearning. No part of this courseware or any training material supplied by gtslearning International Limited to.
W4118 Operating Systems Instructor: Junfeng Yang.
Network-Attached Storage. Network-attached storage devices Attached to a local area network, generally an Ethernet-based network environment.
Silberschatz, Galvin and Gagne ©2013 Operating System Concepts – 9 th Edition Chapter 10: Mass-Storage Systems.
Computer Hardware. Focus Items  Design systems that meet business needs  Hardware industry trends  Problems Legacy hardware (and software) Dealing.
EonStor DS 1000.
CMPE Database Systems Workshop June 16 Class Meeting
A Case for Redundant Arrays of Inexpensive Disks (RAID) -1988
Storage Area Networks The Basics.
Video Security Design Workshop:
A Case for Redundant Arrays of Inexpensive Disks (RAID)
I/O System Chapter 5 Designed by .VAS.
Storage Networking.
Chapter 12: Mass-Storage Structure
Denny Cherry twitter.com/mrdenny
Storage Virtualization
Storage Networking.
Chapter 12: Mass-Storage Systems
Improving performance
Presentation transcript:

Hardware (The part you can kick)

Overview  Selection Process  Equipment Categories  Processors  Memory  Storage  Support

Define Requirements  Service Level Agreements  People  Process  Technology  Budget  You may get an AttaBoy for saving a few dollars.  You WILL get blamed for an inadequate system

What is the difference?  Workstation  Single user (desktop/notebook)  Server  Department  Enterprise

Processors  32 bit  64 bit  AMD  Intel  Single-Core  Multi-Core

32 Bit Processors  Proven, mature technology  Low Cost  Compatible  4GB Memory Address Limit  PAE  3GB  AWE  Called x86 (Intel was the first)

64 Bit Processors  Itanium  Incompatible with existing x86 processors  8 or more proc systems Enterprise Systems  AMD64/EMT64 (x64)  Pioneered by AMD. Intel dragged kicking and screaming into the market.  Binary compatible with x86 procs  Extensions for 64 bit commands  Very price effective (10%-15% premium)

Intel  Front Side Bus  Uniform memory access  1-4 processors is easy and fast  Potential memory bottlenecks  Decouples memory and CPU clock rates

AMD  AMD  NUMA NonUniform Memory Architecture  Memory directly controlled by processor  Matches SQLOS memory alignment  No bus bottlenecks  Processor action required for cross-boundary memory access  SQL 2005 native

AMD vs. Intel Drawing © AMD Technologies

Cores  Single-Core  Cheap, proven  Multi-core  Newer  Licensing advantage for SQL (sockets, not cores)  On-die  In-Package  HyperThreading  Simulates multiple cores. 10% to 15% performance boost for most SQL applications  Can slow down system with many non-parallelizable queries

Memory  Speed  Latency  Error Correction

Storage  Disk characteristics  Storage Subsystems  RAID Configuration

Disk Characteristics  RPM – Higher is better  On disk read cache – More is better  SCSI  Fast, reliable, proven, mature  SATA  Cheaper, slower, reliability? (new)  Good for second tier Storage (backup, historical partitions)  Fibre Channel

Storage Types  Locally Attached  SCSI  SATA  NAS  iSCSI  SAN

Local Storage  Hot swap disks  Controllers  Battery-backed cache  Disk arrays  Cache on controller  Cache in cabinet (clusterable)

NAS  Not a block-write device  SMB drive mapping  Cache corruption  Must be on Windows Catalog  CANNOT CLUSTER!!!

iSCSI  SCSI via IP  Lower Cost  Competes with NAS  Large variance in speed, quality, managability, reliability  Cluster nightmare

SAN  Pseudo-SAN – “Smart Array”  Large write cache (GB)  Fibre Channel (SCSI++)  Options  Split mirror backups  Distance synching  Virtual Snapshot  Management (Provisioning) tools

Disk Stripe Alignment  Low-level stripes (Smart Array controller or SAN)  OS-level stripes  MBR boot record offset (63 sectors)  Cache copying. IO doubling.  Up to 40% slowdown.  Diskpart.exe (Win2003 SP1) can pad offset to match stripe size  Diskpar.exe (Win 2000 Resource Kit) for older systems

RAID  Redundant Array of Inexpensive (later Independent) Disks  1988 ACM SIGMOD paper “A Case for Redundant Arrays of Inexpensive Disks (RAID)” by David A. Patterson, Garth A. Gibson, and Randy H. Katz.  Overcomes size and reliability limitations of physical disks

RAID Levels  JBOD Just A Bunch of Disks  RAID 0 Striping with no redundancy  RAID 1 Mirroring  RAID 2-3 not worth talking about  RAID 4 Stripe with Parity Disk  RAID 5 Stripe with Parity Rotation  RAID 1+0 (10) Stripe of mirrored pairs  RAID 0+1 (10) Mirror of stripes  RAID 50 Stripe of stripes w/ parity

RAID Performance  RAID 0  Read  Stripe advantage N  Write  1  RAID 1  Read  Stripe Advantage 2  Write  2x  RAID 5  Read  Stripe Advantage N-1  Write  N-2 reads + 2 Writes  RAID  Read  Stripe Advantage N  Write  2x

Baseline Performance  SQLIO stress utility  IOMeter stress utility  Performance Monitor capture

Support  Life cycle of equipment  Parts/service SLA  Management and Monitoring software  Working relationship

Questions