Maximizing Performance – Why is the disk subsystem crucial to console performance and what’s the best disk configuration. Extending Performance – How.

Slides:

Advertisements

Similar presentations

Data Storage Solutions Module 1.2. Data Storage Solutions Upon completion of this module, you will be able to: List the common storage media and solutions.

Advertisements

1 Cache and Caching David Sands CS 147 Spring 08 Dr. Sin-Min Lee.

Physical DataBase Design

CA 714CA Midterm Review. C5 Cache Optimization Reduce miss penalty –Hardware and software Reduce miss rate –Hardware and software Reduce hit time –Hardware.

Big Data Working with Terabytes in SQL Server Andrew Novick

Enhanced Availability With RAID CC5493/7493. RAID Redundant Array of Independent Disks RAID is implemented to improve: –IO throughput (speed) and –Availability.

1 Magnetic Disks 1956: IBM (RAMAC) first disk drive 5 Mb – Mb/in $/year 9 Kb/sec 1980: SEAGATE first 5.25’’ disk drive 5 Mb – 1.96 Mb/in2 625.

Lecture 36: Chapter 6 Today’s topic –RAID 1. RAID Redundant Array of Inexpensive (Independent) Disks –Use multiple smaller disks (c.f. one large disk)

CSCE 212 Chapter 8 Storage, Networks, and Other Peripherals Instructor: Jason D. Bakos.

REDUNDANT ARRAY OF INEXPENSIVE DISCS RAID. What is RAID ? RAID is an acronym for Redundant Array of Independent Drives (or Disks), also known as Redundant.

CS4432: Database Systems II Data Storage - Lecture 2 (Sections 13.1 – 13.3) Elke A. Rundensteiner.

Computer ArchitectureFall 2007 © November 28, 2007 Karem A. Sakallah Lecture 24 Disk IO and RAID CS : Computer Architecture.

CS CS 5150 Software Engineering Lecture 19 Performance.

CSE 190: Internet E-Commerce Lecture 16: Performance.

Chapter Physical Database Design Methodology Software & Hardware Mapping Logical Design to DBMS Physical Implementation Security Implementation Monitoring.

1 Storage Hierarchy Cache Main Memory Virtual Memory File System Tertiary Storage Programs DBMS Capacity & Cost Secondary Storage.

Computer ArchitectureFall 2008 © November 12, 2007 Nael Abu-Ghazaleh Lecture 24 Disk IO.

1 CS143: Disks and Files. 2 System Architecture CPU Main Memory Disk Controller... Disk Word (1B – 64B) ~ x GB/sec Block (512B – 50KB) ~ x MB/sec System.

1 CS222: Principles of Database Management Fall 2010 Professor Chen Li Department of Computer Science University of California, Irvine Notes 01.

CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.

© 2009 IBM Corporation Statements of IBM future plans and directions are provided for information purposes only. Plans and direction are subject to change.

Data Storage Willis Kim 14 May Types of storages Direct Attached Storage – storage hardware that connects to a single server Direct Attached Storage.

Chapter 9 Overview  Reasons to monitor SQL Server  Performance Monitoring and Tuning  Tools for Monitoring SQL Server  Common Monitoring and Tuning.

Module 8: Monitoring SQL Server for Performance. Overview Why to Monitor SQL Server Performance Monitoring and Tuning Tools for Monitoring SQL Server.

Microsoft Virtual Academy Module 4 Creating and Configuring Virtual Machine Networks.

Introduction to Database Systems 1 The Storage Hierarchy and Magnetic Disks Storage Technology: Topic 1.

Switching Techniques Student: Blidaru Catalina Elena.

DISKS IS421. DISK  A disk consists of Read/write head, and arm  A platter is divided into Tracks and sector  The R/W heads can R/W at the same time.

LAN / WAN Business Proposal. What is a LAN or WAN? A LAN is a Local Area Network it usually connects all computers in one building or several building.

Microsoft ® System Center Operations Manager Infrastructure Planning and Design Published: November 2012.

Key Perf considerations & bottlenecks Windows Azure VM characteristics Monitoring TroubleshootingBest practices.

Microsoft ® System Center Operations Manager 2007 Infrastructure Planning and Design Published: June 2008 Updated: July 2010.

I/O – Chapter 8 Introduction Disk Storage and Dependability – 8.2 Buses and other connectors – 8.4 I/O performance measures – 8.6.

Nexenta Proprietary Global Leader in Software Defined Storage Nexenta Technical Sales Professional (NTSP) COURSE CONTENT.

Exchange Storage Sizing and Hardware Exposed Jim McBee

Indiana University’s Name for its Sakai Implementation Oncourse CL (Collaborative Learning) Active Users = 112,341 Sites.

Microsoft ® Exchange Server 2010 with Service Pack 1 Infrastructure Planning and Design Published: December 2010 Updated: July 2011.

Designing and Deploying a Scalable EPM Solution Ken Toole Platform Test Manager MS Project Microsoft.

Switching breaks up large collision domains into smaller ones Collision domain is a network segment with two or more devices sharing the same Introduction.

DBI313. MetricOLTPDWLog Read/Write mixMostly reads, smaller # of rows at a time Scan intensive, large portions of data at a time, bulk loading Mostly.

1/14/2005Yan Huang - CSCI5330 Database Implementation – Storage and File Structure Storage and File Structure.

© 2008 Quest Software, Inc. ALL RIGHTS RESERVED. Perfmon and Profiler 101.

Switched Storage Architecture Benefits Computer Measurements Group November 14 th, 2002 Yves Coderre.

11 MANAGING PERFORMANCE Chapter 16. Chapter 16: MANAGING PERFORMANCE2 OVERVIEW  Optimize memory, disk, and CPU performance  Monitor system performance.

Module 3 Planning and Deploying Mailbox Services.

Lecture 3 Page 1 CS 111 Online Disk Drives An especially important and complex form of I/O device Still the primary method of providing stable storage.

2.1 © 2004 Pearson Education, Inc. Exam Designing a Microsoft ® Windows ® Server 2003 Active Directory and Network Infrastructure Lesson 2: Examining.

CENTER FOR HIGH PERFORMANCE COMPUTING Introduction to I/O in the HPC Environment Brian Haymore, Sam Liston,

Database Systems Disk Management Concepts. WHY DO DISKS NEED MANAGING? logical information  physical representation bigger databases, larger records,

SATA In Enterprise Storage Ron Engelbrecht Vice President and General Manager Engineering and Manufacturing Operations September 21, 2004.

Scalability == Capacity * Density.

CPSC 231 Secondary storage (D.H.)1 Learning Objectives Understanding disk organization. Sectors, clusters and extents. Fragmentation. Disk access time.

FILE SYSTEM IMPLEMENTATION 1. 2 File-System Structure File structure Logical storage unit Collection of related information File system resides on secondary.

Chapter 10: Mass-Storage Systems

Table General Guidelines for Better System Performance

SQL Disk I/O Performance

Operating System I/O System Monday, August 11, 2008.

Introduction to Networks

Switching Techniques In large networks there might be multiple paths linking sender and receiver. Information may be switched as it travels through various.

Software Architecture in Practice

Storage Virtualization

Lecture 11: DMBS Internals

Migration Strategies – Business Desktop Deployment (BDD) Overview

20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.

Table General Guidelines for Better System Performance

Switching Techniques.

Persistence: hard disk drive

Mass-Storage Systems.

Chapter 11: Mass-Storage Systems

CPS216: Advanced Database Systems Notes 04: Data Access from Disks

Presentation transcript:

Maximizing Performance – Why is the disk subsystem crucial to console performance and what’s the best disk configuration. Extending Performance – How to further improve console performance by implementing User Roles.

Native Performance (NP) Sequential IO Interactive Performance (IP) Random IO Track to Track Seek Time

Memory – Quantity Processor – Speed Network* – Quantity & Speed Bandwidth & Latency Disk - Multiple Variables Redundancy Quantity (Capacity) I/O Speed

Disk subsystems performance influenced by multiple variables: Storage tuning very complex due to many variables.

Minimum Disks: 4 Advantages: Combines read performance of RAID 0 w/ the fault-tolerance of RAID 1 Fault-Tolerance: Excellent Application: High performance applications requiring data protection and maximum read performance

SAN Optimized for Capacity. High Capacity Disks Reduces Spindle Count – Impedes I/O. Excess Capacity Shared Out. Cost per GB

5000 Agents / 7 Day Retention Primary Database = 170GB Single Disk: 15,000K RPM, SCSI/Fiber Channel IO at 80% Greater than 100% - IO Requests Queued Thus Increasing Latency – Over Size IO Requirements Avg. Disk Sec/Read < 20ms / No Spikes* Max. Disk Reads/Sec = 6000 (Size for this, not the average)

6000 IO = 26 Disks (6000 IO / 225 IO) RAID 10 : 36 GB Disk = 936GB Raw / 468 Usable (36%) 72 GB Disk = 1872GB Raw / 936 Usable (18%) 144 GB Disk = 3744 Raw / 1872 Usable (9%) 300 GB Disk = 7800 Raw / 3900 Usable (04%) Extra space makes for a terrific parking lot, just minimize traffic.

What the customer needs to know: Required Database Size Avg. disk sec/read < 20 ms – maximum value Provide IO – Average & Maximum (n+1000) Information above necessary to design an appropriate disk subsystem. Let the SAN and Disk folks figure it out! Observed vs. Theoretical Capacity

Operations Console introduces load on OperationsManager database. Resource Intensive RMS influences performance too. All operations consoles connect to RMS. Unusually High Activity Disk Persistence Queue Large Number of Monitors Config Files – Large & Frequently Modified Solution: 64-Bit, Fast Disk & Physical Memory

Typical add more and more resources to get performance. Maximize what you have by reducing the overhead: Implement User Roles to control views. Why update objects not needed? Overhead. Considerably improves user experience in console. Deploy Web Console Limit Desktop Consoles Challenge – Requires Planning and Maintenance

RAID Calculator: ading~Room/category/Technical~Information/options/ RAID~Calculator ading~Room/category/Technical~Information/options/ RAID~Calculator OpsManJam Web Site: