Buying Database Hardware Adam Backman – President White Star Software, LLC.

Slides:



Advertisements
Similar presentations
Express5800/ft series servers Product Information Fault-Tolerant General Purpose Servers.
Advertisements

1/17/20141 Leveraging Cloudbursting To Drive Down IT Costs Eric Burgener Senior Vice President, Product Marketing March 9, 2010.
Ted Krueger SQL Server MVP Data Architect Building a SQL Server Test Lab.
1 RAID Overview n Computing speeds double every 3 years n Disk speeds cant keep up n Data needs higher MTBF than any component in system n IO.
Copyright © 2006 Quest Software SQL 2005 Disk I/O Performance By Bryan Oliver SQL Server Domain Expert.
T OP N P ERFORMANCE T IPS Adam Backman Partner, White Star Software.
MUNIS Platform Migration Project WELCOME. Agenda Introductions Tyler Cloud Overview Munis New Features Questions.
Database Storage for Dummies Adam Backman President – White Star Software, LLC.
Chapter 4 Infrastructure as a Service (IaaS)
Numbers, We don’t need no stinkin’ numbers Adam Backman Vice President DBAppraise, Llc.
SAM SPENCER Server Virtualization. Agenda Introduction History Server Virtualization Software Server Virtualization Hardware Determining Server Hardware.
Take your CMS to the cloud to lighten the load Brett Pollak Campus Web Office UC San Diego.
10 REASONS Why it makes a good option for your DB IN-MEMORY DATABASES Presenter #10: Robert Vitolo.
© 2010 VMware Inc. All rights reserved Confidential Performance Tuning for Windows Guest OS IT Pro Camp Presented by: Matthew Mitchell.
Enhanced Availability With RAID CC5493/7493. RAID Redundant Array of Independent Disks RAID is implemented to improve: –IO throughput (speed) and –Availability.
1 Magnetic Disks 1956: IBM (RAMAC) first disk drive 5 Mb – Mb/in $/year 9 Kb/sec 1980: SEAGATE first 5.25’’ disk drive 5 Mb – 1.96 Mb/in2 625.
Chapter 5: Server Hardware and Availability. Hardware Reliability and LAN The more reliable a component, the more expensive it is. Server hardware is.
REDUNDANT ARRAY OF INEXPENSIVE DISCS RAID. What is RAID ? RAID is an acronym for Redundant Array of Independent Drives (or Disks), also known as Redundant.
Empowering Business in Real Time. © Copyright 2009, OSIsoft Inc. All rights Reserved. Virtualization and HA PI Systems: Three strategies to keep your PI.
Adam Duffy Edina Public Schools.  The heart of virtualization is the “virtual machine” (VM), a tightly isolated software container with an operating.
2 June 2015 © Enterprise Storage Group, Inc. 1 The Case for File Server Consolidation using NAS Nancy Marrone Senior Analyst The Enterprise Storage Group,
Ken Birman. Massive data centers We’ve discussed the emergence of massive data centers associated with web applications and cloud computing Generally.
Reliability Week 11 - Lecture 2. What do we mean by reliability? Correctness – system/application does what it has to do correctly. Availability – Be.
OS and Hardware Tuning. Tuning Considerations Hardware  Storage subsystem Configuring the disk array Using the controller cache  Components upgrades.
Presented by Sujit Tilak. Evolution of Client/Server Architecture Clients & Server on different computer systems Local Area Network for Server and Client.
VIRTUALIZATION AND YOUR BUSINESS November 18, 2010 | Worksighted.
Session 3 Windows Platform Dina Alkhoudari. Learning Objectives Understanding Server Storage Technologies Direct Attached Storage DAS Network-Attached.
Data Storage Willis Kim 14 May Types of storages Direct Attached Storage – storage hardware that connects to a single server Direct Attached Storage.
Virtual Network Servers. What is a Server? 1. A software application that provides a specific one or more services to other computers  Example: Apache.
Virtualization A way To Begin with Virtual Reality… - Rahul Khanwani.
CERN IT Department CH-1211 Genève 23 Switzerland t Next generation of virtual infrastructure with Hyper-V Michal Kwiatek, Juraj Sucik, Rafal.
Data Deduplication in Virtualized Environments Marc Crespi, ExaGrid Systems
Measuring zSeries System Performance Dr. Chu J. Jong School of Information Technology Illinois State University 06/11/2012 Sponsored in part by Deer &
Windows Server MIS 424 Professor Sandvig. Overview Role of servers Performance Requirements Server Hardware Software Windows Server IIS.
VAP What is a Virtual Application ? A virtual application is an application that has been optimized to run on virtual infrastructure. The application software.
Effectively Explaining the Cloud to Your Colleagues.
Evolved Virtual Data Center Reserved Resource Pools.
COMPANY AND PRODUCT OVERVIEW Russ Taddiken Director of Principal Storage Architecture.
Redundant Array of Independent Disks
Database Services for Physics at CERN with Oracle 10g RAC HEPiX - April 4th 2006, Rome Luca Canali, CERN.
Database Storage Considerations Adam Backman White Star Software DB-05:
Best Practices for Backup in SAN/NAS Environments Jeff Wells.
Cloud Computing & Amazon Web Services – EC2 Arpita Patel Software Engineer.
Virtualization for Storage Efficiency and Centralized Management Genevieve Sullivan Hewlett-Packard
Hadoop Hardware Infrastructure considerations ©2013 OpalSoft Big Data.
RAID SECTION (2.3.5) ASHLEY BAILEY SEYEDFARAZ YASROBI GOKUL SHANKAR.
DONE-08 Sizing and Performance Tuning N-Tier Applications Mike Furgal Performance Manager Progress Software
How AWS Pricing Works Jinesh Varia Technology Evangelist.
Eric Burgener VP, Product Management A New Approach to Storage in Virtual Environments March 2012.
Clustering In A SAN For High Availability Steve Dalton, President and CEO Gadzoox Networks September 2002.
VMware vSphere Configuration and Management v6
 The End to the Means › (According to IBM ) › 03.ibm.com/innovation/us/thesmartercity/in dex_flash.html?cmp=blank&cm=v&csr=chap ter_edu&cr=youtube&ct=usbrv111&cn=agus.
Buying Database Hardware Adam Backman – President White Star Software, LLC.
Component 8/Unit 9aHealth IT Workforce Curriculum Version 1.0 Fall Installation and Maintenance of Health IT Systems Unit 9a Creating Fault Tolerant.
G046 Lecture 04 Task C Briefing Notes Mr C Johnston ICT Teacher
1 CEG 2400 Fall 2012 Network Servers. 2 Network Servers Critical Network servers – Contain redundant components Power supplies Fans Memory CPU Hard Drives.
Background Computer System Architectures Computer System Software.
Infrastructure for the DBA: An Introduction Peter Shore SQL Saturday Chicago 2016.
REMINDER Check in on the COLLABORATE mobile app Best Practices for Oracle on VMware - Deep Dive Darryl Smith Chief Database Architect Distinguished Engineer.
Capacity Planning For the Hybrid Cloud From an infrastructure owner’s perspective.
Unit 2 VIRTUALISATION. Unit 2 - Syllabus Basics of Virtualization Types of Virtualization Implementation Levels of Virtualization Virtualization Structures.
Amazon Web Services. Amazon Web Services (AWS) - robust, scalable and affordable infrastructure for cloud computing. This session is about:
PHD Virtual Technologies “Reader’s Choice” Preferred product.
RAID Overview.
Integrating Disk into Backup for Faster Restores
Adam Backman Chief Cat Wrangler – White Star Software
Customer Profile (Target)
Specialized Cloud Architectures
CS 295: Modern Systems Organizing Storage Devices
Presentation transcript:

Buying Database Hardware Adam Backman – President White Star Software, LLC.

About the speaker President – White Star Software One of the oldest and most respected consulting and training companies in the Progress OpenEdge sector Vice President – DBAppraise Managed database services backed up by experienced Progress OpenEdge professionals not rookies off the bench Author – Progress Softwares Expert Series Over 25 years of Progress OpenEdge experience Technical support Training Consulting (Database and System configuration, management and tuning)

No need to buy hardware – Progress Pacific will take care of it!

Agenda Understanding system resources Picking the right vendor Where to spend your money CPU fast vs. many Memory – can you ever have too much Disk – where all the data starts Network and other parts of the system Conclusion

Understanding system resources Supported architectures Understand your options Performance tradeoffs

Main types of architectures supported by OpenEdge Database engine Database with no portion of the application Host-based system Database, clients and background all on one system Pure client/server Database on one machine and clients on other machines Part of an n-tier architecture Database and background on Machine A AppServers on Machine B Clients on individual machines

Understand your options Single large system vs. 2 or more smaller machines Virtualization Single platform or multi-platform Cloud vendors SAN vs. Direct attached storage Network considerations

Single large machine vs. 2 or more smaller machines Single large machine Pros Highest potential performance by eliminating network layer Easier to manage as everything is in one place Cons A single machine will have limited scalability Usually two mid-range systems are more cost effective than a single high-end system Potential license cost issues (CPU-Based pricing)

Single large machine vs. 2 or more smaller machines (cont.) Multi-machine Pros Flexibility – ability to repurpose machines Scalability – ability to add additional machines to solution Recoverability – ability to use AppServer machine as the database engine Cons Cost – duplication of items, power, maintnenace Adding network layer can hurt performance Management – more machines to manage Maintenance – more things to break

Purchase guidance Databases tend to use disk extensively Spend on disk subsystem Allow for a minimum of 10% of the database size for database buffers (-B memory) Do not forget other memory allocations OS buffers can be reduced to 10% or less of total memory Applications are memory and CPU intensive Generally better to buy more cores vs. fewer faster cores but not always some apps have major single-threaded operations Memory can greatly reduce I/O via –B -Bp -Bt, -mmax, … Examine your use cases for the machine and buy with both primary use and most likely alternative uses in mind

Purchase guidance Most people over spend on CPU You can have all the CPU in the world but it will do you no good unless you can get data to them efficiently People should focus on the performance food chain Network Disk Memory CPU Slower resources should be addressed before faster resources

Virtualization Everyone is doing it but why? Ability to build new environments Ability to recover quickly (part of a DR solution) Reduction in common resource use per server Power Cooling Floor/rack space Potential for better resource saturation (unused CPU) Why not? Complexity Cost (VMWare is not free :-) More applications affected by an outage

Options: N-tier option Database engine Fast Disk Moderate memory (over 10% of DB + OS and extras) Relatively little CPU AppServer machine Internal disk – setup well but not crazy Higher memory usage CPU intensive Client machine Web/Mobile Desktops Citrix/Windows terminal server

Cloud: Make it someone elses problem

Cloud Watch for variable performance Measure throughput (Disk and memory) Measure compute capacity Measure at different days/times Performance guaranty from vendor Iops/sec. vs. perception (real measurements) Amazon (HPC) high performance computing

Why is disk important CPU capacity doubles every 18 months Network bandwidth doubling every 12 months Memory is 37,000+ times faster than disk Disk (per disk I/O rate) fairly static (150 – 200 iops/sec.) Storage will generally cost more than servers and this is particularly true for database servers

Buy better storage Many disks 150 iops/sec. per disk Look at you buffer hit rate and total request load Dont forget temporary file I/O which can account for a significant percentage of your total I/O load Larger cache Some systems require you to expand cache when you expand your storage but most dont Adding cache is akin to adding database buffers to a database SSD – save money buy fewer devices SSDs are a real solution now and prices are competitive though not cheap when compared to conventional storage on a per GB basis

Do better disk configuration Still no RAID 5, No RAID S, No RAID 6, No RAID 7 RAID 10 still king for database storage – really there are a bunch of really cool stats to prove this out Large stripe widths Performance improved with stripe width through 2MB Use best portion of rotating disk (rotating rust) Using outer edge of disk will provide the best performance which may be as much as 15% better vs. inner portion of disk Even usage across all disks Eliminate disk variance Think of ALL sources of I/O (DB, BI, AI, Temp files, OS, …)

Storage Direct attached Less expensive in most cases Less complex – Single machine tuning OS and Array High performance – Disks dedicated SAN – generalized business storage NAS – file optimized storage SAN – Purpose-built high performance Why SAN twice? There is a huge difference in SANs and you need to buy for your need not for their marketing

Direct-attached storage Pros Not shared with other hosts (isolation is bliss) Easier problem resolution Massive controller throughput for little money Cheaper to maintain Cons Not shared with other hosts (no cost sharing)

SAN: Generalized business storage Pros Best option in virtualized environment Share one powerful storage system with many hosts One stop storage system for all hosts Cons High initial cost Single point of failure unless array mirroring/clustering is in place Not optimized to individual tasks Complex

SAN: Purpose-built Pros: Excellent performance Additional control at array level Massively scalable Ability to dedicate resources to hosts Reliable (fault tolerant) Cons Single point of failure unless array mirroring is in place Cost Complexity

SAN monitoring More difficult as there are many moving parts Multiple hosts need to be monitored SAN needs to be monitored Monitoring data needs to be synchronized Work loads need to be balanced across hosts

NAS: file optimized storage Pros Sharable across hosts Generally cheaper than SAN Good service for application files Cons File optimized not block optimized Not database optimized Not client temporary file optimized

Storage network Should be isolated Physically Separate vlan if physical is not possible Use large MTU size (ALL must be the same) Host Guest Switch Array

Network options Simple Put a single quad card in the server and bind the ports for performance Moderate Multiple cards bound with a two networks. One for Data and the other for client traffic Complex Multiple machine Multiple networks (vlan) Dedicated networks for DB, replication, client traffic, AppServer

Network Try to use your network efficiently -Mm 8192 to increase throughput Remember to move to jumbo frames (client, server, switches, …) Move invasive processes to separate network Backup Replication System syncronizations

Picking the right vendor – The less of two evils

Picking the right vendor Better support nearly always beats a better upfront price Look at quality of local support infrastructure Response time (SLA) In country In the correct language Always comparison shop even if you know what you want This keeps vendors honest Choosing historic rivals helps drive down price Simplify to enhance support Bundle Linux support under hardware contract Single vendor simplicity

Paying for support Buy all support with the initial purchase Allows easier (capital) write-off Years 4+ of support can cost as much as the initial price if purchased later

Picking the wrong solution NetApp for database storage. Performance will be non- optimal NUMA Architecture – Good vendors make bad solutions All CPUs allocated to a Progress domain must come from the same book/shelf/node All Memory must meet the same criteria as CPU Using client/server for reporting Kill the network access whenever possible Use AppServer for complex OLTP

Where to spend your money Disks Storage SAN SSD Really, look at storage first then concern yourself with other trivial issues such as memory and CPU This is the problem over 9 out of 10 times

Questions, Comments, … Preguntas

THANK YOU Thank you for your time