IT Infrastructure Database Tuning – Fall 2015.

Slides:

Advertisements

Similar presentations

1 Mixing Public and private clouds a Practical Perspective Maarten Koopmans Nordunet Conference 2009 Maarten Koopmans Nordunet Conference 2009.

Advertisements

Tuning the Dennis Shasha and Philippe Bonnet, 2013.

Removing the I/O Bottleneck with Virident PCIe Solid State Storage Solutions Jan Silverman VP Operations.

new database engine component fully integrated into SQL Server 2014 optimized for OLTP workloads accessing memory resident data achive improvements.

Virtual Memory 1 Computer Organization II © McQuain Virtual Memory Use main memory as a cache for secondary (disk) storage – Managed jointly.

Challenges in Getting Flash Drives Closer to CPU Myoungsoo Jung (UT-Dallas) Mahmut Kandemir (PSU) The University of Texas at Dallas.

U NIVERSITY U NIVERSITY OF T ORONTO U NIVERSITY OF T ORONTO Bionic databases are coming. What will they look like? *Ryan Johnson & Ippokratis Pandis**

Exadata Distinctives Brown Bag New features for tuning Oracle database applications.

Slides Prepared from the CI-Tutor Courses at NCSA By S. Masoud Sadjadi School of Computing and Information Sciences Florida.

Scalable Multi-Cache Simulation Using GPUs Michael Moeng Sangyeun Cho Rami Melhem University of Pittsburgh.

University of Notre Dame

Differentiated I/O services in virtualized environments

1 Magnetic Disks 1956: IBM (RAMAC) first disk drive 5 Mb – Mb/in $/year 9 Kb/sec 1980: SEAGATE first 5.25’’ disk drive 5 Mb – 1.96 Mb/in2 625.

International Conference on Supercomputing June 12, 2009

SQL Server on VMware Jonathan Kehayias (MCTS, MCITP) SQL Database Administrator Tampa, FL.

OS Tuning Database Tuning - Spring Operating System Software that provide services to applications and abstracts hardware resources: – Processing.

Ji-Yong Shin Cornell University In collaboration with Mahesh Balakrishnan (MSR SVC), Tudor Marian (Google), and Hakim Weatherspoon (Cornell) Gecko: Contention-Oblivious.

Gordon: Using Flash Memory to Build Fast, Power-efficient Clusters for Data-intensive Applications A. Caulfield, L. Grupp, S. Swanson, UCSD, ASPLOS’09.

Cloud computing Tahani aljehani.

Presenter MaxAcademy Lecture Series – V1.0, September 2011 Introduction and Motivation.

1. Outline Introduction Virtualization Platform - Hypervisor High-level NAS Functions Applications Supported NAS models 2.

Operating Systems CMPSC 473 I/O Management (2) December Lecture 24 Instructor: Bhuvan Urgaonkar.

A Brief Overview by Aditya Dutt March 18 th ’ Aditya Inc.

C.S. Choy95 COMPUTER ORGANIZATION Logic Design Skill to design digital components JAVA Language Skill to program a computer Computer Organization Skill.

Key Perf considerations & bottlenecks Windows Azure VM characteristics Monitoring TroubleshootingBest practices.

Overview Introduction The Level of Abstraction Organization & Architecture Structure & Function Why study computer organization?

Introduction. Outline What is database tuning What is changing The trends that impact database systems and their applications What is NOT changing The.

1 CS503: Operating Systems Spring 2014 Dongyan Xu Department of Computer Science Purdue University.

1 - CPRE 583 (Reconfigurable Computing): Reconfigurable Computing Archs, VHDL 3 Iowa State University (Ames) CPRE 583 Reconfigurable Computing Lecture.

1EMC CONFIDENTIAL—INTERNAL USE ONLY Why EMC for SQL Performance Optimization.

Improving Network I/O Virtualization for Cloud Computing.

Cloud Computing & Amazon Web Services – EC2 Arpita Patel Software Engineer.

Mayuresh Varerkar ECEN 5613 Current Topics Presentation March 30, 2011.

Memory  Main memory consists of a number of storage locations, each of which is identified by a unique address  The ability of the CPU to identify each.

Designing and Deploying a Scalable EPM Solution Ken Toole Platform Test Manager MS Project Microsoft.

DBI313. MetricOLTPDWLog Read/Write mixMostly reads, smaller # of rows at a time Scan intensive, large portions of data at a time, bulk loading Mostly.

Price Performance Metrics CS3353. CPU Price Performance Ratio Given – Average of 6 clock cycles per instruction – Clock rating for the cpu – Number of.

1 - CPRE 583 (Reconfigurable Computing): Reconfigurable Computing Architectures Iowa State University (Ames) Reconfigurable Architectures Forces that drive.

1 CS : Technology Trends Ion Stoica and Ali Ghodsi ( August 31, 2015.

Computer Hardware. Lally School of M&T- Microcomputing and Info Systems Lecture Topics 1. Data Representation 2. Data Metrics 3. Central processing Unit.

Cloud Computing is a Nebulous Subject Or how I learned to love VDF on Amazon.

1 Advanced Operating Systems - Fall 2009 Lecture 2 – January 12, 2009 Dan C. Marinescu Office: HEC 439 B.

© 2006 EMC Corporation. All rights reserved. The Host Environment Module 2.1.

Aneka Cloud ApplicationPlatform. Introduction Aneka consists of a scalable cloud middleware that can be deployed on top of heterogeneous computing resources.

Chapter 1: How are computers organized?. Software, data, & processing ? A computers has no insight or intuition A computers has no insight or intuition.

Logical & Physical Address Nihal Güngör. Logical Address In simplest terms, an address generated by the CPU is known as a logical address. Logical addresses.

1 - CPRE 583 (Reconfigurable Computing): Reconfigurable Computing Architectures Iowa State University (Ames) CPRE 583 Reconfigurable Computing Lecture.

CDA-5155 Computer Architecture Principles Fall 2000 Multiprocessor Architectures.

Introduction to Exadata X5 and X6 New Features

CIT 140: Introduction to ITSlide #1 CSC 140: Introduction to IT Operating Systems.

Chapter 3 Getting Started. Copyright © 2005 Pearson Addison-Wesley. All rights reserved. Objectives To give an overview of the structure of a contemporary.

MOTHER BOARD PARTS BY BOGDAN LANGONE BACK PANEL CONNECTORS AND PORTS Back Panels= The back panel is the portion of the motherboard that allows.

E2800 Marco Deveronico All Flash or Hybrid system

Hardware vs. Software Question 1 What is hardware?

Big Data Management – Fall 2016

Flash Storage 101 Revolutionizing Databases

Chapter 1: A Tour of Computer Systems

Using non-volatile memory (NVDIMM-N) as block storage in Windows Server 2016 Tobias Klima Program Manager.

Sebastian Solbach Consulting Member of Technical Staff

Windows Server* 2016 & Intel® Technologies

HPE Persistent Memory Microsoft Ignite 2017

SCSI over PCI Express (SOP) use cases

Building a Database on S3

Today’s agenda Hardware architecture and runtime system

Cloud computing mechanisms

Chap. 12 Memory Organization

COMP4442 Cloud Computing: Assignment 1

CS 295: Modern Systems Storage Technologies Introduction

Presentation transcript:

IT Infrastructure Database Tuning – Fall 2015

Slotnik’s Law of Effort #1: Heterogeneous Systems LOOK UP: Slotnik vs. Amdahl (AFIPS’67), Michael Flynn’s talk on dataflow machines, Ryan Johnson’s paper on bionic databases. @ Dennis Shasha and Philippe Bonnet, 2013 Source: http://www.anandtech.com/show/2933

Bill Daly’s slide deck on exascale computing project NVidia’s vision

@ Dennis Shasha and Philippe Bonnet, 2013 IO Architecture Processor [core i7] 2x21GB/sec RAM 16 GB/sec SSD Memory bus PCI Express HDD Southbridge Chipset [z68] 5 GB/sec RAID controller 3 GB/sec SATA ports PCI HDD SSD 3 GB/sec SSD SSD SSD Byte addressable Block addressable LOOK UP: Smart Response Technology (SSD caching managed by z68) @ Dennis Shasha and Philippe Bonnet, 2013

@ Dennis Shasha and Philippe Bonnet, 2013 RAID Controller PCI bridge Batteries RAM CPU Host Bus Adapter Caching Write-back / write-through Logical disk organization JBOD RAID @ Dennis Shasha and Philippe Bonnet, 2013

Slotnik’s Law of Effort #2: The emergence of SSDs Latency of 5000 random writes on an Intel 710 SSD (10 successive passes over 250 KB with 512B random writes on a random formatted device). Throughput for 4K read IOs from product specifications Read Write Logical address space Scheduling & Mapping Wear Leveling Garbage collection Program Erase Chip … Flash memory array Channels Physical address space LOOK UP: The necessary death of the block device interface @ Dennis Shasha and Philippe Bonnet, 2013

Case: TPC-C Top Performer (01/13) Redo Log Configuration Total system cost 30,528,863 USD Performance 30,249,688 tpmC Total #processors 108 Total #cores 1728 Total storage 1,76 PB Total #users 24,300,000 LOOK UP: TPC-C OLTP Benchmark @ Dennis Shasha and Philippe Bonnet, 2013 Source: http://www.tpc.org/tpcc/results/tpcc_result_detail.asp?id=110120201

Warehouse-Scale Computer LOOK UP: Werner Voegels on virtualization. @ Dennis Shasha and Philippe Bonnet, 2013 Source: http://www.morganclaypool.com/doi/abs/10.2200/S00193ED1V01Y200905CAC006

Cloud Services IaSS: compute and storage abstractions (VM, load balancer) ex: AWS, Azure PaSS: execution environment ex: Google App Engine, AWS, Azure SaSS: managed software ex: SQL Azure, Snowflake Private, public, hybrid coud

source: Microsoft Key metric: number of servers per administrator – Amazon: 10K

@ Dennis Shasha and Philippe Bonnet, 2013 Database Appliances @ Dennis Shasha and Philippe Bonnet, 2013 Source: http://www.oracle.com/us/products/database/exadata/overview/index.html

Mainframe Fast processors, lots of hardware accelerators, lots of RAM and storage Hardware resources are virtualized: e.g., single-level store High-performance, general purpose applicance; or alternative to a private cloud

Storage Architectures source: Virtual Geek’s take on storage tree of life – A MUST READ!! Storage RAM Interconnect © Philippe Bonnet, 2014

Data-Intensive Applications: Server-side Architectures Look up Fabric Computing on Wikipedia. source: Virtual Geek’s take on storage tree of life – A MUST READ!! © Philippe Bonnet, 2014

Source: Chad Sakac,EMC, software-defined storage - what's next, vmworld 2014