1.

Slides:



Advertisements
Similar presentations
Exadata Embracing Change What is familiar and what is new? The statements and opinions expressed here are my own and do not necessarily represent those.
Advertisements

Chris Ruel * Image used without permission.
<Insert Picture Here>
Exadata Distinctives Brown Bag New features for tuning Oracle database applications.
DB-03: A Tour of the OpenEdge™ RDBMS Storage Architecture Richard Banville Technical Fellow.
Oracle Exadata for SAP.
Living with Exadata Presented by: Shaun Dewberry, OS Administrator, RDC Tom de Jongh van Arkel, Database Administrator, RDC Komaran Hansragh, Data Warehouse.
Introduction to DBA.
A Fast Growing Market. Interesting New Players Lyzasoft.
Oracle Database Compression with Oracle Database 12c
Delphix User Experience
Technology Day Business drivers for 10g Migration.
1 - Oracle Server Architecture Overview
Bill Hodak Principal Product Manager
Exchange 2010 Project Presentation/Discussion August 12, 2015 Project Team: Mark Dougherty – Design John Ditto – Project Manager Joel Eussen – Project.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 1.
© 2009 Oracle Corporation. S : Slash Storage Costs with Oracle Automatic Storage Management Ara Vagharshakian ASM Product Manager – Oracle Product.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1 Preview of Oracle Database 12 c In-Memory Option Thomas Kyte
Oracle Partitioning in Oracle Database 11g
SANPoint Foundation Suite HA Robert Soderbery Sr. Director, Product Management VERITAS Software Corporation.
CHAPTER 11 Large Objects. Need for Large Objects Data type to store objects that contain large amount of text, log, image, video, or audio data. Most.
Business and Technology Status 2007 Global economy is more dependent on IT than ever before Information management is THE major mission of the enterprise.
9/11/2015ISYS366 - Week051 ISYS366 – Week 5-6 Database Tuning - User and Rollback Data Spaces, Recovery, Backup.
Chapter Oracle Server An Oracle Server consists of an Oracle database (stored data, control and log files.) The Server will support SQL to define.
Oracle on Windows Server Introduction to Oracle10g on Microsoft Windows Server.
1 Oracle Database 11g – Flashback Data Archive. 2 Data History and Retention Data retention and change control requirements are growing Regulatory oversight.
By Lecturer / Aisha Dawood 1.  You can control the number of dispatcher processes in the instance. Unlike the number of shared servers, the number of.
11g(R1/R2) Data guard Enhancements Suresh Gandhi
Table Compression in Oracle9i R2 Plamen Zyumbyulev INSIDE OUT,, Let someone k n o w ”
Web Access Management and Optimizing Storage Rebecca Astin and Gray Fernandez November 2, 2010.
FlashSystem family 2014 © 2014 IBM Corporation IBM® FlashSystem™ V840 Product Overview.
The Self-Managing Database: Guided Application and SQL Tuning Mohamed Ziauddin Consulting Member of Technical Staff Oracle Corporation Session id:
Oracle Advanced Compression – Reduce Storage, Reduce Costs, Increase Performance Session: S Gregg Christman -- Senior Product Manager Vineet Marwah.
1 Oracle Architectural Components. 1-2 Objectives Listing the structures involved in connecting a user to an Oracle server Listing the stages in processing.
Copyright © Oracle Corporation, All rights reserved. 1 Oracle Architectural Components.
An Oracle server:  Is a database management system that provides an open, comprehensive, integrated approach to information management.  Consists.
Selling the Storage Edition for Oracle November 2000.
1 Chapter 14 DML Tuning. 2 DML Performance Fundamentals DML Performance is affected by: – Efficiency of WHERE clause – Amount of index maintenance – Referential.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1 Oracle Database 12c Sergey Stetsenko Principal Sales Consultant.
Database structure and space Management. Database Structure An ORACLE database has both a physical and logical structure. By separating physical and logical.
Who Hit The Turbo Button? February 13, 2013 Presenter: Stephen Watson ITS System Manager Stephen F. Austin State University.
Week 4 Lecture 2 Advanced Table Management. Learning Objectives  Create tables with large object (LOB) columns and tables that are index-organized 
D Copyright © Oracle Corporation, All rights reserved. Loading Data into a Database.
SQLintersection Putting the "Squeeze" on Large Tables Improve Performance and Save Space with Data Compression Justin Randall Tuesday,
The Self-managing Database: Proactive Space and Schema Object Management Amit Ganesh Director, Data, Space and Transaction Processing Oracle Corporation.
Infrastructure for Data Warehouses. Basics Of Data Access Data Store Machine Memory Buffer Memory Cache Data Store Buffer Bus Structure.
Chapter 5 Index and Clustering
Copyright © 2009 Rolta International, Inc., All Rights Reserved Michael R. Messina, Management Consultant Rolta-TUSC, Oracle Open World 2009 (60 min) ID#:
© 2006 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice Database Growth: Problems & Solutions.
Introduction to Exadata X5 and X6 New Features
REMINDER Check in on the COLLABORATE mobile app Best Practices for Oracle on VMware - Deep Dive Darryl Smith Chief Database Architect Distinguished Engineer.
October 15-18, 2013 Charlotte, NC Accelerating Database Performance Using Compression Joseph D’Antoni, Solutions Architect Anexinet.
All Oracle Spatial Summit Speakers – Please complete the following Case Study Summary slide Note: please insert quantified benefits where possible ($/time.
Oracle Spatial Summit 2015 Session Title Presenter Name, Title Company.
Oracle Announced New In- Memory Database G1 Emre Eftelioglu, Fen Liu [09/27/13] 1 [1]
Oracle Database Architectural Components
Doing fast! Optimizing Query performance with ColumnStore Indexes in SQL Server 2012 Margarita Naumova | SQL Master Academy.
Indexing strategies and good physical designs for performance tuning Kenneth Ureña /SpanishPASSVC.
Compression and Storage Optimization IDS xC4 Kevin Cherkauer
Data, Space and Transaction Processing
Sangam-AIOUG 2016 (11th ,12th Nov) Suvendu
OTN Yatra 2016 (23rd ,24th April) Suvendu
Presenter Name, Title Company
Maximum Availability Architecture Enterprise Technology Centre.
A Technical Overview of Microsoft® SQL Server™ 2005 High Availability Beta 2 Matthew Stephen IT Pro Evangelist (SQL Server)
Blazing-Fast Performance:
Working with Very Large Tables Like a Pro in SQL Server 2014
Data Lifecycle Review and Outlook
Sunil Agarwal | Principal Program Manager
Presentation transcript:

1

Oracle Advanced Compression: Deep Dive into OLTP Table Compression Gregg Christman -- Senior Product Manager Vineet Marwah – Principal Member of Technical Staff

<Insert Picture Here> Program Agenda <Insert Picture Here> Data Growth Challenges OLTP Table Compression Customer Experience Thomson Reuters Questions and Answers 3

Data Growth Challenges Explosion in Data Volumes Government Regulations (Sarbanes-Oxley, etc) User Generated Content (Web 2.0) Application Consolidation IT Managers Must Support Larger Volumes of Data with Limited Technology Budgets Need to optimize storage consumption Also maintain acceptable application performance Intelligent and Efficient Compression Technology can Help Address These Challenges

Oracle Advanced Compression Option OLTP Table Compression SecureFiles Deduplication SecureFiles Compression Data Pump Data Compression RMAN Fast Backup Compression Data Guard Redo Transport Compression Relational Data Compression Unstructured Data Compression Backup Data Compression Network Data Compression Reduces resource requirements and costs Storage System Network Bandwidth Memory Usage

Introduced in Oracle Database 9i Release 2 Table Compression Introduced in Oracle Database 9i Release 2 Compression during bulk load operations (Direct Load, CTAS) Data modified using conventional DML not compressed Optimized compression algorithm for relational data Improved performance for queries accessing large amounts of data Fewer I/Os Buffer Cache efficiency Data is compressed at the database block level Compression enabled at either the table or partition level Completely transparent to applications

OLTP Table Compression Oracle Database 11g extends table compression for OLTP data Support for conventional DML Operations (INSERT, UPDATE) New algorithm significantly reduces write overhead Batched compression minimizes impact for OLTP transactions No impact on reads Reads may actually see improved performance due to fewer I/Os and enhanced memory efficiency

OLTP Table Compression Process Initially Uncompressed Block Compressed Block Partially Compressed Block Empty Block Legend Header Data Free Space Uncompressed Data Compressed Data

Block-Level Batch Compression Patent pending algorithm minimizes performance overhead and maximizes compression Individual INSERTs and UPDATEs do not cause recompression Compression cost is amortized over several DML operations Block-level (Local) compression keeps up with frequent data changes in OLTP environments Competitors use static, fixed size dictionary table thereby compromising compression benefits

OLTP Table Compression Initially Uncompressed Block Employee Table Smith John 3 Doe Jane 4 2 1 LAST_NAME FIRST_NAME ID Header 1•John•Doe 2•Jane• Doe 3•John•Smith 4• Jane • Doe Free Space INSERT INTO EMPLOYEE VALUES (5, ‘Jack’, ‘Smith’); COMMIT;

OLTP Table Compression Employee Table Block 1•• 2•• 3•• 4 •  •  5•Jack• Free Space Compressed Block Doe Jane 4 Smith John 3 Jack 5 2 1 LAST_NAME FIRST_NAME ID Header John=|Doe=|Jane=|Smith= 1•John•Doe 2•Jane• Doe 3•John•Smith 4• Jane • Doe Free Space Local Symbol Table

Table Compression Syntax OLTP Table Compression Syntax: CREATE TABLE emp ( emp_id NUMBER , first_name VARCHAR2(128) , last_name VARCHAR2(128) ) COMPRESS FOR OLTP; Direct Load Compression Syntax (default): ) COMPRESS [BASIC];

Table Compression Advisor Estimate Potential Storage Savings Available in 11g Release 2 Available on OTN * Supports Oracle Database 9i Release 2 through 11g Release 1 Shows projected compression ratio for uncompressed tables Reports actual compression ratio for compressed tables (11g Only) * http://www.oracle.com/technology/products/database/compression/compression-advisor.html

Monitoring Table Compression View: DBA_TABLES, columns: COMPRESSION ( ENABLED / DISABLED ) COMPRESS_FOR ( OLTP / BASIC)

<Insert Picture Here> Table Compression Results

Oracle IT, Oracle’s Internal E-Business Application DB Oracle’s Internal E-Business Suite Production System deployed ACO in 2009 4-node Sun E25K RAC, 11gR1 Average overall storage savings 3x Table compression 4x Index compression 2x LOB compression 2.3x 231TB of realized storage savings primary, standby and test systems Additional benefits were also accrued in Dev clones and Backups Payroll, Order-2-Cash, AP/AR batch flows, Self-Service flows run without regression, Queries involving full table scans show speedup Hi Amit, Attaching a doc containing data relating to GSI Phase1 & IMG compression. For GSI: At present GSI has the following number of environments: - Eight test copies  + 1 test standby - One production + 1 standby Total 9 +2 =11 copies (including production & standby) Phase1 space savings - 5.574 TB Phase2 space savings - 0.822  TB Total for GSI              - 6.396 TB  (say 6.5 TB) Space saved for 11 environments (including standby)  = 6.5 * 11 *3 (including backups, mirroring)                                                                                   = 214.50 TB ~ 215 TB For Imaging Database: (primarily LOBs) Imaging has the following environments: Full sized test copy :1 Production + Standby:  2 Total full sized copies = 3 Space saved per environment: 1.832 TB (Say 1.8 TB) Total space saved  (3 env) =  1.8 *3 * 3=  16.2 TB ~ 16 TB. (including backups, mirroring) Hope this helps. Thanks, Raji © 2009 Oracle Corporation - Confidential 16 16

Oracle IT, Oracle’s Internal Beehive Email DB Production system on 11gR1 & Exadata for Primary and Standby Using Exadata Storage Servers for storage Average Compression Ratio: 2x Storage savings add up with standby, mirroring, flash recovery area Compression went production in 2009 Consolidate 90K employees on this email server, more being migrated Savings As of April 2010 Beehive Saved 365TB of storage using Advanced Compression Incrementally saves 2.6TB/day based on db size growth Savings higher with Sun user migration Compression also helped improve performance by caching only compressed emails in memory and reducing I/O latencies © 2009 Oracle Corporation - Confidential 17 17

SAP R/3, BW, Leading Global Company Compression on SAP databases at Leading global company Tests done using Oracle database 11gR2 SAP R/3 DB 4.67TB Uncompressed 1.93 TB Compressed 2.4x savings factor SAP BW DB 1.38 TB Uncompressed .53 TB Compressed 2.6x savings factor Leverage 11g Compression for Tables, Indexes and LOB data © 2009 Oracle Corporation - Confidential 18 18

Metalink See Metalink Note #1061366.1 Lists recommended Advanced Compression patches applicable to all customers

Customer Experience

Comprehensive data compression capabilities for all types of data Summary Comprehensive data compression capabilities for all types of data Structured, Unstructured, Backup, Network Reduces storage consumption by 2 to 4 times Improves read performance Enhances memory, buffer cache utilization Complete application transparency Benefits diverse application workloads

Oracle Products Available Online Oracle Store Buy Oracle license and support online today at oracle.com/store 22 22

23