Living with Exadata Presented by: Shaun Dewberry, OS Administrator, RDC Tom de Jongh van Arkel, Database Administrator, RDC Komaran Hansragh, Data Warehouse.

Slides:



Advertisements
Similar presentations
Extreme Performance with Oracle Data Warehousing
Advertisements

ITEC474 INTRODUCTION.
Exadata Distinctives Brown Bag New features for tuning Oracle database applications.
2 Copyright © 2005, Oracle. All rights reserved. Installing the Oracle Database Software.
Oracle Exadata for SAP.
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1.
The Power of Platform Solutions to Transform Higher Education
Introduction to DBA.
High Availability Group 08: Võ Đức Vĩnh Nguyễn Quang Vũ
A Fast Growing Market. Interesting New Players Lyzasoft.
Merrill Holt Director Parallel Server Product Management Oracle Corporation.
Data Warehousing - 3 ISYS 650. Snowflake Schema one or more dimension tables do not join directly to the fact table but must join through other dimension.
Greg Pierce| Concerto Cloud Services Which Cloud is Right for Microsoft CRM?
Extreme Performance Data Warehousing
1 © Mahindra Satyam 2011 iDecisions™  Packaged Analytic Applications –Data Model & Meta Data –Analytical Engines –Report Templates –Dashboard Templates.
Exchange 2010 Project Presentation/Discussion August 12, 2015 Project Team: Mark Dougherty – Design John Ditto – Project Manager Joel Eussen – Project.
Introduction to Oracle Backup and Recovery
David Besemer, CTO On Demand Data Integration with Data Virtualization.
© Hitachi Data Systems Corporation All rights reserved. 1 1 Det går pænt stærkt! Tony Franck Senior Solution Manager.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1 Preview of Oracle Database 12 c In-Memory Option Thomas Kyte
Hands-On Microsoft Windows Server 2008 Chapter 1 Introduction to Windows Server 2008.
Bob Thome, Senior Director of Product Management, Oracle SIMPLIFYING YOUR HIGH AVAILABILITY DATABASE.
BI Technical Infrastructure Approach
M ODULE 2 D ATABASE I NSTALLATION AND C ONFIGURATION Section 1: DBMS Installation 1 ITEC 450 Fall 2012.
STEALTH Content Store for SharePoint using Caringo CAStor  Boosting your SharePoint to the MAX! "Optimizing your Business behind the scenes"
+ CS 325: CS Hardware and Software Organization and Architecture Cloud Architectures.
Cloud Computing 1. Outline  Introduction  Evolution  Cloud architecture  Map reduce operation  Platform 2.
Get More out of SQL Server 2012 in the Microsoft Private Cloud environment Steven Wort, Xin Jin Microsoft Corporation.
Business Intelligence Appliance Powerful pay as you grow BI solutions with Engineered Systems.
FlashSystem family 2014 © 2014 IBM Corporation IBM® FlashSystem™ V840 Product Overview.
Best Practices for Real-Time Transactions for Mobile on Oracle SuperCluster Hiromitsu Fujikawa Network Technical Development Division.
Alert Logic Provides a Fully Managed Security and Compliance Solution Based in the Cloud, Powered by the Robust Microsoft Azure Platform MICROSOFT AZURE.
ALMA Archive Operations Impact on the ARC Facilities.
 Database Administration Installing Oracle 11g & Creating Database.
OSIsoft High Availability PI Replication
ECOTRADE AN ECOWAS ICT INITIATIVE TOWARDS GREATER TRADE FACILITATION A Presentation Of : The ECOWAS Computer Centre, Abuja, NIGERIA.
© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 1 Automate your way to.
Built on the Powerful Microsoft Azure Platform, Mproof’s Clientele ITSM Provides Companies with a Complete Software Suite to Manage Services MICROSOFT.
ORCALE CORPORATION:-Company profile Oracle Corporation was founded in the year 1977 and is the world’s largest s/w company and the leading supplier for.
CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,
Microsoft Desktop Virtualization Kiran N R Optimized Desktop – TSP Microsoft Corporation.
1 Copyright © 2008, Oracle. All rights reserved. I Course Introduction.
WHAT EXACTLY IS ORACLE EXALYTICS?. 2 What Exactly Is Exalytics? AGENDA Exalytics At A Glance The Exa Family Do We Need Exalytics? Hardware & Software.
Introduction to Exadata X5 and X6 New Features
© 2014 VMware Inc. All rights reserved. Cloud Archive for vCloud ® Air™ High-level Overview August, 2015 Date.
Cloud Computing 3. TECHNOLOGY GUIDE 3: Cloud Computing 2 Copyright John Wiley & Sons Canada.
OSIsoft High Availability PI Replication Colin Breck, PI Server Team Dave Oda, PI SDK Team.
1 Copyright © 2005, Oracle. All rights reserved. Oracle Database Administration: Overview.
FusionCube At-a-Glance. 1 Application Scenarios Enterprise Cloud Data Centers Desktop Cloud Database Application Acceleration Midrange Computer Substitution.
Oracle Exalytics Business Intelligence Machine Eshaanan Gounden – Core Technology Team.
Oracle & HPE 3PAR.
EMC: Redefining ERP and ROI with a Virtualized SAP HANA® Deployment
Univa Grid Engine Makes Work Management Automatic and Efficient, Accelerates Deployment of Cloud Services with Power of Microsoft Azure MICROSOFT AZURE.
Let's talk about Linux and Virtualization in 'vLAMP'
Leading New ICT, Making eFinance More Effective.
Business Critical Application Platform
What is Cloud Computing - How cloud computing help your Business?
Exadata for Oracle DBAs
Red Hat User Group June 2014 Marco Berube, Cloud Solutions Architect
Business Critical Application Platform
Introduction of Week 3 Assignment Discussion
ORACLE OPEN WORLD – 2018 Session ID: CAS5977 OCTOBER 22, 2018
Ch 4. The Evolution of Analytic Scalability
XtremeData on the Microsoft Azure Cloud Platform:
What's New in eCognition 9
Quasardb Is a Fast, Reliable, and Highly Scalable Application Database, Built on Microsoft Azure and Designed Not to Buckle Under Demand MICROSOFT AZURE.
Cloud Consulting Services and Solutions
Cloud Computing LegalRun Solutions Why It’s Right for You!
What's New in eCognition 9
IBM-SAP Alliance Computer Services
Presentation transcript:

Living with Exadata Presented by: Shaun Dewberry, OS Administrator, RDC Tom de Jongh van Arkel, Database Administrator, RDC Komaran Hansragh, Data Warehouse Manager, Telkom

Introduction Our Message Operational and user experiences and tasks unique to Exadata Roles: Shaun – Hardware, OS, Exadata Storage Server Tom – Grid Infrastructure and Database Komaran – ETL, Reporting Terminology Compute node – The nodes where the databases run. 4 Per system. Cell node – The storage nodes where the Exadata Storage Server Software run. 7 Per system + 4 Storage Expansion = 11 per system

System Hardware Initially acquired two X2-2 Exadata half racks but licensed quarter racks – 7TB usable space. Only 10% of the processing resources used but filling up the disk space quickly. Licensed the extra quarter rack – extra 7TB. Acquired X3 quarter rack storage expansions – extra 44TB usable space Enhanced backup infrastructure

Getting to square 1 Steps taken before storage expansion commissioning: Patch level prerequisite Oracle appoints an installation coordinator Complete a logistics template Complete the Exadata deployment assistant > Installation template Oracle South Africa does a site inspection (space, cooling, power) Oracle South Africa does hardware delivery and installation Oracle international does software installation

Patching Patching involves the entire system. Seven phase approach: Unravelling the patch instructions (which changes every version) Infiniband Switches Additional components (Switches, KVM, PDU) Exadata Storage Server OS and firmware patches for database nodes Grid Infrastructure Database Quarterly Full Stack Downloads

Hybrid Columnar Compression Hybrid Columnar Compression is optimized to use both database and storage capabilities on Exadata to deliver tremendous space savings and performance. Warehouse Compression Low and High are meant to achieve a lower compression ratio but offer better performance. ALTER TABLE MYTABLE COMPRESS FOR QUERY [ LOW | HIGH ] Archive Compression Low and High offers maximum space saving with higher performance costs. ALTER TABLE MYTABLE COMPRESS FOR ARCHIVE[ LOW | HIGH ] Real world compression ratio of 78% achieved for Warehouse Low and up to 88% for Query High.

Flash Cache

Enterprise Manager Oracle Enterprise Manager 12c Release 4

Challenges Installation Hardware failures. Automatic Service Requests. Patching Leading edge Backup volume Learning curve for system administrators Not a black box Cost / limitations of scaling

Benefits Exponential performance increase Specialised team for Oracle support Increase data retention with Hybrid Columnar Compression Combine enterprise and commodity hardware Infiniband internal network Scalability DB Nodes are standard OEL (unbreakable kernel) Massively parallel architecture eliminates single points of failure completely Fast PCI Flash Cache cards Tested software and hardware compatibility Pre-tuned for high performance

User Experience Komaran Hansragh Data Warehouse Specialist / Manager

Background The Telkom Data Warehouse landscape consists of a Fixed-Line and a Mobile Data Warehouse Data Warehouse landscape consists of Historical and Near Real Time Data Historical Revenue data for 7 years All other data for 5 years Near Real Time Data 10 minutes for selected information Total number of Resources in the Data Warehouse

Background Subject Area Order Management Customer Management Financial Management Service Management Network Management Fault Management Incident Management Tools Hardware - Half Rack EXADATA Environment Software - Oracle 11g Release 2 (11.2) Data Integration - ABINITIO Metadata – ABINITIO Presentation Layer – SAP Business Objects Analytics - SAS

Current Environment

Migration Project Replacement of the fixed line Data Warehouse environment with an Oracle Exadata environment Process started on the 5th of March 2014 and end 30th of September 2014 with 17 DW resources working on the project. The new DW database design on EXADATA enables a single version of the truth combining Fixed line and Mobile data. Planning Archiving Cleanup Rewriting

Business Benefits Fix Line and Mobile Data Warehouse on a single environment Low Time-To-Market Low Time-To-Insights Flexible architecture Enable analytics and BI self service Established Data Sets and Data Marts for all Business Unit Sunset legacy data warehouse environments throughout Telkom. Cost saving Single version of the truth Self service Increasing Performance Increasing Productivity Metadata

KPI’s DW daily scheduled jobs completed successfully before 3:30am. Measure – divide the number of daily successfully completed jobs by the total number of jobs listed in the scheduled process log table (as a percentage), the monthly average is green if > 95%, yellow if > 84%, red < 85%

Increasing Performance DW has increased its time to deliver performance by 75%

Start Small and Grow Full RackHalf RackQuarter Rack With Exadata you purchase what you require and as your Business grows you grow your Data Warehouse Environment.

Questions & Answers