1 Copyright © 2012 Oracle and/or its affiliates. All rights reserved. Convergence of HPC, Databases, and Analytics Tirthankar Lahiri Senior Director, Oracle.

Slides:

Advertisements

Similar presentations

Fast Data at Massive Scale Lessons Learned at Facebook Bobby Johnson.

Advertisements

Technische Universität München Massively Parallel Sort-Merge Joins (MPSM) in Main Memory Multi-Core Database Systems Martina Albutiu, Alfons Kemper, and.

Technische Universität München Massively Parallel Sort-Merge Joins (MPSM) in Main Memory Multi-Core Database Systems Martina Albutiu, Alfons Kemper, and.

Extreme Performance with Oracle Data Warehousing

Removing the I/O Bottleneck with Virident PCIe Solid State Storage Solutions Jan Silverman VP Operations.

Data Mining with R/ORE Minming Duan. 2 iTech Solution Profile Agenda R/ORE Overview 1 XML output generation using SQL 4 Integration with IBP and BIEE.

U NIVERSITY U NIVERSITY OF T ORONTO U NIVERSITY OF T ORONTO Bionic databases are coming. What will they look like? *Ryan Johnson & Ippokratis Pandis**

Exadata Distinctives Brown Bag New features for tuning Oracle database applications.

CA 714CA Midterm Review. C5 Cache Optimization Reduce miss penalty –Hardware and software Reduce miss rate –Hardware and software Reduce hit time –Hardware.

Oracle Exadata for SAP.

Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 Oracle on Oracle Harry Corcell - Hardware Account Manager Samin Sabetazad - Technical.

Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1.

Accelerating Your Success™ Oracle on Oracle for NHS 1.

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1.

Inside the Exalytics Osama Mustafa Gurus Solutions.

10 REASONS Why it makes a good option for your DB IN-MEMORY DATABASES Presenter #10: Robert Vitolo.

Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1.

1. Aim High with Oracle Real World Performance Andrew Holdsworth Director Real World Performance Group Server Technologies.

Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12 1.

Oracle Confidential – Highly Restricted1. Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Safe Harbor Statement The following is.

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Oracle Data Warehouse Strategic Update Ray Roccaforte.

Meanwhile RAM cost continues to drop Moore’s Law on total CPU processing power holds but in parallel processing… CPU clock rate stalled… Because.

© Hitachi Data Systems Corporation All rights reserved. 1 1 Det går pænt stærkt! Tony Franck Senior Solution Manager.

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1 Preview of Oracle Database 12 c In-Memory Option Thomas Kyte

Performance and Scalability. Performance and Scalability Challenges Optimizing PerformanceScaling UpScaling Out.

Comp-TIA Standards.  AMD- (Advanced Micro Devices) An American multinational semiconductor company that develops computer processors and related technologies.

Wilhelm Schickhard (1623) Astronomer and mathematician Automatically add, subtract, multiply, and divide Blaise Pascal (1642) Mathematician Mass produced.

1 Advanced Storage Technologies for High Performance Computing Sorin, Faibish EMC NAS Senior Technologist IDC HPC User Forum, April 14-16, Norfolk, VA.

Introduction. Outline What is database tuning What is changing The trends that impact database systems and their applications What is NOT changing The.

Data Warehousing 1 Lecture-24 Need for Speed: Parallelism Virtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics.

1 Recap (from Previous Lecture). 2 Computer Architecture Computer Architecture involves 3 inter- related components – Instruction set architecture (ISA):

Hardware Trends. Contents Memory Hard Disks Processors Network Accessories Future.

Course Introduction Andy Wang COP 5611 Advanced Operating Systems.

Chapter 2 Parallel Architecture. Moore’s Law The number of transistors on a chip doubles every years. – Has been valid for over 40 years – Can’t.

Taking the Complexity out of Cluster Computing Vendor Update HPC User Forum Arend Dittmer Director Product Management HPC April,

COMPUTER ORGANIZATIONS CSNB123. COMPUTER ORGANIZATIONS CSNB123 Why do you need to study computer organization and architecture? Computer science and IT.

Oracle’s Big Plans For Big Data Analysis By Doug Henschen, InformationWeek, Oct 4 th, 2011 Presented by Group 7: Sam Tucker and Ayoung Noh.

Chapter 1 Computer Abstractions and Technology. Chapter 1 — Computer Abstractions and Technology — 2 The Computer Revolution Progress in computer technology.

Next Generation Operating Systems Zeljko Susnjar, Cisco CTG June 2015.

Impact of the convergence of three worlds: High-Performance Computing, Databases, and Analytics Stefan Manegold

Copyright © 2006, GemStone Systems Inc. All Rights Reserved. Increasing computation throughput with Grid Data Caching Jags Ramnarayan Chief Architect GemStone.

Your Data Any Place, Any Time Performance and Scalability.

Antoine Chambille Head of Research & Development, Quartet FS

Parallel IO for Cluster Computing Tran, Van Hoai.

WHAT EXACTLY IS ORACLE EXALYTICS?. 2 What Exactly Is Exalytics? AGENDA Exalytics At A Glance The Exa Family Do We Need Exalytics? Hardware & Software.

Introduction to Exadata X5 and X6 New Features

Looking Forward while Looking Backwards Essbase and Exalytics Seldon Goodwin Principal Sales Consultant Oracle Business Intelligence.

VVols with Adaptive Flash and InfoSight Analytics 1 Manchester Virtualisation User Group Rich Fenton (Nimble North Senior Systems Engineer)

Peter Idoine Managing Director Oracle New Zealand Limited.

Hardware Architecture

Introduction to Data Analysis with R on HPC Texas Advanced Computing Center Feb

Oracle Exalytics Business Intelligence Machine Eshaanan Gounden – Core Technology Team.

sponsored by HP Enterprise

Modeling Big Data Execution speed limited by: Model complexity

Flash Storage 101 Revolutionizing Databases

Andy Wang COP 5611 Advanced Operating Systems

Concurrent Data Structures for Near-Memory Computing

Course Introduction Dr. Eggen COP 6611 Advanced Operating Systems

Andy Wang COP 5611 Advanced Operating Systems

Scaling the Memory Power Wall with DRAM-Aware Data Management

Assembly Language for Intel-Based Computers, 5th Edition

HPE Persistent Memory Microsoft Ignite 2017

Boost Linux Performance with Enhancements from Oracle

Capitalize on modern technology

KISS-Tree: Smart Latch-Free In-Memory Indexing on Modern Architectures

Parallel Analytic Systems

Andy Wang COP 5611 Advanced Operating Systems

CSCI 6442 Main Memory Database

Andy Wang COP 5611 Advanced Operating Systems

Presentation transcript:

1 Copyright © 2012 Oracle and/or its affiliates. All rights reserved. Convergence of HPC, Databases, and Analytics Tirthankar Lahiri Senior Director, Oracle TimesTen In-Memory Database

2 Copyright © 2012 Oracle and/or its affiliates. All rights reserved. Real-Time Analytics Social Media Telecommunications Enabling The Real-Time World eCommerce Multicore 64-bit Processors Massive DRAM capacity High-Speed Networks Financial Services Next Generation DBMSs SSD/Persistent Memory

3 Copyright © 2012 Oracle and/or its affiliates. All rights reserved. Analytics Requirements Intuitive interfaces Instantaneous response time Real-time reporting Structured / Unstructured data Extreme concurrency

4 Copyright © 2012 Oracle and/or its affiliates. All rights reserved. Hardware Trends Processor throughput –Cores per socket: 5x in last 5 years –Clock frequency: Flat in last 2 years Memory capacity 2x every 2 years High-speed networking: Infiniband, RapidIO, 10GigE, etc. Persistent memory technologies –Flash replacing disks for online storage –PC-RAM, MRAM : extension of RAM, or superfast disks for hot data

5 Copyright © 2012 Oracle and/or its affiliates. All rights reserved. Database Design Trends Emerging Industry Trend Exadata, Exalytics, Big-Data Appliance Balanced Compute/Capacity/Power Co-developed components Built-in scale up, scale out Built-in interoperability Pushdown functionality into hardware Exadata Smart Storage Integrated Appliances

6 Copyright © 2012 Oracle and/or its affiliates. All rights reserved. In-Memory Analytics Software Memory Optimized Essbase TimesTen for Exalytics Adaptive In-Memory Tools 1 TB RAM 40 Processing Cores High Speed Networking In-Memory Analytics Hardware Optimized Oracle Business Intelligence Foundation Suite Example: Oracle Exalytics In-Memory Machine

7 Copyright © 2012 Oracle and/or its affiliates. All rights reserved. Database Design Trends CPU core performance is flat Parallelize (dont paralyze) –Coarse-grained parallelism Exploit workload parallelism Parallelize query execution Parallelize maintenance operations (backup/restore) Exploit high speed communication primitives (e.g. Infiniband RDS ) –Fine-grained parallelism Vector execution Multi-threading of low-level primitives Parallelism Everywhere

8 Copyright © 2012 Oracle and/or its affiliates. All rights reserved. Database Design Trends Use all the available tools: –In-memory storage when applicable –Column storage for sequential accesses –Row storage for random accesses Advanced compression techniques –More bang for your storage buck !! Beware of NUMA !! –NUMA locality awareness –Lock free or well partitioned data structures –Avoid global updates to shared memory Storage Management

9 Copyright © 2012 Oracle and/or its affiliates. All rights reserved. Database Design Trends Enhance for analytics Analytic functions, data mining models, graph models, etc Cache-friendly access methods Sequential scans better than random access Cost modeling for modern hardware –Disk IOs are no longer the dominant cost –Cache Misses / Memory References –CPU cycles, execution time Query Optimization Wheres that plan??

10 Copyright © 2012 Oracle and/or its affiliates. All rights reserved.