Oracle Database In-Memory feature at CERN

Slides:



Advertisements
Similar presentations
Migration From Mainframe to SAS Enterprise Guide Reporting Migration From Mainframe to SAS Enterprise Guide Reporting A New Retention Process in IR Office.
Advertisements

17th February, 2000 by Maciej Korzeniowski (CERN-IT-IA-MI) 1 Oracle Discoverer Product Presentation  This is an ad hoc query and analysis tool for.
Teradata Columnar: A new standard for Columnar databases Source: Teradata is thinking Big Stephen Swoyer Presented by: Deesha Phalak and Kaushiki Nag.
A Fast Growing Market. Interesting New Players Lyzasoft.
Chapter 3 Database Management
Index Sen Zhang. INDEX When a table contains a lot of records, it can take a long time for the search engine of oracle (or other RDBMS) to look through.
Business Intelligence Michael Gross Tina Larsell Chad Anderson.
Alternative: Bitmap Indexing Imagine the following query in huge table Find customers living in London, with 2 cars and 3 children occupying a 4 bed house.
How can agile Business Intelligence (BI ) support PMO 15 October 2014, London, Olympia.
Data Warehousing: Defined and Its Applications Pete Johnson April 2002.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1 Preview of Oracle Database 12 c In-Memory Option Thomas Kyte
CERN – European Laboratory for Particle Physics Administrative Information Services Implementing Oracle Workflow Derek Mathieson CERN - Switzerland.
Databases & Data Warehouses Chapter 3 Database Processing.
LOGO Business Intelligence System Mr. Natapong Wongprommoon Solution Architect G-ABLE Company Limited
Scale-out databases for CERN use cases Strata Hadoop World London 6 th of May,2015 Zbigniew Baranowski, CERN IT-DB.
Bob Thome, Senior Director of Product Management, Oracle SIMPLIFYING YOUR HIGH AVAILABILITY DATABASE.
1.
CERN - IT Department CH-1211 Genève 23 Switzerland t The High Performance Archiver for the LHC Experiments Manuel Gonzalez Berges CERN, Geneva.
CS 345: Topics in Data Warehousing Tuesday, October 19, 2004.
September 2011Copyright 2011 Teradata Corporation1 Teradata Columnar.
Enterprise Reporting Solution
Oracle Advanced Compression – Reduce Storage, Reduce Costs, Increase Performance Session: S Gregg Christman -- Senior Product Manager Vineet Marwah.
1 Data Warehouses BUAD/American University Data Warehouses.
5-1 McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved.
CERN – European Organization for Nuclear Research Administrative Support - Internet Development Services CET and the quest for optimal implementation and.
Datawarehouse A sneak preview. 2 Data Warehouse Approach An old idea with a new interest: Cheap Computing Power Special Purpose Hardware New Data Structures.
© 2006 Pearson Education Canada Inc. 3-1 Chapter 3 Database Management PowerPoint Presentation Jack Van Deventer Ward M. Eagen.
My audience will be excited to learn the basics of what a network systems & data communications analyst does.
Jet Reports. KARYA Technologies partners with Jet Reports to Provide Reporting Solutions.
Foundations of information systems : BIS 1202 Lecture 4: Database Systems and Business Intelligence.
Business Intelligence dan Dashboard Ensys – minggu ke 6.
Oracle Announced New In- Memory Database G1 Emre Eftelioglu, Fen Liu [09/27/13] 1 [1]
Atlantic Coast Operations Business Intelligence Mobility Project.
Melody A. Currey, Commissioner State of Connecticut Out of State Compact Notice Scanning and Data Entry System.
Bartek Doruch, Managing Partner, Kamil Karbowiak, Managing Partner, Using Power BI in a Corporate.
Eric Grancher CERN IT department Overview of Database Technologies Computing and Astroparticle Physics 2 nd ASPERA Workshop /1.
SUSE Linux Enterprise Server for SAP Applications
It’s time to refresh your data in Power BI!
Data warehousing AND Data mining PRESENTED by N.GANESH (10QF1A0447)
SQL Server Analysis Services Fundamentals
Data Platform and Analytics Foundational Training
Data Platform Modernization
Let’s Build a Tabular Model in Azure
Database Services Katarzyna Dziedziniewicz-Wojcik On behalf of IT-DB.
Future Database Challenges
THE COMPELLING NEED FOR DATA WAREHOUSING
CERN Openlab: my transition from science to business
Fundamentals of Information Systems, Sixth Edition
Power BI Premium overview
Using Oracle Database In-Memory feature to Speed-up CERN Applications
Upgrade, Migrate & Consolidate to Oracle Database 12.2 and the Cloud
Optimizing SQL Queries
Oracle Storage Performance Studies
ORACLE INFRASTRUCTURE SOLUTIONS PEGASUS AIRLINES SUCCESS STORY
SQL Server Analysis Services Fundamentals
SQL Server Analysis Services Fundamentals
Data Platform Modernization
InLoox PM Web App product presentation
Azure's Performance, Scalability, SQL Servers Automate Real Time Data Transfer at Low Cost MINI-CASE STUDY “Azure offers high performance, scalable, and.
Collaborative Business Solutions
Column-Stores vs. Row-Stores: How Different Are They Really?
Instructional Improvement Systems (IIS)
World Tour London Event
Let’s Build a Tabular Model in Azure
McGraw-Hill Technology Education
Big DATA.
Presented by: Michael Brockmann Maik Hölter Olaf Reimann
OU BATTLECARD: Business Intelligence
Ellucian On-Demand Subscription Library Overview and Demonstration Joe Debole Sr. eLearning Administrator.
Presentation transcript:

Oracle Database In-Memory feature at CERN Emil Pilecki Introduce myself: 8 years data engineering, data analytics (make sense)

About Emil Senior DBA at CERN First joined CERN in 2000, staff member as of 2012 Previously DBA team lead at Hewlett-Packard Poland 16 years of experience with Oracle databases Specializes in: High availability solutions – RAC, Data Guard Database performance and testing Oracle In-Memory Data warehousing

About CERN CERN - European Laboratory for Particle Physics Founded in 1954 by 12 countries for fundamental physics research – Higgs boson discovery in 2012 Today 22 member states + world-wide collaborations About ~1000 MCHF yearly budget 13000 employees and users from 110 countries Over 100 Oracle databases, mostly RAC Running Oracle 11.2.0.4 and 12.1.0.2 750 TB of production data files, NAS as a storage

Administrative Data Warehouse Currently in production, uses In-memory feature Supports CERN reports, dashboards and data analytics HR data and personal records Financial data, orders/purchases Resource usage planning Electronic recruitment and others Unique data source for all BI applications – for data consistency Bi-temporal data model – full change tracking

Reporting Before In-memory Many different reporting / analytics applications Completely separated for performance reasons Data model optimized for each application Data consistency was a serious issue Maintenance cost was huge Several teams of developers + DBAs Performance far from satisfactory Some complex queries used to run for hours Simply speaking – it was a mess!

Reporting with In-memory (ADW) In-memory – natural choice for BI applications Early tests at CERN (12.1 beta) very promising Purchased license in December 2014 Unified Administrative Data Warehouse only possible with In-memory Designed specifically for In-memory In production since July 2015 Greatly improved performance! Significantly reduced maintenance cost

ADW In-memory Benefits Realistic gain in PRODUCTION Queries on average 10x faster! IMC vs Direct IO 5.6x faster! IMC vs Small BC 63x faster!! IMC vs Big BC 2x faster

In-memory – Conclusion Use for Business Intelligence, Data Warehousing, Data Analytics and Reporting, including ad-hoc Biggest benefit for very wide tables and when queries select only few out of many columns Queries scan big data sets – full table scan Data sets fit entirely in memory (compressed) Big performance boost guaranteed for such use-cases! Simplification! also reduces maintenance costs Graphic: www.oracle.com

Thank you for your attention!