Database Services Katarzyna Dziedziniewicz-Wojcik On behalf of IT-DB.

Slides:



Advertisements
Similar presentations
Copyright © SoftTree Technologies, Inc. DB Tuning Expert.
Advertisements

High Availability Group 08: Võ Đức Vĩnh Nguyễn Quang Vũ
Evolution of database services
Updates from Database Services at CERN Andrei Dumitru CERN IT Department / Database Services.
F Fermilab Database Experience in Run II Fermilab Run II Database Requirements Online databases are maintained at each experiment and are critical for.
Module 14: Scalability and High Availability. Overview Key high availability features available in Oracle and SQL Server Key scalability features available.
ORACLE APPLICATION SERVER BY PHANINDER SURAPANENI CIS 764.
National Manager Database Services
Oracle Database High Availability Brandon Kuschel Jian Liu Source: Oracle Database 11g Release 2 High Availability An Oracle White Paper November 2010.
High Availability & Oracle RAC 18 Aug 2005 John Sheaffer Platform Solution Specialist
1 Copyright © 2005, Oracle. All rights reserved. Introduction.
1 Copyright © 2009, Oracle. All rights reserved. Exploring the Oracle Database Architecture.
Monitoring Scale-Out with the MySQL Enterprise Monitor Andy Bang Lead Software Engineer MySQL-Sun, Enterprise Tools Team Wednesday, April 16, :15.
Database Services for Physics at CERN with Oracle 10g RAC HEPiX - April 4th 2006, Rome Luca Canali, CERN.
Oracle on Windows Server Introduction to Oracle10g on Microsoft Windows Server.
Oracle10g RAC Service Architecture Overview of Real Application Cluster Ready Services, Nodeapps, and User Defined Services.
Sofia, Bulgaria | 9-10 October SQL Server 2005 High Availability for developers Vladimir Tchalkov Crossroad Ltd. Vladimir Tchalkov Crossroad Ltd.
HBase A column-centered database 1. Overview An Apache project Influenced by Google’s BigTable Built on Hadoop ▫A distributed file system ▫Supports Map-Reduce.
The protection of the DB against intentional or unintentional threats using computer-based or non- computer-based controls. Database Security – Part 2.
7202ICT – Database Administration
CERN IT Department CH-1211 Geneva 23 Switzerland t Daniel Gomez Ruben Gaspar Ignacio Coterillo * Dawid Wojcik *CERN/CSIC funded by Spanish.
Marcin Blaszczyk, Zbigniew Baranowski – CERN Outline Overview & Architecture Use Cases for Our experience with ADG and lessons learned Conclusions.
High Availability in DB2 Nishant Sinha
Alwayson Availability Groups
CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,
Database Competence Centre openlab Major Review Meeting nd February 2012 Maaike Limper Zbigniew Baranowski Luigi Gallerani Mariusz Piorkowski Anton.
Michelle Malcher PepsiCo Session # For the DBA Manager – Understanding Oracle and DBAs.
CERN IT Department CH-1211 Geneva 23 Switzerland t WLCG Operation Coordination Luca Canali (for IT-DB) Oracle Upgrades.
Emil Pilecki Credit: Luca Canali, Marcin Blaszczyk, Steffen Pade.
CNAF Database Service Barbara Martelli CNAF-INFN Elisabetta Vilucchi CNAF-INFN Simone Dalla Fina INFN-Padua.
LHC Logging Cluster Nilo Segura IT/DB. Agenda ● Hardware Components ● Software Components ● Transparent Application Failover ● Service definition.
Replicazione e QoS nella gestione di database grid-oriented Barbara Martelli INFN - CNAF.
2 Copyright © 2006, Oracle. All rights reserved. RAC and Shared Storage.
SQL Server High Availability Introduction to SQL Server high availability solutions.
DB Questions and Answers open session (comments during session) WLCG Collaboration Workshop, CERN Geneva, 24 of April 2008.
4 Copyright © 2004, Oracle. All rights reserved. Managing the Oracle Instance.
AlwaysOn In SQL Server 2012 Fadi Abdulwahab – SharePoint Administrator - 4/2013
OSIsoft High Availability PI Replication Colin Breck, PI Server Team Dave Oda, PI SDK Team.
Practical Hadoop: do’s and don’ts by example Kacper Surdy, Zbigniew Baranowski.
10 Copyright © 2007, Oracle. All rights reserved. Managing Undo Data.
1 Gaurav Kohli Xebia Breaking with DBMS and Dating with Relational Hbase.
Eric Grancher CERN IT department Overview of Database Technologies Computing and Astroparticle Physics 2 nd ASPERA Workshop /1.
Hadoop Introduction. Audience Introduction of students – Name – Years of experience – Background – Do you know Java? – Do you know linux? – Any exposure.
Oracle Database High Availability
From Disk to Memory It’s 2016 Folks!
Backup and Recovery for Hadoop: Plans, Survey and User Inputs
IT Services Katarzyna Dziedziniewicz-Wojcik IT-DB.
Database Services Katarzyna Dziedziniewicz-Wojcik On behalf of IT-DB.
How To Pass Oracle 1z0-060 Exam In First Attempt?
From DBA to DPA – Becoming a Data Platform Administrator
Oracle Database In-Memory feature at CERN
Future Database Challenges
High Availability Linux (HA Linux)
Disaster Recovery Where to Begin
Elizabeth Gallas - Oxford ADC Weekly September 13, 2011
Database Workshop Report
Maximum Availability Architecture Enterprise Technology Centre.
WLCG Service Interventions
Upgrade, Migrate & Consolidate to Oracle Database 12.2 and the Cloud
Change Deployment in ServiceN w
Oracle Database High Availability
Features of TMySQL/TSpider port into MariaDB
Oracle Database Monitoring and beyond
Introduction of Week 6 Assignment Discussion
Data Lifecycle Review and Outlook
The Memory B. Ramamurthy C B. Ramamurthy.
Overview Assignment 12: solution Distributed file systems 1/13/2019.
OPS-14: Effective OpenEdge® Database Configuration
Designing Database Solutions for SQL Server
The Database World of Azure
Presentation transcript:

Database Services Katarzyna Dziedziniewicz-Wojcik On behalf of IT-DB

Agenda Database service overview Oracle Database On Demand Status Plans Database On Demand 20/04/2016 DB Services

The history of architecture DBoD Oracle Hadoop Databases 20/04/2016 DB Services

Databases 3 main pillars Oracle Database on-demand Hadoop For critical, transactional load Administered by experts (DBAs) Database on-demand Different database engines MySQL, PostgreSQL, Oracle Instance owners have the DBA rights Hadoop For analysis where DBs are not suitable Check presentation by Kacper Surdy 20/04/2016 DB Services

Questions? 20/04/2016 DB Services

Oracle in numbers ~100 databases, most of them RAC Mostly NAS storage plus some SAN with ASM More than 600 TB of data files for production DBs in total 20/04/2016 DB Services

Oracle main users Accelerator logging Experiment databases ~ 4 billion records/day ~ 160 GB/day  52 TB/year stored Experiment databases Online Data taking operations Offline Data analysis 20/04/2016 DB Services

Oracle main users Administrative Engineering & component All applications are Oracle based Engineering & component Managing a million components over a lifecycle of 30 years Quench Protection System Stores ~150 K rows/second Consolidated WinCC/PVSS archive repository Stores ~50-60K rows/second 20/04/2016 DB Services

Oracle - plans Oracle 11.2 and 12.1 LS2 upgrade Supported until 2020 and 2021 respectively LS2 upgrade Oracle 12.2 (recommended) Release date 2016 20/04/2016 DB Services

Oracle 12 - why Main new feature In-Memory database We cannot forget… Real-time responsiveness We cannot forget… … bug fixes 20/04/2016 DB Services

In Memory DB New hype in DB technology More solutions appearing on the market A new in-memory cache – columnar format Huge performance boost for full table scans! 20/04/2016 DB Services

In Memory DB - why Deployment is transparent to applications Automatically used when beneficial Compression helps to put more data in memory More data than in traditional Buffer Cache No negative impact on DML operations Please, contact IT-DB for more details 20/04/2016 DB Services

On-Demand in numbers All databases – 326 By DB Type Production – 225 Oracle - 9 MySQL - 269 PostgreSQL - 48 20/04/2016 DB Services

On-Demand in numbers By DB Type MySQL: 269 PostgreSQL: 48 Oracle: 9 20/04/2016 DBServices

On-Demand Users 20/04/2016 DB Services

Databases – On-Demand MySQL CE 5.7 PostgreSQL 9.4 Q3/Q4 2016 To stay for next 3 years PostgreSQL 9.4 Oracle as for General Service Upgrades require database reboot 20/04/2016 DB Services

Plans for On-Demand High availability Replication App/DB Gateways Clustered Databases 20/04/2016 DB Services

DBoD High Availability Oracle Clusterware Widely used by DBoD clients Ensures that resources are running in any of the cluster nodes Issues Only 1 active instance on the same data volume Unused resources MySQL NFS locking Requires manual intervention in storage Clusterware overreaction May lead to data corruption 20/04/2016 DB Services

DBoD High Availability Master Slave replication Already being done for both PostgreSQL and MySQL (Drupal,..) Possible to have a replica in Wigner Read Only replica which can be manually promoted to be master (RW) or used as failover during master outages Requires application/admins to be aware 20/04/2016 DB Services

DBoD High Availability Application to DB Gateway Builds on standard replication for HA Transparent to applications DB Load distribution Solutions MariaDB MaxScale pgpool-ii 20/04/2016 DB Services

DBoD High Availability Clustered databases Multimaster solution Support for rolling interventions New model, new operational challenges Galera Cluster for MySQL CitusDB for PostgreSQL 20/04/2016 DB Services

Acknowledgments Colleagues from IT-DB Special thanks Ignacio Coterillo Emil Pilecki 20/04/2016 DB Services