Oracle Database 11g: First Experiences with Grid Computing Plamen Zyumbyulev Head of DBAs Mobiltel

Mobiltel (M-Tel) M-Tel is the market leader in Bulgaria and one of the most successful mobile operators in Europe More than 4.8 M subscribers Founded in March 1994 Part of Mobilcom Austria Group M-Tel became the world fifth to offer HSDPA services

The IT reality IT becomes more and more complicated New roles and tasks Hundreds of systems Increased system dependencies and integration Lot’s of new systems Constant changes / Increased Risk Everything is important and 24/7 Increased demand for reliability, availability, performance, etc. Islands of Computation Limited scalability, no resource sharing Must be configured for peak loads Single point of failure Slow to adjust to business needs

Challenges Provide Highest Quality of Service Be more flexible implement new technologies decrease the risk Be more flexible online changes, virtualization, dynamic provisioning How to do more with less automation, consolidation, monitoring

Why Grid? Technical Benefits Dynamically configurable infrastructure Data Warehouse Custom Application Technical Benefits Dynamically configurable infrastructure Effective (automatic) workload management No single point of failure Incremental scaling Centralised automated monitoring & management Better Quality of Service Fast response to changes Effectiveness Service Oriented Applications ERP Application CRM Application Mid-Tier Management Lets look at some of GRIDs key concepts: Resource pooling and sharing: Virtualization effectively decouples the static deployment of databases and applications. This enables resources (storage and servers) to be pooled and shared – More efficient Dynamic resource provisioning: The ability to provision resources dynamically from a shared pool becomes essential once Dbs and apps are no longer statically deployed. – you can change a server from a DB to a Apps server in seconds Automated monitoring and management: The ability to provision resources on demand creates a dynamically configurable infrastructure where resources can be immediately switched and allocated in order to achieve required service levels. Clearly this cannot cannot be achieve using the reactive manual procedures that characterise the management of a silo infrastructure. It requires the ability to monitor all resources continually and to rellocated them automatically when necessary. Lets investigate the three layers of the grid – storage, database, and application server and its management capabilities Database Tier Storage

Why Grid Computing with Oracle 11g HA and DR Real Application Clusters (RAC) DR with real time query Service Oriented Architecture Resource Management Automation and simplification Oracle Enterprise Manager Grid/DB Control Automatic Diagnostic Workflow. Incident Packaging Service Online Maintenance Change assurance Database Replay SQL Plan Management Snapshot standby

Grid Configuration Hardware Oracle Stack Storage 6+1 Nodes, HP BladeSystem c-Class , 2 CPU dual Core 3.2 GHz, 10GB RAM RedHat Enterprice Linux 4 Oracle Stack Oracle Database 11.1.0.5 Oracle RAC 11.1.0.5 Oracle Clusterware 11.1.0.5 Oracle Automatic Storage Management 11.1.0.5 Storage IBM DS6800 – 28 disks

Our GRID implementation Big RAC environment Consolidate many Business Systems into small number of databases Single database – this is not mandatory It is possible to have different DB versions Many services per Business System – OLTP, Batch, Read Only, Test, etc. Every system/service is separate from the others Separate tablespaces Guaranteed resources – Memory, CPU, I/O, etc

Our GRID Implementation … Many features are configured out of the box High availability Backup Disaster recovery Force logging can be enabled per tablespace Reporting instance Test System Extremely fast provisioning of new systems, System Cloning, Creation of Test Systems Services can span databases * Oracle EM 10g Grid Control can monitor 11g GRID

Single Database – Not mandatory Our GRID Architecture Business systems BS 1 BS 2 BS 3 BS 4 BS 5 BS 6 BS 7 SOA DR with real time query – no idle resources Resource Manager Continuous Redo Shipment and Apply Single Database – Not mandatory Open in Read Only One or more DBs

Fast Test System Creation Business systems BS 1 BS 2 BS 3 BS 4 BS 5 BS 6 BS 7 SOA Replay Driver Resource Manager Process Capture Workload Single Database – Not mandatory Open in Read/Write One or more DBs

Rules to automatically assign sessions to Consumer Groups Resource Management Rules to automatically assign sessions to Consumer Groups

Service allocation (DG in RO mode) Business System 1 Business System 2 … Service name / Instance N online batch RO test 1 P A* A** A D 2 3 4 5 6 P** DG 1 P* --- A – available; P – preferred; D – disabled; DG – data guard; RO – Read Only; * - implemented with tns; ** - different schema

Service allocation (DG in RW mode) Business System 1 Business System 2 … Service name / Instance N online batch RO test 1 P A* A** A D 2 P* 3 4 5 6 P** DG 1 D* --- A – available; P – preferred; D – disabled; DG – data guard; RO – Read Only; * - implemented with tns; ** - different schema

A Paradigm shift We cannot solve our problems with the same thinking we used when we created them. Albert Einstein Start small Test systems Development systems Temporary/Permanent storage for data from other systems. (ex. 1GB in Billing System means ~ 15GB storage) Non critical production systems Create “Atmosphere”. Fight Ignorance and Status quo Build expertise, confidence and habits

The Results Availability 100% Lot’s of changes, reconfigurations and experiments Lot’s of problems, bugs, human errors No unplanned downtime since the beginning - May 2007 GRID is in the production since July 2007 Oracle Database 11g 32bit beta 5 for Linux There is a big list of new important systems waiting for Linux 64 bit production release Mobiltel gained a lot of experience and confidence with Oracle 11g GRID computing