1. Oracle Database 11g: First Experiences with Grid Computing
Plamen Zyumbyulev
Head of DBAs Mobiltel

2. Mobiltel (M-Tel)
M-Tel is the market leader in Bulgaria and one of the most successful mobile operators in Europe
More than 4.8 M subscribers
Founded in March 1994
Part of Mobilcom Austria Group
M-Tel became the world fifth to offer HSDPA services

3. The IT reality IT becomes more and more complicated
New roles and tasks
Hundreds of systems
Increased system dependencies and integration
Lot’s of new systems
Constant changes / Increased Risk
Everything is important and 24/7
Increased demand for reliability, availability, performance, etc.
Islands of Computation
Limited scalability, no resource sharing
Must be configured for peak loads
Single point of failure
Slow to adjust to business needs

4. Challenges Provide Highest Quality of Service Be more flexible
implement new technologies
decrease the risk
Be more flexible
online changes, virtualization, dynamic provisioning
How to do more with less
automation, consolidation, monitoring

5. Why Grid? Technical Benefits Dynamically configurable infrastructure
Data
Warehouse
Custom
Application
Technical Benefits
Dynamically configurable infrastructure
Effective (automatic) workload management
No single point of failure
Incremental scaling
Centralised automated monitoring & management
Better Quality of Service
Fast response to changes
Effectiveness
Service Oriented Applications
ERP
Application
CRM
Application
Mid-Tier
Management
Lets look at some of GRIDs key concepts:
Resource pooling and sharing: Virtualization effectively decouples the static deployment of databases and applications. This enables resources (storage and servers) to be pooled and shared – More efficient
Dynamic resource provisioning: The ability to provision resources dynamically from a shared pool becomes essential once Dbs and apps are no longer statically deployed. – you can change a server from a DB to a Apps server in seconds
Automated monitoring and management: The ability to provision resources on demand creates a dynamically configurable infrastructure where resources can be immediately switched and allocated in order to achieve required service levels. Clearly this cannot cannot be achieve using the reactive manual procedures that characterise the management of a silo infrastructure. It requires the ability to monitor all resources continually and to rellocated them automatically when necessary.
Lets investigate the three layers of the grid – storage, database, and application server and its management capabilities
Database Tier
Storage

6. Why Grid Computing with Oracle 11g
HA and DR
Real Application Clusters (RAC)
DR with real time query
Service Oriented Architecture
Resource Management
Automation and simplification
Oracle Enterprise Manager Grid/DB Control
Automatic Diagnostic Workflow. Incident Packaging Service
Online Maintenance
Change assurance
Database Replay
SQL Plan Management
Snapshot standby

7. Grid Configuration Hardware Oracle Stack Storage
6+1 Nodes, HP BladeSystem c-Class , 2 CPU dual Core 3.2 GHz, 10GB RAM
RedHat Enterprice Linux 4
Oracle Stack
Oracle Database
Oracle RAC
Oracle Clusterware
Oracle Automatic Storage Management
Storage
IBM DS6800 – 28 disks

8. Our GRID implementation
Big RAC environment
Consolidate many Business Systems into small number of databases
Single database – this is not mandatory
It is possible to have different DB versions
Many services per Business System – OLTP, Batch, Read Only, Test, etc.
Every system/service is separate from the others
Separate tablespaces
Guaranteed resources – Memory, CPU, I/O, etc

9. Our GRID Implementation …
Many features are configured out of the box
High availability
Backup
Disaster recovery
Force logging can be enabled per tablespace
Reporting instance
Test System
Extremely fast provisioning of new systems, System Cloning, Creation of Test Systems
Services can span databases *
Oracle EM 10g Grid Control can monitor 11g GRID

10. Single Database – Not mandatory
Our GRID Architecture
Business
systems
BS 1
BS 2
BS 3
BS 4
BS 5
BS 6
BS 7
SOA
DR with real time query
– no idle resources
Resource Manager
Continuous Redo
Shipment and Apply
Single Database – Not mandatory
Open in Read Only
One or
more DBs

11. Fast Test System Creation
Business
systems
BS 1
BS 2
BS 3
BS 4
BS 5
BS 6
BS 7
SOA
Replay Driver
Resource Manager
Process
Capture Workload
Single Database – Not mandatory
Open in Read/Write
One or
more DBs

12. Rules to automatically assign sessions to Consumer Groups
Resource Management
Rules to automatically assign sessions to Consumer Groups

13. Service allocation (DG in RO mode)
Business System 1
Business System 2 …
Service name / Instance N
online
batch RO
test 1 P A*
A** A D 2 3 4 5 6
P**
DG 1 P*
---
A – available; P – preferred; D – disabled; DG – data guard; RO – Read Only;
* - implemented with tns; ** - different schema

14. Service allocation (DG in RW mode)
Business System 1
Business System 2 …
Service name / Instance N
online
batch RO
test 1 P A*
A** A D 2 P* 3 4 5 6
P**
DG 1 D*
---
A – available; P – preferred; D – disabled; DG – data guard; RO – Read Only;
* - implemented with tns; ** - different schema

15. A Paradigm shift
We cannot solve our problems with the same thinking we used when we created them.
Albert Einstein
Start small
Test systems
Development systems
Temporary/Permanent storage for data from other systems. (ex. 1GB in Billing System means ~ 15GB storage)
Non critical production systems
Create “Atmosphere”. Fight Ignorance and Status quo
Build expertise, confidence and habits

16. The Results Availability 100%
Lot’s of changes, reconfigurations and experiments
Lot’s of problems, bugs, human errors
No unplanned downtime since the beginning - May 2007
GRID is in the production since July 2007
Oracle Database 11g 32bit beta 5 for Linux
There is a big list of new important systems waiting for Linux 64 bit production release
Mobiltel gained a lot of experience and confidence with Oracle 11g GRID computing