1. Provisioning of CRS / ASM / RAC with Enterprise Manager
02/06/2018
Provisioning of CRS / ASM / RAC with Enterprise Manager
Rob Zoeteweij
Copyright – 2009 Zoeteweij Consulting
Copyright Zoeteweij Consulting

2. This Presentation… Is pretty technical
02/06/2018
This Presentation…
Is pretty technical
Includes several (many) Screen dumps
Covers OEM –
Gives you an insight overview of: How to … / How it works
Is about how we do this at Rabobank
Copyright Zoeteweij Consulting

3. Agenda
Introduction
Out of Box Deployment Procedures
Customizing

4. Introduction Working with Oracle Technology since 1985
Oracle 3  11g
Development, DBA, Consultant (Oracle Netherlands)
Last 5 Years
Oracle 10g RAC installations
Oracle 10g Enterprise Manager projects
Working at Rabobank as independent Oracle consultant since 2007

5. Introduction Project Oracle ECO System – 2008 Complete Oracle Stack
Oracle Enterprise Linux
Oracle RDBMS 10gR2 / 11g
Oracle Internet Directory
Oracle Application Server
Weblogic
Oracle Enterprise Manager GRID Control

6. Oracle ECO System business Application (e.g. Siebel)
02/06/2018
Oracle ECO System
business
Appliance interface layer
Enterprise Manager
Application (e.g. Siebel)
Applications build in ADF / WebCenter
Management Packs for
- Database
- Application Server
- SOA Suite
- Applications
Oracle Application Server
Application server / Coherence
SOA Suite
Oracle RDBMS
Oracle Database r10/11 / Real Application Clusters / Dataguard / Security / ASM
Oracle Enterprise Linux
Oracle VM
Virtualisation layer to optimize performance
SAN
Hardware
X86
Bare metal provisioning / security patches / plug-in for DMX / ASM / mirroring
TEC
TDP
Mercury
Copyright Zoeteweij Consulting

7. Expectations of the business
02/06/2018
Expectations of the business
Reduce complexity
Improve stability and continuity
Shorten time to market
Improve scalability and flexibility
Comply with Basel II, SOX, IFRS, etc.
Oracle is a strategic vendor for Rabobank
Be comparable with market standards
Copyright Zoeteweij Consulting

8. Expectations of the business
Standardize
Reduce Human Errors
Shorten Training Curve
Shorten Time to Market

9. Oracle Enterprise Manager Centre of the Universe!

10. Database Clusters HP Blade Servers Oracle Enterprise Linux AS 4.7
Servers configured using BMP
OS Install + Configuration
OEM Agent installation

11. Provisioning at Rabobank
Bare Metal Provisioning
CRS / ASM / DB Provisioning
One Click Extend Cluster
Create RAC Database on existing stack
Delete RAC Database
Patching
Agent
ASM
Database

12. CRS / ASM / RAC Provisioning
Requirements
Clusterware
Install Software and configure
ASM
Install Software
Create +ASM Instance on each Server in Cluster DB

13. Out of Box – DP Procedure
Make sure right Patches are installed
, , , , , , , , , , , , , , , , , , , , , , , ,

14. Out of Box – DP Procedure
Make sure to read:
Achieving Grid Automation with Deployment Procedures
Saving time and labor on Oracle Patching with EM Provisioning Pack
Documentation:
Using Enterprise Manager For Grid Automation With Deployment Procedures
Using a Software Library

15. Out of Box – DP Procedure
Oracle Clusterware / RAC Provisioning for UNIX
Installs
CRS
ASM DB
Allows you to
Create + ASM instance
Create starter Database

16. Out of Box – DP Procedure
Consists out of 43 Steps
Allows the source to be:
Existing OracleHome
Software Library
Use Software Library!
Central located baselines
CRS / ASM / DB

19. Out of Box – DP Procedure
Enable notification (see next slide)
Results in message like:
Subject 45.Attention.Step.Failed
No message text
Not tested yet
Should be fixed

21. Out of Box – DP Procedure
Notice that: (see next slide)
each step can be:
Edited
Enabled
Disabled
Removed
Step outcome
Can be inherited
Ingnore

26. Out of Box – DP Procedure
We don’t use Create Starter Database (See next slide)
We use a separate DP Procedure for this
Create RAC Database on configured Stack

28. ASM Disk String /dev/mpath/36* not allowed No use of wildcards
Not tested yet
Should be fixed

33. Out of Box – DP Procedure
Procedure takes 2 – 2 ½ hours
Includes +/- 22 Steps – “Checks and Fixes”
Takes +/- half of processing time
Doesn’t make sense if target platform is guaranteed the same
Was configured with same image – BMP
Split the Out of Box procedure
Just checking
To be used when BMP image changes
Do the actual job
Reduces processing time to approx 50 Minutes

34. Customizing – DP Procedure
New procedure with Create Like
Unable to edit the Out Of Box procedures!
So Create Like and then edit

35. Customizing – DP Procedure
Requirements
Diskgroup to be used
Default DATA
We use DGO, DGT… (Development, Testing,…)
Listener port
Default 1521
We use 39000
We use one Listener per Server
Network Admin
Default $ORACLE_HOME/network/admin
We use /u01/app/oracle/admin/network/admin
Shared for server

36. Customizing – DP Procedure
Software Library
Components
Directives
Oracle Directives
RABO Directives

38. Customizing – DP Procedure
Make new “RABO” Directives
RABO – Run Oui Only Prerereqs
Based on Run Oui Only Prerereqs
runOuiOnlyPrereqs.pl copied to raboRunQuiOnlyPrereqs.pl
then make modifications
RABO – Run ASM Config Tools
Based on Run Database Config Tools
runDatabaseConfigTools.pl copied to raboRunASMConfigTools.pl

43. Customizing – DP Procedure
Next, edit the procedure
Rabo – CRS / ASM / DB Provisioning
Edit steps you want to modify
In this example:
Verify Prerequisite Checks
Run ASM Configuration Tools

46. Customizing – DP Procedure
Save the modifications
Start testing
Notice that when running a DP procedure
When a Step fails – because of Input typo
Do an update and retry or…
Ignore the failure and proceed
Check /u01/app/oracle/product/10.2.0/agent10g/EMStage/PAF/Job_59beb3609b747a3fe d0a3729 (this should be the most recent directory that is present in the ../../PAF directory)
outputFile

47. Wrap-up It does work! Make sure you have your requirements
Start testing the Out Of The Box procedure
Enhance the Software Library for custom Directives
Create your customized Directives
Create your customized Procedure
Edit the Procedure Steps you want to customize
Assign the new created Directive
Configure how the Directive Arguments should be processed
Ask User at Runtime
Choose Variable
Set Value

48. Q & A