Nationwide Database Operations Team Database Software Currency Using EM 12c Provisioning and Patching Gary Henderson

September 29, 2014 Nationwide Database Operations Team About Me Nationwide employee for 22 years Application Programming background Joined DBA Team at the beginning of 2000 EM Administrator since 2008 (10g) EM 12c Early Adopter NW Champion of EM Provisioning and Patching 1

Contents June 12, 2012 Nationwide Database Operations Team 2 Insurance and Financial Services Company Fortune 100 Company Founded in Billion in Revenues 171 Billion in Assets 33,000 Employees 26 core DBAs with combined 410 years DBA experience Nationwide

September 29, 2014 Nationwide Database Operations Team Agenda Why software currency is important Current Configuration State Patching –Traditional - OPatch –With EM – In Place –With EM – Out of Place Provisioning Maturity Stages Nationwide Experiences –Success –Challenges –Future Questions 3

September 29, 2014 Nationwide Database Operations Team Database Software Currency Why software currency is important to us..at Nationwide –Availability –Security –Efficiency –Stability 4

September 29, 2014 Nationwide Database Operations Team Current Situation -- Versions 5

September 29, 2014 Nationwide Database Operations Team Current Situation -- Configuration 6

September 29, 2014 Nationwide Database Operations Team Enterprise Manager 12c Deployment Architecture 7

September 29, 2014 Nationwide Database Operations Team EM12c Monitoring & Management – Current Target Availability 8

September 29, 2014 Nationwide Database Operations Team Patching (Classic) Find the proper patch(s) Download Stage the patch(s) on target server Unzip patch(s) Upgrade Opatch Analyze patch(s) for conflicts –Schedule Downtime Blackout targets (databases & listeners) Bring down database(s) & listener(s) Apply patch(s) Process post upgrade steps (if any) Start database(s) & listener(s) End Blackout 9

September 29, 2014 Nationwide Database Operations Team Patching with EM12c – My Oracle Support Integration 10

September 29, 2014 Nationwide Database Operations Team Patching with EM12c – Patch Selection 11

September 29, 2014 Nationwide Database Operations Team Patching with EM12c – Create New Plan & Pick Target 12

September 29, 2014 Nationwide Database Operations Team Patching with EM12c – Plan Information 13

September 29, 2014 Nationwide Database Operations Team Patching with EM12c – Specify Patches 14

September 29, 2014 Nationwide Database Operations Team Patching with EM12c – Deployment Options 15

September 29, 2014 Nationwide Database Operations Team Patching with EM12c – Specify Credentials 16

September 29, 2014 Nationwide Database Operations Team Patching with EM12c - Analyze 17

September 29, 2014 Nationwide Database Operations Team Patching with EM12c – Execution Status,Logs 18

September 29, 2014 Nationwide Database Operations Team Complex Configuration – Real World example 19

September 29, 2014 Nationwide Database Operations Team Lifecycle of an Oracle Home – Out of Place patching 20 Oracle Home DB 1 DB 2 DB 3 Oracle Home + PSU DB 1 DB 2 DB 3

September 29, 2014 Nationwide Database Operations Team EM12c Provisioning 21

September 29, 2014 Nationwide Database Operations Team Crawl … Walk … Run … Fly In-place patching via EM12c Some provisioning of Database homes Some provisioning of Cluster Ready Services (CRS) Out of place patching of database homes Gold Copies for each unique configuration Leveraging templates and profiles All provisioning via EM12c Patch frequency increased to semiannual or quarterly Utilizing Change Activity Planner Cloud Provisioning 22

September 29, 2014 Nationwide Database Operations Team EM12c Provisioning – Lessons Learned - Success Test EM12c patches/upgrades Oracle Home and inventory verification (especially for Veritas) Sticking with Oracle (RAC) vs other Clustering (Veritas) Having a dedicated EM12c team (we have 2 people) Global Credentials Maintain currency with EM12c and database codebase Extensive testing of provisioning and patching 23

September 29, 2014 Nationwide Database Operations Team EM12c Provisioning – Lessons Learned - Challenges Initial /tmp space too small Assign to single person Tried to implement prior to proper training Entrenched DBA team with decades of experience New approach to one-off patches “Configuration Pollution” 24

September 29, 2014 Nationwide Database Operations Team EM12c Provisioning – Future Leverage Patch templates more Leverage Provisioning Profiles more and better Integrate –Patch Levels –Gold Copies –Patch templates –Change Activity Planner Attempt the 100% provisioning goal Accelerate the patching cycle Develop Cloud Proof of Concept 25

September 29, 2014 Nationwide Database Operations Team EM12c Lifecycle Management Pack Configuration Management Compliance Change Management Patching Provisioning Prerequisite to Cloud Provisioning 26 Features used currently at Nationwide

Nationwide Database Operations Team Summary: Recognition: Questions???

Nationwide Database Operations Team Other Sessions: HOL9532Achieving Standardization with Oracle Enterprise Manager Database Lifecycle Management