1. CDF DB Taking Stock ‘10 1 By Anil Garg – Database Services Aug 18, 2010

2. 2  Infrastructure  Capacity Planning  Backup & Recovery  Accomplishments  DB Availability Metrics  What’s Next  Concerns  Q & A CDF DB Taking Stock ‘10 - Outline

3. 3 CDF DB Taking Stock ‘10 – Infrastructure - Databases TypeMachineUsageOSType Oracle v10.2.0.4 bzora2CDF online PrdSunOS 5.10 64bitSPARC T5220 1165 MHz 32GB b0dau36CDF online Dev /IntSunOS 5.10 64bitSunE450, 4x400MHz, 4Gb fcdfora3CDF offline PrdSunOS 5.10 64bitSun M4000, 4x2.4MHz, 32G fcdfora1CDF offline Dev/IntSunOS 5.10 64bitSunE4500, 8x400MHz, 2.5G fcdfora7CDF offline Prd ReplicaRHEL 5.5 64bitSENECA 8x2.66GHz 16Gb fcdfora5CDF offline Replica TestRHEL 5.5 32bitDELL 2650, 4x2.8GHz, 2.0G

4. 4 CDF DB Taking Stock ‘10 – Infrastructure - Databases TypeMachineUsageOSType Oracle v10.2.0.4 bzora1Future CDF online Dev/int SunOS 5.10 64bitSunFire V440, 4x1.2GHz, 16Gb fcdforaNFuture CDF offline Replica Test RHEL 5.5 64bitSENECA 8x2.66GHz 16Gb

5. 5  Report for: Space Usage for Database cdfonprd Period: Apr 2010 To June 2010  SLA breaches: None  Incidents/Near-misses: None.  Current Database Space Usage  Allocated (GB) 871  Used (GB) 680  Allocated Free Space (GB) 192 This Quarter EST: Next Quarter Available on Server Begin 650G 680GBbzora2 428GB End 680GB 710GB Based upon current usage trending, we are NOT expecting any storage need in next 1 year. CDF DB Taking Stock ‘10 – Disk Capacity Planning  Graph/Trending: Used Allocated Used

6. 6  Report for: Space Usage for Database cdfofpr2 Period: Apr 2010 To June 2010  SLA breaches: None  Incidents/Near-misses: None.  Current Database Space Usage  Allocated (GB) 764  Used (GB) 484  Allocated Free Space (GB) 280 This Quarter EST: Next Quarter Available on Server Begin450GB484GBfcdfora3 472GB End484GB518GB Based upon current usage trending, we are NOT expecting any storage need in next 1 year. D0 DB Taking Stock ‘10 – Disk Capacity Planning  Graph/Trending: Used Allocated Used Allocated

7. 7  Report for: Space Usage for Database cdfstrm1 Period: Apr 2010 To Jun 2010  SLA breaches: None  Incidents/Near-misses: None.  Current Database Space Usage  Allocated (GB) 497  Used (GB) 324  Allocated Free Space (GB) 172 This Quarter EST: Next Quarter Available on Server Begin303GB324GB fcdfora7 1.3T End324GB345GB Based upon current usage trending, we are NOT expecting any storage need in next 1 year. D0 DB Taking Stock ‘10 – Disk Capacity Planning  Graph/Trending: Used Allocated

8. 8 Graph/Trending cdfonprd - Growth 91GB per yr / cdfofpr2 – 96GB/ per yr CDF DB Taking Stock ‘10 – Yearly Charts cdfonprd cdfofpr2 * Used Allocated * New Agent was Implemented in Sep ’09 Note: Not enough Data for cdfstrm1 since migrated to new host in Jul ‘10. However, growth is 80GB/Year

9. 9 CDF DB Taking Stock ‘10 – Backups Details DatabaseFrequency Local CopiesExport Archive RetentionDcacheSizeFree cdfonprdDaily2*No5Daily - Dcache1.7T440G cdfofpr2Daily2No5Daily - Dcache900G436G cdfstrm1Daily2No7 560G1.2T

10. 10  Migrated cdfofpr2 database to fcdfora3  Migrated cdfstrm1 to fcdfora7  Migrated cdfonprd to bzora2  Implemented backup for cdfstrm1  Deployed SAM Schema cuts as needed  Moved the backups to HITACHI SMS100 from NEXSAN for cdfonprd database  OS and DB Security Patches up-to-date  Kerberos Proof of Concept  Migrated and upgraded the Database Monitoring tool CDF DB Taking Stock ‘10 - Accomplishments

11. 11 Time Period Jun 01, 2009 to Jul 21, 2010 CDT cdfonprd: Overall Availability(%): 99.46 Total Downtime (hours): 0.33 Total Blackout Time (hours): 5.65 cdfofpr2: Overall Availability (%): 99.79 Total Downtime (hours): 0 Total Blackout Time (hours): 3.4 Note: 655 minutes downtime due to Power Outage. Not reported by OEM since OEM was down due to Power Outage. cdfstrm1 : Overall Availability (%): 100% ( Due to failover to cdfofwrite service) Note: 201 minutes downtime due to Power Outage. Not reported by OEM since OEM was down due to Power Outage. CDF DB Taking Stock ‘10 – DB Availability Metrics Availability State

12. 12  Upgrade Oracle Databases to 11g ( Support Expiry Jul ‘11)  Migrate off of 3par SAN storage to another vendor in FY11. ( Since maintenance cost on 3par will be too high in FY 2012)  Co-ordinate testing Oracle Kerberos for SAM App  Upgrade the DB Monitoring Agent  Move b0dau36 to bzora1  Move fcdfora1 to fcdfora4  Replace fcdfora5 to new hardware CDF DB Taking Stock ‘10 - Next

13. 13  Schedule to switch to Ntuples for migration of PRE-SCALE data.  Need to get the name of current application owners for CDF online and offline. Offline Application Owners ( To be reviewed) http://www- css.fnal.gov/dsg/internal/databs_appl/applications_CDFoffline.html Online Application Owners ( To be reviewed) http://www-css.fnal.gov/dsg/internal/databs_appl/applications_CDFonline.html  CDF SAM Replication Pros and Cons : http://www- css.fnal.gov/dsg/internal/ora_repl/CDF_SAM_REPLICATION.htm CDF DB Taking Stock ‘10 – Concerns

14. 14 Q & A CDF DB Taking Stock ‘10 – Q & A