1 RAL Status and Plans Carmine Cioffi Database Administrator and Developer 3D Workshop, CERN, 26-27 November 2009.

Slides:



Advertisements
Similar presentations
INTRODUCTION TO ORACLE Lynnwood Brown System Managers LLC Backup and Recovery Copyright System Managers LLC 2008 all rights reserved.
Advertisements

IWR Ideen werden Realität Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Institut für Wissenschaftliches Rechnen Status of Database Services.
DB server limits (process/sessions) Carlos Fernando Gamboa, BNL Andrew Wong, TRIUMF WLCG Collaboration Workshop, CERN Geneva, April 2008.
CERN - IT Department CH-1211 Genève 23 Switzerland t Backup & Recovery with RMAN LCG 3D Workshop, Bologna June 12 th, 2007 Jacek Wojcieszuk.
Oracle Clustering and Replication Technologies CCR Workshop - Otranto Barbara Martelli Gianluca Peco.
Database Hardware Resources at Tier-1 Sites Gordon D. Brown Rutherford Appleton Laboratory 3D/WLCG Workshop CERN, Geneva 11 th -14 th November 2008.
Orhan BIYIKLIOGLU feat Husnu SENSOY1. Orhan Bıyıklıo ğ lu Hüsnü Şensoy Orhan BIYIKLIOGLU feat Husnu SENSOY2 UNIX/Linux experience over 10 years. Certified.
CERN IT Department CH-1211 Genève 23 Switzerland t Backup configuration best practices Jacek Wojcieszuk, CERN IT-DM Distributed Database.
Oracle’s Backup and Recovery Tool
Configuring Recovery Manager
4 Copyright © 2008, Oracle. All rights reserved. Configuring Backup Specifications.
Chapter 5 Configuring the RMAN Environment. Objectives Show command to see existing settings Configure command to change settings Backing up the controlfile.
Backup & Recovery with RMAN
9 Copyright © Oracle Corporation, All rights reserved. Oracle Recovery Manager Overview and Configuration.
1 Recovery and Backup RMAN TIER 1 Experience, status and questions. Meeting at CNAF June of 2007, Bologna, Italy Carlos Fernando Gamboa, BNL Gordon.
CHAPTER 17 Configuring RMAN. Introduction to RMAN RMAN was introduced in Oracle 8.0. RMAN is Oracle’s tool for backup and recovery. RMAN is much more.
The Oracle Recovery Manager (RMAN)
Backup Concepts. Introduction Backup and recovery procedures protect your database against data loss and reconstruct the data, should loss occur. The.
Agenda  Overview  Configuring the database for basic Backup and Recovery  Backing up your database  Restore and Recovery Operations  Managing your.
Oracle backup and recovery strategy
CERN IT Department CH-1211 Geneva 23 Switzerland t CERN IT Department CH-1211 Geneva 23 Switzerland t
Backup Infrastructure – Additional Information Gordon D. Brown, RAL Carlos Fernando Gamboa, BNL 3D Workshop, CNAF, Bologna, Italy 13 th June 2007.
BNL Oracle database services status and future plans Carlos Fernando Gamboa RACF Facility Brookhaven National Laboratory, US Distributed Database Operations.
Castor F2F Meeting Barbara Martelli Castor Database CNAF.
Storage review Carmine Cioffi Database Administrator and Developer 3D Workshop, Barcelona (ES), April 2009.
Oracle Recovery Manager (RMAN) 10g : Reloaded
PPOUG, 05-OCT-01 Agenda RMAN Architecture Why Use RMAN? Implementation Decisions RMAN Oracle9i New Features.
Recovery Manager Overview Target Database Recovery Catalog Database Enterprise Manager Recovery Manager (RMAN) Media Options Server Session.
CERN IT Department CH-1211 Geneva 23 Switzerland t Experience with NetApp at CERN IT/DB Giacomo Tenaglia on behalf of Eric Grancher Ruben.
ASGC 1 ASGC Site Status 3D CERN. ASGC 2 Outlines Current activity Hardware and software specifications Configuration issues and experience.
D0 Taking Stock1 By Anil Kumar CD/CSS/DSG July 10, 2006.
5 Copyright © 2004, Oracle. All rights reserved. Using Recovery Manager.
5 Copyright © 2008, Oracle. All rights reserved. Using RMAN to Create Backups.
Chapter 7 Making Backups with RMAN. Objectives Explain backup sets and image copies RMAN Backup modes’ Types of files backed up Backup destinations Specifying.
11 Copyright © Oracle Corporation, All rights reserved. RMAN Backups.
Backup and Recovery Protects From Data Loss. Backup and Recovery Protects From Data Loss Provides for Media Recovery.
11 Copyright © Oracle Corporation, All rights reserved. RMAN Backups.
Windows Servers.  HP Advanced Model (7.5 Unit) model 3 - $5912  ML 350 Chassis, Tower Form Factor  Dual-Core Intel Xeon 5140 Processor (IA64)  5 Gb.
Chapter 9 Scripting RMAN. Background Authors felt that scripting was a topic not covered well Authors wanted to cover both Unix/Linux and Windows environments.
Backup & Recovery Backup and Recovery Strategies on Windows Server 2003.
Service Review and Plans Carmine Cioffi Database Administrator and Developer 3D Workshop, Barcelona (ES), April 2009.
CERN - IT Department CH-1211 Genève 23 Switzerland t Tier0 database extensions and multi-core/64 bit studies Maria Girone, CERN IT-PSS LCG.
DB Installation and Care Carmine Cioffi Database Administrator and Developer ICAT Developer Workshop, The Cosener's House August
CASTOR Databases at RAL Carmine Cioffi Database Administrator and Developer Castor Face to Face, RAL February 2009.
Summary of the status and plans of FTS and LFC back-end database installations at Tier-1 Sites Gordon D. Brown Rutherford Appleton Laboratory WLCG Workshop.
CERN - IT Department CH-1211 Genève 23 Switzerland t Oracle Real Application Clusters (RAC) Techniques for implementing & running robust.
Review of Recent CASTOR Database Problems at RAL Gordon D. Brown Rutherford Appleton Laboratory 3D/WLCG Workshop CERN, Geneva 11 th -14 th November 2008.
CERN IT Department CH-1211 Genève 23 Switzerland t Possible Service Upgrade Jacek Wojcieszuk, CERN/IT-DM Distributed Database Operations.
CERN Database Services for the LHC Computing Grid Maria Girone, CERN.
3 Copyright © 2006, Oracle. All rights reserved. Using Recovery Manager.
CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,
LHCb File-Metadata: Bookkeeping Carmine Cioffi Department of Physics, Oxford University UK Metadata Workshop Oxford, 04 July 2006.
2 Copyright © 2007, Oracle. All rights reserved. Configuring for Recoverability.
2 Copyright © 2006, Oracle. All rights reserved. Configuring Recovery Manager.
BNL Oracle database services status and future plans Carlos Fernando Gamboa, John DeStefano, Dantong Yu Grid Group, RACF Facility Brookhaven National Lab,
Maria Girone CERN - IT Tier0 plans and security and backup policy proposals Maria Girone, CERN IT-PSS.
CNAF Database Service Barbara Martelli CNAF-INFN Elisabetta Vilucchi CNAF-INFN Simone Dalla Fina INFN-Padua.
Database CNAF Barbara Martelli Rome, April 4 st 2006.
PIC port d’informació científica Luis Diaz (PIC) ‏ Databases services at PIC: review and plans.
RAL Plans for SC2 Andrew Sansum Service Challenge Meeting 24 February 2005.
14 Copyright © 2007, Oracle. All rights reserved. Backup and Recovery Concepts.
RMAN Maintenance.
RMAN Maintenance.
Scalable Database Services for Physics: Oracle 10g RAC on Linux
The INFN Tier-1 Storage Implementation
Configuring Recovery Manager
Oracle ASM on Azure: Backup Scenarios
Scalable Database Services for Physics: Oracle 10g RAC on Linux
Configuring Backup Settings
IBM Tivoli Storage Manager
Presentation transcript:

1 RAL Status and Plans Carmine Cioffi Database Administrator and Developer 3D Workshop, CERN, November 2009

2 OUTLINE 3D –Database configuration and HW spec –Storage configuration and HW spec –Future plans CASTOR –Database configuration and HW spec –Storage configuration and HW spec –Schemas Size and Versions –Future plans Backup configuration

3 3D: Database Configuration and HW Spec 3 nodes RAC for ATLAS (Ogma) –Red hat 4.8 –64 bit –2 Quad Core Xeon(R) 2.33GHz –16 GB 2 nodes RAC for LHCb (Lugh) –Red Hat 4.8 –64 bit –2 Dual-Core AMD Opteron(tm) 2216 –16 GB 3

4 3D: Database Configuration and HW Spec For both RAC Ogma and Lugh: –Oracle –Single OCR –Single Voting Disk 4

5 3D: Storage Configuration and HW Spec Single disk array shared by both databases (Ogma, Lugh): –Storage (SAN, 2GBps FC): Ogma:~1/2 TB Pluto: ~100GB –Single switch SANBOX Gb/s –16 disks SATA 260GB –Configured with RAID10 5

6 3D: Storage Configuration and HW Spec ASM: –Ogma (ATLAS): Normal redundancy Single disk group Two failure groups One disk (512G) per failure group –Lugh (LHCb): Normal redundancy Single disk group Two failure groups One disk (512G) per failure group 6

7 3D: Database diagram 7 OGMALUGH FC switch SANBOX Gb/s OGMA (1/2TB / 1TB GB) LUGH (100GB / 1/2TB) SAN

8 3D Future Plans: DB Configuration and HW Spec There will be no changes on: –Number of nodes per RAC –Hardware spes –Oracle version Deploy on both RAC Ogma and Lugh: –Two OCRs –Three Voting Disks 8

9 3D Future Plans: DB Configuration and HW Spec Two disk arrays shared by both databases (Ogma, Lugh): –Storage: SAN 4GBps FC –Physical disk available: Array 1: 16 disks SATA 260GB Array 2: 6 disks SATA 550GB –Arrays with RAID5 configuration Two switches: SANBOX Gb/s SANBOX Gb/s 9

10 3D Future Plans: Storage Configuration and Spec ASM: –Ogma (ATLAS): Normal redundancy Single disk group two failure groups Two or more disks per failure group –Lugh(LHCb): Normal redundancy Single disk group two failure groups One or more disks per failure group 10

11 3D: Database Diagram 11 OGMALUGH FC switch 1 SANBOX Gb/s Disk array 1 LUGH OGMA FC switch 2 SANBOX Gb/s Disk array 2 mirror LUGH OGMA ASM mirroring

12 Castor: Database Configuration and HW Spec 2 5-nodes RAC (Pluto, Neptune) + one single instance (Uranus) –Red hat 4.8 –32 bit –Dual Quad Core (Intel Xeon 3Ghz) –4 GB Oracle Single OCR Single Voting Disk 12

13 Castor: Storage Configuration and HW Spec Single disk array used by the two RACs: Storage: –Pluto:~200GB –Neptune:~220GB –Single instance: 624GB Overland 1200 disk array –Twin controller –Twin Fibre Channel ports to each controller –10 SAS disk (300GB each 3TB total gross space) –Raid 1(1.5 TB net space) Two Brocade 200E 4Gbit switched 13

14 Castor: Storage Configuration and HW Spec ASM (Pluto, Neptune): Normal redundancy Single disk group Two failure groups One disk (512G) per failure group 14

15 Database Overview 15 NeptunePluto Brocade 200E Uranus SCSI attached disk array (624GB / 1.8TB Pluto (200GB / 1/2TB) Neptune (220GB / ½ TB) Overland 1200

16 Castor Future plans: DB Configuration and HW Spec There will be no changes on the number of node per RAC, the hardware or Oracle version Deploy on both RAC Pluto and Neptune: –Two OCRs –Three Voting Disks 16

17 Castor Future plan Storage Configuration and HW Spec Two disk arrays shared by both databases (Neptune, Pluto): –Storage: EMC Clarion –Physical disk available: SAS 300GB Drives 2TB gross –RAID5 configuration Two Brocade 200E 4Gbit switched 17

18 Castor Future plan Storage Configuration and Spec ASM (Pluto, Neptune): Normal redundancy Single disk group two failure groups One or more disks per failure group 18

19 Castor: Schemas Size and Versions 19 SchemasVersionSize Name Servern/a1.8GB VMGRn/a1.7MB CUPVn/a0.2MB CMS Stager 2_1_7_27_1 1.9GB Gen Stager 2_1_7_27_1 3.8GB Repack_2192_1_9_117MB Repack2_1_7_2762MB Gen SRM2_8_2540MB SRM CMS2_8_21.1GB VDQM2 2_1_8_3_1 5MB Pluto SchemasVersionSize Atlas Stager 2_1_7_27_1 18GB LHCb stager 2_1_7_27_1 1.8GB SRM Atlas2_8_25.1GB SRM LHCb2_8_21.2GB Neptune

20 Backup configuration Incremental 0 once a week Incremental 1 the other days of the week All backups are followed by logical validation Archived log backup done during the day (for now) Once we move to the new hardware the archived log will be multiplexed on a shared disk outside ASM Backup are stored on the local disk Backup are copied from the local disk to tape and kept for three months

21 Backup configuration RMAN configuration parameters are: –CONFIGURE RETENTION POLICY TO RECOVERY WINDOW OF 8 DAYS; –CONFIGURE BACKUP OPTIMIZATION ON; –CONFIGURE DEFAULT DEVICE TYPE TO DISK; –CONFIGURE CONTROLFILE AUTOBACKUP ON; –CONFIGURE CONTROLFILE AUTOBACKUP FORMAT FOR DEVICE TYPE DISK TO '/oracle_backup/pluto/%F.bak'; –CONFIGURE DEVICE TYPE DISK PARALLELISM 2 BACKUP TYPE TO BACKUPSET; –CONFIGURE DATAFILE BACKUP COPIES FOR DEVICE TYPE DISK TO 1; –CONFIGURE ARCHIVELOG BACKUP COPIES FOR DEVICE TYPE DISK TO 1; –CONFIGURE CHANNEL DEVICE TYPE DISK FORMAT '/oracle_backup/pluto/pluto_%U.bak'; –CONFIGURE MAXSETSIZE TO UNLIMITED; –CONFIGURE ENCRYPTION FOR DATABASE OFF; –CONFIGURE ENCRYPTION ALGORITHM 'AES128'; –CONFIGURE ARCHIVELOG DELETION POLICY TO NONE; –CONFIGURE SNAPSHOT CONTROLFILE NAME TO '/opt/oracle/app/oracle/product/10/db_1/dbs/snapcf_pluto1.f'; # default

22 Backup configuration Incremental 0: –backup incremental level 0 duration 12:00 database; –backup archivelog all delete all input; –report obsolete; –delete noprompt obsolete; Incremental 1: –backup incremental level 1 duration 12:00 minimize time database; –backup archivelog all delete all input; Validation: –restore validate check logical database archivelog all;

23 ANY QUESTIONS?