ASGC 1 ASGC Site Status 3D CERN

ASGC 2 Outlines Current activity Hardware and software specifications Configuration issues and experience sharing

ASGC 3 Current activity System migration to phase out the old system based on a mixture of Pentium-4 and Itanium-II machines Oracle RAC build-up to power the Oracle-related LCG services by an extendable and more reliable Oracle system

ASGC 4 Why migration? Previous Oracle services were run by Itanium-II IA64 machines Hardware complexity on Itanium servers made configuration quite time consuming. More standard architectures can simplify deployment. If adopting Itanium servers, it appears that future RAC expansion will also require us to purchase Itanium servers. This is not a cost effective solution for us. The new system is running on Pentium-D

ASGC 5 System evolution and experience in building Oracle RAC system CPU Pentium-4 3.2GHz Itanium-II IA64 1.5GHz Pentium-D GHz OSSLC3SLC4 Nodes(#)2222 ASM ConfigNOYES NO OCFS ConfigYESNO OCFS2 Config NOYES PastNow

ASGC 6 Hardware configuration Four servers CPU : Intel Pentium-D GHz Memory 2G (ECC) Local Disk S-ATA2 80G 7200 rpm Fiber Channel LSI 7102XP-LC, PCI X 1 SAN Switch : Silkworm ports Backend Raid subsystem: StorageTek B280 Each RAC group shares 1.7TB exported from SAN RAC group for 3D RAC group for other LCG services Dual channel & redundant controller

ASGC 7 Software installation OS SLC 4, release EL.cernsmp Oracle Enterprise Edition Real Application Clusters manual patch to (identical to CERN setup) OCFS2 configured CRS home shared among all cluster Partition for backup OEM agent is under re-installation

ASGC 8 Configuration issues Hardware configuration Complexity of hierarchical SAN configuration may cause the RAC unstable Redundant controller issues  The node will see and mount the redundant volume as the second physical volume (“rdac” module is needed to avoid this wrong behavior) Software installation In the pre-installation stage, default OCFS kernel modules couldn’t be loaded in SLC4 ( ), recompilation from source is needed

ASGC 9 Work around on SLC Build Oracle RAC 10g Release2 Cluster on IA64 and Scientific Linux CERN 43: er_on_IA64_and_Scientific_Linux_CERN_43?highlight=%28rac%29 er_on_IA64_and_Scientific_Linux_CERN_43?highlight=%28rac%29 Pres-installation of Oracle RAC: Installation_on_All_Nodeshttp://lists.grid.sinica.edu.tw/apwiki/Pre- Installation_on_All_Nodes 3D testbed installation note: e?highlight=%28oracle%29 e?highlight=%28oracle%29 Oracle RAC installation note: hlight=%28oracle%29 hlight=%28oracle%29 Oracle 10g RAC: ASM & OCFS %3A_ASM_%26_OCFS?highlight=%28oracle%29 %3A_ASM_%26_OCFS?highlight=%28oracle%29 Oracle EM Grid Control and Agent Installation ent_Installation?highlight=%28oracle%29 ent_Installation?highlight=%28oracle%29

ASGC 10 Extended plan complete the installation of OEM agent Experiment support: ATLAS / CMS migrate Castor 2 name sever into the RAC environment Migration of FTS backend Oracle is also considered

ASGC 11 Summary The Oracle services has been migrated to the new system running on 1U Pentium-D machines A 4-node Oracle RAC has been setup with OSFS with manual patch to nodes are dedicated for 3D Fiber channel connection to backend storage through SAN switch 1.7 TBytes storage is supported by a raid system with redundant controller OEM is under re-installation All software configuration is based on SLC4 Site contact Yi-Ping Wu ASGC OPS