1. Cluster Concepts and Configuration H6487S I.02 Module 5

2. 2 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. Definition of a Cluster A Cluster is a collection of nodes which cooperate together to improve the availability of applications running on the nodes. Two major benefits of a cluster during downtime events ensure: – High Availability when another node takes over. (Unplanned) – The cluster can be used for rolling upgrades. (Planned)

3. 3 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. Lan 2 Primary Mirror VG01 System B A Primary Mirror VG02 Root Heartbeat Packet Mirror Root Mirror Root cmcld process cmcld process Cluster Lock lan0 lan1 Lan 2 lan1lan0 Major Components of a Cluster Bridge 4 3 1 2

4. 4 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. Heartbeat Packet Data Packet Data Packet lan0lan1lan0lan1 lan2 Standby LAN Bridge NETWORK_INTERFACE lan0 HEARTBEAT_IP 15.19.83.121 NETWORK_INTERFACE lan1 STATIONARY_IP 192.20.45.121 NETWORK_INTERFACE lan2 # Possible standby network interfaces for lan1 or lan0 Excerpt from Cluster Configuration file 15.19.83.121192.20.45.121 Network Interface Configuration NETWORK_POLLING_INTERVAL 2000000

5. 5 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. Primary Mirror VG01 Primary Mirror VG02 Cluster Lock SystemBSystemA FIRST_CLUSTER_LOCK_VG /dev/vg01 NODE_NAME SystemA FIRST_CLUSTER_LOCK_PV /dev/dsk/c1t4d0 Cluster Lock Configuration Excerpt from Cluster Configuration file

6. 6 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. SystemB SystemA Cluster Lock Configuration Using a Quorum Server Quorum Server QS_HOST SystemC QS_POLLING_INTERVAL 120000000 QS_TIMEOUT_EXTENSION 2000000 Excerpt from Cluster Configuration file

7. 7 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. Heartbeat Packet lan0 HEARTBEAT_INTERVAL 1000000 NODE_TIMEOUT 5000000 Primary Mirror VG01 Cluster Lock Heartbeat Configuration Excerpt from Cluster Configuration file

8. 8 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. cmcld process cmcld process service process service process The cmcld process Sends and receives Heartbeats Checks the LAN cards for functionality Monitors the service processes of packages Heartbeat Packet cmcld Process

9. 9 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. Cluster Formation Requirements Cluster Lock Mechanism Required for 2 nodes (Quorum Server or LVM Disk) Recommended for 3 or 4 nodes (Quorum Server or LVM Disk) Optional for 5 or more nodes (Quorum Server only) Should be on separate power sources from other systems in cluster Node Attendance 100% node attendance is required for initial cluster formation Network Requirements All nodes in the cluster must be on same subnet LAN cards in the same system MUST be on separate subnets At least one HEARTBEAT_IP network is configured

10. 10 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. Steps to Configure a Cluster 1.Build cluster configuration file cmquerycl -v -C cmclconfig.ascii -n node1 -n node2… 2.Compile and distribute binary file cmcheckconf -v -C cmclconfig.ascii cmapplyconf -v -C cmclconfig.ascii 3.Start MC/SG daemons cmruncl –v 4.If necessary, halt the cluster cmhaltcl -v

11. 11 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. Cluster Config ASCII file cmclconfd process cmclconfd process FIRST_CLUSTER_LOCK_VG NODE_NAME - NETWORK_INTERFACE - HEARTBEAT_IP or STATIONARY_IP or blank - FIRST_CLUSTER_LOCK_PV - SERIAL_DEVICE_FILE HEARTBEAT_INTERVAL NODE_TIMEOUT AUTOSTART_TIMEOUT NETWORK_POLLING_INTERVAL VOLUME_GROUP CLUSTER_NAME MAX_CONFIGURED_PACKAGES Steps to Configure a Cluster 1.Build Cluster Configuration File 2.Compile and Distribute Binary File 3.Start MC/SG Daemons Use cmquerycl command to build cluster configuration ASCII file Step 1: Build Cluster Configuration ASCII File

12. 12 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. Cluster Config ASCII file Cluster Binary File cmapplyconf Cluster Configuration ASCII File Cluster Binary File This file is automatically distributed to all nodes in the cluster. 1.Build Cluster Configuration File 2.Compile and Distribute Binary File 3.Start MC/SG Daemons Steps to Configure a Cluster Step 2: Compile and Distribute Binary File

13. 13 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. # cmruncl -v Cluster Binary file cmcld process Cluster Config ASCII file Cluster Binary file cmcld process 1.Build Cluster Configuration File 2.Compile and Distribute Binary File 3.Start MC/SG Daemons Steps to Configure a Cluster Step 3: Start MC/SG Daemons

14. 14 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. Cluster Configuration Procedure 1. Set up trusted hosts within cluster systems: vi /etc/cmcluster/cmclnodelist this_node_hostname root other_node_hostname root 2. cd /etc/cmcluster 3. cmquerycl –v -C cmclconf.ascii -n nodel -n node2 4. vi cmclconf.ascii Modify CLUSTER_NAME field Modify MAX_CONFIGURED_PACKAGES field 5. cmcheckconf –v -C /etc/cmcluster/cmclconf.ascii 6. cmapplyconf –v -C /etc/cmcluster/cmclconf.ascii 7. cmruncl -v

15. 15 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. # cmviewcl -v CLUSTERSTATUS cluster1 up NODE STATUS STATE SystemA uprunning Network_Parameters: INTERFACE STATUS PATH PRIMARY up 8/16/6 STANDBY up 8/20/5/1 NAME lan0 lan1 Serial Heartbeat: DEVICE FILE NAME CONNECTED TO: /dev/tty0p3 /dev/tty0p3 Viewing the Cluster — cmviewcl Command

16. 16 H6487S I.02© 2003 Hewlett-Packard Development Company, L.P. May 2 15:30:52 systemA cmcld[2048]: clvmd initialized successfully # tail -f /var/adm/syslog/syslog.log May 2 15:30:45 systemA cmcld[2048]: cmruncl May 2 15:30:47 systemA cmcld[2048]: Starting cluster protocols May 2 15:30:48 systemA cmcld[2048]: Attempting to form a new cluster May 2 15:30:50 systemA cmcld[2048]: Clearing the Cluster Lock May 2 15:30:45 systemA cmcld[2048]: Turning on safety time protection May 2 15:30:50 systemA cmcld[2048]: Two nodes have formed a new cluster May 2 15:30:51 systemA cmcld[2048]: The new active membership is: systemA, systemB Checking the Cluster Log