Download presentation
Presentation is loading. Please wait.
Published byPauline Thompson Modified over 8 years ago
1
IBM Power Systems © 2012 IBM Corporation PowerVM Live Partition Mobility César Diniz Maciel Executive IT Specialist IBM Global Techline cmaciel@us.ibm.com
2
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 2 Rebalance processing power across servers when and where you need it Reduce planned downtime by moving workloads to another server during system maintenance Live Partition Mobility requires the purchase of the optional PowerVM Enterprise Edition IBM i only supports LPM between POWER7 systems Move a running partition from one POWER6 or POWER7 server to another with no application downtime Live Partition Mobility
3
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 3 Partition Mobility: Active and Inactive LPARs Active Partition Mobility Active Partition Migration is the actual movement of a running LPAR from one physical machine to another without disrupting the operation of the OS and applications running in that LPAR. Applicability Workload consolidation (e.g. many to one) Workload balancing (e.g. move to larger system) Planned CEC outages for maintenance/upgrades Impending CEC outages (e.g. hardware warning received) Ability to move from Power7 servers to Power8 servers (when available) without an outage Active Partition Mobility Active Partition Migration is the actual movement of a running LPAR from one physical machine to another without disrupting the operation of the OS and applications running in that LPAR. Applicability Workload consolidation (e.g. many to one) Workload balancing (e.g. move to larger system) Planned CEC outages for maintenance/upgrades Impending CEC outages (e.g. hardware warning received) Ability to move from Power7 servers to Power8 servers (when available) without an outage Inactive Partition Mobility Inactive Partition Migration transfers a partition that is logically ‘powered off’ (not running) from one system to another. Inactive Partition Mobility Inactive Partition Migration transfers a partition that is logically ‘powered off’ (not running) from one system to another. Suspended Partition Mobility Suspended Partition Migration transfers a partition that is suspended from one system to another. Suspended Partition Mobility Suspended Partition Migration transfers a partition that is suspended from one system to another.
4
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation What Live Partition Mobility Isn’t It is not a replacement for High Availability. –It is not automatic. –LPARs cannot be migrated live from failed CECs. –Failed OS’s cannot be dynamically migrated. It is not a Disaster Recovery Solution. –For the same reasons as above. –Migration across long distances not supported in first delivery. –Additional SAN and LAN considerations to treat.
5
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 5 Requirements – AIX/Linux HMC/Firmware version 7 releases 3.2 Note that for POWER7 it has to be the minimum level supported with the system Firmware service 01Ex320 (POWER6), or later – All POWER7 systems are supported (except the Power 755 and Power 775) PowerVM Enterprise Edition VIOS 1.5.1.1 or later (VIOS 2 or later on POWER7) Supported client operating systems AIX 5.3 TL7 SP1, AIX 6 and AIX 7 RedHat Linux 5 U1 or later SuSE 10 or later Software I/O All I/O through the VIOS vSCSI, NPIV, Virtual Ethernet External Storage Storage must be SAN-attached to both source and target systems POWER6 or POWER7 processor-based systems Both source and destination on same Ethernet network
6
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 6 Requirements – IBM i HMC/Firmware version 7 releases 7.5 Firmware service pack 730_xx, 740_xx, or later PowerVM Enterprise Edition VIOS 2.2.1.4 Supported client operating systems IBM i 7.1 TR4 Software I/O All I/O through the VIOS vSCSI, NPIV, Virtual Ethernet External Storage Storage must be SAN-attached to both source and target systems POWER7 processor-based systems Both source and destination on same Ethernet network
7
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 7 M Once enough memory pages have been moved, suspend the source system Create shell partition on target system Validate environment for appropriate resources Live Partition Mobility System #2System #1 Storage Subsystem A HMC Hypervisor VIOS A vscsi0 vtscsi0 vhost0 fcs0 en2 (if) VLAN ent2 SEA ent0 ent1 en0 ent0 Hypervisor VIOS fcs0 en2 (if) VLAN ent2 SEA ent0 ent1 A vscsi0 en0 ent0 vtscsi0 vhost0 Mover Service VASI Mover Service VASI Shell PartitionSuspended PartitionPartition 1 Finish the migration and remove the original LPAR definitions Start migrating memory pages Create virtual SCSI devices MMMMMMMMMMMMMMM
8
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 8 If using 5250 interactive support, ensure both the source and target systems have the "5250 application capable" set to “True”. AIX Active Memory Expansion is another HW capability that must be available on target system if being used on source system
9
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 9 VIOS - Mover service partition (MSP) Required for ACTIVE Partition Mobility only Maximum of four (4) concurrent migrations per control point –With PowerVM 2.2.2, maximum of 8 concurrent migrations per MSP Provides VIOS functions: –Asynchronously extracts, transports, installs partition state during migrations
10
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 10 Can have 2 MSPs for a total of 16 concurrent Migrations with PowerVM 2.2.2
11
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 11 No Required, only Desired virtual adapters allowed
12
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Restrictions The logical partition must have all disks backed by physical volumes. The logical partition must not be assigned a virtual SCSI optical or tape device or an NPIV attached tape device. The logical partition cannot be activated with a partition profile which has a virtual SCSI server adapter: can not be hosting another partition. The logical partition cannot be activated with a partition profile which has a virtual SCSI client adapter that is hosted by another IBM i logical partition No virtual SCSI server adapters can be dynamically added to the logical partition. No virtual SCSI client adapters that are hosted by another IBM i logical partition can be dynamically added to the logical partition being moved. The logical partition must not be an alternative error logging partition. –An alternative error logging partition is a target from the HMC for error logs. The logical partition cannot collect physical I/O statistics. The logical partition must not be a time reference partition. –Used to synchronize time between partitions The VIOS partitions will synchronize the time automatically as part of the migration 12
13
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Restricted IO Partition During validation, if the partition has any of the following “restricted resources”, the validation fails: –Virtual server is designated as service partition. –Server SCSI adapter. –Client SCSI adapter. –BSR array. –Huge pages. –Is EWLM virtual server –Redundant error path reporting virtual server. –Incompatible LMB size. –More than one VASI adapter. –HCA adapter. –Is a system profile. –Virtual Opticonnect adapter –Physical Opticonnect adapter. –Is a member of a failover pool. –VTERM open. 13
14
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 14 vSCSI Zoning Source System 1 VIOS IBM i Client (System 1) POWER7 with IBM i 7.1 TR4 FC HBA Hypervisor Destination VIOS POWER7 with IBM i 7.1 TR4 FC HBA Hypervisor All zoning is done to the physical HBA in the VIOS Assign storage to the physical HBAs in both the VIOS lpars Make sure to set no_reserve on the hdisks (chdev -dev hdiskX - attr reserve_policy=no_reserve)
15
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 15 NPIV Zoning for Mobility Source VIOS IBM i Client (System 1) POWER7 with IBM i 7.1 TR 4 System 1 8Gbs HBA Hypervisor Destination VIOS POWER7 with IBM i 7.1 TR 4 8Gbs HBA Hypervisor 1. Zone your storage ports to both WWPNs on the Virtual Fibre Channel Adapter. 2. No need to zone physical WWPNs to the storage. 3. Only assign storage to the virtual WWPNs
16
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Virtual LAN requirements The migrating partition uses the virtual LAN for network access. –Must be bridged to a physical network using a shared Ethernet adapter in the VIOS partition. –Must be configured such that migrating partitions can continue to communicate with other necessary clients and servers after a migration is completed. The VLAN IDs used must exist on both systems. 16
17
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 17 Source Managed System – Migrating From Destination Managed System – Migrating To
18
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 18 Validate - Live Partition Mobility and Mobility Readiness Check Select the partition to be validated Operations –> Mobility -> Validate Logical Partition Mobility - Process
19
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 19
20
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 20 Migration Validation – components involved
21
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 21 HMC validation Checks the source and destination systems, POWER Hypervisor, Virtual I/O Servers, and mover service partitions for active partition migration capability and compatibility Checks that the RMC connections to the mobile partition, the source and destination Virtual I/O Servers, and the connection between the source and destination mover service partitions are established Checks that there are no required physical adapters in the mobile partition and that there are no required virtual serial slots higher than slot 2 Checks that no client virtual SCSI disks on the mobile partition are backed by logical volumes and that no disks map to internal disks Checks the mobile partition, its OS, and its applications for active migration capability. Checks that the logical memory block size is the same on the source and destination systems Checks that the mobile partition is not configured with barrier synchronization registers Checks that the mobile partition is not configured with huge pages Checks that the partition state is active or running Checks that the mobile partition is not in a partition workload group Checks the uniqueness of the mobile partition’s virtual MAC addresses Checks that the mobile partition’s name is not already in use on the destination server Checks the number of current active migrations against the number of supported active migrations
22
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 22 IBM i Validation During validation HMC sends a command to the partition to prepare for hibernation. Work Management has 3 exit points for suspend/resume or mobility –The first one exit program to ask if it’s ok to proceed. –The exit program is called again for any action required before the operation. –The exit for resume is called after the partition is resumed or moved and it allows for any necessary cleanup. Current functions that will prevent suspend/resume –The partition is a member of an active cluster –A tape resource varied on Current functions that will prevent a migration –A tape resource varied on
23
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 23 No Network Connection – RMC won’t function Internal Storage would cause another failure on Validation - must be shared external storage
24
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 24 Migrate
25
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Migration wizard 25
26
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Migration wizard continued… 26
27
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Migration wizard continued… 27
28
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Migration wizard continued… 28
29
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Migration wizard continued… 29
30
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Migration wizard continued… 30
31
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Migration wizard continued… 31
32
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Performance Considerations Active partition migration involves moving the state of a partition from one system to another while the partition is still running. –Partition memory state is tracked while transferring memory state to the destination system –Multiple memory transfers are done until a sufficient amount of clean pages have been moved. Memory updates on the source system affect transfer time –Reduce the partition’s memory update activity prior to the migration Network speed affects the transfer time –Use a dedicated network, if possible –At least 1Gb speed Recommend using link aggregated ports for redundancy PowerVM 2.2.2 increases memory migration performance by 3x! 32
33
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Destination partition looks like the source partition Partition name is the same. Logical partition configuration is the same –min, online, and max logical cpus –min, online, and max logical memory blocks –min, actual, and max entitled capacity Same processor interface –Instructions, feature set, cache line size, reservation granule size, … Same FW interface Same Logical Device Configuration –Virtual MAC addresses –Same IP addresses –Same LUN map to target devices
34
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Destination partition is different from source partition Partition number is different Server serial number Maximum number of potential (hot pluggable) and installed physical processors Maximum number of PHBs that can be configured The model class (i.e. D5 -> H5 server is supported) L1 and L2 cache characteristics –Cache size and associativity –No functional issues here, just performance issues
35
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation AIX partition parameters that may be different uname –mMfFuL command uname system call confstr system call for model class lpar_get_info system call –partition number –installed and potential processors Sys0 attributes –modelname –modelcode –systemid –id_to_system –id_to_partition –clock-frequency –extended clock-frequency –dasd-spin-delay _system_configuration –icache, dcache, tlb, slb parameters
36
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Applications that would want to know about migration License Managers Capacity planning and chargeback tools Performance analysis tools Workload managers like LL, PLM, eWLM PowerHA CSM / RSCT Uninterruptible power supply (UPS) programs L1 cache aware programs –Java JIT builds optimized instruction streams –Some HPC programs carefully lay out data Programs that use processor and memory affinity
37
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation Thank you!! César Diniz Maciel cmaciel@us.ibm.com
38
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 38 This document was developed for IBM offerings in the United States as of the date of publication. IBM may not make these offerings available in other countries, and the information is subject to change without notice. Consult your local IBM business contact for information on the IBM offerings available in your area. Information in this document concerning non-IBM products was obtained from the suppliers of these products or other public sources. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM may have patents or pending patent applications covering subject matter in this document. The furnishing of this document does not give you any license to these patents. Send license inquires, in writing, to IBM Director of Licensing, IBM Corporation, New Castle Drive, Armonk, NY 10504-1785 USA. All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. The information contained in this document has not been submitted to any formal IBM test and is provided "AS IS" with no warranties or guarantees either expressed or implied. All examples cited or described in this document are presented as illustrations of the manner in which some IBM products can be used and the results that may be achieved. Actual environmental costs and performance characteristics will vary depending on individual client configurations and conditions. IBM Global Financing offerings are provided through IBM Credit Corporation in the United States and other IBM subsidiaries and divisions worldwide to qualified commercial and government clients. Rates are based on a client's credit rating, financing terms, offering type, equipment type and options, and may vary by country. Other restrictions may apply. Rates and offerings are subject to change, extension or withdrawal without notice. IBM is not responsible for printing errors in this document that result in pricing or information inaccuracies. All prices shown are IBM's United States suggested list prices and are subject to change without notice; reseller prices may vary. IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply. Any performance data contained in this document was determined in a controlled environment. Actual results may vary significantly and are dependent on many factors including system hardware configuration and software design and configuration. Some measurements quoted in this document may have been made on development-level systems. There is no guarantee these measurements will be the same on generally- available systems. Some measurements quoted in this document may have been estimated through extrapolation. Users of this document should verify the applicable data for their specific environment. Revised September 26, 2006 Special notices
39
STG Technical Enablement Conference IBM Power Systems © 2012 IBM Corporation 39 IBM, the IBM logo, ibm.com AIX, AIX (logo), AIX 5L, AIX 6 (logo), AS/400, BladeCenter, Blue Gene, ClusterProven, DB2, ESCON, i5/OS, i5/OS (logo), IBM Business Partner (logo), IntelliStation, LoadLeveler, Lotus, Lotus Notes, Notes, Operating System/400, OS/400, PartnerLink, PartnerWorld, PowerPC, pSeries, Rational, RISC System/6000, RS/6000, THINK, Tivoli, Tivoli (logo), Tivoli Management Environment, WebSphere, xSeries, z/OS, zSeries, Active Memory, Balanced Warehouse, CacheFlow, Cool Blue, IBM Systems Director VMControl, pureScale, TurboCore, Chiphopper, Cloudscape, DB2 Universal Database, DS4000, DS6000, DS8000, EnergyScale, Enterprise Workload Manager, General Parallel File System,, GPFS, HACMP, HACMP/6000, HASM, IBM Systems Director Active Energy Manager, iSeries, Micro-Partitioning, POWER, PowerExecutive, PowerVM, PowerVM (logo), PowerHA, Power Architecture, Power Everywhere, Power Family, POWER Hypervisor, Power Systems, Power Systems (logo), Power Systems Software, Power Systems Software (logo), POWER2, POWER3, POWER4, POWER4+, POWER5, POWER5+, POWER6, POWER6+, POWER7, System i, System p, System p5, System Storage, System z, TME 10, Workload Partitions Manager and X-Architecture are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A full list of U.S. trademarks owned by IBM may be found at: http://www.ibm.com/legal/copytrade.shtml. Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. AltiVec is a trademark of Freescale Semiconductor, Inc. AMD Opteron is a trademark of Advanced Micro Devices, Inc. InfiniBand, InfiniBand Trade Association and the InfiniBand design marks are trademarks and/or service marks of the InfiniBand Trade Association. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries or both. Microsoft, Windows and the Windows logo are registered trademarks of Microsoft Corporation in the United States, other countries or both. NetBench is a registered trademark of Ziff Davis Media in the United States, other countries or both. SPECint, SPECfp, SPECjbb, SPECweb, SPECjAppServer, SPEC OMP, SPECviewperf, SPECapc, SPEChpc, SPECjvm, SPECmail, SPECimap and SPECsfs are trademarks of the Standard Performance Evaluation Corp (SPEC). The Power Architecture and Power.org wordmarks and the Power and Power.org logos and related marks are trademarks and service marks licensed by Power.org. TPC-C and TPC-H are trademarks of the Transaction Performance Processing Council (TPPC). UNIX is a registered trademark of The Open Group in the United States, other countries or both. Other company, product and service names may be trademarks or service marks of others. Revised December 2, 2010 Special notices (cont.)
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.