1. Drive Enclosure for Gen 3 and Gen 4 Arrays
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Drive Enclosure for Gen 3 and Gen 4 Arrays
Module 7
U4879S L.01
HP Education Services
U4879S L.01

2. Managing HP Enterprise Virtual Array
Objectives
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Describe the features of the Gen 3 and Gen 4 primary disk drive enclosure models (M6412x)
Describe the front and rear layouts of the disk drive enclosure
Identify and describe the types of disk drives used in the disk drive enclosure
Describe the components and functions of the EMU used in the M6412x disk drive enclosure
Describe the components and functions of the I/O modules used in the disk drive enclosure
Describe the components and functions of the blowers and power supplies used in the disk drive enclosure
Identify controller Customer Self Repair (CSR) parts
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

3. Drive enclosure models and characteristics
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
EVA models
Backend
Type
RoHS compliant
M6412A
EVA 4400/6400/8400
Copper
Cut Through Switch (CTS)
Yes, fully 6 of 6
M6412
Yes, 5 of 6
Instructor notes
Go over the table with students. Note that the fiber-optic back-end has separate SFP transceivers in the I/O module, whereas copper cables have integrated SFPs.
The M5314A and M5314B drive enclosures are backward compatible with all EVA family arrays, except the EVA 4100/6100/8100.
The M6412 and M6412A drive enclosures are not compatible with previous generation arrays.
The material in this module is separated by the two principal drive enclosure types: M5x14x and M6412x.
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

4. Drive enclosure features (1 of 2)
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
M6412A has same functionality as M6412, the design used with the original EVA4400
Only difference is full ROHS compliance (6 of 6)
M6412 is only ROHS 5 of 6 compliant
2U height
inch form factor Fibre Channel or FATA drives
Up to 8 (EVA4400), 18 (EVA6400), and 27 (EVA8400) enclosures supported
All 4Gb copper Fibre Channel back end (I/O module and disks)
Instructor notes
Now begins the discussion of the new drive enclosures. Emphasize differences between these and the M5314C.
M6412A front
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

5. Drive enclosure features (2 of 2)
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Two I/O modules (different design from M5x14x) per shelf
A on left, B on right, eases the cabling of HSV300 or HSV4x0 controllers
No cabinet bus (or CAN, EAB), just Fibre Channel connect
I/O module provides Fibre Channel and EMU functionality
No hardware EMU present
7-segment display (controller assigned)
Not shelf loop position
Not cabinet position
Support for CSR of all components
Inband communications to I/O module and EMU functionality (but no physical EMU module)
Instructor notes
SAS: Serial Attached SCSI
CAN: Controller area network
EAB: Enclosure address bus
The M6412A is a complete 4Gb enclosure, from external connections through to the internals the enclosure run at full 4Gb speeds.
Both I/O modules provide completely redundant back-end loops. With the addition of the a CTS (Cut Through Switch), the JBOD is a fully switched solution, providing speed and reliability to the Fibre Channel loop.
Communication to the I/O modules is now in-band through the Fibre Channel loops. The I/O modules have the ability to communicate directly to the controllers, collecting diagnostic information, logs, and setting changes to the enclosure.
The disk loop ports are reversed from the previous EVA products. We now have port A on the left side (standard naming convention). HP has clearly defined the naming convention for ports ordering, that is, top-to-bottom, left-to-right.
Previous EVA generations used the CAN/EAB bus to communicate with the drive enclosure EMU and I/O module.
The HSV300 and HSV4x0 have no EAB connection or CAN bus. The controller communicates directly with the I/O module:
In-band through the Fibre Channel loops
I/O modules communicate directly to the controllers
Allows collection of diagnostic information and logs
Allows setting changes to the enclosure, such as enclosure number
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

6. Managing HP Enterprise Virtual Array
Drive enclosure front
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Drive bay 1
Drive status LEDs
Enclosure status LEDs
Bay 1
Bay 4
Bay 7
Bay 10
Instructor notes
Due to the changes in orientation of the drives, the drive slot numbering has changed. Note that it is not zero-based. The slot numbering is an HP standard. They run top to bottom, and left to right. This is the same as the back of the enclosure.
Bay 2
Bay 5
Bay 8
Bay 11
Bay 3
Bay 6
Bay 9
Bay 12
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

7. Drive enclosure status LEDs
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Condition
Indicator
Indication
Reason
Power up
Green
Blink
The enclosure is initializing and is not ready.
Normal operation On
The enclosure is operating normally.
Firmware hang
Off
The enclosure’s firmware is not operating normally.
Local locate
Blue
UID button depressed.
Locate
Asserted by external application.
Lesser fault
Amber
Fast blink
Fault of lesser importance.
Fault
Fault of greater importance.
Instructor notes
These are located on the right bezel ear and mimicked on the enclosure rear power pod.
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

8. Managing HP Enterprise Virtual Array
Disk drive overview
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
EVA4400
EVA6400
EVA8400
Minimum number of drives
8 Fibre Channel or FATA
6 SSD
Maximum number of drives
96 FC or FATA
8 SSD
216 FC or FATA
324 FC or FATA
Physical capacity range
0.4 to 96TB
0.4 to 216TB
0.4 to 324TB
Drive types
Fibre Channel / FATA / SSD
M6412A Fibre Channel drives supported
146GB / 300GB / 450GB / 600GB FC @ 15K RPM
300GB / 450GB / 600GB FC @ 10K RPM
1TB 7.2K RPM
72GB SSD
Instructor notes
Note the presence of SSDs, unlike the drives for the M5x14x drive enclosure.
You get the 0.4TB capacity in the table by multiplying 6 drives by 72GB to get 0.43TB, then rounding down.
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

9. Supported disk drives (1 of 3)
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Not compatible with previous EVAs
All drives run at 4Gb
No enclosure services interface (ESI) bus operation
New carriers
12 drives per 2U shelf
Drive carrier has bicolor LED (amber/blue)
Instructor notes
The enclosure services interface (ESI) bus in the EVA 4000/6000/8000 and EVA 4100/6100/8100 series connects disk drives to the EMU in the drive enclosure. The ESI occupies 10 pins on the disk drive.
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

10. Supported disk drives (2 of 3)
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Fibre Channel disk drives
High-performance online drives (current versions)
300GB/450GB/600GB 10K rpm
146GB/300GB/450GB/600GB 15K rpm
Designed for high performance, standard duty cycle purposes
Low-cost Fibre Attached Technology Adapted (FATA) near-online drives (current versions)
1TB 7.2K rpm
Designed for lower duty cycle applications, such as near on-line data replication for backup
Not designed for online purposes
Can mix both types in array, but not in the same disk group
Must pay attention to best practices
Instructor notes
Online drives are for primary storage; near-online drives are for secondary storage.
The duty cycle on FATA drives is 30% less than that of online drives.
Never use near-online drives for online purposes.
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

11. Supported disk drives (3 of 3)
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Fibre Channel disk drives (continued)
Solid state disk (SSD)
Emulate disk drives
Built using flash memory technology
Integrated controllers
Green (watts per I/O are good)
For high I/O, low latency applications (database operations)
One capacity point: 72GB (146GB possibly in phase 2)
Minimum of 6, maximum of 8 in one array
Requires its own 6-member disk group, no intermix of drive types in a disk group is allowed
VRAID5 support only
No remote replication (local replication supported)
No LUN grow/shrink
Instructor notes
Point out that SSDs are new as of the EVA 6400/8400 release and also apply to EVA4400.
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

12. Managing HP Enterprise Virtual Array
Disk drive status LEDs
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Disk drives (LEDs based on ISS standards)
Condition
Indicator
Indication
Reason
Spin up or down
Green
Blink
The disk drive is spinning up or down and is not ready.
Ready On
The disk drive is ready to perform I/O operations.
Activity
Flicker
The disk drive is performing I/O operations.
Locate
Blue
Slow blink
Fast blink
Medium blink
Asserted by external application
Reserved Locate to identify ILF
Critical Locate, locates quorum disks
Fault
Amber
Drive fault condition
Instructor notes
Note: the green status is controlled by the disk drive.
LED behavior is based on ISS standards.
Other notes:
The Locate condition overrides the Reserved and Critical Locate.
The Reserved Locate condition cannot be seen when the Critical Locate condition is active.
If the Fault condition and the Locate condition are both active, the indicator alternates between blue and amber at the slow flash rate (1/2 Hz).
If the Fault condition and the Reserved Locate condition are both active, the indicator alternates between blue and amber at the fast (4Hz) flash rate.
If the Fault condition and the Critical Locate condition are both active, the indicator alternates between blue and amber at the medium (1Hz) flash rate.
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

13. Managing HP Enterprise Virtual Array
Drive enclosure rear
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Enclosure status LEDs and power
Power status LED
Fan status LED
Transceiver LEDs
I/O module status LEDs
Power supply 1
Power supply 2
Fan 1
I/O Module A
I/O Module B
Fan 2
Display
I/O ports
Serial port
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

14. Drive enclosure status LEDs and power button
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
LEDs have same functions as enclosure front
Additional power button on pod has bicolor green/amber LED
Green: powered on
Amber: standby power
If current power state is off, button can be held in 1–2 seconds to change to on (green LED)
If power state is on, it cannot be powered off by the power button
Inband command from controllers is required (puts in standby state with amber LED)
Pulling both power cords turns power state off (unlit LEDs)
Plugging one or both back in turns power state back on
Instructor notes
If the power state is on, it cannot be powered-off by the power button. An in-band command from the controllers is necessary to turn off power to the disk shelf and put it into a standby state (amber LED). By pulling both power cords, the power state becomes off (unlit LEDs). By plugging one or both power cords back in, the shelf will turn back on (there is no memory of an Off state induced by the controller).
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

15. I/O module description
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Two I/O modules per enclosure
A and B I/O modules distinguished by slot pin
Two Fibre Channel ports with status LEDs
14-segment display is used to display the enclosure number
RJ45 connection for Services allows
Connecting serial cable for debugging
Basic data collection
Three LEDs on the top right show the controller status
Instructor notes
This is a major change for the drive enclosure.
The M6412A contains two identical I/O modules to control and manage the two redundant back-end loops. The I/O modules know which slot they are in by a slot pin. On insertion, the I/O module will know it is in slot A or slot B. The I/O module contains the Enclosure Management Processor (EMP) and a 20-port cut-through switch (CTS). This is the same CTS as used in the M5314C. However, this new version is a 20-port CTS, while the older M5314C CTS is only 18-port.
The EMP is a active participant of the Fibre Channel loop and provides basically same function as EMU in the M5x14x. This means that it has an ALPA address and can be communicated directly to by the array controllers. The EMP uses SCSI Enclosure Services (SES) version 9 to communicate on the loop.
Inter-EMP communication is through the UART bus, not over the loops or I2C buses.
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

16. Shelf identification (1 of 2)
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Either shelf I/O module can receive a shelf number from the controller (HSV300, HSV4x0)
No supported way to manually set shelf number
Device shelves are shipped as 0
When a shelf is added to the system, it will get the lowest available unassigned number
Instructor notes
The shelf numbering is received by the I/O module from the array controller. There is no supported way at this time to manually enter in the shelf number or change the shelf number. The shelf number is displayed on both I/O modules.
If you add a shelf to a system that already has a shelf number assigned (for example, because it had been installed in another system before), the shelf keeps the existing number if it does not conflict with another shelf. If it has a conflict, the system assigns the lowest unassigned shelf number to one of the conflicting shelves.
7-segment shelf number display
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

17. Shelf identification (2 of 2)
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Shelf number has no relationship to physical location within a rack
Shelf number is used in error and event logs for reference purposes
Array controllers assign a shelf number to a shelf
Valid shelf number are 01–99; 00 is used as a default until a number is assigned
Conflicts for a given shelf number are resolved by awarding the enclosure with the lowest WWN the desired shelf number
Remaining enclosures in conflict are assigned the first available value, starting at 01
Whenever an I/O module is being assigned a new shelf number, the controller logs an event indicating that the enclosure is being assigned a new value from the old value
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

18. M6412A drive enclosure replaceable units
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
CSR units
Fan
Power supply
Hard drive
I/O module
Backplane
Mid-plane
Front UID interconnect board
Power UID board
Front UID board
Disk drive and drive blank
Cables
Instructor notes
Refer students to the following sources for removal and replacement instructions for all EVAs:
Videos on the Services Media Library website
Individual removal and replacement documents for each of the components
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

19. Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Configurations
U4879S L.01

20. Drive Enclosure data routing
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
M6412/A switch data directly to drive:
Note that all disks are dual-ported, so these data paths/switches are duplicated in the enclosure
SWITCH
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

21. Managing HP Enterprise Virtual Array
EVA Cabling: EVA4400
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Cables loop through disk shelves; cut-through switches route data to disks
DP1A
DP1B
DP1A
DP1B P1 P2 P1 P2 P1 P1 P2 P1 P2 P1 P2 P1 P2 P1 P2 P1 P2
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

22. Managing HP Enterprise Virtual Array
EVA Cabling: EVA6400/8400
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
Same topology as EVA4400, but different controller and loop “regions” to shorten loops to each disk shelf
Loop 1A connections
Loop 2A connections
Loop 1B connections
Loop 2B connections
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

23. Managing HP Enterprise Virtual Array
Review Questions
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
The M6412 drive enclosure has ___________ bays in the front for insertion of disks.
True or False: Mixing of drive sizes in the same drive shelf is not supported.
Name 3 components in the rear of the M6412 drive enclosure.
The maximum number of drive shelves for the following models is: : ________________
6400: ________________
8400: ________________
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

24. Managing HP Enterprise Virtual Array
Lab
activity
Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
8 – 24
8 – 24
5 – 24
uc420s g.10 – © 2009 Hewlett-Packard Development Company, L.P.
u4879s k.00/uc420s h.00 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01 – © 2011 Hewlett-Packard Development Company, L.P.
u4879s k.01/uc420s h.01 – © 2011 Hewlett-Packard Development Company, L.P.
U4879S L.01

25. Managing HP Enterprise Virtual Array
Drive Enclosure for Gen 3 and Gen 4 Arrays
U4879S L.01