1. Shelf Management & IPMI SRS related activities
Shelf Management & IPMI
SRS related activities
Mihai Savu
Samway Electronic
Bucharest -ROMANIA

2. Shelf Management & IPMI PICMG and VITA Standards
CPCI
ATCA
MicroTCA
CPCI-S
VME
VPX

3. Shelf Management & IPMI Evolution of PICMG Standards
DATA RATE
40 Gb/s
PICMG 3.0
AdvancedTCA
MTCA.0 R1.0
Micro TCA
CPCI S.0
CompactPCI Serial
10 Gb/s
1 Gb/s
PICMG 2.16
Packet Switching
PICMG 2.0
CompactPCI
528 Mb/s
TIME
1999
2001
2003
2006
2011

4. Together with data rate have increased also: Power consumption
Shelf Management & IPMI
Evolution challenges
Together with data rate have increased also:
Power consumption
Cooling requirements
Component density
=> The system monitoring and control becomes more important and more sophisticated 4

5. Traditional system monitoring: Monitor temperatures inside the system
Shelf Management & IPMI
System monitoring
Traditional system monitoring:
Monitor temperatures inside the system
Controls fans speed based on temperatures
Monitor power supply output voltages and currents
Remote reset or shutdown
Trigger alarms in case of failures (LEDs, buzzers)
Limitations:
No information about the boards present and their healthy
Temperature on boards are not used for thermal management
The boards may run hot even the temperatures inside the system are fine
The limit comes from the fact that was no standard protocol to communicate with the cards

6. Shelf Management & IPMI System monitor example
Example: System monitor used in VME crates on Linac4 project at CERN
Was developed custom software to monitor CERN's own boards over I2C

7. Shelf Management & IPMI Evolution of management specifications
SAMWAY
VITA 46.11
System Management
on VPX
2000
2003
2006
System
Management
based on IPMI
2015
2005
2014
PICMG 2.9
CompactPCI
System
Management
CPCI S.0
CompactPCI Serial
System Management
PICMG 3.0
AdvancedTCA
VME64X
MTCA.0 R1.0
Micro TCA
CPCI S.0
CompactPCI Serial
PICMG 2.16
Packet Switching
VPX
VITA 46
VME
PICMG 2.0
CompactPCI
TIME
1994
1997
1999
2001
2003
2006
2007
2009
2011

8. Shelf Management & IPMI Management on IPMI
To overcome the system monitoring limitations PICMG has adopted a standard protocol (IPMI) for system management and monitoring
IPMI (Intelligent Platform Management Interface)
The protocol was initially developed by Intel, Hewlett-Packard, NEC and DELL for server management
It is as a software protocol, a language, transported over I2C inside the chassis
First implemented in CPCI and further developed for ATCA and MTCA
With IPMI the cards could be discovered and the sensors they support are read
There is no need to know in advance what sensors are implemented on a card, they will be discovered
This requires every component (Card, PSU, Fan tray) to have a management controller capable of “speaking” IPMI
An additional module, the shelf manager, centralizes the information it collects from cards and present it to the external System Management Software

9. System Monitor Shelf Manager
Shelf Management & IPMI
Management and Monitoring
System Monitor
Provides information about chassis health by reading temperatures, voltages, fan speeds, I/Os
Shelf Manager
Provides information about chassis and the cards present 9

10. Shelf Management & IPMI Shelf Manager
Designed for multiple architectures: ATCA, AXIe, CPCI, CPCI-S and VPX
Monitors/controls cards supporting IPMI
Monitors the chassis by reading: voltages, temperatures, currents and fans status
Provides configurable digital I/Os
10/100Mbps Ethernet interface supporting RMCP, HTTP (graphical WEP page), Telnet, SNMP v3, DHCP, TFTP and Serial Over Lan
Extended temperature range: deg C
Mounted as a mezzanine module on a card or on dedicated carrier board
Dimensions 68mmx95mm

11. Shelf Management & IPMI Shelf Manager features
8 Analog
6 Thermistors
RS232
12 Fan TACH
Shelf Manager
3 Fan PWM
IPMB
16 Digital Inputs
RTC
16 Digital Outputs
I2C MUX
I2C_2

12. Shelf Management & IPMI System monitor example
Integrated WEB Server
Provides a simple and intuitive interface for reading management information
Based on XML
No additional software needed- just a WEB browser (could be accessed from a mobile phone or tablet)
Information about a board is obtained with just a mouse click

13. Shelf Management & IPMI MCH
In MicroTCA the MicroTCA Carrier Hub (MCH) is responsible for management and monitoring of the boards. Beside this it has also the switching functionality
Features:
Support for up to 12 AMCs, 12uRTMs, 2 CUs and 4 PMs
MTCA.4 Compliant
16 ports Gigabit Ethernet Switch
PCIe Gen 3 switch, x4 links to each AMC
PCIe clock distribution
Front panel 16x PCIe optical link.

14. Shelf Management & IPMI IPMI software for cards
IPMI Software for ATCA/MTCA cards
(IPMC/MMC)
Delivered on pre-programmed microcontrollers
Fast development, low cost and minimum risk
Reference schematic provided
Graphical tools for configuring the sensors and board information (manufacturer name, part number, supported interfaces...)

15. SRS related activities

16. Optical mezzanine board
Features
Optical mezzanine board – collaboration with IFIN-HH in Romania
Mezzanine board for ATCA SRS
Two Virtex7 FPGAs
6 TX and 6 RX MicroPod Avago optical modules (12 fibers each)
Flexible clock distribution
Management Controller (IPMI)

17. Optical mezzanine board
Block diagram

18. FEC v6 assembly Status FEC v6 assembly status
-SMD assembly for first batch done
- Follows edge connector plus through hole components
- Software for functional test under development

19. Shelf Management & IPMI
Thank You!