ATCA in ATLAS meeting 16/05/2013 Evaluation results of equipment equipment PH-ESE-BE 1 Collaboration (PH/ESE) Vincent Bobillier, Matteo Di Cosmo, Stefan Haas, Markus Joos, Sylvain Mico, Francois Vasey and Paschalis Vichoudis

ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment > Outline Outline Introduction xTCA Evaluation Project ESE-BE xTCA Equipment Tests and procedures for evaluation Test performed and tools IPMI Tester Test examples  Power Module NAT DC780 Test setup Results discussion  Aspiro and Guardian PSU for MTCA and ATCA Results discussion Conclusions Failures and reparations Observation/Future work 2

> Outline 3 ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment Outline Introduction xTCA Evaluation Project ESE-BE xTCA Equipment Tests and procedures for evaluation Test performed and tools IPMI Tester Test examples  Power Module NAT DC780 Test setup Results discussion  Aspiro and Guardian PSU for MTCA and ATCA Results discussion Conclusions Failures and reparations Observation/Future work

> Introduction\xTCA Evaluation Project xTCA evaluation project in PH-ESE group launched in 2011 –Technical evaluation of components for MicroTCA, MTCA.4 and ATCA systems –Technical evaluation of AC/DC converters –Development of tools (H/W and S/W) for the testing of commercial components –Conduct market surveys –Report and share results Longer term goal –Try to standardize MicroTCA and ATCA shelves and power supplies Many options (backplanes, cooling, RTMs, power supply, …) –Propose acceptance test procedures –Propose a selected set of equipment to the experiments –Provide centralized support for these items 4 ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

> Introduction\ESE-BE xTCA equipment MTCA Crates Vadatech VT892 MTCA.0 (12 AMCs, 2 MCHs, 2PMs, 2CUs) ELMA MTCA.4 (12 AMCs, 12 RTMs, 2 MCHs, 4PMs, 2CUs) Schroff MTCA.4 + AC/DC CM100 (6 AMCs, 6 RTMs, 1 MCHs) PMs 4xNAT DC780 (792W) Vadatech UTC010 (792W) MCHs Vadatech UTC001 NAT MCHKontron AM4904 AMCs ELMA Load Board Kontron AM5030 ESD ADIO24CCT AM31 5 Wiener AC/DC (Prototype, 800W) Schroff MTCA.4 (12 AMCs, 12 RTMs, 2 MCHs, 4PM) ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

ATCA Crates 6 Schroff 14-slot 13U ATCA boards AC/DC Power Supply Emerson network power NetSure501PowerOne Aspiro PowerOne Guardian > Introduction\ESE-BE xTCA equipment Kontron AMC Carrier Comtel load boards (including RTM) Lineage Power CPS ASIS 14-slot ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

> Outline 7 ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment Outline Introduction xTCA Evaluation Project ESE-BE xTCA Equipment Tests and procedures for evaluation Test performed and tools IPMI Tester Test examples  Power Module NAT DC780 Test setup Results discussion  Aspiro and Guardian PSU for MTCA and ATCA Results discussion Conclusions Failures and reparations Observation/Future work

> Tests and procedures for evaluation\Test performed and tools Electrical Evaluation of Power Modules  Static Tests - Load Regulation - Line Regulation  Dynamic Tests - Load transient Response - Ripple and noise  Efficiency and Power Factor  Sensor Accuracy and overcurrent protection Instruments LeCroy 104Xi LeCroy API015 Current probe Agilent 34970A Data Logger Agilent N3300A Electronic Load 8 ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

Electrical Evaluation of AC/DC PSU  Static Tests - Load Regulation - Soak Testing  Dynamic Tests - Load transient Response - Ripple and noise - Inrush Current  Efficiency and Power Factor  EMC Tests  Sensor Accuracy Instruments LeCroy 104Xi LeCroy API015 Current probe Agilent 34970A Data Logger Agilent N3300A Electronic Load 9 > Tests and procedures for evaluation\Test performed and tools ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

Crate Thermal Evaluation  Cooling performance ALB heat distribution ALB temp sensors position Instruments Agilent 34970A Data Logger 34901A 20 Channel Multiplexer 10 > Tests and procedures for evaluation\Test performed and tools ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

Remote Linux Server (ipmitool) Labview GUI MCH IPMI over LAN Target FRU PM CU AMC SSH IPMI CMD LIST Ipmitool –I lan –h mch –U admin… 11 > Tests and procedures for evaluation\Test performed and tools ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

Functionality Test Polaris Tester  MicroTCA Tester  MCMC  MMC  EMMC  Carrier  AMC Tester  ATCA Tester  MTCA.4 Tester 12 > Tests and procedures for evaluation\IPMI tester ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

IPMI Sniffer  Useful for test, debug and development purposes.  Many I2C Analyzer available but no universal commercial IPMI real-time monitor  The solution consists in using a Totalphase i2c Beagle Protocol Analyzer and Wireshark IPMB_L SniffingIPMB_0 Sniffing 13 > Tests and procedures for evaluation\IPMI tester ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

> Outline 14 ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment Outline Introduction xTCA Evaluation Project ESE-BE xTCA Equipment Tests and procedures for evaluation Test performed and tools IPMI Tester Test examples  Power Module NAT DC780 Test setup Results discussion  Aspiro and Guardian PSU for MTCA and ATCA Results discussion Conclusions Failures and reparations Observation/Future work

NAT DC780 PM Standard MicroTCA DC/DC PM 792 W, Minimum efficiency 95.5% Support for -12 AMCs, -2 CUs -2 MCHs > Test example\PM NAT DC780 Test Setup -Host: Vadatech VT982 Crate -External AC/DC Power Source (1.5kW) -Auxiliary PM to power Cus and MCH 2 PM DC780 in a Vadatech VT982 crate 15 ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

NAT DC780 PM Results discussion: Input Voltage/Line Regulation NAT DC PM PCB bottom layer after failure According to the manufacturer: The input FET experienced much current causing the rupture of the PM. A modification of the existing specification will be required (min ≌ -48V) New HW version soon available to meet the existent specification DC780 Specs: -60V<Vin<-40V > Test example\PM NAT DC780 ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

NAT DC780 PM Results discussion: Efficiency 17 Efficiency measurement setup Efficiency measurement NAT DC780 DC780 Specs: 95.5% (min) > Test example\PM NAT DC780 ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

NAT DC780 PM Results discussion and comparison with Vadatech UTC010 and Wiener AC PSU Test ConditionsMeasuredDC780 Specs Maximum PowerVi=-48V730W780W Input Voltage -48V to -53V-40V to -60V Load RegulationFull power8.6%10% Line RegulationFull load, Vin: -40V to -53V2mV (max) before failureNot reported EfficiencyVi = -48V, 1-100% of full power94% (max)95.5% (min) RippleFull power20mVNot reported Voltage transient deviationLoad step from 25% to 75% of full load±0.5VNot reported Test ConditionsMeasuredUTC010 Specs Maximum PowerVi=-48V600W780W Input Voltage -38V to -53V-36V to -75V Load RegulationFull power1.2%Not reported Line RegulationFull load, Vin: -38V to -53V1.93VNot reported Minimum load, Vin: -38V to -53V1.22VNot reported EfficiencyVi = -48V, 1-100% of full power93% (max at 300W)95% (full load) RippleFull power73mVNot reported Minimum Power700mVNot reported Voltage transient deviationLoad step from 25% to 75% of full load±0.4VNot reported Vadatech UTC010 NAT DC780 TTR ≌ 3d TTR ≌ 13d 18 TTR = Time To Reply Wiener AC/DC PM (Prototype) Test ConditionsMeasuredWiener Specs Maximum Power800W Load Regulation1-100% of full power3.5%Not reported Efficiency1-100% of full powerNot possible to measure93% (min) Power FactorNot possible to measure0.99 RippleFull power10mV<10mV Pk-to-Pk Voltage transient deviationLoad step from 25% to 75% of full loadTo be doneNot reported > Test example\PM NAT DC780 ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

AC/DC PSU 19 Aspiro PSU description : Up to 4 AC/DC rectifier modules 1200W per rectifier module Vout : -48VDC 8 output channels under breakers (20A) 1 cooling fan per rectifier module Front panel control interface Remote control via USB or Ethernet port N+1 redundancy system Guardian PSU description : Up to 5 AC/DC rectifier modules 2900W per rectifier module Vout : -48VDC 8 output channels under breakers (32A) 2 cooling fans per rectifier module Front panel control interface Remote control via USB or Ethernet port N+1 redundancy system > Test example\ Aspiro and Guardian PSU for MTCA and ATCA ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment TESTEDPartially TESTEDTO BE TESTED Emerson PSU description : Up to 5 AC/DC rectifier modules 2000W per rectifier module Vout : -48VDC 10 output channels under breakers (32A) 1 cooling fans per rectifier module Front panel control interface Remote control via USB or Ethernet port N+1 redundancy system -48V

20 Test typeTest conditionmeasuredspecifiedResult Sensor accuracy voltage < 0.15%not specifiedNA current < 1%not specifiedNA Soak testing 2 75% loadvoltage fluctuation < 4mVnot specifiedNA SW-HW limits voltage70% loadSW limit <0.15%Specified via the GUIpass current48VSW limit <1%; HW limit: 26.3ASpecified via the GUIpass Static regulation 0 to 100% loadoutput variation < 1.3%± 1%pass Dynamic regulation voltage variation10-90% and 90-10% load5.6% (worst case)3%fail recovery time10-90% and 90-10% load14 ms20 mspass Voltage ripple 90% load135 mV p-p< 100mV p-pfail EMC tests input90% loadwithin specEN pass output90% loadQP: ok, Avg: 2 dBuV out of specEN fail Inrush current within specETS pass Efficiency % load95%> 95%pass Power factor % load> 0.99EN (0.99 typ.)pass > Test example\ Aspiro and Guardian PSU for MTCA and ATCA ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment Aspiro PSU results

21 Test typeTest conditionmeasuredspecifiedResult Sensor accuracy voltage < 0.31%not specifiedNA current < 3.33%not specifiedNA Soak testing 14 50% loadvoltage fluctuation < 6mVnot specifiedNA SW-HW limits voltage To be performed current To be performed Static regulation 0 to 100% loadoutput variation < 1.75%± 1%pass Dynamic regulation voltage variation10-90% and 90-10% load5.64% (worst case)5%fail recovery time10-90% and 90-10% load24 ms20 msfail Voltage ripple At 90% load152mV pk-pk< 250mV p-ppass EMC tests input EN To be performed output EN To be performed Inrush current within specETS pass Efficiency 0-90% >18% power> 95% typicalfail Power factor 0-90% load> >24.64% load>0.995% at >25% loadpass Guardian PSU results > Test example\ Aspiro and Guardian PSU for MTCA and ATCA ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

> Outline 22 ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment Outline Introduction xTCA Evaluation Project ESE-BE xTCA Equipment Tests and procedures for evaluation Test performed and tools IPMI Tester Test examples  Power Module NAT DC780 Test setup Results discussion  Aspiro and Guardian PSU for MTCA and ATCA Results discussion Conclusions Failures and reparations Observation/Future work

NAT PM DC780. Input stage compromised after line regulation tests  Repaired under warranty and new HW design NAT MCH. i2c ports failing.  Sent twice for repair under warranty, still waiting for a report  Up to now one i2c port not working again Schroff for Physics Crate. Management Power not available for MCH and first AMC slot. Same problem encountered two years ago on two AMC slots.  Repaired under warranty Schroff for Physics Crate. Backplane connectors wear for excessive mating cycles:  Sent for repair last Christmas. (Backplane replacement) Further analyses showed a misalignment of the Schroff Backplane which caused the wrap of the ALB connectors. The manufacturer took entirely the responsibility and precautions will be taken. The crate will be shipped soon for expertise. > Conclusions\Failures and reparations 23 ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

But also Several interoperability problems faced during test Must be solved in collaboration with the manufactures Interoperability not always assured (standards lacks…) Complete technical specification not always verified or provided by manufacturers Importance of Support > Conclusions\Observation 24 Lesson learned and results obtained List of written evaluation reports System architecture knowledge Cooperation with manufacturers Detailed test procedure defined Test setup available Load modules LabView GUI IPMI monitor Full IPMI test suite (Polaris Tester) Availables on the uTCA/ATCA Repository ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

 MicroTCA Equipment evaluation will be kept going Waiting for new HW releases (NAT, Vadatech and Wiener)  Start AdvancedTCA Evaluation  Schroff Crate and ATCA components evaluation  Annecy IPMC + Test Carrier  ASIS ATCA crate (Vertical airflow)  AC/DC Converters (first results available) > Conclusions\Future work ASIS ATCA Crate coming soon 25 ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

> References Useful links MicroTCA Evaluation Repository ATCA Evaluation Repository PICMG Website MicroTCA Short Form Specification AMC Short Form Specification ATCA Short Form Specification IPMI, IPMB Specification Polaris Tester NAT Website Vadatech Website 26 ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment

> THANK YOU 27 ATCA in ATLAS meeting, CERN, 16 May Evaluation of microTCA equipment