MicroTCA Common Platform For CMS Working Group E. Hazen - Boston University for the CMS Collaboration 2010-10-27 E. Hazen -- Upgrade Week

uTCA Common Platform WG Included in scope of this WG Backplane connectivity (port connections) Protocols on common ports (TTC / TTS / DAQ) Crate and MCH specification Guidelines for AMC designers Not in scope (but negotiable) Implementation of MMC, GbE on AMCs and MCH Power supplies 2010-10-27 E. Hazen -- Upgrade Week

One proposal Most of the remainder of my talk represents a “gentlemen's agreement” on a possible configuration 2010-10-27 E. Hazen -- Upgrade Week

uTCA Ports Use for CMS 2010-10-27 E. Hazen -- Upgrade Week

Fabrics A, B Use Port 0 is GbE sourced from commercial MCH1 Port 1 – Compatible with Xilinx GTP (<= 3.125 Gb/s) DAQ data from AMC to MCH2 May be used also for fixed-latency controls (TTC) May be used also for buffer status (TTS) May be used also for auxiliary data (selective readout) Port 3 – “Low speed” serial LVDS (80-400 Mb/s) Fixed-latency controls (TTC) Buffer status (TTS) Auxiliary data (selective readout) 2010-10-27 E. Hazen -- Upgrade Week

Fabrics D and up Use not mandated by this WG Mainly for trigger users Two options for interconnection Star connection to tongue 3, 4 of MCH slots Interconnect passively or with crosspoint switch at MCH Fixed connections on backplane Or, a combination: Ports 4-7 interconnected on backplane Ports 8-12 routed to crosspoint switch on MCH2 2010-10-27 E. Hazen -- Upgrade Week

CMS Readout Crate (i.e. HCAL) 2010-10-27 E. Hazen -- Upgrade Week

TCA Dual-Star Backplane Bi-directional serial (up to 10Gb/sec) point-to-point links from each AMC to MCH (redundant links to each MCH) Note: Interconnections can be customized by the backplane manufacturer inexpensively. Fabric A (1 link) Gigabit Ethernet Fabric B (1 link) LVDS private protocol Fabric D-G (4 links) CLK1/2 (1 link) Dedicated MLVDS clock MCH 1 Commercial /Std MCH 2 aka “AMC13”, “CMS-MCH”, “DTC” Custom design for CMS 2010-10-27 E. Hazen -- Upgrade Week

MCH Construction Four stacked PCBs, 8mm board-to-board spacing! Mechanically a real challenge. T1 T2 T3 T4 T1 board – Management functions; Fabric A (Ethernet) port T2 board – Clocks and Fabric B port T3 and T4 – Fabric D-G ports 2010-10-27 E. Hazen -- Upgrade Week

CMS-MCH Preliminary Thoughts Base configuration has only tongues 1, 2 Base board - “AMC13” with optics and HS links Clocks board - distributes LHC clock and controls Mezzanine connector for T3 with IPMI New custom T1 base board MMC functions (as AMC-13) TTC optical rx 2x SFP (or QSFP) Cross-over GbE from MCH1 for controls and local DAQ Optional T3 board Optional (not in std CMS-MCH) Crosspoint switch for trigger applications Clocks board Clock / controls fanout T4 T3 T2 T1 2010-10-27 E. Hazen -- Upgrade Week

MicroTCA Crate Layout Option 1 (preferred) Option 2 12 full-height AMCs non-redundant power single-width MCH i.e. Vadatech VT892 Option 2 12 mid-height AMCs redundant power double-width MCH Rear transition modules evolving xTCA “physics profile” 2010-10-27 E. Hazen -- Upgrade Week

Vadatech 891 available now 892 is a modified version Typical MicroTCA Crate with 12 AMC slots Vadatech VT891 MCH 2 Vadatech 891 available now 892 is a modified version with vertical cooling and a few other optons MCH 1 Power Modules 1-6 9-12 AMC slots Schroff xTCA physics profile 2010-10-27 E. Hazen -- Upgrade Week

Crate Layout Why we prefer option 1 above Full-height modules improve cooling Mid-height may be acceptable, but we will be using large FPGAs with lots of synchronous logic -> HEAT! Other crate issues Need JTAG interface on front/rear for flash programming Need vertical cooling rather than telecoms std front-to- back 2010-10-27 E. Hazen -- Upgrade Week

Status and Plans Draft document on the items discussed To be circulated this week for editing Public draft ~ next week Make a list of work to be done, seek volunteers Work! 2010-10-27 E. Hazen -- Upgrade Week

Reserve Slides 2010-10-27 E. Hazen -- Upgrade Week

HCAL DTC (CMS-MCH Pre-prototype) Built on NAT-MCH base board Single-width MCH module Provides controls, clock distribution (TTC initially) Provides DAQ interface via fat pipes (external SLink/TTS adapter) Font panel I/O: 2x SFP+ optical transceiver DAQ + Spare TTCrx fiber receiver T2 gets power, GbE, SPI, I2C from NAT-MCH. 3.3V Regulators Clock fanout Spartan-3A FPGA T3 logic board V6 FPGA Fabric I/O to T3, T4 Connector board TTC optical rx, CDS SFP+ T4 T3 T2 T1 NAT-MCH base board Standard MCH functions GbE to mezzanines SPI for flash programming I2C bus 2010-10-27 E. Hazen -- Upgrade Week

Prototype DTC (CMS-MCH) SFP/TTC board T2 (clocks) board T3 (fabric) board SFP+ (2) TTC Fiber GbE (2) Prototype DTC (CMS-MCH) 2010-10-27 E. Hazen -- Upgrade Week

Legacy DAQ Adapter One i.e. 9U VME module handles two uTCA crates, each with 400MBytes/sec out Crate 1: SLink (2) TTS Carrier PCB (i.e. 9U VME!) SLink64 SLink64 Power (only) from VME Dual RJ-45 Virtex 5/6 FPGA Fiber I/O from 2 uTCA crates SFP+ SFP+ SLink64 Crate 2: TTS SLink (2) SLink64 2010-10-27 E. Hazen -- Upgrade Week