1. 2011-02-01E. Hazen -- Upgrade Meetings1 AMC13 Project DAQ and TTC Integration For MicroTCA in CMS Status Report E. Hazen - Boston University for the CMS Collaboration

2. 2011-02-01E. Hazen -- Upgrade Meetings2 AMC13 Configuration Summary ● Dual-star backplane ● Standard MCH in MCH1 slot (required) ● AMC13 custom module in MCH2 slot (optional) ● AMC13 ● TTC Functions (low-jitter clock, fast controls) ● DAQ Functions (data readout, buffer management) ● No involvement in services to AMCs (ipmi, Ethernet) ● Managed as “13 th AMC” by MCH1 REVIEW – As proposed in November 2010 WG and draft document

3. 2011-02-01E. Hazen -- Upgrade Meetings3 Proposed uTCA Ports Use for CMS REVIEW – As proposed in November 2010 WG and draft document

4. 2011-02-01E. Hazen -- Upgrade Meetings4 MicroTCA Fabrics A, B Use ● Port 0 is GbE sourced from commercial MCH1 ● Port 1 – Compatible with Xilinx GTP (<= 3.125 Gb/s) ● DAQ data from AMC to MCH2 ● May be used also for fixed-latency controls (TTC) ● May be used also for buffer status (TTS) ● May be used also for auxiliary data (selective readout) ● Port 3 – “Low speed” serial LVDS (80-400 Mb/s) ● Fixed-latency controls (TTC) ● Buffer status (TTS) ● Auxiliary data (selective readout) REVIEW – As proposed in November 2010 WG and draft document

5. 2011-02-01E. Hazen -- Upgrade Meetings5 MicroTCA Fabrics D and up Use ● Use not mandated by MicroTCA WG ● Mainly for trigger users ● Two options for interconnection ● Star connection to tongue 3, 4 of MCH slots – Interconnect passively or with crosspoint switch at MCH ● Fixed connections on backplane ● Or, a combination: – Ports 4-7 interconnected on backplane – Ports 8-12 routed to crosspoint switch on MCH2 REVIEW – As proposed in November 2010 WG and draft document

6. 2011-02-01E. Hazen -- Upgrade Meetings6 Spartan 6 DAQ in AMC13 Virtex 6 GT X SFP GT X SFP GT X SFP GT X Fabric A To AMC 1..12 IO SFP? CD S MCH1 GbE (“cross- over”) 128 Mbyte DDR3 Data from each AMC at up to 3.125 Gb/s (may be combined With TTC) TTC (3) SFP for: DAQ GbE backup Other? At up to 4.25 GB/s Fabric B TTC to AMC 1..12 GT P MMC uC IPMI

7. 2011-02-01E. Hazen -- Upgrade Meetings7 MicroTCA Crate Layout 12 full-height AMCs non-redundant power single-width MCH i.e. Vadatech VT892 REVIEW – As proposed in November 2010 WG and draft document

8. 2011-02-01E. Hazen -- Upgrade Meetings8 DAQ options and non-options ● Anything in SFP up to 4.25 Gb/s easy to support ● Possible upgrade to SFP+ or SNAP-x with 10 Gb/s in the future requires board redesign ● No room for mezzanine boards ● Most of the “housekeeping” firmware will be on a separate FPGA, so users can design their own firmware for the AMC13 Virtex-6 if required.

9. 2011-02-01E. Hazen -- Upgrade Meetings9 CMS-MCH Preliminary Design (aka HCAL DTC version 2) T1 T2 T3 T4 New custom T1 base board MMC functions (as AMC-13) TTC optical rx 4x SFP Cross-over GbE from MCH1 for controls and local DAQ Clocks board Clock / controls fanout Optional T3 board Optional (not in std CMS-MCH) Crosspoint switch for trigger applications ● Base configuration has only tongues 1, 2 ● Base board - “AMC13” with optics and HS links ● Clocks board - distributes LHC clock and controls ● Mezzanine connector for T3 with IPMI

10. 2011-02-01E. Hazen -- Upgrade Meetings10 T1 T2 T3 T4 Custom T1 base board Clocks boardOptional T3 board T1 T2 T3 T4 Configuration in v0.8 document: Proposed change: Custom T1 base board Voltage regs, MMC, Fabric A connections (from T2) T2 Board Virtex-6, 4x SFP, TTC, clocks, Fabrics A/B logic Optional T3 (short) And T4 (full- length) Power connector for T3/T4 Panel LEDs and connectors SFPs (4) Note that the location of tall parts on bottom of T4 and top of T2 would need to be negotiated to avoid conflict. Not enough space for: Front panel parts PCB parts :( Encroaches on T3, T4 Is this a problem?

11. 2011-02-01E. Hazen -- Upgrade Meetings11 DRAFT Draft document Under review by WG

12. 2011-02-01E. Hazen -- Upgrade Meetings12 ADN2814 Clock/Data Recovery Dat a Clock Lock Virtex 6 uTCA CLK1 Fabric B DC coupled LVDS TTC encoded timing/control TTC Data 160 40 40Mhz TTC Opto rx (or SFP) SY8987 2 Divider /2 or /4 nRST DS91M125 M-LVDS repeater Base Board (T1) Clocks Board (T2) SFP+ GTXGTX GTXGTX Fabric A AC coupled CML DAQ GbE from MCH1 Atmel AVR-8 uC SPI Flas h AMC13 Block Diagram (evolving) SFP+ GTXGTX

13. 2011-02-01E. Hazen -- Upgrade Meetings13 Requirements Summary

14. 2011-02-01E. Hazen -- Upgrade Meetings14 CMS-MCH Preliminary Design ● Propose 4 SFP on front panel ● TTC / TTS(80-400 Mb/s) ● DAQto S-Link adapter / DAQ upgrade ● GbEoption if backplane not available ● Spare

15. 2011-02-01E. Hazen -- Upgrade Meetings15 Action Items ● Draft document (now out for review by WG) ● Crate Specification (~done by Greg Iles) ● Have quote from Vadatech; working on other vendors ● Confirm that commercial MCH have req'd features ● Vadatech supports AMC13 ● NAT supports “update channel” Ethernet ● Neither support both currently :( ● Research use of eSATA, PCIe ● Confirm these are compatible with our configuration

16. 2011-02-01E. Hazen -- Upgrade Meetings16 Action Items (continued) ● Acquire VT892 crate for testing ● CERN colleagues are now buying ~6 crates ● HCAL is waiting for M&S funding............... ● Proceed with design of DTC-2 / CMS-MCH ● Milestone: tested/installed during “2012” shutdown ● Funding.......................?

17. 2011-02-01E. Hazen -- Upgrade Meetings17 A brief word on DAQ & CREMA ● CREMA Introduced in June... no meetings so far Scope is evolving ● Magnus has asked me to participate in any future meetings as MicroTCA coordinator... ● Had several discussions with DAQ hardware folks about future ● Still no firm plans, but I am in the loop