W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 1 The CMS Regional Calorimeter Trigger Electronics Integration W. H. Smith, S. Dasu, R. Fobes, T. Gorski, M. Grothe, M. Jaworski, P. Klabbers, J. Lackey, G. Ott, P. Robl Physics Department, University of Wisconsin, Madison, WI, USA IEEE 2006 November 1, 2006 The pdf file of this talk is available at: See also the CMS Level 1 Trigger Home page at

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 2 CMS in 2007 MUON BARREL CALORIMETERS Pixels Silicon Microstrips 210 m 2 of silicon sensors 9.6M channels 2007: no pixels (installed during 1st shutdown) ECAL 76k scintillating PbWO4 crystals 2007: no endcap ECAL (installed during 1st shutdown) Cathode Strip Chambers (CSC) Resistive Plate Chambers (RPC) Drift Tube Chambers (DT) Resistive Plate Chambers (RPC) Superconducting Coil, 4 Tesla IRON YOKE TRACKER MUON ENDCAPS HCAL Plastic scintillator/brass sandwich 2007: RPC |  | < 1.6 instead of 2.1 & 4th endcap layer missing Level-1 Trigger Output 2007: 50 kHz (instead of 100)

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 3 CMS July 2006

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 4 CMS Trigger & DAQ Overall Trigger & DAQ Architecture: 2 Levels: Level-1 Trigger: Interaction rate: 1 GHz Bunch Crossing rate: 40 MHz Level 1 Output: 100 kHz (50 initial) Output to Storage: 100 Hz Average Event Size: 1 MB Data production 1 TB/day this talk

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 5 Calorimeter Trig.Overview (located in underground counting room) Calorimeter Electronics Interface Regional Calorimeter Trigger Receiver Electron Isolation Jet/Summary Global Cal. Trigger Sorting, E T Miss,  E T Global Trigger Processor Muon Global Trigger Iso Mu MinIon Tag Lumi- nosity Info. 4K 1.2 Gbaud serial links w/ 2 x (8 bits E/H/FCAL Energy + fine grain structure bit) + 5 bits error detection code per 25 ns crossing US CMS HCAL: BU/FNAL/ Maryland/ Princeton US CMS ECAL: Lisbon/ Palaiseau US CMS: Wisconsin UK CMS: Imperial/Bristol CMS: Vienna 72  x60  H/ECAL Towers (.087  x.087  for  <2.2 & ,  >2.2) HF: 2x(12  x 12  ) Copper 80 MHz Parallel 4 Highest E T : Isolated & non-isol. e/  Central, forward,  jets, E x, E y from each crate MinIon & Quiet Tags for each 4  x 4  region

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 6 CMS Calorimeter Geometry EB, EE, HB, HE map to 18 RCT crates Provide e/  and jet,  E T triggers

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 7 Trigger Mapping

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 8 Calorimeter Trig. Algorithms Electron (Hit Tower + Max) 2-tower  E T + Hit tower H/E Hit tower 2x5-crystal strips >90% E T in 5x5 (Fine Grain) Isolated Electron (3x3 Tower) Quiet neighbors: all towers pass Fine Grain & H/E One group of 5 EM E T < Thr. Jet or  E T 12x12 trig. tower  E T sliding in 4x4 steps w/central 4x4 E T > others  : isolated narrow energy deposits Energy spread outside  veto pattern sets veto Jet    if all 9 4x4 region  vetoes off

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger MHz point to point backplane, differential ECL with 0.4 Tbit/sec dataflow Physics object selection: Isolated & Non-Isolated Electron, Tau & Jet Triggers 18* Clock&Control, 126* Electron ID, 18* Jet/Summary Cards Operate at 4X LHC crossing frequency: 160 MHz Use 5 Custom Gate-Array 160 MHz GaAs Vitesse Digital ASICs Phase, Adder, Boundary Scan, Electron Isolation, Sort Regional Calorimeter Trigger Crate Data from Calorimeter Trigger Primitive Generators on Cu links at 1.2 Gbaud to 18 Crates: Into 126* rear Receiver CardsInto 126* rear Receiver Cards *Spares not included 2 Std. VME Slots 48V DC Power Custom Point-to-point Dataflow on AMP Stripline HD Conn. VME Designed by J. Lackey 18 X

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 10 Regional Cal. Trigger Cards I Provides 160 MHz and 120 MHz clocks, reset, LHC orbit signal to entire RCT crate Signals generated on board or received from Master Clock Crate fed by CMS Trigger Timing and Control (TTC) System Fans out signals and adjusts phase to all boards Clock and Reset timing set with delay adjust delay adjust Receives 8x8 E/HCAL towers on 1.2 GB Cu Links (Vitesse ) on RMC’s Phase ASIC: Deskew,Mux at 160MHz & provides Test Vectors for Memory Lookup Tables Memory LUT at 160 MHz Adder ASIC: 8 inputs at 160 MHz in 25 ns. BSCAN ASIC: Synchronizes shared data & Diff. Output at 160 MHz to backplane Reg. Sum E T ’s, MIP,  sent to Jet/Sum. Card 50 Tower E T ’s & vetos sent to Electron ID Card Master Clock Crate Input Receiver (126* - 7 per crate) Clock & Control (18* - one per crate) Receiver Mezzanine Card (RMC) Data Sharing on cables for e/  algo Adder ASICs *spares not included

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 11 Regional Cal. Trigger Cards II Processes a 4x8 tower region at 160 MHz Uses Sort (disabled) ASIC for backplane receive & the EISO ASIC fully implements e/  algos LUT for E T conversion Highest E T iso and non-iso e/  per 4x4 region sent to JSC for sorting and top 4 of each type forwarded to Global Calorimeter Trigger 7 cards send candidates over backplane to Jet Summary card 14 Isolated e/  14 Non-Iso e/  Electron Identification Card (126* - 7 per crate) Jet Summary Card (18* - 7 per crate) Output to Global Calorimeter Trigger Sort ASICs Forward Calorimeter Input Electron/photon/muon Sort ASICs receive data on BP & find top iso. & non-iso.) 14 Quiet Bits by threshold on JS 14 MinIon bits from RC Forward Calorimeter (HF) functionality RMC on board & LUTs for HF E T ’s Region energies HF and 4x4 tower sums (regions) to GCT for jets, , & calculation of global quantities total & missing E T *spares not included EISO ASICs one per 4x4 region }

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger Compact Receiver Mezzanine Cards for each Receiver Card accept 4 x 20 m 1.2-Gbaud copper pairs transmitting 2 cal. tower energies w/error detection every 25 ns with low cost & power. Uses Vitesse Link Chips ( ). Custom Serial Link Test Card to check links Used for integration with ECAL/HCAL, Mezzanine Card Testing, RC/JSC link validation Bit Error Rate < RCT 4 Gbaud Copper Link Cards & Serial Test Card

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 13 Test Card: Jet Capture Card FPGAs Translators Delays CCC Signals In Signals Out JSC Inputs Receives all the data from one RCT crate: 14 Reg. Sums, 8 HF E T ’s, 8 e/ , and  and  bits on 6 SCSI type cables Located in spare VME slot of RCT crate Clocks, Reset, and Orbit from Clock and Control Card on low-skew cable (Kerpen MegaLine® 8) Triggers out on programmable thresholds Different data capture modes Used in final validation of RCT crates Used in integration tests with HCAL and ECAL Trigger Primitive Generators Trigger Output to be used in Magnet Test and Cosmic Challenge Phase II for an HCAL Trigger

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 14 RCT Board Production Full production available: Standard RCT Boards Backplanes and Crates - 28 (BP) & 26 (crates) Clock and Control Cards - 25 Receiver Mezzanine Cards Receiver Cards Electron Identification Cards Jet Summary Cards - 25 Test Cards Serial Test Cards - 20 Jet Capture Cards - 10 In production Master Clock Crate and Cards Clock Input Card in Revision B Cards for Clock Fanout in Design Clock Fanout Card Midlevel Clock Fanout Card to Crates Courtesy of Jeff Miller, University of Wisconsin, Madison

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 15 Operate fully functional trigger electronics Use in tests & preparation activities Tests in Electronics Integration Center Labs & row of racks for all electronics subsystems Integration row of racks identical to underground counting room (USC55) Test interfaces & integration as much as possible before move to USC55 Magnet Test & Cosmic Challenge (MTCC) in Surface Hall (SX5) Simultaneous activities with testing 4T solenoid operation. Test multiple trigger components with multiple detector components Verify trigger functions & interfaces w/detectors on surface Underground Counting Room Trigger Integration Activities at CERN now USC55 Experimental Hall Shielding Wall (7 m) Trigger Tunnels

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 16 CMS Electronics Integration Center at CERN Large scale integration tests in central racks using common clocking involving trigger primitives, regional & global processing: CMS Trigger Timing and Control System (TTC) used for common clock HCAL ECALRCTGlobal Calo. Trigger Global TriggerTrigger Timing and Control DTTF CSCTF Global Muon Trig.

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 17 ECAL TCC SLB: Link Boards HCAL HTR ECAL & HCAL Input to RCT Integration Tests Both HCAL HTR (HCAL Trigger and Readout) and ECAL TCC (Trigger Concentrator Card) use a Serial Link Board (SLB) with the V on it Configurable mezzanine card Two Altera Cyclone FPGAs synchronize data for V2716 and calculate Hamming Code Common Clocking w/CMS TTC system Separate adjustment ensures data in time between subsystems HTR - HCAL Receives data from Front-End on fiber Up to 19 SLBs send Tower Energies Used JCC RC created 4x4 Tower sums Verified value and alignment 19 HCAL-HTR cables used - all in sync TCC - ECAL Up to nine SLBs send Tower Energies Front-end data received on Fiber Valid link established 9 ECAL- TCC cables sent in sync to RCT Tests run for > 10 hours error free

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 18 HCAL to RCT for Magnet Test & Cosmic Challenge (MTCC) RCT input RCT output Muon system, ECAL, HCAL, & tracker: understand magnetic field & perform a “slice test” of CMS DAQ Two Phases: Summer (I) & Fall (II) - ongoing now Use RCT to create a trigger using HCAL MIP bits MIP bit uses upper and lower thresholds Installed one full RCT crate and support Receive 56 HCAL links to all inputs (448 towers) Split cabling to create separate paths HCAL top to HCAL inputs HCAL bottom to ECAL inputs Send trigger out with JCC to Global Trigger System OR of towers in each half using HCAL MIP bit HCAL to RCT

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 19 Results from MTCC From Running today (Nov. 1): Drift Tube Trigger vs. Calorimeter Trigger time in 25 ns bunch crossings (coincidence = 0 bx)

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 20 Commissioning Underground at CMS Rack Infrastructure Installed in Underground Control Room (USC55) 10 racks worth of crates, fans, custom rack monitoring, power & associated cabling. Card installation and integration starts in November Large scale links being installed/checked Power & Temp. Fans & Readout Rack Monitor Card and power chassis

W. Smith, U. Wisconsin, IEEE, November 1, 2006 CMS Regional Calorimeter Trigger - 21 ConclusionsConclusions Full production of CMS Regional Calorimeter Trigger boards Main RCT board production finished Test Boards STC and JCC produced to validate input and output and help with integration tests Master Clock Crate and cards in production Integration in full swing Integration performed with HCAL HTR and ECAL TCC in Electronics Integration Facility Alignment verified Common clocking used Long term stability checked RCT is part of CMS Magnet Test and Cosmic Challenge Phase II Running Now RCT Installation during November Integration tests to continue underground Integration Facility to remain as testing, debugging, and storage area