1. Conference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 2006 Irakli.MANDJAVIDZE@cea.fr The Selective Read-out Processor for the CMS Electromagnetic Calorimeter Irakli Mandjavidze DAPNIA, CEA Saclay, 91191 Gif-sur-Yvette, France

2. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 20062 Overview Motivation and Goals The CMS ECAL read-out system and SRP SRP Challenges SRP Design → Platform FPGAs → Xilinx Virtex-II Pro devices → Firmware → Optical communication channels Current Status Conclusive remarks

3. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 20063 Motivation and goals CMS DAQ capabilities → Total event size: 1 Mbyte Allowed average ECAL event size: 100 Kbyte → Data throughput of 100 Gbyte/s ECAL raw data → Size: 1.5 Mbyte → Bandwidth: 150 Gbyte/s @ 100 kHz L1 trigger rate Reduction factor of almost 20 is necessary → Crystal zero suppression: non-linearity and degraded energy resolution Selective Read-Out → Define zones of interest on event-by-event basis → Read full precision data from channels within these zones → Apply strong zero suppression on the rest of channels

4. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 20064 The ECAL Read-out System Trigger Selective read-out processor: SRP Front-end electronics Read-out High level triggers and DAQ Raw data 1.5 Mbyte Selected data Selective read-out flags Trigger tower flags 5 µs timing budget L1 Accept100 kHz 40 MHz 100 Kbyte ECAL Asynchronous hard real-time system

5. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 20065 Type of Selective Read-out Algorithms Sliding windows algorithm → Trigger towers (TT) are classified as SuppressedSingleCenter NNNNN N N N NNNNN N N N N NNN NNN NC Neighbors ETET Low High → Singles, centers, neighbors: full precision read-out → Suppressed: zero suppression read-out → Complemented by coarse grain data i.e. energy deposited in all TTs Reduction factor of 20 → detector performance: no noticeable degradation 0.50.60.70.80.91.0 40 60 80 100 120 Low threshold (GeV) Event size (KB) High threshold 2 GeV ZS (0σ) ZS (1σ) ZS (2σ)

6. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 20066 SRP Challenges Asynchronous operation at 100 kHz L1 trigger rate 5 µs timing budget High number of input / output channels → ~200 optical communication links 1.6 Gbit/s throughput per link Certain flexibility to allow changes and evolution of selective read-out algorithms Combine advances in technologies of → the programmable logic (FPGA) → the optical communication

7. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 20067 SRP Architecture Compact system: single VME 6U crate → 12 identical VME64x compliant boards 3 boards covering each of 4 ECAL partitions Note: the SRP board is used also as SRP tester → VME-PCI interface board with a contol PC → Boindary Scan controller for remote firmware management Just one custom board to develop and maintain Half barrels - + End- cap + End- cap - VME-PCI interface Boundary Scan Controller

8. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 20068 SRP Boards VME64x compliant board with PnP capability → 3 firmware : « barrel », « end-cap », « tester » sharing a bulk of VHDL code P1P2 VME buffers VME Serial links Algorithms Trigger IF FPGA Xilinx Virtex-II Pro xc2vp70-6-ff1704 Power supply Clock synthesizer Contrôleur JTAG FPROMs T T F Rx S R F Tx S R P Rx S R P Tx Parallel optics Throttling TTS Out O/E Trigger, timing, and control Cons., JTAG Aux. connector Trigger Interface

9. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 20069 SRP Boards → 12 layers, 1.6mm thick → Up to 20 bidirectional optical communication links at 1.6 Gbit/s each → 40 differential pairs with 100Ω controlled impedance → Synthesizable clock → Monster FPGA with 1704-pin ball grid array package Reset Reload Stratus LEDs RS232 Trigger TTF SRF SRP Trigger throttle JTAG

10. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 200610 Platform FPGAs Xilinx 2vp70 Virtex-II Pro 2 PowerPC 405 CPUs @ 300 MHz 20 RocketIO transceivers up to 3 Gbit/s 18 kbit dual-port memories Flexible reconfigurable System-On-Chip Devices Programmable logic cells → combinatorial and synchronous Versatile IOs → Single ended and differential Hard IP cores → Clock management → Memory blocks → Serial transceivers → Embedded processor(s) Plus various soft IP cores → Microcontrollers, network IF... CPU DCM MGT MEMORYMEMORY

11. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 200611 Firmware System-on-Chip design: handy for debugging and monitoring → embedded 80 MHz PowerPC with 128 Kbyte memory stand-alone “C” applications for testing, debugging and monitoring → 32-bit slave interface on a 40 MHz peripheral bus SRP Barrel and Endcap: 6 000 000 equivalent logic cells: 40% → 3.5 µs latency from L1 accept till SR flags delivered to the read-out SRP Tester: 8 000 000 equivalent logic cells: 60% Plenty of resources for future enhancements Memory 128 KB Processor bus PowerPC 80 MHz Bridge RS232 console Slave interface SRP board 80 MHz pipeline logic 40 MHz 32-bit R/W Peripheral bus VME Optical IO Firmware organization

12. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 200612 Trigger-SRP and SRP-Read-out links Optical communication channels Fan-in/Fan-out modules Individual LC fibers 12-fiber MTP cables SerializerTx Trigger DeserializerRx Readout Rx Up to 12 deserializers in FPGA Tx Up to 12 serializers in FPGA SRP Small form factor pluggable transceivers Pluggable parallel optic modules

13. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 200613 SRP-SRP links → are needed to exchange information on frontiers → passive optical cross-connect: all-to-all connectivity Optical communication channels

14. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 200614 Optical communication channels Measurements done with the LeCroy Serial Data Analyzer MPO/MPO cable 2m LC/LC cable 30 m Tx Serial Data Analyzer Parallel transmitter FDM 0.8 UI @ 10 -12 BER ~0.8 UI eye opening → 0.65 is required for 10 -12 BER by specifications

15. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 200615 Some Photos Test system with prototypes → one card tests another LeCroy Serial Data Analyzer Control PC & Console for the embedded SoC Processor VME crate with the two prototypes

16. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 200616 Some Photos Test system with all 12 SRP boards → organized as 6 barrel and 6 tester boards Passive optical cross-connect VME crate with 12 boards

17. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 200617 Some Photos Barrel SRP boards installed in the CMS service cavern 6 barrel SRP boards Cross-connect & 12-fiber MPO cables Patch-panel & 12-fiber MPO cables Fan-in/Fan-out modules and individual LC fibers

18. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 200618 Summary All SRP boards produced and verified → 12 + 4 spares + 2 completely operational prototypes → up to 100 kHz trigger rate → weeks of operation without communication link errors 6 barrel boards installed at CERN → commissioning underway 6 end-cap boards to be commissioned early in 2008 → together with trigger and read-out electronics 6 spare boards as development systems → 4 at CERN and 2 at Saclay Impatient to meet the very first collisions

19. Irakli.MANDJAVIDZE@cea.frConference on ''Physics at the Future Colliders'', Tbilisse, Georgia, October 22-28, 200619 Les mots de la fin... Just a little drop in the Sea(MS)... → Only one crate → 12 electronic boards but extremely attractive → Modern Platform FPGAs → Multi gigabit per second links → Parallel optics → System-on-chip design An insight of electronics to be used in HEP experiments at future colliders