29 May 2009 Henk Boterenbrood, Augusto Ceccucci, Bjorn Hallgren, Mauro Piccini and Helmut Wendler 1 The Calorimeter Recorder CARE

29 May 2009 Henk Boterenbrood, Augusto Ceccucci, Bjorn Hallgren, Mauro Piccini and Helmut Wendler 2 Contents STATUS PCBs Features of CARE Technical details of CARE Details under discussion Acknowledgements

29 May 2009 Henk Boterenbrood, Augusto Ceccucci, Bjorn Hallgren, Mauro Piccini and Helmut Wendler 3 STATUS The project was started in December The PCB design in Jan 2009 by EN/ICE. All design documentation from ~1996 is available! The 3 x PCB layouts finished on 13 May The PCBs is being fabricated at CERN (ready mid June). Most components are available except: –3 types of Precidip connectors, expected mid of June. –2 MICREL timing circuits, samples confirmed. The first two prototypes ready for mid July? Next steps SOFTWARE both the FPGA, the ELMB, test programs for test to be started.

29 May 2009 Henk Boterenbrood, Augusto Ceccucci, Bjorn Hallgren, Mauro Piccini and Helmut Wendler 4 Motherboard PCB Layout ELMB TTC CLK LVDS FPGA Very fine lines (3 mil)

29 May 2009 Henk Boterenbrood, Augusto Ceccucci, Bjorn Hallgren, Mauro Piccini and Helmut Wendler 5 CARE PCB Layouts … FPGA 4 x GbE CAN bus 9-pol DSUB

29 May 2009 Henk Boterenbrood, Augusto Ceccucci, Bjorn Hallgren, Mauro Piccini and Helmut Wendler 6 Features of CARE The analog LKr signals are digitized at 40 MHz. The CARE consists of 4 indentical sectors = “896 virtual modules”! Each sector has 2 DDR2 SODIMM sockets with maximum 2 x 4 GB. This corresponds to ~8.3 s, but can be more with memory managment. Raw data correspond to 960 MBytes/s per sector with 16 CPDAS channels. Readout is done with 1 GbE links/sector = ~80 MBytes/s if jumbo frames. The same mechanics as CPD to keep the 7000 CPDAS and CPDTR cards. 80 MHz Clock as CPD with SoB and EoB (Start of Burst) and (End of Burst). CAN bus for the DCS (Slow Control).

29 May 2009 Henk Boterenbrood, Augusto Ceccucci, Bjorn Hallgren, Mauro Piccini and Helmut Wendler 7 Technical Details of CARE The data from CPDAS is transmitted via a Gbits/s to the main FPGA (Lattice ECP2-50). The FPGA has 8 input double buffers (one per link), while one buffer is written the data of the other is read out and put into a DDR2 memory. The DDR2 works in a time interleaved mode with fixed time slots for WR, RD and REFRESH operations. TTC input with one TTCRx to be compatible with the TELL1. The intellegent DCS is integrated on the motherboard with one ELMB. –It is used for storing and loading of the CPDAS registers. –Communication with the FPGAs and TTCRx. –Voltage and Temperature monitoring > 36 parameters/CARE. Standard LHC type of DCS for racks and crates?

29 May 2009 Henk Boterenbrood, Augusto Ceccucci, Bjorn Hallgren, Mauro Piccini and Helmut Wendler 8 1 Gbps CARE Readout (1 sector) DDR2 IP command burst operation WRITE EXAMPLE 1792 bytes takes 1006 MHz (=1781 MB/s) Sum of the 8 LVDS links 960 MB/s Raw data stored in packets 74 ts of 16 ch = 1776 bytes +16 bytes with extra info. SIMULATION EXAMPLE GbE JUMBO frames should be used!

29 May 2009 Henk Boterenbrood, Augusto Ceccucci, Bjorn Hallgren, Mauro Piccini and Helmut Wendler 9 Points to (discuss) 1 Pernicka 80 MHz clock with 1 usec stop during which an asychronous reset is transmitted to each CARE. Note, the CARE module is dead for 10 ms after the reset of the 80 MHz clock due to the PLLs in the LVDS links chips. (But not the GbE links to read status). Clock error checking as in the CPD (number of clocks received). The same clock 125 MHz is used for the GbE and FPGA. TTC clock not used inside CARE because it is 40 MHz. TTC can be used for input L0 pulse, L0 trigger information (channel B) plus start/end of burst (but not the reset of the 80 MHz clock)?

29 May 2009 Henk Boterenbrood, Augusto Ceccucci, Bjorn Hallgren, Mauro Piccini and Helmut Wendler 10 Points to discuss (2) GbE is used as data output. The output protocol to be defined. GbE can be used as input (64 1 MHz) in the same way as TTC. Direct connection between CARE and PC as with the SLM without NETWORK SWITCH is becoming very interesting. Because one PC server chassis has 12 x 1 GbE links. How long is the response time of the CARE? Flow control needed maybe but depends on DAQ architecure. Tests and Error finding –Analog “calibration” system is the same as the CPD. –Digital signals can be injected instead of ADC data in the CPDAS. –The DDR2 memories write and readable.

29 May 2009 Henk Boterenbrood, Augusto Ceccucci, Bjorn Hallgren, Mauro Piccini and Helmut Wendler 11 Acknowledgements Sophie Baron PH/ESE. DigiKEY, US component with large stock and distributor. Pascale Gattolliat, Internal Sales, ARROW CE International GmbH. Alex Hahn, Lattice/Munich, FPGA support. Brian Martin, ATLAS, GETB project. Douglas Tserkezoglou, retired CERN, test system documentation. Pacal Vulliez, PCB layout. Nicole Wauquier, CERN EN/ICE(Assembly).