ATCA LLP CARRIER BLOCK DIAGRAMS LAST UPDATE 09/05/2007

Master / Slave Structure TCLK SLOT A (n) SWITCHES MASTER/SLAVE CARD_PRESENT TCLK_PRESENT TRIGGER CLOCK SYNCs And DATA MANAGERS SLOT B (n+1) MASTER/SLAVE CARD_PRESENT TCLK_PRESENT TRIGGER CLOCK SYNCs And DATA MANAGERS DATAPATH CLOCK AND SYNCS DATAPATH CLOCK AND SYNCS

200Mhz Clock and Clock SYNC distribution TCLK GTS CORE SEGMENT PLL SWITCH GTS_CLOCK VIRTEX4 FX100 MAIN FPGA SMB INSP VIRTEX4 LX25 DATA DISTRIBUTON MGT CLOCK SYSTEM CLOCK_ SYNC 200MHz FANOUT SWITCH MASTER 100MHz SWITCH SEGMENT PLL SWITCH GTS_CLOCK VIRTEX4 FX100 MAIN FPGA SMB INSP VIRTEX4 LX25 DATA DISTRIBUTON MGT CLOCK SYSTEM CLOCK_ SYNC 200MHz FANOUT SWITCH SLAVE 100MHz SWITCH PPC_CLOCK 100MHz 200MHz 100MHz 200MHz PPC_CLOCK $07 – D0 $07 – D1 $07 – D2 $08 – D1 $07 – D0 $07 – D1 $07 – D2 $08 – D1

GTS ADCs CLOCK SYNC distribution TCLK GTS CORE SEGMENT FANOUT SYNC_RTN MASTER SLAVE SEGMENT FANOUT GTS_SYNC 100MHz clock with missed periods as SYNC event SWITCH SYNC_AUX SYNC_RTN SYNC_AUX

Serializers SYNC signal distribution TCLK GTS CORE SEGMENT FANOUT MASTER SLAVE SEGMENT TRIGGER FPGA MAIN FPGA SWITCH SEGMENT FANOUT TRIGGER FPGA MAIN FPGA SWITCH 10MHz clock signal (the patterns must be equal at any rising edge)

Bcast & Msg Handler Serialized SERIALIZERS 8  1 8 FROM REMOTE (TCLK) GTS MEZZANINE MAIN FPGA Msg_str0 Msg_str1 B_cast_data (7 downto 0) B_cast_str0 B_cast_str1 LLP Status (7 downto 0) GTS Status (7 downto 0) Msg_data (7 downto 0) SEG/CORE MEZZANINE Msg_str0 Msg_str1 LLP Status (7 downto 0) Msg_data (7 downto 0) FROM REMOTE (TCLK) TO REMOTE (TCLK) FANOUT TO MAIN FPGA, LOCALS MEZZANINES, AND REMOTE MEZZANINES (TCLK) Concentrator LX25 x6 LX25 x4

Trig_req (1 downto 0) Trig_val (1 downto 0) Lt_data (7 downto 0) Tv_data (7 downto 0) Lt_Strobe Tv_Strobe TRIGGER Handler serialized Trig_Rej (1 downto 0) 8 FANOUT TO OTHERS DEST 8 8 CORE MEZZANINE Local_Trigger (1 downto 0) MAIN FPGA LX25 GTS MEZZANINE FROM REMOTE (TCLK) Trig_req (1 downto 0) x4 TCLK

Trig_req (1 downto 0) Trig_val (1 downto 0) Lt_data (7 downto 0) Tv_data (7 downto 0) Lt_Strobe Tv_Strobe Trig_Rej (1 downto 0) SERs / DESERs 8  1 GTS MEZZANINE Trig_req (1 downto 0) B_cast_data (7 downto 0) B_cast_str0 B_cast_str1 GTS Status (7 downto 0) 44 lines SERs / DESERs 8  pairs (20 lines) 44 lines 200 lines lines MEZZANINEs Sync_rtn Sync TCLK 266 / 448 ~50% of LX25_FF668 4 lines Alignement BUS (3 lines) CMC #1CMC #2CMC #3CMC #4FX100 TRIGGER & BCAST Handler (parallel)

Using 1 16 bit port : 128 words/event 256 bytes/event 6 channels  1536bytes 16bit 100MHz Need 7.68µs (20µs 50KHz) Serializer Data_A (15 downto 0) Empty_A Data_Ready_A Data_Request_A Deserializer 8 pairs ; 16 I/O 1Mx18 DPRAM 20bit Data readout engine Data_A (15 downto 0) Empty_A Data_Ready_A Data_Request_A X4 Mezzanines 18bit Serializer 20bit 18bit 1536*4 = 6144 byte/Event 16bit 200MHz Need 15.36µs (20µs 50KHz Max 325 Events stored Data Rate Required Data Readout Protocol Peak Bandwidth [Mb/sec] Peak Event Rate [KHz] Fast Ethernet [100Mbit/sec] G Ethernet [1.25 Gbit/sec] PCI Express [2.5 Gbit/sec]

MGT Clocking Layout RocketIO 101 MUX RocketIO 102 MUX RocketIO 103 MUX RocketIO 105 MUX MGTclk M34/N34 MGTclk AP28/AP29 RocketIO 106 MUX RocketIO 109 MUX RocketIO 110 MUX RocketIO 112 MUX RocketIO 113 MUX MGTclk AP3/AP4 MGTclk J1/K1 RocketIO 114 MUX 100  250MHz PCI Express JITTER ATTENUATOR 200MHz GTS Clock (***) User SFP could be used as 1GEnet or PCIExpress DAQ without FABRIC ATCA FABRIC CH15 ABAB ABAB ABAB ABAB ABAB ABAB ABAB ABAB ABAB ABAB 100MHz GTS Clock OPTICAL SFP LOCAL 100MHz PHASE LOCKED ATCA FABRIC CHxx ATCA FABRIC CH13 ATCA FABRIC CH14 PCI Express SFP ATCA FABRIC CH02 ATCA FABRIC CH01 ATCA FABRIC CH04 ATCA FABRIC CH03 ATCA FABRIC CH06 ATCA FABRIC CH05 ATCA FABRIC CH12 ATCA FABRIC CH11 ATCA FABRIC CH10 ATCA FABRIC CH09 ATCA FABRIC CH08 ATCA FABRIC CH07

FPGA0 Temp MAX1617A Address $18 FPGA1 Temp MAX1617A Address $19 FPGA2 Temp MAX1617A Address $4C CMC1 Address $50 CMC2 Address $51 CMC3 Address $52 CMC4 Address $53 Temp Sens MAX6626 Address $48 Temp Sens MAX6626 Address $49 Temp Sens MAX6626 Address $4A SFP Lanes I2C Multiplexer MAIN FPGA (FX100) SFP Clock Temp Sens MAX6626 Address $4B Mon. ADC MAX1239 Address ? IO Expander ? Address ? FPGA1 Sw LX25 Address $60 FPGA2 Trigger LX25 Address $61 1K EEPROM ? Address ? I2C Multiplexer DC-DC ATC210 Address ? I2C bus layout Fast Ethernet ATCA Zone1 IPMI IPMI Address IPMI A IPMI B IO Expander ? Address ?

JTAG Connector (Front Panel) MANUAL SW Slow control layout (JTAG Management) MAIN FPGA (FX100) JTAG SWITCH Fast Ethernet ATCA Zone1 IPMI IPMI Address IPMI A IPMI B I2C Multiplexer CONF[1..0] SEL PROGRAM [1..0] TCK TMS TDO INIT TDI X7 (4 Mezzanines + 3 FPGAs) RMT JTAG

TCLK Port Layout

ATCA Power Supply (maximum) Fusing -48V DC HS ENABLE DC to DC Converter DC to DC Converter DC to DC Converter DC to DC Converter P3V3-5A 16.5W MEZZANINE 1 MEZZANINE 2 MEZZANINE 3 MEZZANINE 4 MAIN BOARD P3V3-7A 23W P3V3/P2V5 Linear Reg M48/P12 DC P12/P3V3 DC MAIN BOARD P2V5-7A 17.5W P12/P2V5 DC FPGAs CORE P1V2-9A 11W P12/P1V2 DC FPGA MGT P1V2-5A 6W P12/P1V2 DC P5V0/P2V5 Linear Reg P2V5-1.5A P2V5-0.05A P5V0/P1V8 Linear Reg P1V8-0.5A PROMS VCCAUX Fpga 1 VCCAUX MGT P5V0/P2V5 Linear Reg P2V5-1.5AVCCAUX Fpga 2 P5V0/P1V5 Linear Reg P1V5-2.6A VTTTXs P5V0/P1V5 Linear Reg P1V5-0.2AVTTRXs MGT BUFFERSP1V8-5A 9W P12/P1V8 DC P12V-14.2A 171W P3V3-5A 16.5W M48V-3.9A 188W DC-DC Efficency is estimated at least 90% ATC210 (210W) P3V3_BOOT 10x LTM W P12/P5V0 DC P3V3-7A 23W LINEAR REGULATORS

1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM PCIExpress Case 1 : PCIExpress 1Mx36 DPRAM PRE PROCESSING ADCs

1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM Case 2 : 1G Ethernet switch GEthernet Switch EB FARM

1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM 1Mx36 DPRAM PCIExpress Case 3 : PCIExpress (full mesh)