UT Optical Connections Jianchun Wang For the UT electronics group 10/13/2015

(Slides are updated to include what was discussed at the meeting) Introduction The UT optical connection scheme was presented the LHCb upgrade electronics meeting on April 9th, 2015. There are small adjustments on the scheme since then. The cost estimates are based on the unit prices that Laurent received from the Optical Fibre Group. A worst-case scenario is assumed. Better prices may be negotiated for large quantity. (Slides are updated to include what was discussed at the meeting) 10/13/2015

UT Optical Connection Needs Data concentrator boards (DCB) in the PEPI chassis. Transfer event data out: SALT  DCB (GBTx, VTTx)  TELL40 Master control boards (MCB) in the PEPI chassis. Generate master clocks for DCBs & SALT ASICs, Distribute TFC to SALT, Configure & read back SALT registers via ECS, Read out temperature, voltage, humidity etc via ECS. MCB(GBTx, GBT-SCA, VTRx)  SOL40 LV monitor board in the service boxes. Monitor LV parameters. LV monitor board (GBTx, GBT-SCA, VTRx)  SOL40 10/13/2015

UT Optical Connection Plan (I) Electronics Chassis UX85 Cavern Patch Panel Data Center Patch Panel DAQ PC Rack x8 MPO type A adapter MPO(F) (MPO or MTP) LC MCB MPO MPO MPO(F) MPO(M) MPO SOL40 MPO(M) 12 f 12 f DCB 12 f 1 f 12 f 144 f TELL40 12 f DCB L ~ 350 m DCB L ~ 5 m L=10-30 m  L ~ 1.5 m MPO-to-LC Cassette x4 Service Box 2 f Scenario I: no regrouping of the 12f bundles in the counting room. 10/13/2015

UT Fiber Counts For Scenario I Unit Quant. For GBTx (3e/4e/5e) Single fibers 12f bundles UTa Chassis  4 Event Data 138 (106/16/16) 138 16 TFC/ECS 32 4 UTb Chassis 152 (120/16/16) 152 18 36 Service box PS ECS 1 2 2 (total) Total 1440 168+2 Only ~18 of the 24 inputs of TELL40 can be due to FPGA limits. Inside UT chassis ~3 fibers of each 12f bundle are connected. There is no regrouping at later stages in this scenario. The number of 12x fiber cables from the VELO/RICH/UT patch panel to one chassis is 20+2 (UTa) & 22+2 (UTb), where 2/chassis are mounted spares, total 168+16. UT needs 170 (12x) bundles in the ~350 m long cables. No extra spares are needed as ~30% fibers are not used. 10/13/2015

Total Cost For Scenario I Subracks and MPO adapter plates are included in long cable cost. Spare for a same item at different locations is counted only once. Long cables have ~30% fibers unused and are spares. 10/13/2015

Sample Of Accessories 2,8,11 7 2 3,4,12 5 1. 1, 6,10 10/13/2015

UT Optical Connection Plan (II) Electronics Chassis UX85 Cavern Patch Panel Data Center Patch Panel DAQ PC Rack x8 MPO type A adapter Duplex LC MPO(F) LC MPO MCB MPO MPO(F) SOL40 MPO(M) MPO(M) 12 f 12 f DCB 1 f 1 f 12 f 144 f TELL40 DCB 12 f L ~ 350 m DCB L=10-30 m  MPO-to-LC Cassette L ~ 5 m L ~ 1.3 m x4 Scenario II: Regrouping in the counting room. Variation: LC on the long cables at end of data center. LC adapters on data center patch panel. Service Box 2 f 10/13/2015

UT Fiber Counts For Scenario II Unit Quant. For GBTx (3e/4e/5e) Single fibers 12f bundles UTa Chassis  4 Event Data 138 (106/16/16) 138 15 TFC/ECS 16 32 UTb Chassis 152 (120/16/16) 152 18 36 Service box PS ECS 1 2 1 (total) Total 1440 124+1 In this scenario the fibers are regrouped to 12f bundle in the counting room before connecting to TELL40/SOL40. The number of 12x fiber cables from the VELO/RICH/UT patch panel to one chassis is 15+2 (UTa) & 16+2 (UTb), where 2/chassis are mounted spares, total 124+16. UT needs 125+12 (12x) bundles in the ~350 m long cables, where 12 bundles are spares (10%). 10/13/2015

Total Cost For Scenario II Compare to 302,388 for scenario I We may save 3-4 PCIe40 boards in this scheme. 10/13/2015

Total Cost For Scenario II.V Compare to 302,388 for scenario I If the trunk cables are terminated with 144x LC at the end in the counting room. 10/13/2015

Backup Slides 10/13/2015

ASIC E-ports To GBTx Connection E-ports operate @ 320 Mbps (8 bits / BCO). All e-ports of an ASIC connect to the same GBTx. Wide GBT frame (112 = 14  8 bits), partially filled. 4  3-eport ASICs (96 bits). 3  4-eport ASICs (96 bits). 2  5-eport ASICs (80 bits). Half staves are shown in tables below. ASICs/sensor: 4(G), 8 (Y/R) e-ports / ASIC: value inside 2 (a/b)  4 (quads) chassis 3 backplanes / chassis AAAAAAABCCBAAAAAAA * A 4x3 E-ports 84 1 GBTx 7 4x3 4x4 E-ports 88 1 2 GBTx 8 A* B 4x3 8x3 8x5 E-ports 124 1 2 4 GBTx 11 4x3 8x4 8x5 E-ports 164 1 3 4 GBTx 15 C 16 staves in UTaX / UTaU 18 staves in UTbV / UTbX 10/13/2015

GBTx & VTTx For Event Data For each quadrant Stave Type A A* B C Sum GBTx UTaX - 7 8 11 15 69 UTaU BackPlane 28 42 68 138 UTbV 76 UTbX 152 Multiple DCBs are plugged into one backplane. Back planes route ASIC data lines to different DCBs. Total 1160 GBTx chips (4138 + 4152) for event data. Electronic signals are converted to optical and sent out at VTTx links. Each VTTx serves 2 GBTx chips, & have 1 duplex LC receptacles. 10/13/2015

Active GBTx In PEPI Chassis U/V X MCB PEPI backplanes route ASIC data lines to DCBs, distribute TFC, LV etc (ref: Jason Andrews’ presentation at mechanics review). X plane U/V plane 10/13/2015

Constraint of TELL40 Boards ASIC Type (eports/ASIC) GBT Links # of TELL40 ASICs per Link Links per quadrant Links per chassis Total Links Max Links per TELL40 Per chassis 3 4 53 / 60 106 / 120 904 18 6/7 52 (51) 8 16 128 19 1 8 (7) 5 2 20 Sum 69 / 76 138 / 152 1160 - 8/9 68 (65) Needs update regrouping One TELL40 board can have max 212 optical inputs. Not all inputs can be used for UT due to the sub-GBT-frame structure and limited resources in the FPGA. Designated TELL40s will be used separately for links of 3-, 4-, 5- eports/ASIC. The difference will be hard coded in the firmware so as to save resources. There will be NO regrouping of optical fibers in the counting room. What ever grouping of 12f in the chassis will be pertained at TELL40. 10/13/2015

TFC/ECS Needs Each UT chassis has 3 MCBs, 1 per backplane. One MCB can house 7 GBTx chips, total 21 per chassis. In the latest revision from Tom O’Bannon, only 16 (18) GBTx are needed per chassis. For optical communication 1 GBTx needs 1 VTRx and 2 fibers for input & output. Thus there are total 32 (36) active fibers per chassis, in four 12x fiber cables. With possible I2C changing to a different protocol, the total number of fibers may change. It should not affect the optical cable counts as there is room. We also need to monitor LV powers in the service boxes (Carlos Abellan Beteta). Each service box needs 2 fibers for input & output. The efficient way is to route a duplex fiber cable from a service box to the UTa chassis that the box serves. In the UTa chassis the pair of fibers can connect to the TFC/ECS fiber cables. 10/13/2015

Optical Connections In PEPI Chassis 24 MPO adapters 1 duplex LC adapter in UTa chassis Drawing by Jason 10/13/2015