WBS Readout Infrastructure Craig Dukes University of Virginia Bill Gilbert University of Minnesota CD2/3a DOE Review of NO  A October 23-25, 2007

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Organization Low voltage power supplies/racks High voltage power supplies Power cables/cable trays Power distribution boxes (PDBs) Cooling Shipping 1. Power Distribution System (PDS) (Dukes) 2. APD Thermoelectric Cooler Cooling System (Gilbert) Craig Dukes, Nicole Fields, Emmanuel Munyangabe, Yoshihiro Masui, Andrew Norman University of Virginia Bill Gilbert, Roger Rusak University of Minnesota Leon Mualem Caltech WBS Items

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Power Distribution System Feeds electrical power to: –The Avalanche Photodiodes (APDs) –The Thermoelectric Coolers (TECs) –The Front End Boards (FEBs) –The Data Concentrator Modules (DCMs) Requirements –Low noise (3.3V + 450V) –Remote control and monitoring –Floating power supplies –Remote sensing for LV supplies –Reliable operation over 10+ years

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Power Distribution System Layout DetectorCAENWienersPDBsFEBs FD ,036 ND IPND126310

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS PDS Power Requirements Power Delivered per Power Distribution Box ItemVoltageCurrentMax Channels Total Current Total Power FEB3.3 V1 A6464 A260 W TEC24 V0.15 A6410 A232 W DCM24 V1.25 A1 30 W Timing24 V1.04A1/241 A24 W APD450 V 40  A A1.35 W FD Power DeliveredTotal 3.3 V51 kW72 kW 24 V52 kW72 kW

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Far Detector Di-block Layout

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Near Detector Layout

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS IPND Layout

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Electronics Counts

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS High Voltage Supply CAEN SY1527LC mainframe CAEN A1511B card 12 ch, V, 15 mA Individually floating channels Voltage resolution: 100 mV (~0.5%) Ripple: < 30 mV pp Each channel serves 2 PDBs Only 1 mainframe needed for entire FD Ethernet (TCP/IP) interface Widely used at Fermilab

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Low Voltage Supply Wiener PL508 System Floating Remote sense 3 3.3V pods, 3 24V pods → each MF feeds 3 PDBs → 66 MFs needed Ripple: < 3 mV pp Ethernet (TCP/IP) interface Widely used at Fermilab

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Fans out 3.3V, 24V, and 450V to up to 64 FEB boards, and 24V to 1 DCM 3U crate 16 x = 66 FEB channels LED indicators for crate 3.3V, 24V, and 450V power LED indicators for card 3.3V and 24V power Front panel on/off switches Fused with TVS for 3.3V lines Note: FEBs have voltage regulators Reference to ground Designed and built at UVa FD: 198 ND: 10 Power Distribution Box

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Prototype PDB Fabricated Works according to specifications Minor redesign in progress (mainly to simplify construction)

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Mounting the PDS on the Far Detector

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Cables Type Size (AWG)Cond. Length (m)Different Lengths # Cables Min.Max.Ave.Total 3.3V , V , Sense , V , PDB-FEB , ,036 PDB-DCM Ground6, 1/0, 3/ All cables “tray cable” Oil resistant jackets Power Supply to PDB

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Cable Safety PDB-FEB 4A max Wiener-FEB 24V: 23A max Wiener-FEB 3.3V: 110A max Power supply to PDB cables can handle full current capacity of power supplies.

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Power Budget and Voltage Drops Detector Total Total144 kW Output103 kW

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Cable Trays

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Detector Cooling Overview 17 air breathing 2 ton chillers located on upper walkway Each chiller serves 2 detector blocks Started one at a time to reduce peak electrical and heat load Steady state heat load to air per chiller: Heat from APD/TE modules 3.35w x 744 = 2492w Heat from chiller operation (33% capacity)+ 2310w Net* heat load to air per chiller = 4802w Net* total heat rejected to air by 17 units= 82 kw *Ignores pipe & tube loading, gained from air, rejected to air, approx 2.3 kw per chiller 17 chillers Detector Top View

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Water Distribution Scheme prefabricated distribution manifolds prefabricated hose manifolds

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Hose Manifold Section 3/4”Sch 120 plastic pipe 1/8” I.D. hoses with valved disconnect With single-sided detector readout, all manifolds are identical, 32 hose style. Two piece construction eases shipping and handling overall length 350 cm Cap compression couplings distribution manifold 1.25” 175 cm

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Prototype Hose Manifold Shown with pipe insulation, will be tested with & without insulation

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Distribution Manifold Section 1.25” plastic pipe 262 cm (8.6 ft) +/- 3.37cm 131cm116cm 15cm 3/4” pipe taps union couplings ball valves Expansion joint, 6.75cm range, handles exp/contr and dimensional tolerances Return Pipe Section

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Water Schematic Far Detector

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Water Schematic IPND Each manifold serves 31 APD modules Chiller Sensor Panel 310 APD Modules Total 2 APD rows detector top 3 APD rows detector side 9.8 GPM, 1.04 kW

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Water Schematic Near Detector

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Water System Pressures Working pressure and worst case pressure is well under design pressure of 100 PSI

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Chiller Control & Instrumentation DCS monitors cooling system, can adjust water temp, and start/stop chillers

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Flow Network Modeling Cooling system design is being modeled using:

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Hose/Heatsink Net Model

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Hose Assy Diff Pressures Drilled orifices in hose barbs are the dominant restriction governing flow Changes in hose length or heatsink resistance will not be significant

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Hose Manifold Network Model

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Hose Manifold Temp Uniformity Total Spread = 0.15 DegC

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Hose Manifold Flow Uniformity Excellent uniformity is due to large relative diameter (0.690 in) of manifold pipe

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Distribution Network Model

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Distribution Flow Balance Use of orifices in hose barbs creates inherent balance Detector Top Detector Side Flow balance will not be disturbed by minor modifications to supply piping Flow can be adjusted using one valve near chiller without affecting balance

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Distribution Temp Uniformity Detector Top Detector Side Total Spread = 0.06 DegC

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Testing the Cooling Model Two key model elements will be tested: Hose/heatsink assembly flow and pressure characteristics will be measured with various orifice sizes Prototype manifold pair with hose assemblies will be tested for ambient heat gain and temperature uniformity Details: Chiller will provide 15 DegC water at 64 mL/s 4 hose/heatsink assemblies along manifold will be instrumented with thermistors Input & output water temperatures measured with thermistors Overall flow rate measured with rotameter, controlled with valve Input & output pressures measured with transducers Temp & pressure recorded using data logger and computer

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Costs (ND+FD) ItemM&SLaborContingencyTotal Low voltage supplies$542K$6K25%$682K High voltage supplies$104K$1K15%$120K Power cables$205K$47K32%$334K PDBs$370K$68K21%$526K Cooling$1,335K$17K31%$1,778K PDS shipping$21K$3K15%$28K Total:$2,578K$142K28%$3,471K

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Procurement Power Distribution System –Power supplies to be bought and shipped to Virginia to be tested. –Cables will be cut, terminated and tested at Virginia. –Power Distribution Boxes will be fabricated and tested at Virginia. –Cable trays and relay racks will be delivered directly to the Far Detector site and FNAL. Cooling System –Manifolds will be fabricated and shipped by vendor to the Far Detector site and FNAL on a di-block by di-block basis. –Chillers and cooling interface panels will be ordered and shipped by vendor to Far Detector and FNAL. Installation in WBS 2.9.4

October 23-25, 2007 CD2/3a DOE Review Breakout Dukes/Gilbert/WBS Schedule Lots of float: no critical-path items! Power Distribution System Fabrication of PDBs: Need 215, including spares. Make and test 1/day with 1 tech 200 days/1 tech Fabrication of cables: Dominated by 12,000 PDB-FEB cables: 1 student: cut, terminate, pack 5 cables/h: 80 days/4 undergrads Will do it in summer of 2010 with student labor UVa HEP building has enough storage for complete system → will deliver to detector in 3 shipments Cooling System Vendors can deliver as needed to keep up with outfitting schedule