1. 1 DB 3.1 The Life Cycle of a Data Center Steven Shapiro PE, ATD Morrison Hershfield Mission Critical Company Logo OK

2. 2 Data Center World – Certified Vendor Neutral Each presenter is required to certify that their presentation will be vendor-neutral. As an attendee you have a right to enforce this policy of having no sales pitch within a session by alerting the speaker if you feel the session is not being presented in a vendor neutral fashion. If the issue continues to be a problem, please alert Data Center World staff after the session is complete.

3. 3 Agenda Life Cycle Introduction Physical Plant Infrastructure Building White Space Electrical Power Systems Mechanical Cooling Systems Fire Protection Systems Questions

4. 4 The Life Cycle of a Data Center Beginning at the starting point to the end of the data center’s economic useful life The decisions that go into the design, construction, commissioning and operation of a data center facility

5. 5 The Life Cycle of a Data Center How do we evaluate the Data Center Life Cycle? Total Cost of Ownership – Measurable Process of evaluating the economic performance of a building and its components over its entire life Environmental Impact – Not so measurable Carbon Footprint?

6. 6 The Life Cycle of a Data Center $125M Facility 10MW UPS

7. 7 The Life Cycle of a Data Center TCO incorporates cost of energy ($/kWh) and cost of all resources throughout the life of facility.

8. 8 The Life Cycle of a Data Center Demand cost ($/kW) throughout life of facility Cost of water ($/1000 gal) throughout life of facility Capital costs ($) at initial build Capital costs ($) at future build (for modular systems) Maintenance costs ($/year) throughout life of facility Replacement costs ($ in years X, Y, or Z) Cost of funds (% Interest) Escalation (% Increase) Accounts for opportunity costs, or Internal Rate of Return (IRR) All costs over life of project are expressed as Net Present Value (NPV), or normalized to today’s dollars. If I need $1 at this time next year, I can invest 95 cents today. $1 at this time next year is worth 95 cents today.

9. 9 The Life Cycle of a Data Center Focus on the Physical Plant Infrastructure Building White Space Electrical Power Systems Mechanical Systems Fire Protection Systems

10. 10 The Life Cycle of a Data Center Biggest Bang for the Buck Electrical Power Systems Mechanical Systems

11. 11 Building How is it built? Precast concrete

12. 12 Building How is it built? Steel frame and poured concrete floors

13. 13 Building How is it built? Interior wall construction: Block or Rock

14. 14 Building How is it built? Extreme weather resistance Extreme security threat resistance

15. 15 White Space How is it built? Raised floor Slab on grade Ceiling plenum Tray Superstructure

16. 16 Electrical Power Systems How is it built? UPS – technology and configuration for reliability and maintenance Rotary Rotary Diesel Static

17. 17 UPS – Static vs. Rotary Diesel 90K SF white space 9MW UPS load 2N systems Diesel Rotary: 8-A systems and 8-B systems 16 systems Static Parallel Redundant UPS – 4-A and 4-B systems: Each 4-750kVA/675kW modules 8 systems, 32 modules total 10 Year Analysis 7% Interest Rate Cost of Energy – 0.05/kWh

18. 18 UPS – Static vs. Rotary Diesel System Cost Rotary: $36,853,000 Static: $28,360,000 Equipment cost savings of $8,493,000 for static.

19. 19 UPS – Static vs. Rotary Diesel Energy Cost Rotary efficiency – 94% Static efficiency – 93% Energy losses – P o (1-eff)/Eff, P o system output power, Eff system efficiency Rotary system losses: 9,000(1 - 0.94)/0.94 = 575 kW Static system losses: 9,000(1 - 0.93)/0.93 = 677 kW Yearly cost of energy (30% allowance for the mechanical system losses) Rotary system: 575 Kw x 1.3 x 24 hours x 365 days x $0.05 = $327,405 Static system: 677 kW x 1.3 x 24 hours x 365 days x $0.05 = $385,484 The additional yearly cost of energy for using a static system is: $385,484 - $327,405 = $58,079 Present worth of energy savings over 10 years – NPV = $58,079 ((1 + 0.07) 10 )-1)/(0.07(1 + 0.07) 10 ) = $407,889 There is a $407,889 savings in energy costs if the rotary system is installed.

20. 20 UPS – Static vs. Rotary Diesel Maintenance Costs Yearly cost rotary $22,000 per unit. Assuming 3% yearly escalation, present worth of the maintenance cost is: $172,524 plus the induction coupling replacement at year 6: 16 x ($172,524 + $29,985)= $3,240,144 Yearly cost static $32,877 per module (including the batteries) for five years. Assuming a 15% escalation/5 years, the present worth of the static equipment maintenance is: 32 Units x ($32,877 + 1.15 x 32,877 x (1+i) -n ) = $1,667,150 Rotary $3,240,144 – Static $1,667,150 = $1,572,994 There is a $1,572,994 savings in maintenance costs if the static system is installed.

21. 21 UPS – Static vs. Rotary Diesel Battery Replacement Flooded batteries last approximately 15 years, battery replacement is not considered for this 10 year analysis Cooling Required Rotary – no cooling requirement – just ventilation Static – total 677 kW in losses, $1000/ton in cooling assumed There is a $191,817 savings in A/C equipment costs if the rotary system is installed.

22. 22 UPS – Static vs. Rotary Diesel Cost of Displaced Space The potential savings generated by the loss of additional space inside the building by the use of Rotary UPS systems is about $400 per SF Static UPS system about 4,200 SF Static total space is 33,600 SF Rotary die­sel UPS with intake, exhaust/sound attenuation ple­nums, and switchgear about 2000 SF Rotary diesel total space is 32,000 SF $400 x (33,600 SF – 32,000 SF) = $640,000 Present worth – $4,494,720 There is a $4,494,720 savings by not building interior floor space if the rotary system is utilized.

23. 23 UPS – Static vs. Rotary Diesel Initial equipment cost-$8,493,000 Energy costs $407,889 Maintenance costs-$1,572,994 Battery replacement costs$0 Additional A/C equipment costs$191,817 Displaced floor space cost$4,494,720 Total-$4,971,568 Based on these considerations, it is clear that there is a cost benefit of almost $5,000,000 in using static UPS systems.

24. 24 Electrical Power Systems How is it built? Batteries – type Flooded Wet Cells VRLA

25. 25 Batteries – Flooded vs. VRLA 100,000 SF white space 150 watts per SF 15 MW UPS load 20 year analysis 7% interest rate 15 minutes backup time Flooded vs. VRLA 20 year vs. VRLA 10 year batteries 5 – 2N systems Total 10 systems of (5) 750kVA/675kW modules 50 strings of batteries

26. 26 Load Growth for Scalable Site Batteries – Flooded vs. VRLA LoadSystemsModules Day 15 MW4 systems20 modules Year 77.5 MW2 systems10 modules Year 1215 MW4 systems20 modules

27. 27 Batteries – Flooded vs. VRLA IssueFlooded Wet Cell20 Year VRLA10 Year VRLA Reliability 0.00746* 0.02014* (Failure Rate) 2.67 Times The Flooded Cell Rate Over-temperature Decreased life of battery. Life is cut in half for every 18 degree rise. Must be kept cool or will over- heat (thermal runaway) destroying itself. Life is cut in half for every 15 degree rise. Failure Mode Shorted CellFails Open Results in lowered string voltage. String still provides power in an event. Makes the string useless. Possible for cell to fail violently in thermal runaway. Installation TypeRack Cabinet Backup TimeAny level available 7 Minutes maximum typical for large UPS module support Footprint Larger than 20Yr VRLALarger than 10Yr VRLASmallest footprint 72’WX2’D 2 Tier,144 SF18’Wx5’D 5 Cabinets of 4’Wx3’D=> 20’Wx3’D 48’WX2’D 3 Tier,96SF90SF/Module60SF/Module /Module Only 7 minutes Max Maintenance ModerateMinimal Electrolyte level must be maintained above the plates. Quarterly Semiannual $5,600/Year/String$2,800/Year/String$2,000/Year/String Life Cycle 20 year design, 10 year design, 12 to 15 year actual11 to 13 year actual3 to 5 year actual 20 Year Scope1 Replacement 3 Replacements Budget Cost Material$550,000$662,000$366,000 *-Reliability Analysis Center – Relex Software Corporation

28. 28 Batteries – Flooded vs. VRLA Cost FloodedCost 20 YearCost 10 Year Cost per system$570,000$677,000$373,000 Day 1: $11,400,000$13,540,000$7,470,000 20 modules Year 7: $7,010,281$8,326,246$4,593,579 10 additional modules Year 12: $16,253,674$19,304,802$10,650,434 20 additional modules

29. 29 Batteries – Flooded vs. VRLA Maintenance Cost Yearly cost of maintenance for each battery strings is as follows: Flooded Cell - $5,600 20 year VRLA - $2,800 10 Year VRLA - $2,000 10 Year VRLA Year # of Strings Maintained Maintenance Cost @ $2000 per string (PV) 120$40,000 220$41,200 320$42,436 420$43,709 520$45,020 620$46,371 730$71,643 830$73,792 930$76,006 10 $26,095 1130$80,635 1220$55,369 1350$142,576 1450$146,853 1530$90,755 1650$155,797 1720$64,188 1850$165,285 1950$170,243 2050$175,351

30. 30 Batteries – Flooded vs. VRLA Space Requirements Space savings generated by the physical size differences between the various systems Flooded cell - 96 SF x 5 modules x 10 systems x 3.33 = 15,984 SF 20 Year VRLA – 90 SF x 5 modules x 10 systems x 3.33 = 14,985 SF 10 Year VRLA – 60 SF x 5 modules x 10 systems x 3.33 = 9,990 SF There is a 999 square foot savings by utilizing the 20 year VRLA cells over the flooded cells.

31. 31 Batteries – Flooded vs. VRLA Cash Flow Tables Flooded Cell Yearly Cash Flow20 Year VRLA Yearly Cash Flow10 Year VRLA Yearly Cash Flow YearEquipment Cost Maintenance Cost Yearly CostEquipment Cost Maintenance Cost Yearly CostEquipment Cost Maintenance Cost Yearly Cost 1$11,400,000$112,000$11,512,000$13,540,000$56$13,596,000$7,470,000$40,000$7,510,000 2 $115,360 $57,680 $41,200 3 $118,821 $59,410 $42,436 4 $122,385$122,365 $61,193 $43,709 5 $126,057 $63,028 $8,659,777$45,020$8,704,798 6 $129,839 $64,919 $46,371 7$7,010,281$133,734$7,144,015$8,326,246$66,867$8,393,113$4,593,579$71,643$4,665,222 8 $212,817 $106,409 $73,792 9 $219,202 $109,601 $76,006 10 $225,778 $112,889 $10,039,055$26,095$10,065,151 11 $232,551 $116,276 $81 12$16,253,674$239,528$16,493,202$19,304,802$119,764$19,424,566$10,650,434$55,369$10,706,803 13 $449,318 $19,883,946$41,119$19,925,065$5,484,973$142,576$5,627,550 14 $462,797 $231,399 $146,853 15$17,760,829$87,246$17,848,075 $238,341 $21,094,870$90,755$21,185,634 16 $490,982 $245,491 $155,797 17 $505,711 $252,856 $11,205,002$64,188$11,269,190 18 $520,882 $260 $165,285 19 $536,509 $268,254 $170,243 20 $552,604 $276,302 $175,351

32. 32 Batteries – Flooded vs. VRLA Over 20 year period, the flooded cell is the most cost effective system due to fewer replacements though higher initial and higher maintenance costs impact the yearly cash flows making VRLA systems more attractive in 1 st and 12 th year. FLOODED 20 YEAR VRLA 10 YEAR VRLA BENEFITS OF FLOODED SYSTEMS OVER VRLA SYSTEMS DAY 1 20 YEAR VRLA10 YEAR VRLA Equipment Cost $11,400,000$13,540,000$7,470,000$2,140,000-$3,930,000 Maintenance Costs $112,000$56,000$40,000-$56,000-$72,000 Total$11,512,000$13,596,000$7,510,000$2,084,000-$4,002,000 YEAR 7 (END- present worth paid to date) Equipment Cost $16,777,257$19,926,671$18,294,822$3,149,415$1,517,565 Maintenance Costs $655,470$327,735$248,968-$327,735-$406,502 Total$15,675,326$18,167,108$16,265,228$2,491,782$589,902 YEAR 12 ( END - present worth paid to date) Equipment Cost $30,045,096$35,685,141$33,547,181$5,640,044$3,502,085 Maintenance Costs $1,230,174$615,087$409,418-$615,087-$820,756 Total$30,045,096$27,026,023$26,257,945-$3,019,073-$3,787,152 PRESENT VALUE OF OVERALL 20 YEAR COSTS Equipment Cost $43,594,747$50,854,508$56,860,294$7,259,761$13,265,547 Maintenance Costs $2,399,398$1,194,111$772,812-$1,205,287-$1,626,586 Total$31,073,421$35,856,178$40,090,379$4,782,757$9,016,957

33. 33 Batteries – Flooded vs. VRLA Recommendation – Best TCO Size and space for flooded cells Install VRLA 10 year systems Day 1 Replace VLRA with flooded cells at end of useful life

34. 34 Electrical Power Systems How is it built? Generators: size configuration reliability maintenance

35. 35 Generator Size - 2MW vs. 2.5MW Data Center: 100,000 SF 150 Watts per SF UPS: 15MW Total facility load is 27.75MW Generator plant configuration is N+2 Generator distribution is 2N Life cycle analysis duration: 20 years Interest rate: 7% Load growth: 5MW UPS Power Day 1 7.5MW UPS Power Year 7 15MW UPS Power Year 12

36. 36 Generator Size - 2MW vs. 2.5MW N+2 plants 16 – 2MW generators N capacity = 28MW vs. 14 – 2.5MW generators N capacity = 30MW

37. 37 Generator Size - 2MW vs. 2.5MW Quantity Cost Per ComponentTotal Cost Quantity Day 1 Quantity Year 7 Quantity Year 12 Critical Load 5MW7.5MW15MW Equipment Description 2MW Generator Plant Generators16$480,000$7,680,0007916 Duplex Switches/Surge Cabinets16$75,000$1,200,0007916 MV Switchgear – CBs32$75,000$2,400,000141832 Controls1$1,600,000 1 Feeders – Generator1$112,000 1 $12,992,000 2.5MW Generator Plant Generators14$720,000$10,080,0006814 Duplex Switches/Surge Cabinets14$75,000$1,050,0006814 MV Switchgear – CBs28$77,143$2,160,000121628 Controls1$1,400,000 1 Feeders – Generator1$98,000 1 $14,788,000

38. 38 Generator Size - 2MW vs 2.5MW Maintenance Cost Generators Distribution equipment Controls Space Requirements – Indoor Installation Unit size Sound attenuation Distribution equipment 120 SF difference between 2MW and 2.5MW plants

39. 39 Generator Size - 2MW vs. 2.5MW 2MW2.5 MW DAY 1 Equipment Cost$6,647,000.00$7,193,714.29 Maintenance Costs$78,750.00$67,500.00 Total$6,725,750.00$7,261,214.29 YEAR 7 (END - PRESENT WORTH PAID TO DATE) Equipment Cost$13,028,072.04$14,881,027.00 Maintenance Costs$460,877.22$395,037.62 Total$11,532,685.30$12,934,626.10 YEAR 12 ( END - PRESENT WORTH PAID TO DATE) Equipment Cost$26,156,250.24$30,348,534.82 Maintenance Costs$807,238.82$702,914.59 Total$19,019,906.00$21,655,802.49 PRESENT VALUE OF OVERALL 20 YEAR COSTS Equipment Cost$26,156,250.24$30,348,534.82 Maintenance Costs$1,578,138.60$1,377,451.90 Total$19,790,805.78$22,330,339.80 2.5 MW plant is less to maintain Overall cost of the 2 MW is less at every stage

40. 40 Electrical Power Systems How is it built? Power Distribution to the Floor

41. 41 Power to the Floor Underfloor vs Tray vs Bus Underfloor Raised Access Floor IT Cabinet RPP

42. 42 Power to the Floor: Underfloor vs. Tray vs. Bus Overhead in Busway Raised Access Floor IT Cabinet Panel Board Busway Overhead in Busway

43. 43 Power to the Floor: Underfloor vs. Tray vs. Bus Overhead in Tray Raised Access Floor IT Cabinet RPP Tray

44. 44 Power to the Floor Underfloor vs. Tray vs. Bus First Cost Underfloor to the cabinet least first cost option

45. 45 Power to the Floor Underfloor vs. Tray vs. Bus Accessibility, Risk Exposure, and Ease of Modification Overhead busway accessibility with a lower level of risk exposure, ease of modification Branch Circuit Monitoring Available and cost competitive - all

46. 46 Power to the Floor : Underfloor vs. Tray vs. Bus Cost Impact for Future Modification Underfloor and overhead in tray - least cost for power modification requirements Understanding that electrician is required for all modification work Recommendation – it depends

47. 47 Mechanical Cooling Systems Technology and Configuration for Reliability, Maintenance, and Best PUE

48. 48 Mechanical Cooling Systems

49. 49 Mechanical Cooling Systems How is it built? Cooling storage – reliability and off peak generation Ice Water

50. 50 Fire Protection Systems How is it built? Water/Preaction Gas Mist

51. 51 3 Key Things You Have Learned During this Session 1.What is TCO? 2.How do my initial decisions impact the costs and the ease of growing a facility? 3.How do I evaluate my building infrastructure relative to TCO?

52. 52 Thank you Steven Shapiro PE, ATD Mission Critical Practice Lead (914) 420-3213 sshapiro@morrisonhershfield.com http://www.linkedin.com/in/stevenshapirope @stevenshapirope