THE EVOLUTION OF TECHNOLOGY SPACES Dave McGrath Director Business Development Construction, Facilities and Engineering Division

© 2004 APC corporation. "The fatal conceit with managers is that tomorrow will look like today..." Peter Druker

© 2004 APC corporation. Are we designing towards, or away from future problems?

© 2004 APC corporation. More…

© 2004 APC corporation. More…

© 2004 APC corporation. High Density – todays problem High Density Requirements Increasing power Increasing need for cooling Increasing runtime Increase need for redundancy Blade Servers

© 2004 APC corporation. High-density is going to bite your customer Its not if, its when!

© 2004 APC corporation. Catch 22 for IT managers What is the greatest facility problem with your primary data center? (Source: Gartner, 2006)

© 2004 APC corporation. IT Facilities

© 2004 APC corporation. How will it be solved With a Clear and Concise language on Scalable, Modular datacenter design. Rack, Power, and Cooling Infrastructure will be designed using pre-engineered modular components and configuration tools

© 2004 APC corporation. Traditional Design Unable to Respond adequately to todays growing power and heat loads

© 2004 APC corporation. We must re-tool the design process Power Cooling Service Engineering Space Improvements Racks Thinking about Data Centers by the square foot is obsolete

© 2004 APC corporation. Blade Server Power Draw 733 W/SF 500 W/SF

© 2004 APC corporation. 18 kW POWER 18kW ( Assume dual-corded blade chassis) 30-amp circuits 208 / 230 V 18 kW COOLING Density Power & Cooling Challenges 3 kW

© 2004 APC corporation cfm 18kW 3 kW 2500 cfm The Cooling Challenge

© 2004 APC corporation. Grate tile Blade Servers Standard IT Equipment With Effort Typical Capability Extreme Impractical [47.2] [94.4] [141.6] [188.8] [236.0] [283.2] [330.4] [377.6] [424.8] [471.9] Limits of Floor Tile Cooling cfm Additionally requires grate-type tiles Perf tile Rack Power (kW) that can be cooled by one tile with this airflow

© 2004 APC corporation. Traditional Configuration

© 2004 APC corporation. Room-oriented cooling airflow patterns

© 2004 APC corporation. In Row Configuration (Coupled Cooling)

© 2004 APC corporation. Row-oriented cooling airflow patterns Predictable Performance

© 2004 APC corporation. Alternative cooling architectures MethodApplicationDensity Traditional room- oriented raised floor cooling Low density Very flexible 1-5kW per rack In-rowMedium density General use 3-15kW per rack In-row with hot aisle containment Very high density Targeted zones Assured redundancy 10-25kW per rack Rack-coupledVery high density specific racks Mix of very high and low density 20-45kW per rack

© 2004 APC corporation. Why is it so critical to address during design? Cooling problem Efficiency problem Rate of change problem

© 2004 APC corporation. In-row rack-coupled architecture InfraStruXure Cooling Distribution Unit Coupled to adjacent IT racks Up to 40kW rating today with efficient designs Higher availability via N+1 standards Predictable performance Mix into existing legacy data center

© 2004 APC corporation. IDC: Time to push reboot button… …it appears that it will be cheaper to build new datacenters to accommodate blades than to attempt to retrofit the existing ones…

© 2004 APC corporation. It is getting to the CEOs plate… Power will be #1 design issue for many IT shops over next two to three years… RFG predicts that power and cooling costs will increase to more than one-third of the total IT budget. This will elevate this cost element into a priority position for CFOs, facilities managers, and IT executives. Coordination with facilities management is crucial to successful power and cooling planning -Robert Frances Group, January 06

© 2004 APC corporation. We must all pay close attention…

© 2004 APC corporation. Density is driving an unprecedented collision between IT, Facilities and vendors We have a shared problem The traditional solutions wont work, and the typical solution providers are either focused on making the problem worse or hoping it goes away The shared problem is getting bigger and hairier by the minute We need a shared language to promote learning Learning offers an opportunity for standardization, leading to lower costs, higher availability, and much greater productivity Everyone has to decide if they are part of the problem or part of the solution

© 2004 APC corporation. Network-Critical Physical Infrastructure (NCPI) Essential foundation of reliability

© 2004 APC corporation. Rack Power Implement designs with a completely scalable and modular approach at the rack level Rack Power delivery must be scalable in response to density variation Rack Power must be redundant (UPS N+1 or greater) Rack Power design must be completely flexible in configuration and voltage The Rack is the Basic Building Block of any IT deployment.

© 2004 APC corporation. Design the rack accordingly Rack Configuration: Select rack IT actual loads reflected in design Simulate 3 rd party equipment Model power Model airflow

© 2004 APC corporation. Scale & Manage Power at the Rack Switched Rack PDU Control individual outlets Turn unused outlets off Recycle power to locked-up equipment 1.4 kW kW, 15A - 50A, Horizontal or Vertical Mount Monitor current Avoid overloads Balance loads across phases Sequence power-on Avoid in-rush current Power high- density racks Multi-branch units supports 12.5kW Fit up to 4 units in one rack 42 outlets on one strip

© 2004 APC corporation. Manage at the Row / Room

© 2004 APC corporation. Rack Cooling Eliminate the unpredictable nature of traditional cooling architectures in dense environments Closely couple the IT load with cooling capacity Increase Capacity per rack Increase Cooling Efficiency Model the cooling requirements from day 1 and be prepared to adapt to change Power In equals Heat Out design in accordance with the dynamic nature of the load

© 2004 APC corporation. CFD model of in-row with Hot Aisle Containment: Modeling failure of one CRAC

© 2004 APC corporation. in real time during design Rack-by-rack airflow analysis for various failure conditions in real time during design

© 2004 APC corporation. Building Management System Enterprise Management System Network Devices Storage Devices Server Devices Server Manager Storage Manager Network Manager Building Power Comfort Air Building Environment Power Devices Rack Devices Cooling Devices InfraStruXure® Manager Integrate it all into Your Management Architecture Building Management System Integration Manage critical building infrastructure from single system via modbus RTU Enterprise Management System Integration Forward SNMP traps to your preferred management system Manage Network- Critical Physical Infrastructure Similar to server, storage and networking equipment. Scalability Manage up to 1000 APC networked devices

© 2004 APC corporation. Summary Man must sit in chair for very long time before roast duck fly in mouth… Chinese Proverb Take Action …understand the Rack Level challenges and design accordingly!

© 2004 APC corporation. And of course… Look out for the Shark!

© 2004 APC corporation. #130 #130 The Advantage of Row and Rack-Oriented Cooling Architectures for Data Centers #131 #131 Improved Chilled Water Piping Distribution Methodology for Data Centers #125 #125 Strategies for Deploying Blade Servers in Existing Data Centers #43 #43 Dynamic Power Variations in Data Centers and Network Rooms For further information on these topics consult APC white papers at