SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA, SAN DIEGO Green Datacenter Initiatives at SDSC Matt Campbell SDSC Data Center Services Manager

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA, SAN DIEGO SDSC Data Center Overview 19,000 sq ft 13 MW of on-site power 100+ projects operating IT equipment in data center

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA, SAN DIEGO Key Points How do we illustrate energy loss and quantify savings? Establishing a common unit of measurement for data centers What areas can be improved? Mechanical Electrical IT equipment

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA, SAN DIEGO Power Usage Effectiveness PUE = Industry accepted unit of measurement 2+ is still the data center industry norm SDSCs datacenter came was audited last year with a resulting PUE of 1.35 – Systems located at SDSC would save 28-65% on energy alone! Total Facility Power IT Equipment Power

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA, SAN DIEGO Energy Savings Multiply Courtesy Jack Pouchet, Emerson

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA, SAN DIEGO Working on Many Fronts Air handling retrofit with variable frequency drive fans and modulating chilled water valves to match cooling to real-time loads. High-efficiency UPS Retrofit Cold / Hot Aisle Containment Free Cooling Opportunities Efficient System Lifecycles Distributing Higher-Voltage (277/480V) Power to the floor to reduce transformer and distribution losses. Experimenting with DC-Only Power Distribution Distributing Higher-Voltage (277/480V) Power to the floor to reduce transformer and distribution losses. Experimenting with DC-Only Power Distribution

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA, SAN DIEGO Data Center Improvements to Lower PUE Mechanical Systems Aisle containment CRAH VFD retrofits Blanking panels, floor brushes Electrical Systems High efficiency UPS System Lifecycles Virtualization Consolidation of ghost servers

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA, SAN DIEGO Cold/Hot Aisle Containment Cold Aisle Containment Knuerr Coolflex First deployment in the United States Requires a standardized datacenter Enclosed cold aisles (70-78F) Servers exhaust to room as a whole, which runs hot (90-100F) Hot Aisle Containment Essentially a heat chimney on top of hot aisles with doors at each end. Flexible, can be phased incrementally Cold room as a whole (70-78F) Exhaust to enclosed hot aisle (100+F), ducting directly to cooling systems Expect 50-80% better cooling airflow efficiency than traditional hot/cold aisle Separates cold/hot air, eliminating the need for over-cooling, over-blowing Allows for high temperature differentials, maximizing efficiency of cooling equipment

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA, SAN DIEGO Filling In The Gaps Brushes to cover tile cutouts Allows cables to pass through while blocking air Cost effective blanking panels Minimizes leakage

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA, SAN DIEGO CRAH VFD Retrofits Added variable frequency drives to computer room air handlers Allows CRAH units to modulate based on control signal

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA, SAN DIEGO Electrical Systems High efficiency UPS units that can save ~500,000 kWh/year Higher voltage to IT equipment Providing 277/480V power on the floor to more efficiently power HPC systems without transformer and distribution losses Exploration of DC power for IT equipment

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA, SAN DIEGO Hardware Lifecycle Efficiency Hardware retirement Equipment refresh more often leverages technology improvements Virtualization Maximize equipment utilization Consolidation of ghost servers Underutilized IT equipment Forgotten equipment

SAN DIEGO SUPERCOMPUTER CENTER at the UNIVERSITY OF CALIFORNIA, SAN DIEGO QUESTIONS?