Federal Data Center Programs 7 X 24 Exchange October, 2007 William Tschudi

Acknowledgement of LBNL sponsors California Energy Commission – PIER program California Energy Commission – PIER program Pacific Gas and Electric Company Pacific Gas and Electric Company New York State Energy and Development Agency (NYSERDA) New York State Energy and Development Agency (NYSERDA) US - Environmental Protection Agency US - Environmental Protection Agency US – Department of Energy US – Department of Energy

LBNL data center activities Research Roadmap Research Roadmap Benchmarking and 23 data center case studies Benchmarking and 23 data center case studies Self-benchmarking protocol Self-benchmarking protocol Power supply &UPS efficiency studies Power supply &UPS efficiency studies Standby generation losses Standby generation losses Performance metrics – Computation/watt Performance metrics – Computation/watt Demonstration projects Demonstration projects EPA report to Congress EPA report to Congress DOE Save Energy Now program DOE Save Energy Now program

Data center energy roadmap July, 2003 – Research roadmap developed for the California Energy Commission July, 2003 – Research roadmap developed for the California Energy Commission The problem receded for several years as excess data center space was absorbed The problem receded for several years as excess data center space was absorbed Now the concerns are back Now the concerns are back

Current LBNL CA focus Developing LEED TM type criteria for data centers Developing LEED TM type criteria for data centers Evaluating modular and scalable cooling solutions Evaluating modular and scalable cooling solutions Promoting use of air economizers Promoting use of air economizers –study filtration options –research failure modes –collaborate with ASHRAE Demonstrating spray cool technology Demonstrating spray cool technology Continuing DC power initiative Continuing DC power initiative

Current LBNL internal focus Designing new supercomputing facility Designing new supercomputing facility Goal - a model of energy efficiency Goal - a model of energy efficiency –Convened workshop of all supercomputer vendors –Better projections of future power needs –Pushing the envelop – environmental conditions, power distribution Leading scientific computing facility Leading scientific computing facility First hand exposure to barriers First hand exposure to barriers

Current LBNL Federal focus EPA activities EPA activities –Report to Congress follow-on –Energy Star server spec –Energy Star buildings – data center metric DOE activities DOE activities –EERE - Save Energy Now Pilot assessments Pilot assessments Profiler tool Profiler tool Assessment tools Assessment tools –FEMP – Technical assistance

Why Data Centers? Highly energy-intensive and rapidly growing Highly energy-intensive and rapidly growing Consume 10 to 100 times more energy per square foot than a typical office building Consume 10 to 100 times more energy per square foot than a typical office building Large potential impact on electricity supply and distribution Large potential impact on electricity supply and distribution Used about 45 billion kWh in 2005 Used about 45 billion kWh in 2005 At current rate, power requirements could double in 5 years. At current rate, power requirements could double in 5 years.

Where do data centers fit in? Data centers are energy intensive facilities Data centers are energy intensive facilities –Server racks now designed to carry 25 kW or more –Typical facility ~ 1MW, but can be > 20 MW Information factories Information factories –Nationally 1.5% of US Electricity consumption in 2006 Could double in next 5 years Could double in next 5 years Critical national and global infrastructure Critical national and global infrastructure –Few technology barriers to increased efficiency –Good candidates for efficiency investments by utilities to reduce peak loads

IT equipment load density – LBNL benchmark results

Rising cost of ownership Rising cost of ownership From 2000 – 2006, computing performance increased 25x but energy efficiency only 8x From 2000 – 2006, computing performance increased 25x but energy efficiency only 8x –Amount of power consumed per $1,000 of server spending has increased 4x Cost of electricity and supporting infrastructure now surpasses capital cost of IT equipment Cost of electricity and supporting infrastructure now surpasses capital cost of IT equipment Perverse incentives --- IT and facilities costs separate Perverse incentives --- IT and facilities costs separate Source: The Uptime Institute, 2007

IT Industry is taking action

What is US Government’s role? EPA & DOE want to be the catalyst EPA & DOE want to be the catalyst –Stimulate competition on energy efficiency –Foster discussions between key stakeholders –Provide key recommendations (EPA Report to Congress) –Develop standardized protocols and metrics to measure energy consumption (e.g., ENERGY STAR) Take the lead on assessing and implementing best practices in federal datacenters Take the lead on assessing and implementing best practices in federal datacenters Promote initiatives globally Promote initiatives globally

Findings from EPA report to Congress Trends in data center energy use Sector consumed about 61 billion KWh in 2006 Sector consumed about 61 billion KWh in 2006 –Equates to ~1.5% total U.S. electricity consumption and ~$4.5 billion –Federal sector: ~6 billion kWh and ~$450 million Projected to increase to 100 billion kWh in 2011 Projected to increase to 100 billion kWh in 2011 –Equates to ~2.5% of total U.S. electricity consumption and ~$7.4 billion

Projected electricity use Various scenarios

Percentage of electricity delivered to IT equipment Average.57 Higher is better Source: LBNL Benchmarking

Data Center total electrical demand/ IT equipment demand Average 1.83 Lower is better Source: LBNL Benchmarking

LBNL design target LBNL’s new supercomputer facility is being designed to achieve a ratio of 1.2

EPA report recommendations Standardized performance measurements for IT equipment and data centers Standardized performance measurements for IT equipment and data centers –Development of benchmark/metric for data centers –ENERGY STAR label for servers Leadership by Federal Government Leadership by Federal Government –Publicly report energy performance of datacenters –Conduct energy efficiency assessments in all datacenters in 2-3 years –Architect of the Capital, implement server-related recommendations in Greening of the Capital report

Recommendations cont. Private sector challenge Private sector challenge –CEOs conduct DOE Save Energy Now energy efficiency assessments, implement measures, and report performance Information on best practices Information on best practices –Raise awareness and reduce perceived risk of energy efficiency improvements in datacenter –Government partner with private industry: case studies, best practices Research and development Research and development –Develop technologies and practices for datacenter energy efficiency (e.g., hardware, software, power conversion)

DOE data center program objectives Build tools, expertise, and strategy in collaboration with industry Build tools, expertise, and strategy in collaboration with industry Raise awareness of the opportunity Raise awareness of the opportunity Recognize industry leaders Recognize industry leaders

DOE program strategy Build on Save Energy Now model Build on Save Energy Now model –DOE deployed software tools, training curriculum, and qualified experts to train and work with staff at large U.S. industrial plants. –65% of recommended actions now completed, in progress, or planned. With industry input, develop appropriate tools, training, and qualified experts to improve data centers. With industry input, develop appropriate tools, training, and qualified experts to improve data centers. Conduct pilots, peer reviewed by industry, promote and facilitate industry implementation. Conduct pilots, peer reviewed by industry, promote and facilitate industry implementation.

Data center program Build on Save Energy Now model Build on Save Energy Now model With industry input, develop appropriate tools, training, and qualified experts to improve data centers. With industry input, develop appropriate tools, training, and qualified experts to improve data centers. Conduct pilots, peer reviewed by industry, promote and facilitate industry implementation. Conduct pilots, peer reviewed by industry, promote and facilitate industry implementation.

DOE near term plan Build strong liaisons and partnerships with industry Develop robust new energy assessment program Begin to develop tools and info on best practices –Assessment framework and energy profiling tool – System level assessment protocol and analysis tools Partner with industry – joint development/peer review Conduct pilot assessments Provide awareness training Screen for demonstration opportunities Update Federal procurement specifications

Server Load/ Computing Operations Cooling Equipment Power Conversion & Distribution Alternative Power Generation High voltage distribution Use of DC power Highly efficient UPS systems Efficient redundancy strategies Load management Server innovation Energy efficiency opportunities are everywhere Better air management Move to liquid cooling Optimized chilled-water plants Use of free cooling On-site generation Waste heat for cooling Use of renewable energy/fuel cells

Potential benefits of improved data center energy efficiency Save 20 billion kWh per year by 2015 Save 20 billion kWh per year by 2015 –Worth $2 billion, ≈ annual electricity use in 1.8 million American homes Potentially defer need to build 2,300 MW of new generating capacity Potentially defer need to build 2,300 MW of new generating capacity –Avoid 3.4 million metric tons of carbon emissions (like taking 675,000 cars off the road) Extend life and capacity of existing data center infrastructures Extend life and capacity of existing data center infrastructures

Typical data center energy end use Server Load /Computing Operations Cooling Equipment Power Conversions & Distribution 100 Units 33 Units Delivered 35 Units

Performance varies The relative percentages of the energy actually doing computing varied considerably. Source: LBNL case studies

U.S. data center energy efficiency goal by 2011 Industry, DOE and partners perform 1,000 Save Energy Now assessments using a common protocol and tool suite to yield savings of 5 billion kWh per year Industry, DOE and partners perform 1,000 Save Energy Now assessments using a common protocol and tool suite to yield savings of 5 billion kWh per year Industry-DOE energy efficiency campaign saves an additional 20 billion kWh per year Industry-DOE energy efficiency campaign saves an additional 20 billion kWh per year Total energy savings of 25 billion kWh per year by 2011; 25% below current trends, which yields: Total energy savings of 25 billion kWh per year by 2011; 25% below current trends, which yields: -$2 billion of electricity cost savings -carbon emission reduction of 5 MTCEE; equal to the emissions from 3.5 million cars -All the electricity consumed in the state of Utah in one year

Web-based resources Good starting point for those seeking efficiency measures Best Practices Case Studies Design Guidance Self-benchmarking Guide Benchmark data Other Reports (demonstrations)

Additional resources Guides available through PG&E’s Energy Design Resources Website

How can industry participate? Participate in EPA and DOE workshops Participate in EPA and DOE workshops Participate in peer review of products, protocols and best practices Participate in peer review of products, protocols and best practices Conduct self-benchmarking and report results Conduct self-benchmarking and report results – Use tools from LBNL site and download protocol at: Participate in DOE data center energy efficiency program Participate in DOE data center energy efficiency program –Register on web site to get regular updates

Paul Scheihing Contacts Andrew Fanara Bill Tschudi

websites: