1 Université Laval, Calcul Québec, Calcul Canada Colosse Sun 6048 system 10 compute racks 960 nodes, 7680 cores 1 PB Lustre filesystem 1.

Slides:



Advertisements
Similar presentations
Upgrade of Jaguar from Cray XT5 to XK6 Cray Linux Environment operating system Gemini interconnect 3-D Torus Globally addressable memory Advanced synchronization.
Advertisements

Power Measurements on Mira Argonne Leadership Computing Facility Susan Coghlan Mira Project Manager Argonne National Laboratory June 18, 2012.
Harwood Union High School Board of Directors Presenters: Gabriela Meade and Lorne Nix Presented: April 25 th, 2007 Vermont Energy Education Program.
P1.3 Electrical Energy. Power Power (watts) = Energy Transferred (joules) Time (seconds) This means the more powerful something is, the more energy is.
KW Energy Solutions, LLC Increasing Energy Efficiency Increasing Energy Effectiveness.
Electrical energy consumption Section 9. Lighting 40 Watts 100 Watts 60 Watts.
Electrical Energy Use in the Home
12. 2 Using Electrical Energy Wisely. (Pages )
Wind Energy Basics The Kidwind Project
Wind Energy for Students The Kidwind Project Copyright 2008.
Welcome and Introductions CoServ Presentation & Member Input.
Household Electricity
Power Calculations Noadswood Science, 2011.
 POWER: the rate of change in energy; also the rate at which work is done or energy is transformed  JOULE (J): the unit for measuring energy  WATT.
Driving HPC energy efficiency  Energy Efficient HPC Working Group Forum for sharing of information Peer-to-peer exchange Best practices and case studies.
Ch Electricity IV. Measuring Electricity (p )  Electrical Power  Electrical Energy.
Joint OSPE – PEO Chapter Energy Policy Presentation Prepared by OSPE’s Energy Task Force 1.
© Oxford University Press 2011 IP Electricity meters Electricity meters.
Generating and Using Electricity
Book Reference : Pages To understand how electricity is distributed in the UK via the National Grid 2.To understand how transformers are used.
C-11 Energy Systems Energy Transformation and Power Physics 2015.
Power. Your Utilization of Electricity Have you ever heard the word Watt before? Have you ever used the word Kilowatt before? When? When a person is speaking.
Electrical Energy.  Electrical energy is the energy transferred to an electrical device by moving electrical charges. The energy used at home is measured.
Electricity Electrical Power & Energy. Electrical Energy Every major appliance sold in Canada has either an “Energy Star” or “EnerGuide” label. Shows.
Herbert Huber, Axel Auweter, Torsten Wilde, High Performance Computing Group, Leibniz Supercomputing Centre Charles Archer, Torsten Bloth, Achim Bömelburg,
Solar Energy By: Autumn Kutek DaJohnna Johnson Alex Lucketti
Paying for Electricity How much does it cost to watch T.V. for 2 hours?
Units Of Electricity Ashfield Direct Learning Holly Millar Ks4 Energy.
5.5 Power It takes time to change one form of energy into another. Physicists use the word power (P) to describe the rate at which energy is transformed,
Electrical Efficiency. Electrical Efficiency Electrical Energy Consumption: the amount of electrical energy used.
50th HPC User Forum Emerging Trends in HPC September 9-11, 2013
CHP & DG METERING & MONITORING IN NEW YORK STATE CASE STUDIES AND IMPLEMENTATIONS Presented By: STEPHEN STONE, PE DSM ENGINEERING ASSOCIATES, PC
Parking Lots 10 & 11. Child Care Parking Lot #12.
Patryk Lasoń, Marek Magryś
Understanding Small Wind David Ryan PE NCAT 3040 Continental Drive Butte, MT
Electrical Power & Efficiency.  I will be able to calculate cost to operate and percent efficiency of various devices.
#3.20 Aim: How does the sun make energy? Agenda QOD (5) Lesson: solar power (15) Activity: passive and active solar (15) Summary (5) HW #27 QOD : What.
Calculating Energy Use and Converting Units Chapter 2.
Topic 7: Measuring Electric Power. Getting electricity to your home Power generating station  transmission lines  home Step- up transformer Step- down.
Energy Consumption Energy consumption is measured in kilowatt. hours. A kilowatt hour is the amount of energy being consumed per hour. –Energy (kwh) =
ENERGY CONSERVATION. Measuring Energy Energy is the ability to do work. Can be measured by: 1. Newton (N) – unit of force needed to push/pull mass of.
Lighting Efficiency. Lighting Efficiency Problem Suppose that 25 incandescent light bulbs rated at 100 Watt are replaced by 25 fluorescent lamps rated.
PIC port d’informació científica First operational experience from a compact, highly energy efficient data center module V. Acín, R. Cruz, M. Delfino,
Energy Conservation. What is a Watt? Unit of measurement for power Amount of energy per time Used to measure amount of energy used Usually measured in.
Wind Energy Basics The Kidwind Project
Buying electricity. Calculating the units of electricity The amount of electrical energy (i.e. the amount of electricity) used by an appliance depends.
Energy Calculations Revision Energy = Power x Time (Joule) (Watt) (Second) Energy Power x Time Example 1: How much energy does a 40 Watt bulb use in 2.
Wind Energy Basics.
Electrical Power and Cost of Electricity
Less power consumption than running a light bulb.
bre Innovation Park Visitor Centre:
The Cost of Electricity
East Bay Community Energy Local Development Business Plan
Energy Sources and Demands
Electrical Calculations
Power, Electrical Energy and Efficiency
Solar City: Effect of Solar Technologies on Network Performance
SNC1D PHYSICS THE CHARACTERISTICS OF ELECTRICITY
9.2 The Power of Electricity
IV. Measuring Electricity
Does the Charge (kW) or the Discharge (kWh) drive the Cost
ENERGY CONSERVATION.
Energy Consumption at Home
Electrical power & efficiency
Facility Power Management
Energy Efficiency.
Comparing Efficiency VS.
Cost of Electricity & Energy Usage Energy Use Recall: Measured in Watts (W) Electrical power is the rate at which electrical energy is produced.
Presentation transcript:

1 Université Laval, Calcul Québec, Calcul Canada Colosse Sun 6048 system 10 compute racks 960 nodes, 7680 cores 1 PB Lustre filesystem 1

Where are we measuring? 2 Université Laval, Calcul Québec, Calcul Canada 2 600V 3p 208V 3p UPS distribution panels 60kW lighting pumps transformers compute storage compute... metered rack PDU 40 PDUs total 1.2 MW electrical distribution Energy meter (kWh) Rack level power meters (W)... A- Electrical distribution meter Siemens 9330 power meter PRO: measures kWh, qualifies for L3 measurement CON: cannot isolate compute nodes B- Rack PDU APC 7866 metered PDU PRO: measures (almost) compute only CON: instantaneous kW only Selected A in order to achieve a L3 measurement

3 Université Laval, Calcul Québec, Calcul Canada HPL run on May 23 3 Energy measurement period: 30 s Core phase duration: s Application avg. power WCore phase avg. power WIdle period avg. power W

4 Université Laval, Calcul Québec, Calcul Canada Comments (1) 4 ~7h Ramping up, remplacing bad parts One node crashed Successful run Running HPL is expensive: One run lasts for several hours; Increases maintenance window significantly; Consumes a lot of energy to measure energy efficiency... :-/ For power measurement, a shorter benchmark would be beneficial Make it easier for a site in production to apply the new measurement methodology; Lower impact on downtime during a maintenance.

5 Date/Time,kWh imp,kWh exp,kWh net,kVARh imp,kVARh exp,kVARh net,kVAh imp,kW swd,kVAR swd,kVA swd,I avg swd,PF sign mean23/05/ :49:00.000, , , , , , , , , , , , /05/ :49:30.000, , , , , , , , , , , , /05/ :50:00.000, , , , , , , , , , , , /05/ :50:30.000, , , , , , , , , , , , /05/ :51:00.000, , , , , , , , , , , , /05/ :51:30.000, , , , , , , , , , , , /05/ :52:00.000, , , , , , , , , , , , /05/ :52:30.000, , , , , , , , , , , , /05/ :53:00.000, , , , , , , , , , , , /05/ :53:30.000, , , , , , , , , , , , /05/ :54:00.000, , , , , , , , , , , , /05/ :54:30.000, , , , , , , , , , , , /05/ :55:00.000, , , , , , , , , , , , /05/ :55:30.000, , , , , , , , , , , , /05/ :56:00.000, , , , , , , , , , , , /05/ :56:30.000, , , , , , , , , , , , /05/ :57:00.000, , , , , , , , , , , , /05/ :57:30.000, , , , , , , , , , , , /05/ :58:00.000, , , , , , , , , , , , /05/ :58:30.000, , , , , , , , , , , , /05/ :59:00.000, , , , , , , , , , , , /05/ :59:30.000, , , , , , , , , , , , /05/ :00:00.000, , , , , , , , , , , , /05/ :00:30.000, , , , , , , , , , , , /05/ :01:00.000, , , , , , , , , , , , /05/ :01:30.000, , , , , , , , , , , , /05/ :02:00.000, , , , , , , , , , , , /05/ :02:30.000, , , , , , , , , , , , /05/ :03:00.000, , , , , , , , , , , , /05/ :03:30.000, , , , , , , , , , , , /05/ :04:00.000, , , , , , , , , , , , /05/ :04:30.000, , , , , , , , , , , , /05/ :05:00.000, , , , , , , , , , , , /05/ :05:30.000, , , , , , , , , , , , Université Laval, Calcul Québec, Calcul Canada Comments (2) Direct access to the power/energy meter Turned out to be a very important point for us to achieve a L3 measurement Even better would be to have energy metering at the rack level Should be a HPC site design recommendation? 5 Ethernet