© Crown copyright Met Office Technical developments at the Met Office Matthew Glover
© Crown copyright Met Office
Overview Data Centre DC power Cooling Coupled models Components Coupling Unified Model IO server NEMO-CICE Direct coupling
© Crown copyright Met Office The Met Office National Weather Service for the UK Climate Prediction (Met Office Hadley Centre) Operational and Research activities About 1,700 staff in 60 locations around the world
Collaboration
© Crown copyright Met Office The same model formulation is used for all models from climate scale to mesoscale The Unified Model Climate modelling: input into IPCC reports (Coupled Atmosphere-Ocean models) Seasonal forecasting: For commercial and business customers NWP: Public Weather Service WAFC, Commercial ……
© Crown copyright Met Office Data Centre
© Crown copyright Met Office Energy efficiency Supercomputer on DC power Free cooling Cold aisle containment Efficient cooling at lower power - motor efficiency
© Crown copyright Met Office IBM Phase2 Timescales: Frames accepted
© Crown copyright Met Office Coupling
© Crown copyright Met Office Coupling Schematic Simple example – 2 component system Atmos OASIS3 Ocean
© Crown copyright Met Office HadGEM3 Schematic UM Atmos OASIS3 NEMO Ocean CICE Sea ice
© Crown copyright Met Office Pseudo Parallel OASIS3 You can use more than one instance of OASIS3 Work is divided by field – i.e. TASK PARALLELISM e.g. instance 0 deals with SST and heat flux instance 1 deals with U, V and PME instance 2 deals with ice thickness and river runoff NEMO-CICE Atmos OASIS3
© Crown copyright Met Office Couplers
© Crown copyright Met Office Unified Model - IO Server
© Crown copyright Met Office N512 scalability – Nov 2010 Figure 1
© Crown copyright Met Office N512 scalability – Cray XE6 Thanks: Pier Luigi Vidale, NCAS. Climate model (atmosphere only) Preparation for real science on PRACE XE6
© Crown copyright Met Office Data output inhibits scaling Thanks to Martyn Foster for this plot
© Crown copyright Met Office Older I/O I/O
© Crown copyright Met Office I/O Server I/O
© Crown copyright Met Office Key design considerations Output units distributed over servers Server is threaded “Listener” receives data & puts in queue “Writer” processes queue including packing Ensures asynchronous behaviour First-in, first-out (FIFO) queue Preserves instruction order Metadata/Data split Data initially stored on compute processes Enables more data “in-flight” Data of same type combined into large messages
© Crown copyright Met Office How data gets output ComputeI/O ListenerWriter Thread 0 Thread 1
© Crown copyright Met Office Overloaded servers
© Crown copyright Met Office Well tuned…
© Crown copyright Met Office What savings do we get? 19%28%33%10%
© Crown copyright Met Office Nemo-Cice coupling
© Crown copyright Met Office Sea ice decomposition
© Crown copyright Met Office Nemo-Cice decomposition
© Crown copyright Met Office Direct coupling
© Crown copyright Met Office Direct vs Indirect – timings
© Crown copyright Met Office Direct vs Indirect – scaling
© Crown copyright Met Office Summary Data Centre DC power Free cooling; Cold aisle containment; Cooling motor efficiency Unified Model IO server Encouraging scaling on Cray XE6 NEMO-CICE Direct coupling Coupling Short term: Oasis3 Longer: continue with Oasis4?
© Crown copyright Met Office Questions and answers