Testing multicomponent multiphysics climate models

Slides:



Advertisements
Similar presentations
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech.
Advertisements

Part 1a: Overview of the UM system
NCAS Unified Model Introduction Part 5: Finale University of Reading, 3-5 December 2014.
1 CW2015, Manchester, 04/ Working Session II - Future Issues Working Session II – Future Issues: interoperability, sharing of models/infrastructure,
Part 5: Rose and shared repositories
NCAS Unified Model Introduction Part 1a: Overview of the UM system University of Reading, 3-5 December 2014.
© Crown copyright Met Office SRNWP Interoperability Workshop, ECMWF, January 2008 SRNWP Interoperability Terry Davies Met Office.
CGAM Running the Met Office Unified Model on HPCx Paul Burton CGAM, University of Reading
Copyright © 2008 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Computer Science: An Overview Tenth Edition by J. Glenn Brookshear Chapter.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
© Crown copyright Met Office Atmosphere-Chemistry Model Coupling in the UK Earth System Model (UKESM) Richard Hill, April 2015 Credits: Marc Stringer,
1 CW 2015, Manchester, 04/ Coupling technology benchmarking in IS-ENES2 Coupling technology benchmarking in IS-ENES2 IS-ENES2 WP10-T3 Evaluation.
Overview of the Infrastructure Jim Mather. Overview Objectives ARM Climate Research Facility Concept Organization Roles and Responsibilities Management.
Using ICENI to run parameter sweep applications across multiple Grid resources Murtaza Gulamali Stephen McGough, Steven Newhouse, John Darlington London.
1 Monday, 26 October 2015 © Crown copyright Met Office Computing Update Paul Selwood, Met Office.
SUPERCOMPUTING CHALLENGE KICKOFF 2015 A Model for Computational Science Investigations Oct 2015 © challenge.org Supercomputing Around.
Migration to Rose and High Resolution Modelling Jean-Christophe Rioual, CRUM, Met Office 09/04/2015.
1 PRogramme for Integrated earth System Modelling (PRISM) An Infrastructure Project for Climate Research in Europe.
Page 1© Crown copyright 2004 The Hadley Centre The forcing of sea ice characteristics by the NAO in HadGEM1 UK Sea Ice Workshop, 9 September 2005 Chris.
Figure 11.1 The overlap of DMS and PDM functions. © 2003 Crnkovic, Asklund, Persson Dahlqvist, ”Implementing and Integrating Product Data Management and.
CCSM Performance, Successes and Challenges Tony Craig NCAR RIST Meeting March 12-14, 2002 Boulder, Colorado, USA.
Page 1© Crown copyright 2004 FLUME Marco Christoforou, Rupert Ford, Steve Mullerworth, Graham Riley, Allyn Treshansky, et. al. 19 October 2007.
Welcome to the PRECIS training workshop
Page 1© Crown copyright 2005 Met Office plans for sea ice model development within a flexible modelling framework Helene Banks Martin Best, Ann Keen and.
Sol-Terra: A Roadmap to Operational Sun-to- Earth Space Weather Forecasting Mike Marsh 1, David Jackson 1, Alastair Pidgeon 2, Gareth Lawrence 2, Simon.
The Community Climate System Model (CCSM): An Overview Jim Hurrell Director Climate and Global Dynamics Division Climate and Ecosystem.
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech 5 th GO-ESSP Community Meeting.
Design with Vivado IP Integrator
QESM: The QUEST Earth System Manoj Joshi, Jonathan Gregory, Allan Spessa, Annette Wallingford: Eleanor Blyth, Doug
School of Earth and Environment INSTITUTE FOR CLIMATE AND ATMOSPHERIC SCIENCE The UK Chemistry and Aerosol Project (UKCA)
© Crown copyright Met Office Technical developments at the Met Office Matthew Glover.
Experiences and Decisions in Met Office coupled ESM Development
CMIP6 Catherine Senior C Senior, WGRC Montevideo, 14th March 2014
Overview of climate configurations of the UM
How To Apply Quality Management
Software Engineering (CSI 321)
Introduction to Nesting suite
Plans for Met Office contribution to SMOS+STORM Evolution
GPC-Seoul: Status and future plans
Catherine Senior WGCM-19, October 19th 2015
UNIFIED GLOBAL COUPLED SYSTEM (UGCS) FOR WEATHER AND CLIMATE PREDICTION Saha-UMAC-09Aug2016.
Evaluation of a scheme representing cloud inhomogeneous structure in the Australian Community Climate and Earth System Simulator (ACCESS)
A sensitivity study of the sea ice simulation in the global coupled climate model, HadGEM3 Jamie Rae, Helene Hewitt, Ann Keen, Jeff Ridley, John Edwards,
The Earth Simulator System
Testing multicomponent multiphysics climate models
Monsoon, NEXCS and access to MASS
Dave Bi, Peter Dobrohotoff, Arnold Sullivan
UM Science Configurations
ACCESS NWP Version Releases
Applied Software Implementation & Testing
Weather forecasting in a coupled world
What is a Climate Model?.
Mariana Vertenstein (CGD)
Unified Model I/O Server : Recent Developments and Lessons
What is a Climate Model?.
UM Science Configurations
Systems Engineering for Mission-Driven Modeling
Systems Construction and Implementation
Climate change mash-ups
The ACCESS-CM2 rose/cylc suite
Systems Construction and Implementation
GloSea4 – the new Met Office Hadley Centre seasonal forecast system
Metadata Development in the Earth System Curator
AGREPS – ACCESS Global and Regional EPS
GA 7.1 n216 Scott Wales & Holger Wolff ARCCSS CMS
Overview Activities from additional UP disciplines are needed to bring a system into being Implementation Testing Deployment Configuration and change management.
Executable Specifications
Marina Tonani Manager Shelf Seas Forecasting
Implementation Plan system integration required for each iteration
Presentation transcript:

Testing multicomponent multiphysics climate models Stephen Haddad, Scientific Software Engineer 7 September 2017 www.metoffice.gov.uk © Crown Copyright 2017, Met Office

Introduction & Overview Introduction: Testing to verify reproducible climate model output Overview: Met Office Hadley Centre (MOHC) climate models Initial state of development and testing Model Restartability Future developments www.metoffice.gov.uk © Crown Copyright 2017, Met Office

MOHC Models – HadGEM3 Scientific configurations GA7, GL7, GO6, GSI8, GC3.1 Component applications & libraries UM, NEMO, CICE Auxiliary: XIOS, oasis3-mct Workflow: rose, post-processing, drivers Developed by consortia www.metoffice.gov.uk © Crown Copyright 2017, Met Office

NEMO UM CICE JULES XIOS UM IOS, Stash Main technical components OASIS3- MCT Cycling CICE JULES Archiving, Post-processing X nodes Y nodes Main technical components Embedded components Increased Technicality Rose suites Coupler IO subsystems www.metoffice.gov.uk © Crown Copyright 2017, Met Office

Development hierarchy Global Coupled (GC3) Global Atmosphere (GA7) Unified Model Global Land-use (GL7) Jules Global Ocean (GO6) NEMO Global Sea (GSI8) CICE www.metoffice.gov.uk © Crown Copyright 2017, Met Office

Initial State of Models Rigorous, formal, operational forecast requirements UM, NEMO Informal, research-oriented CICE, XIOS, scientific configurations Disparity between tests and climate experiments Goal: check technical requirements of coupled model Starting point: state of atmosphere model www.metoffice.gov.uk © Crown Copyright 2017, Met Office

Testing Scientific Software Validation vs Verification Scientist – validation: Model correctly describes physical processes SSE – verification Model is correctly implemented Meets technical requirements e.g. performance, restartability www.metoffice.gov.uk © Crown Copyright 2017, Met Office

Bit-comparable output LRUN CRUN NRUN Day TS Day TS Day TS Restarting a model 1 1 1 1 1 1 6 161 6 1 10 320 Simulation broken into cycle Quick and full restart modes Cycle length arbitrary, technical Identical output for different modes Checkpoint restart driven by scientific needs 11 321 11 321 11 1 16 481 16 1 20 640 21 641 21 641 21 1 26 721 26 1 30 960 Bit-comparable output www.metoffice.gov.uk © Crown Copyright 2017, Met Office

Implementing restart tests Component tests (rose stem tests) Small and fast Run frequently Climate experiment (suite tests) Closer to actual configuration More resource-hungry www.metoffice.gov.uk © Crown Copyright 2017, Met Office

Implementation Challenges Getting scientists to understand there is a problem! Missing documentation Additional bugs www.metoffice.gov.uk © Crown Copyright 2017, Met Office

Current state Restart tests in components and model configuration Nightly tests to verify new developments www.metoffice.gov.uk © Crown Copyright 2017, Met Office

Future work Testing additional models & requirements UK Earth System Model (UKESM) Processor decomposition Exascale programme – Lfric Talk by Matthew Hambley www.metoffice.gov.uk © Crown Copyright 2017, Met Office

Conclusion and questions www.metoffice.gov.uk © Crown Copyright 2017, Met Office