ESMF and the future of end-to-end modeling Sylvia Murphy National Center for Atmospheric Research

Outline What is ESMF What is Curator Towards an Earth System Modeling Infrastructure ESMF and the advent of self-describing models Metadata lifecycle Curator and ESG support to a NCAR summer 2008 colloquium on atmospheric dynamical cores Demonstration: – How to search for dynamical cores – How to look at models, simulations, and experiments – How to create a comparison table

What is ESMF? The components can be reused in different contexts and shared by multiple research and operational centers. ESMF also provides toolkits for common modeling functions, so modelers don’t need to develop those utilities independently. The Earth System Modeling Framework (ESMF) wraps model components with standard calling interfaces, and provides tools for coupling them together.

Features and News The Flow-Following Finite Volume Icosahedral Model (FIM) from NOAA GSD is converting to ESMF to couple to National Weather Service models ESMF v3.1.1 beta release includes – unstructured mesh class – observational data streams – on-line parallel regridding – standard metadata packets Many (current count: 76) ESMF science components in diverse domains Consortium of U.S. operational and research centers (NOAA, NASA, DoD) is implementing next generation U.S. weather prediction system as a multi-model global ensemble of ESMF components ESMF parallel regrid: Grid-Grid, Grid-Mesh, Mesh-Mesh Bilinear and higher order National Unified Operational Prediction Capability

Performance Portability 30+ platform/compiler combinations regression tested nightly, new ports include gfortran (4.3) and Solaris Performance at the petascale… The chart at right shows scaling of the ESMF sparse matrix multiply, used in regridding transformations, out to 16K processors. (ESMF v3.1.0rp2) msec ASMM Run-Time Comparison Plot from Peggy Li, NASA/JPL. Tested on ORNL XT4 in a variety of configurations. -N1 means 1 core per node.

Curator Has built a prototype web portal that links model components and data together via metadata. The portal: – enables model components, models, simulations, experiments, and data to be searched and browsed (using ESG faceted search) – provides new tools to support model and component inter-comparison projects – implements dataset “trackback” - connecting datasets with detailed information about the models used to create the data

Earth System Modeling Infrastructure ESMF data structures and standardized interfaces Interoperability Tools Workflow Metadata XML Web services System Configuration Database Search/Browse Compare Download Other tools

ESMF XML Output (example) ……

Metadata Lifecycle Slide from Rocky Dunlap, Georgia Institute of Technology

Numerical Techniques for Global Atmospheric Models Colloquium Numerical Techniques for Global Atmospheric Models Colloquium 9 atmospheric dynamical core components Running 22 test cases at up to 5 resolutions Component comparison table Automated upload of simulation data, publishing, and comparison Data search and browse via ESG Gateway

Workshop Gateway

Table Comparison

Table Comparison Details Select model components Select criteria Table generated dynamically Eventually selections can be placed in a user’s saved workspace

Example Table Results

Search Interface

Trackback Page

Questions?