Climate Data Assimilation Weather Earth System Modeling Framework (ESMF) Community Meeting, 2006. DODNSFDOENASANOAA.

Slides:



Advertisements
Similar presentations
A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
Advertisements

NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH Arlindo da Silva, NASA/GSFC/GMAO The Earth System Modeling Framework.
NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH Emergence of the Earth System Modeling Framework NSIPP Seasonal Forecast.
Earth System Curator Spanning the Gap Between Models and Datasets.
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech.
Feature Analysis of Coupling Technologies for Climate Models Spencer Rugaber, Rocky Dunlap and Leo Mark College of Computing Georgia Institute of Technology.
Integrated Frameworks for Earth and Space Weather Simulation Timothy Killeen and Cecelia DeLuca National Center for Atmospheric Research, Boulder, Colorado.
1 ESMF in Production at NCEP Mark Iredell Chief NCEP/EMC Global Climate and Weather Modeling Branch May 23, 2006 NCEP: “where America’s climate, weather,
Mesoscale & Microscale Meteorological Division / NCAR ESMF and the Weather Research and Forecast Model John Michalakes, Thomas Henderson Mesoscale and.
1 NCEP Mark Iredell Chief NCEP/EMC Global Climate and Weather Modeling Branch May 23, 2006 NCEP: “where America’s climate, weather, and ocean services.
The NASA Modeling, Analysis and Prediction (MAP) Modeling Environment Don Anderson NASA HQ Sience Mission Directorate Earth-Sun Division Manager, Modeling,
Coupling Climate and Hydrological Models Interoperability Through Web Services Kathy Saint/SGI – NESII Jon Goodall/University of South Carolina Richard.
Components and Concurrency in ESMF Nancy Collins Community Meeting July 21, GMAO Seasonal.
NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT Adoption and field tests of M.I.T General Circulation Model (MITgcm) with ESMF Chris Hill ESMF.
NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH First Field Tests of ESMF GMAO Seasonal Forecast NCAR/LANL CCSM NCEP.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
Project Overview GMAO Seasonal Forecast NCAR/LANL CCSM NCEP Forecast GFDL FMS Suite MITgcm NASA GMAO Analysis Climate Data Assimilation.
An Introduction to Software Architecture
Science Computing BranchGoddard Space Flight Center Code 930 Support for GMI Tom Clune (NASA) Bigyani Das (CSC) Jae-Hoon Kim (CSC)
What is ESMF and what does it mean to adopt it? 3 rd ESMF Community Meeting Cecelia DeLuca Nancy Collins
Metadata for the Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS) using the Earth System Modeling Framework (ESMF) Peter Bosler University.
NE II NOAA Environmental Software Infrastructure and Interoperability Program Cecelia DeLuca Sylvia Murphy V. Balaji GO-ESSP August 13, 2009 Germany NE.
ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather.
Computational Design of the CCSM Next Generation Coupler Tom Bettge Tony Craig Brian Kauffman National Center for Atmospheric Research Boulder, Colorado.
Initial Results from the Integration of Earth and Space Frameworks Cecelia DeLuca/NCAR, Alan Sussman/University of Maryland, Gabor Toth/University of Michigan.
Architecting Web Services Unit – II – PART - III.
Overview of ESMF in the Community Climate System Model (CCSM) Erik Kluzek NCAR -- CCSM Software Engineering Group (CSEG) Erik Kluzek NCAR -- CCSM Software.
ESMF Code Generation Rocky Dunlap Spencer Rugaber Leo Mark Georgia Tech College of Computing.
ESMF Application Status GMAO Seasonal Forecast NCAR/LANL CCSM NCEP Forecast GFDL FMS Suite MITgcm NCEP/GMAO Analysis Climate Data Assimilation.
The use of modeling frameworks to facilitate interoperability Cecelia DeLuca/NCAR (ESMF) Bill Putman/NASA GSFC (MAPL) David Neckels/NCAR.
4.2.1 Programming Models Technology drivers – Node count, scale of parallelism within the node – Heterogeneity – Complex memory hierarchies – Failure rates.
February 2012 Milestone Materials Implicit coupling design document NUOPC Layer software prototype bundled with ESMF Updated NUOPC Layer reference manual.
USE OF ESMF IN THE GEOS-5 MODELING AND ASSIMILATION SYSTEM GEOS-5 ESMF Design Overview THE GEOS-Generic Library 21 JULY 2005.
CESM/ESMF Progress Report Mariana Vertenstein NCAR Earth System Laboratory CESM Software Engineering Group (CSEG) NCAR is sponsored by the National Science.
Modeling Component-based Software Systems with UML 2.0 George T. Edwards Jaiganesh Balasubramanian Arvind S. Krishna Vanderbilt University Nashville, TN.
Earth System Modeling Framework Status Cecelia DeLuca NOAA Cooperative Institute for Research in Environmental Sciences University of Colorado, Boulder.
Regional Models in CCSM CCSM/POP/ROMS: Regional Nesting and Coupling Jon Wolfe (CSEG) Mariana Vertenstein (CSEG) Don Stark (ESMF)
Components, Coupling and Concurrency in the Earth System Modeling Framework N. Collins/NCAR, C. DeLuca/NCAR, V. Balaji/GFDL, G. Theurich/SGI, A. da Silva/GSFC,
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
Grid programming with components: an advanced COMPonent platform for an effective invisible grid © 2006 GridCOMP Grids Programming with components. An.
Portable Infrastructure for the Metafor Metadata System Charlotte Pascoe 1, Gerry Devine 2 1 NCAS-BADC, 2 NCAS-CMS University of Reading PIMMS provides.
Earth System Modeling Framework Python Interface (ESMP) October 2011 Ryan O’Kuinghttons Robert Oehmke Cecelia DeLuca.
Experimental El Niño/Southern Oscillation Predictions by the UCLA Atmospheric General Circulation Model (GCM) Coupled to the MIT and POP Oceanic GCMs using.
Strategic Plan Implementation Cecelia DeLuca/NCAR (ESMF) December 17, 2008 ESMF Board/Interagency Meeting.
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH May 15, 2003 Nancy Collins, NCAR 2nd Community Meeting, Princeton, NJ Earth System.
NCEP ESMF GFS Global Spectral Forecast Model Weiyu Yang, Mike Young and Joe Sela ESMF Community Meeting MIT, Cambridge, MA July 21, 2005.
Coupling protocols – software strategy Question 1. Is it useful to create a coupling standard? YES, but … Question 2. Is the best approach to make a single.
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 Cecelia DeLuca / NCAR 2 nd ESMF Community Meeting Princeton, NJ NSIPP Seasonal.
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH May 14, 2003 Nancy Collins, NCAR Components Workshop, Princeton, NJ Components in the.
ESMF Strategic Discussion Cecelia DeLuca NOAA ESRL/University of Colorado ESMF Executive Board/Interagency Meeting June 12, 2014.
Software Engineering Chapter: Computer Aided Software Engineering 1 Chapter : Computer Aided Software Engineering.
1 Accomplishments. 2 Overview of Accomplishments  Sustaining the Production Earth System Grid Serving the current needs of the climate modeling community.
Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.
ESMF,WRF and ROMS. Purposes Not a tutorial Not a tutorial Educational and conceptual Educational and conceptual Relation to our work Relation to our work.
Building Community and Capability through Common Infrastructure: ESMF and the Earth System Curator Cecelia DeLuca MAP Meeting College.
CCSM Software Engineering Update Tony Craig CCSM SEWG Meeting Feb 4, 2003.
Emergence of a Common Modeling Architecture for Earth System Science American Geophysical Union December 13, 2010 Cecelia DeLuca NOAA/CIRES.
From Use Cases to Implementation 1. Structural and Behavioral Aspects of Collaborations  Two aspects of Collaborations Structural – specifies the static.
The NOAA Environmental Modeling System at NCEP Mark Iredell and the NEMS group NOAA/NWS/NCEP Environmental Modeling Center June 12, 2014.
A TIME-GCM CAM Multi-executable Coupled Model Using ESMF and InterComm Robert Oehmke, Michael Wiltberger, Alan Sussman, Wenbin Wang, and Norman Lo.
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH C. DeLuca/NCAR, J. Anderson/NCAR, V. Balaji/GFDL, B. Boville/NCAR, N. Collins/NCAR,
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech 5 th GO-ESSP Community Meeting.
ETICS An Environment for Distributed Software Development in Aerospace Applications SpaceTransfer09 Hannover Messe, April 2009.
From Use Cases to Implementation 1. Mapping Requirements Directly to Design and Code  For many, if not most, of our requirements it is relatively easy.
A Quick Tour of the NOAA Environmental Software Infrastructure and Interoperability Group Cecelia DeLuca Dr. Robert Detrick visit March 28, 2012
GMAO Seasonal Forecast
Joint GEOS-Chem and NCAR Modeling Workshop:
An Introduction to Software Architecture
Metadata Development in the Earth System Curator
A brief introduction to NEMS
Presentation transcript:

Climate Data Assimilation Weather Earth System Modeling Framework (ESMF) Community Meeting, DODNSFDOENASANOAA

Today’s Agenda A reception from 5:30pm to 7:30pm in the same room as the Community Meeting, Chesapeake I and II. Tomorrow (May 24) Tomorrow (May 24) Sheraton Inner Harbor Room - Loch Raven 1

Climate Data Assimilation Weather Earth System Modeling Framework (ESMF): Introduction to ESMF and ESMF Components in the Community. ESMF Community Meeting, Baltimore, 2006 DODNSFDOENASANOAA

Outline What is ESMF? –ESMF components. Where is ESMF being used? –Components in production or being developed. What does it take to use ESMF? –Future directions

What is ESMF ESMF provides a software library for turning model codes into coupled components with standard interfaces and standard drivers. ESMF provides library of common infrastructure that components use for routine services such as data communications, regridding, time management and message logging. ESMF Infrastructure Data Classes: Bundle, Field, Grid, Array Utility Classes: Clock, LogErr, DELayout, Machine ESMF Superstructure AppDriver Component Classes: GridComp, CplComp, State User Provided Numerical/Science Code e.g ocean transport, optimization line search, atmospheric radiation. e.g. three model codes operating as coupled components – ESMF provides a parallel, scalable standard software platform to facilitate this coupling, including a programming model for coding drivers that steer individual component computations data structures for passing information between components This software is the core of the ESMF component model. Component 1 Component 2 Component 3

Graph of hypothetical ESMF app. in left panel. Numbers correspond hypothetical app. user code ESMF Component Model climate _comp ocn _comp atm _comp atm2ocn _coupler atm_phys _comp phys2dyn _coupler atm_dyn _comp Hypothetical application on parallel machine _comp _coupler gridded components coupler components hierarchy components Provides machinery for coding a hierarchy of interacting components coupler components, e.g. ocm2atm_coupler and gridded components, e.g. atm_phys_comp Machinery includes general-purpose mechanisms to code “wirings” between components ( ESMF_State, ESMF _ regrid() ) general purpose mechanisms to create components and to control their lifecycle ( SetServices, Init(), Run(), Final() …) Components are nodes. Flow of data between components is shown by edges.

GEOS-5 surfacefvcoregravity_wave_drag historyagcm dynamicsphysics chemistrymoist_processesradiationturbulence infraredsolarlakeland_icedata_oceanland vegetationcatchment coupler Boxes are user written ESMF components Every component has a standard ESMF interface Init(),Run(), Finalize(). These drive the components. Data in and out of components are packaged in ESMF_state types New components can be added to the hierarchical system Coupling tools include parallel regridding and redistribution methods Example – ESMF component graph for GEOS-5 † AGCM † GEOS-5 presentation later Max Suarez, Atanas Tryanov

Creating and controlling ESMF Components dyn_init(dGC,dI,dE,cl,rc) : ESMF_CCInit(dyn2fv,dI,dE,cl,rc) ESMF_GCInit(fvGC,fvI,fvE,cl,rc) ESMF_CCInit(fv2dyn,dI,dE,cl,rc) : Initialize dyn_run(dGC,dI,dE,cl,rc) : ESMF_CCRun(dyn2fv,dI,fvI,cl,rc) ESMF_GCRun(fvGC,fvI,fvE,cl,rc) ESMF_CCRun(fv2dyn,fvE,dE,cl,rc) : Run ESMF component model defines standard interfaces that a component must provide Key onesInitialize(IState,EState,Clock,RC)Run(IState,EState,…)Finalize(IState,EState,…) ESMF component model defines a standard “container” type for passing information between components e.g TYPE(ESMF_State) :: fvI, fvE, dI, dE ESMF_State Components exchange data (with their peers and parent in the graph) by encoding/decoding ESMF_State data type arguments. ESMF_state An ESMF_state can hold many sorts of information and includes meta-data needed to decode it.

ESMF Component Modeling. Data is transferred between components through ESMF_State type “container variables”. Functions such as ESMF_regrid/ESMF_redist are used in coupler components to succinctly remap data within components. Every component registers ESMF_Init(), ESMF_Run(), ESMF_Finalize() so that it can be controlled from a parent. Components may also use an internal state pointer to maintain private state between calls. The component model provides everyone with a common model of time and alarms at the component interface. These aspects of the ESMF component model are being used both to develop interoperable applications and to develop new applications.

Outline What is ESMF? –ESMF components. Where is ESMF being used? –Components in production or being developed. What does it take to use ESMF? –Future directions/challenges

Components in production or in test and development Components in production or in test and development ~37 different components, span research to production

Using ESMF: CCSM example Using ESMF: CCSM example Group looking for way to provide a single-executable system like the NCAR Community Atmosphere Model (CAM) (left) but that has coupling flexibility of CCSM. For this CCSM is prototyping ESMF as a way to separate out ice and ocean from under a CAM specific driver (right). Erik Kluzek, Mariana Vertenstein

Using ESMF: BEI † example Using ESMF: BEI † example Part of BEI project targeting coupled HYCOM (Hybrid Coordinate Ocean Model) – CICE (Los Alamos Sea Ice Model) system for more accurate polar modeling. Using ESMF to wire CICE and HYCOM together. BEI † presentation later Alan Wallcroft

Using ESMF: LIS example Using ESMF: LIS example LIS team looking for strategy to integrate land- surface and atmospheric dynamics modeling and assimilation. Using ESMF to wire LIS and GMAO atmospheric modules together. Sujay Kumar, Christa Peters-Liddard

Using ESMF: SWMF example Using ESMF: SWMF example SWMF exploring approach to coupling space weather to Earth atmosphere. Using ESMF to provide SWMF as an encapsulated ESMF component. Quentin Stout

ESMF in the community – examples of strategies ESMF gridded and coupler components are user written, so ESMF can be used flexibly at different levels of abstraction and with mixed coupling paradigms. Fine grain components Whole model components Complete framework component Hub-and-spoke coupling One-to-one coupling

Outline What is ESMF? –ESMF components. Where is ESMF being used? –Components in production or being developed. What does it take to use ESMF? –Future directions/challenges

Using ESMF - why? The emerging pool of other ESMF-based science components. Can be used to create applications. To reduce the amount of infrastructure code that you need to maintain and write, and allow you to focus more resources on science development. ESMF is addressing two major technical problems in model development: Structuring large, multi-component applications so that they are easier to use and extend, and achieving performance portability on a wide variety of parallel architectures. It may be better software (better features, better performance portability, better tested, better documented, more stable maintenance) than the infrastructure software that you are currently using. Community development and use means that the ESMF software is widely reviewed and tested, and that you can leverage contributions from other groups.

Using ESMF - how? More in later talks and, especially, at tomorrows tutorial Basic steps to get started Download (from ) and build Read manual (not all of it!) Try a few of the examples Decide on scope of your components e.g. is your code one monolithic component or several sub-components. Arrange the code internally into init(), run(), finalize() sections. Attach ESMF_Init() etc… to your internal init() Develop couplers to map between sub-components, if needed. Q’s to More advanced steps Develop internal state for your component that can be attached to component. Refactor infrastructure to use ESMF basis

Future directions and challenges Having a standard interface doesn’t guarantee meaningful results! Conventions, rules, best-practices and higher-level protocols are required to describe, precisely and unambiguously (to a machine), what inputs a component expects and what it can export, what rules it must adhere to etc… Some of this can be automated (Curator presentation and discussion session later). Some requires expert knowledge.

Summary The ESMF community has a growing pool of components upcoming presentations from Mark Iredell (NCEP), Max Suarez (GSFC), Alan Wallcraft (DOD), but room for lots more! The granularity of available components spans sub-process models to complete frameworks, and covers algorithm areas from assimilation algebra to cloud processes. Some emerging standard rules (see later presentations) The basis of ESMF is a component paradigm tailored to Earth and planetary science disciplines. The component paradigm in ESMF centers on components written in a user community.

What is ESMF The Earth System Modeling Framework (ESMF) is a software package for building scalable, portable, modular modeling and data assimilation applications. …. ESMF promotes an organized, hierarchical application architecture that makes complex applications easier to maintain and extend, and allows individual components of an application to be exchanged and used in multiple contexts. ESMF provides tools for turning model codes into components with standard interfaces and standard drivers. ESMF provides library of common utilities that components use for routine services such as data communications, regridding, time management and message logging. ESMF Infrastructure Data Classes: Bundle, Field, Grid, Array Utility Classes: Clock, LogErr, DELayout, Machine ESMF Superstructure AppDriver Component Classes: GridComp, CplComp, State User Provided Numerical/Science Code e.g ocean transport, optimization line search, atmospheric radiation.