NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 Cecelia DeLuca / NCAR 2 nd ESMF Community Meeting Princeton, NJ NSIPP Seasonal Forecast NCAR/LANL CCSM NCEP Forecast GFDL FMS Suite MITgcm NASA GSFC PSAS ESMF Design Overview and Implementation Strategy

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 Outline ESMF Design Goals ESMF Design Strategies Architecture and Features Implementation Strategy

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 ESMF Design Goals Composable, swappable, nestable model components for building Earth system applications dyn assim atm hurr_sim phys assim_atm ocean

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 ESMF Design Goals (cont.) Reusable toolkits for grid operations and routine utilities Performance portability and ease of use in a complex, transient computing environment Application and infrastructure codes that are maintainable and extensible

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 ESMF Design Goals (cont.) Flexibility – To allow unconstrained scientific development – To encourage technical innovation – To support partial adoption of framework services – To accommodate different programming models

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 Outline ESMF Design Goals ESMF Design Strategies Architecture and Features Implementation Strategy

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 Architecture External Libraries Low Level Utilities Fields and Grids Layer Model Layer Coupling Layer ESMF Infrastructure User Code ESMF Superstructure BLAS, MPI, NetCDF, … Composable, swappable, nestable model components for building Earth system applications Reusable toolkits for grid operations and routine utilities Performance portability and ease of use in a complex, transient computing environment

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 ESMF Design Approach Component-based architecture: large, functionally related pieces of software (e.g., atmosphere, land models) interact through well- defined interfaces Object oriented design: smaller, functionally related pieces of software are bundled into modules containing data and methods Layered design: details of platform and parallelism are not visible at the highest level interfaces Application and infrastructure codes that are maintainable and extensible

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 ESMF Design Approach (cont.) Flexibility To allow unconstrained scientific development To encourage technical innovation To support partial adoption of framework services To accommodate different programming models Physical interfaces to components are not prescribed Designed to be compatible with user-managed intra- component communication Extensible for new grids / algorithms / comm libraries Many ESMF services may be used independently Allows arbitrary placement of inter-component communication

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 Outline ESMF Design Goals ESMF Design Strategies Architecture and Features Implementation Strategy

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 General Features ESMF will be usable by models written in F90/C/C++ ESMF will be usable by models requiring adjoint capability ESMF will be usable by models requiring shared or distributed memory parallelism semantics ESMF will support sequential and concurrent modes of execution ESMF will support several I/O formats, including GRIB/BUFR, netCDF, HDF ESMF will have uniform syntax across platforms ESMF will target a broad range of platforms, from major centers  commodity hardware

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 ESMF Services event alarms performance profiling I/O primitives communication primitives, etc. Low-Level Utilities transpose, halo, etc. abstract machine layout Parallel Utilities grid metadata grid decomposition Grids field metadata field and field bundle data field I/O Fields Fields and Grids components (gridded, coupler, app) states Components / Coupling

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 Field: Halo( ), Import( ), Export( ) + I/O ESMF Components 2.ESMF provides a toolkit that components use to i.increase interoperability ii.improve performance portability iii.abstract common services Component: Init( ), Run( ), Checkpoint( ) Grid: Regrid( ), Transpose( ) + Metrics DELayout, PE List, Machine Model Application Component Gridded ComponentsCoupler Components 1.ESMF provides an environment for assembling geophysical components into an application.

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 ESMF Version 1.0 MachineModel Layout DistGrid PhysGrid State Bundle Gridded Component Array Utilities: TimeMgr, Config, LogErr, I/O etc. F90 Superstructure Infrastructure Field Grid Regrid Comm Data Communications Design Complete Limited Prototype Fuller Prototype Route Coupler Component C++ Application Component

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 Outline ESMF Design Goals ESMF Design Strategies Architecture and Features Implementation Strategy

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 Implementation Strategy for ESMF Version 1.0 Infrastructure Superstructure Sufficient breadth to prototype how all major parts of the ESMF system will interact Well-developed superstructure (Components and States) Basic functions in most infrastructure classes

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 Implementation Strategy for ESMF Version 1.0 (cont.) Sufficient depth to develop simple ESMF applications Groundwork laid for high performance communication, uniform API across shared/distributed memory, load balancing capability Fully developed F90/C++ interoperability strategy Infrastructure Superstructure

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 Implementation Strategy for ESMF Version 1.0 (cont.) Infrastructure Superstructure Over the next year: Development of grid and parallel regrid services Continued work on communication, decomposition, and other utilities Organization, standardization, fine- tuning interfaces Hardening and optimizing implementation Extending and polishing documentation and tutorial examples

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 Development Focus Near-term framework development focus is on creating sufficient infrastructure and superstructure to achieve the initial set of interoperability experiments. These are: – FMS B-grid atmosphere coupled to MITgcm ocean – CAM atmosphere coupled to NCEP analysis – NSIPP atmosphere coupled to DAO analysis

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 The Team Fields and Grids – Nancy Collins, Jon Wolfe, David Neckels Regrid – Phil Jones Time + Machine Model/Comms – Earl Schwab Benchmarks – Gerhard Theurich Web and Admin – Robbie Stauffer I/O – Nancy Collins, Atanas Trayanov Profiling and logging – Shep Smithline, Erik Kluzek Attributes – Leonid Zaslavsky, Nancy Collins System Tests and Demos – Silverio Vasquez, Nancy Collins, Jon Wolfe Build – Dennis Flanigan

NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH 15 May 2003 More information ESMF website: On the website: Information about the Community Meeting ESMF documents ESMF browsable source code repository On-line forms for community input and catalogued responses Milestone schedule, project archives and history, related projects Management plan, board and team contacts More …