Initial Results from the Integration of Earth and Space Frameworks Cecelia DeLuca/NCAR, Alan Sussman/University of Maryland, Gabor Toth/University of Michigan.

Slides:



Advertisements
Similar presentations
Weather Research & Forecasting: A General Overview
Advertisements

Expanding Regridding Capabilities of the Earth System Modeling Framework Andrew Scholbrock University of Colorado – Boulder Robert Oehmke NOAA/CIRES 1.
INTRODUCTION TO SIMULATION WITH OMNET++ José Daniel García Sánchez ARCOS Group – University Carlos III of Madrid.
NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH Emergence of the Earth System Modeling Framework NSIPP Seasonal Forecast.
Earth System Curator Spanning the Gap Between Models and Datasets.
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech.
WRF Modeling System V2.0 Overview
MotoHawk Training Model-Based Design of Embedded Systems.
1 Earth System Modeling Framework ESMF and the Transformation of Earth System Modeling Sylvia Murphy
Integrated Frameworks for Earth and Space Weather Simulation Timothy Killeen and Cecelia DeLuca National Center for Atmospheric Research, Boulder, Colorado.
DCABES 2009 China University Of Geosciences 1 The Parallel Models of Coronal Polarization Brightness Calculation Jiang Wenqian.
Expanded Observatory support (redundancy, verification) CME (Empirical) propagation (Cone Model) (ICME strength and arrival time) Electrodynamics model.
Flexible Control of Data Transfer between Parallel Programs Joe Shang-chieh Wu Alan Sussman Department of Computer Science University of Maryland, USA.
July 14, 2005 Shine 2005 Coupling Frameworks in Solar-Terrestrial Research Chuck Goodrich Boston University.
The Earth System Modeling Framework and the Earth System Curator Cecelia DeLuca and the ESMF Joint Specification Team.
Earth System Modeling Framework Capabilities Cecelia DeLuca SCD Users Forum May 18, GMAO.
Building Coupled Parallel and Distributed Scientific Simulations with InterComm Alan Sussman Department of Computer Science & Institute for Advanced Computer.
Chapter 13 Starting Design: Logical Architecture and UML Package Diagrams.
NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT Adoption and field tests of M.I.T General Circulation Model (MITgcm) with ESMF Chris Hill ESMF.
NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH First Field Tests of ESMF GMAO Seasonal Forecast NCAR/LANL CCSM NCEP.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
What is ESMF and what does it mean to adopt it? 3 rd ESMF Community Meeting Cecelia DeLuca Nancy Collins
Metadata for the Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS) using the Earth System Modeling Framework (ESMF) Peter Bosler University.
NE II NOAA Environmental Software Infrastructure and Interoperability Program Cecelia DeLuca Sylvia Murphy V. Balaji GO-ESSP August 13, 2009 Germany NE.
Coordination of Common Modeling Infrastructure Cecelia DeLuca WGCM/WMP Meeting, Exeter, UK Oct 6, 2005 Climate Data Assimilation Weather.
ESMF Development Status and Plans ESMF 4 th Community Meeting Cecelia DeLuca July 21, 2005 Climate Data Assimilation Weather.
Coupling Parallel Programs via MetaChaos Alan Sussman Computer Science Dept. University of Maryland With thanks to Mike Wiltberger (Dartmouth/NCAR)
Computational Design of the CCSM Next Generation Coupler Tom Bettge Tony Craig Brian Kauffman National Center for Atmospheric Research Boulder, Colorado.
1 CW 2015, Manchester, 04/ Coupling technology benchmarking in IS-ENES2 Coupling technology benchmarking in IS-ENES2 IS-ENES2 WP10-T3 Evaluation.
Introduction to the Earth System Modeling Framework V. Balaji, GFDL Cecelia DeLuca, Chris Hill, MIT
The Fujin Development of Parallel Coupler Takashi Arakawa Research Organization for Information Science & Technology.
The use of modeling frameworks to facilitate interoperability Cecelia DeLuca/NCAR (ESMF) Bill Putman/NASA GSFC (MAPL) David Neckels/NCAR.
ESMF Performance Evaluation and Optimization Peggy Li(1), Samson Cheung(2), Gerhard Theurich(2), Cecelia Deluca(3) (1)Jet Propulsion Laboratory, California.
CESM/ESMF Progress Report Mariana Vertenstein NCAR Earth System Laboratory CESM Software Engineering Group (CSEG) NCAR is sponsored by the National Science.
Architectural Design Yonsei University 2 nd Semester, 2014 Sanghyun Park.
Center for Component Technology for Terascale Simulation Software CCA is about: Enhancing Programmer Productivity without sacrificing performance. Supporting.
ARGONNE NATIONAL LABORATORY Climate Modeling on the Jazz Linux Cluster at ANL John Taylor Mathematics and Computer Science & Environmental Research Divisions.
Earth System Modeling Framework Status Cecelia DeLuca NOAA Cooperative Institute for Research in Environmental Sciences University of Colorado, Boulder.
Regional Models in CCSM CCSM/POP/ROMS: Regional Nesting and Coupling Jon Wolfe (CSEG) Mariana Vertenstein (CSEG) Don Stark (ESMF)
Components, Coupling and Concurrency in the Earth System Modeling Framework N. Collins/NCAR, C. DeLuca/NCAR, V. Balaji/GFDL, G. Theurich/SGI, A. da Silva/GSFC,
Chapter 2 Introduction to Systems Architecture. Chapter goals Discuss the development of automated computing Describe the general capabilities of a computer.
A Portable Regional Weather and Climate Downscaling System Using GEOS-5, LIS-6, WRF, and the NASA Workflow Tool Eric M. Kemp 1,2 and W. M. Putman 1, J.
Earth System Modeling Framework Python Interface (ESMP) October 2011 Ryan O’Kuinghttons Robert Oehmke Cecelia DeLuca.
Experimental El Niño/Southern Oscillation Predictions by the UCLA Atmospheric General Circulation Model (GCM) Coupled to the MIT and POP Oceanic GCMs using.
Strategic Plan Implementation Cecelia DeLuca/NCAR (ESMF) December 17, 2008 ESMF Board/Interagency Meeting.
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH May 15, 2003 Nancy Collins, NCAR 2nd Community Meeting, Princeton, NJ Earth System.
CCA Common Component Architecture CCA Forum Tutorial Working Group CCA Status and Plans.
Coupling protocols – software strategy Question 1. Is it useful to create a coupling standard? YES, but … Question 2. Is the best approach to make a single.
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH May 14, 2003 Nancy Collins, NCAR Components Workshop, Princeton, NJ Components in the.
Connections to Other Packages The Cactus Team Albert Einstein Institute
Extension of the ESMF for Space Weather Cecelia DeLuca SWW April 7, NSIPP Seasonal Forecast.
TK2023 Object-Oriented Software Engineering CHAPTER 8 LOGICAL ARCHITECTURE.
ESMF,WRF and ROMS. Purposes Not a tutorial Not a tutorial Educational and conceptual Educational and conceptual Relation to our work Relation to our work.
Building Community and Capability through Common Infrastructure: ESMF and the Earth System Curator Cecelia DeLuca MAP Meeting College.
An update on BFG, The Bespoke Framework Generator Graham Riley (& Rupert Ford, STFC) Coupling Workshop Boulder, Colorado - February 20 th -22 nd.
SDM Center High-Performance Parallel I/O Libraries (PI) Alok Choudhary, (Co-I) Wei-Keng Liao Northwestern University In Collaboration with the SEA Group.
Emergence of a Common Modeling Architecture for Earth System Science American Geophysical Union December 13, 2010 Cecelia DeLuca NOAA/CIRES.
Climate Data Assimilation Weather Earth System Modeling Framework (ESMF) Community Meeting, DODNSFDOENASANOAA.
ESMF and the future of end-to-end modeling Sylvia Murphy National Center for Atmospheric Research
State of ESMF: The NUOPC Layer Gerhard Theurich NRL/SAIC ESMF Executive Board / Interagency Working Group Meeting June 12, 2014.
A TIME-GCM CAM Multi-executable Coupled Model Using ESMF and InterComm Robert Oehmke, Michael Wiltberger, Alan Sussman, Wenbin Wang, and Norman Lo.
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH C. DeLuca/NCAR, J. Anderson/NCAR, V. Balaji/GFDL, B. Boville/NCAR, N. Collins/NCAR,
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech 5 th GO-ESSP Community Meeting.
GMAO Seasonal Forecast
GMAO Seasonal Forecast
Mariana Vertenstein (CGD)
Starting Design: Logical Architecture and UML Package Diagrams
Analysis models and design models
Metadata Development in the Earth System Curator
A brief introduction to NEMS
Presentation transcript:

Initial Results from the Integration of Earth and Space Frameworks Cecelia DeLuca/NCAR, Alan Sussman/University of Maryland, Gabor Toth/University of Michigan Abstract There is increasing call to couple Earth and space models, as the interplay between the regions is an active topic of basic research and a key factor in operational prediction systems. Two pilot projects to combine Earth and space software frameworks have produced initial technical results. The projects, which were initiated under NASA and NSF funding, demonstrate 1) transfers of data between models using the Earth System Modeling Framework (ESMF) and those that are part of the Center for Integrated Space Weather Modeling (CISM) and 2) transfers of data between models using ESMF and those running under the Space Weather Modeling Framework (SWMF). We describe technical approaches, capabilities achieved, and possible next steps. The ESMF architecture is based on components with standard interfaces and standard methods An ESMF application runs as a single executable New components can be added to the application systematically Data in and out of components are state types that contain fields, bundles of fields, arrays, or nested states Toolkits include regridding and redistribution methods and utilities such as time management ESMF is free for download at ESMF Component 1 (e.g. land) ESMF Component 2 (e.g. atm) ESMF App Driver ESMF Coupler Configuration  InterComm is used for data transfers between an ESMF application and a CISM model (or other non-ESMF code)  These are in separate executables  Data transfers can be from anywhere, to anywhere  Minimal changes to codes  Each code doesn’t need to know anything about the internals of the other CISM Model Multiple executables InterComm data transfer and sequencing 1. ESMF and CISM / InterComm Coupling ESMF Earth System Component ESMF App Driver SWMF Driver ESMF SWMF Component ESMF Coupler Configuration  The entire SWMF is wrapped as an ESMF component  The SWMF component can communicate data to one or more Earth system components  The application is run using an ESMF driver  The application runs as a single executable Single Executable 2. ESMF and SWMF Coupling Conclusions Space Weather Modeling Framework Center for Integrated Space Weather Modeling Earth System Modeling Framework TECHNICAL APPROACH Mode of executionSingle executableMultiple executableSingle executable or multiple executable Mode of component concurrency Sequential, concurrent, mixed ConcurrentSequential, concurrent, mixed Mode of inter- component data exchange Argument list before/after component run Put/get anywhereArgument list before/after component run Standard data structure for inter-component data exchanges No, although interfaces are generic Yes Framework support for nested components No Yes ParallelismComponents may use MPI or OpenMP Execution environmentCommand line or GUI interface Command line Supported platformsLinux cluster with NAG, PGF90, and Lahey compilers, OSF1, Altix, SGI 3000, Mac OSX with NAG and XLF Linux, AIX, and SolarisAIX, SGI IRIX64, OSF1, Linux with Intel, PGI, NAG, Absoft, and Lahey compilers, Mac OSX with XLF and Absoft, Altix, Cray X1 COMPUTATIONAL APPROACH Supported grids and grid methods Supported grids and methods: any 1D, 2D, or 3D logically Cartesian grid, and any 2D or 3D block adaptive grid; 2nd order interpolation methods are provided, and user supplied interpolation schemes can also be used Any grids and methods supported by Overture Intrinsic support only for simple logically rectangular grids, bilinear and first order conservative regrid In CISM applications, the InterComm library (University of Maryland) is used for parallel data transfers between models that are in separate executables The Overture framework (LLNL) for solving PDEs in complex moving geometries is used to write coupling code, which may be put in its own separate executable or within a subroutine of one of the models being coupled The approach requiress minimal modification to existing programs InterComm and Overture are both general purpose, freely downloadable packages Global Magnetosphere Ionosphere Electrodynamics Inner Magnetospher e Radiation belts Solar Energetic Particles Upper Atmosphere Solar Corona Eruptive Event Generator Inner Heliosphere The SWMF architecture is based on components with generic interfaces A SWMF application runs as a single executable Many different configurations may be run The SWMF is freely available at Polar Wind Plasmasphe re Photosphere to Corona SWMF Modifications Required 3 new ESMF functions required 1 to translate ESMF array descriptors into InterComm descriptors ESMF_ArrayExternalICTranslate() 2 to export/import ESMF sub-arrays to another program ESMF_ArrayExternalICSend() ESMF_ArrayExternalICRecv() Status Implementation of prototype complete and tested Currently limited to block array distributions InterComm functions will appear as option in ESMF release Prototype coupling of ESMF model to NCAR space weather model is being discussed Future Work We will demonstrate in a simple model the ability to execute a data transformation between an ESMF component and a CISM component using InterComm, with the ESMF component using ESMF interfaces and the CISM component using native InterComm interfaces. Motivation The main motivations for interfacing ESMF-based Earth simulations to space simulations and vice versa are the desire to better express boundary conditions for these domains, and the desire to improve representation of the boundary region. End goals are to deepen understanding of physical processes and to produce better forecasts. The ability to exchange component versions between the CISM and SWMF frameworks would afford space weather researchers more opportunities for experimentation and collaboration. There are also a number of upper atmosphere researchers who are interested in implementing their component versions in an ESMF-compatible way. The initial results from these pilot projects are proof of concept that SWMF components, CISM components, and ESMF components can be connected to each other to create applications. A natural next step is to explore the possibility of component exchanges between the CISM and SWMF frameworks, perhaps mediated by ESMF interfaces. Example: GEOS-5 AGCM FRAMEWORK: Earth System Modeling Framework (ESMF) FRAMEWORK: Space Weather Modeling Framework (SWMF) FRAMEWORK: Center for Integrated Space Weather Modeling (CISM) / InterComm Framework Comparison Table Pilot Projects Status Implementation of prototype complete and tested ESMF functions appear as options in the SWMF distribution Similarities Between ESMF and SWMF ESMF and SWMF are layered and structured in a similar fashion (see diagrams below). This made it rather straightforward to modify the SWMF so that it could be run as an ESMF component. Problems that occurred during integration were due largely to the immaturity of aspects of the ESMF software at the time of the implementation. ESMF SWMF