Coupling protocols – software strategy Question 1. Is it useful to create a coupling standard? YES, but … Question 2. Is the best approach to make a single.

Slides:



Advertisements
Similar presentations
© 2014 Systems and Proposal Engineering Company. All Rights Reserved Using Natural Language Parsing (NLP) for Automated Requirements Quality Analysis Chris.
Advertisements

Weather Research & Forecasting: A General Overview
Expanding Regridding Capabilities of the Earth System Modeling Framework Andrew Scholbrock University of Colorado – Boulder Robert Oehmke NOAA/CIRES 1.
DOE Global Modeling Strategic Goals Anjuli Bamzai Program Manager Climate Change Prediction Program DOE/OBER/Climate Change Res Div
NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH Emergence of the Earth System Modeling Framework NSIPP Seasonal Forecast.
Earth System Curator Spanning the Gap Between Models and Datasets.
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech.
CCSM cpl6 Design and Interfaces Tony Craig Brian Kauffman Tom Bettge National Center for Atmospheric Researc Robert Jacob Jay Larson Everest Ong Argonne.
Component Patterns – Architecture and Applications with EJB copyright © 2001, MATHEMA AG Component Patterns Architecture and Applications with EJB JavaForum.
Rational Unified Process Workflows. The Rational Unified Process.
Integrated Frameworks for Earth and Space Weather Simulation Timothy Killeen and Cecelia DeLuca National Center for Atmospheric Research, Boulder, Colorado.
THE OBJECT-ORIENTED DESIGN WORKFLOW Interfaces & Subsystems.
1 ESMF in Production at NCEP Mark Iredell Chief NCEP/EMC Global Climate and Weather Modeling Branch May 23, 2006 NCEP: “where America’s climate, weather,
Chapter 13 Embedded Systems
1 NCEP Mark Iredell Chief NCEP/EMC Global Climate and Weather Modeling Branch May 23, 2006 NCEP: “where America’s climate, weather, and ocean services.
Web Application Architecture: multi-tier (2-tier, 3-tier) & mvc
Overview of Eclipse Parallel Tools Platform Adam Leko UPC Group HCS Research Laboratory University of Florida Color encoding key: Blue: Information Red:
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 11 Slide 1 Architectural Design.
System Design Chapter 8. Objectives  Understand the verification and validation of the analysis models.  Understand the transition from analysis to.
Q and A for Ch. 17 CS 332, Spring Fiber Modems Q: Why use fiber modem extensions? Is it to save money on not having to use as much fiber (otherwise.
Components and Concurrency in ESMF Nancy Collins Community Meeting July 21, GMAO Seasonal.
NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT Adoption and field tests of M.I.T General Circulation Model (MITgcm) with ESMF Chris Hill ESMF.
NSF NCAR | NASA GSFC | DOE LANL ANL | NOAA NCEP GFDL | MIT | U MICH First Field Tests of ESMF GMAO Seasonal Forecast NCAR/LANL CCSM NCEP.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
IS-ENES Kick-off meeting Paris, March 2009 Overview of JRA2 European ESM: Performance Enhancement Graham Riley, University of Manchester IS-ENES Kick-off.
What is ESMF and what does it mean to adopt it? 3 rd ESMF Community Meeting Cecelia DeLuca Nancy Collins
Metadata for the Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS) using the Earth System Modeling Framework (ESMF) Peter Bosler University.
NE II NOAA Environmental Software Infrastructure and Interoperability Program Cecelia DeLuca Sylvia Murphy V. Balaji GO-ESSP August 13, 2009 Germany NE.
Cecelia DeLuca, Don Stark, Chris Hill Arctic System Model Workshop May 20, 2008 Earth System Modeling Framework.
Computational Design of the CCSM Next Generation Coupler Tom Bettge Tony Craig Brian Kauffman National Center for Atmospheric Research Boulder, Colorado.
Initial Results from the Integration of Earth and Space Frameworks Cecelia DeLuca/NCAR, Alan Sussman/University of Maryland, Gabor Toth/University of Michigan.
©Ian Sommerville 2000 Software Engineering, 6th edition. Chapter 10Slide 1 Architectural Design l Establishing the overall structure of a software system.
ESMF Application Status GMAO Seasonal Forecast NCAR/LANL CCSM NCEP Forecast GFDL FMS Suite MITgcm NCEP/GMAO Analysis Climate Data Assimilation.
Composing Adaptive Software Authors Philip K. McKinley, Seyed Masoud Sadjadi, Eric P. Kasten, Betty H.C. Cheng Presented by Ana Rodriguez June 21, 2006.
The use of modeling frameworks to facilitate interoperability Cecelia DeLuca/NCAR (ESMF) Bill Putman/NASA GSFC (MAPL) David Neckels/NCAR.
CESM/ESMF Progress Report Mariana Vertenstein NCAR Earth System Laboratory CESM Software Engineering Group (CSEG) NCAR is sponsored by the National Science.
©Ian Sommerville 2000 Software Engineering, 6th edition. Chapter 10Slide 1 Architectural Design l Establishing the overall structure of a software system.
Earth System Modeling Framework Status Cecelia DeLuca NOAA Cooperative Institute for Research in Environmental Sciences University of Colorado, Boulder.
Regional Models in CCSM CCSM/POP/ROMS: Regional Nesting and Coupling Jon Wolfe (CSEG) Mariana Vertenstein (CSEG) Don Stark (ESMF)
Components, Coupling and Concurrency in the Earth System Modeling Framework N. Collins/NCAR, C. DeLuca/NCAR, V. Balaji/GFDL, G. Theurich/SGI, A. da Silva/GSFC,
A Portable Regional Weather and Climate Downscaling System Using GEOS-5, LIS-6, WRF, and the NASA Workflow Tool Eric M. Kemp 1,2 and W. M. Putman 1, J.
Towards development of a Regional Arctic Climate System Model --- Coupling WRF with the Variable Infiltration Capacity land model via a flux coupler Chunmei.
Manno, , © by Supercomputing Systems 1 1 COSMO - Dynamical Core Rewrite Approach, Rewrite and Status Tobias Gysi POMPA Workshop, Manno,
Earth System Modeling Framework Python Interface (ESMP) October 2011 Ryan O’Kuinghttons Robert Oehmke Cecelia DeLuca.
CCSM Portability and Performance, Software Engineering Challenges, and Future Targets Tony Craig National Center for Atmospheric Research Boulder, Colorado,
Strategic Plan Implementation Cecelia DeLuca/NCAR (ESMF) December 17, 2008 ESMF Board/Interagency Meeting.
ESMF Code Generation with Cupid Update and Demo October 2009 Rocky Dunlap Spencer Rugaber Leo Mark Georgia Tech College of Computing.
CCSM Performance, Successes and Challenges Tony Craig NCAR RIST Meeting March 12-14, 2002 Boulder, Colorado, USA.
Metadata and Meta tag. What is metadata? What does metadata do? Metadata schemes What is meta tag? Meta tag example Table of Content.
WMT The CSDMS Web Modeling Tool Mark Piper Eric Hutton Irina Overeem
Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.
Component Patterns – Architecture and Applications with EJB copyright © 2001, MATHEMA AG Component Patterns Architecture and Applications with EJB Markus.
PLANETS, OPF & SCAPE A summary of the tools from these preservation projects, and where their development is heading.
Page 1© Crown copyright 2005 Met Office plans for sea ice model development within a flexible modelling framework Helene Banks Martin Best, Ann Keen and.
Banaras Hindu University. A Course on Software Reuse by Design Patterns and Frameworks.
Enhancements for Hydrological Modeling in ESMF Cecelia DeLuca/NCAR (ESMF) December 19, 2008 AGU Fall Meeting.
ESMF and the future of end-to-end modeling Sylvia Murphy National Center for Atmospheric Research
A TIME-GCM CAM Multi-executable Coupled Model Using ESMF and InterComm Robert Oehmke, Michael Wiltberger, Alan Sussman, Wenbin Wang, and Norman Lo.
NSF NCAR / NASA GSFC / DOE LANL ANL / NOAA NCEP GFDL / MIT / U MICH C. DeLuca/NCAR, J. Anderson/NCAR, V. Balaji/GFDL, B. Boville/NCAR, N. Collins/NCAR,
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech 5 th GO-ESSP Community Meeting.
BG 5+6 How do we get to the Ideal World? Tuesday afternoon What gaps, challenges, obstacles prevent us from attaining the vision now? What new research.
Options for Framework Connectivity Cecelia DeLuca NOAA Environmental Software Infrastructure and Interoperability February.
Overview of the CCSM CCSM Software Engineering Group June
Experiences and Decisions in Met Office coupled ESM Development
GMAO Seasonal Forecast
FUJIN: a parallel framework for meteorological models
Mariana Vertenstein CCSM Software Engineering Group NCAR
Metadata Development in the Earth System Curator
Chapter 2: Building a System
Building a “System” Moving from writing a program to building a system. What’s the difference?! Complexity, size, complexity, size complexity Breadth.
Presentation transcript:

Coupling protocols – software strategy Question 1. Is it useful to create a coupling standard? YES, but … Question 2. Is the best approach to make a single coupler/coupling standard available for community collaboration? YES, but…

Q#2: A coupling standard is a good idea but it is a fast evolving standard in time (e.g. CPL7 vice ESMF)

Q#1: Key Points on / Requirements of a coupling standard: 1. Identify the split between technical and physical requirements. 2. We can standardize the technical part of the coupler, but leave the physical requirements loose, with the restriction that the physical requirements will have to meet certain requirements such as conservation. Standard will evolve over time. 3. Need a wide range of supported platforms. 4. Coupling Tools need to have a low overhead. 5. Design needs to be modular to simplify the development of the System Model. 6. Regridding support - CCSM uses LANL SCRIP to generate the weights with a sparse matrix multiply to compute the interpolation. Oasis generates weights on the fly and computes the interpolation internally. ESMF can both generate weights on the fly or use pre- computed weights and conducts the interpolation by sparse matrix multiply. 7. It is worth considering what tools are used by external groups that have models we'd want to use couple to in the future such as biology, watershed, etc. 8. Make the coupler as general, stable and solid as possible, so that its usefulness outlasts the life of the model components. The coupler is the nexus of the community.

Detailed Comments Hill: Have a hierarchy of standards - some technical and others conceptual/physical. I.e. Physical: what does the atmosphere need from the ocean. Where as the software engineering of coupling. Experience with ECCO - has both in house (MAPLE) and ESMF. Need a vision when working on a long time line. Define interfaces, but allow people to decide on everything beyond that. Don't want to lock into a standard that can't evolve as model develops. Standard shouldn't restrict the process. Maslowski: Ocean/sea ice is good example - sea ice and upper ocean can be viewed as a single layer. A standard coupling approach would get in the way of this sort of integration. Doescher: They defined an interface in terms of standard variables - an agreement of what physical variables to share. This proved too restrictive to the science groups. Instead he feels that each group should be allowed to define shared states and let the coupler reconcile the two states. Their model sends each field individually using oasis. No packing. Run concurrent. Does time stepping create bottle necks. No just add more processors. Timing information handled through meta data. Maslowski: Would Oasis meet the needs of the project. Both the technical and physical standards don't have to be meet at the same time.

Detailed Comments Coupler must not add significant over head. : Software must be portable to a wide variety of machines. Doescher: Need to create a list of technical requirements. What about remapping? CCSM uses scrip to generate the weights, Oasis can generate weights on the fly, ESMF can both generate weights on the fly or use pre-computed weights. Maslowski: Additional points in ESMF not already discussed. Cecelia: ESMF has the ability to recursively call components - used in applications such as ensemble runs. It is useful to think about the specific coupling tools adopted by external groups that may be of future interest - such as fisheries, biology, watershed, etc. : it is important to be inclusive - let the coupling standard be used to create a "community coupler model" that so that others can bring in their model. Hill: we agree that there should be a standard, exactly what is currently undefined. Requires a working group. Cecelia: put out the requirements and compare the options. Stark: make the coupler as general, stable and solid as possible, so that its usefulness outlasts the model components.

Detailed Comments : We're actually creating an Arctic System Model Framework. Maslowski: Layered way of thinking - coupler joined separate models - end goal is to create an Arctic System Model, but an ice or ocean, or atmospheric model. Difference between CCSM and ESMF design is that CCSM is hub and spoke, while ESMF allows the addition of a layered approach with a hierarchy of couplers. Maslowski: Extension needed to CPL 7 for the System model. - lateral boundary condition support - way to handle non overlapping domains Stark: coupler tools would be used to build support for these issues, rather than solve them directly. : Does ESMF handle Meta data Cecelia: Yes. A system is being built into ESG to automate code generation, as a step toward that meta data class was created.