Common Infrastructure for Modeling the Earth

Slides:



Advertisements
Similar presentations
GIS Executive Council and Advisory Committee Update November 2010.
Advertisements

GEOSS Common Infrastructure (GCI): status and evolution EC Side Event - GEO Plenary IX Foz do Iguacu, November 2012 Mirko Albani Earth Observation.
Introduction to ORYX. Agility without Control  Unacceptable rate of error (88%*)  Highly manual, with …  … limited automation potential  Lack of audit.
Professional Services Overview
Request Management Mirror-. A random three day sample of Incidents revealed that about 86% of the registered Incidents were legitimate Requests Many other.
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech.
JTX Overview Overview of Job Tracking for ArcGIS (JTX)
Database Systems: Design, Implementation, and Management Tenth Edition
Recovery Support Systems The Role of Electronic Records (ERs) in the Recovery Support Model. (Why not paper charts?)
DHS, National Cyber Security Division Overview
6th MSDI Working Group Meeting
CONFUSED? DON’T BE. IT’S ACTUALLY REALLY STRAIGHTFORWARD. RICK FREEMAN FEBRUARY 4, 2015 The HSPC Tier 1 & Tier 2 Technical Specification Explained.
On-Time Product Delivery COPC - HPCC Best Practices March 2011 Allan Darling Deputy Director NCEP Central Operations Where America’s Climate, Weather,
THE JOINED UP WORLD OF E-RESEARCH Professor Neil McLean National Technical Standards Adviser to the Department of Education Science and Training (DEST)
Sharepoint 2007  An integrated suite of server capabilities can help improve organizational effectiveness by providing various processes.  Provides.
Alabama GIS Executive Council November 17, Alabama GIS Executive Council Governor Bob Riley signs Executive Order No. 38 on November 27 th, 2007.
Packetizer ® Copyright © 2009 H.325: An Application Platform A Closer Look at the “Container” Paul E. Jones Rapporteur Q12/16 April 7,
LEVERAGING THE ENTERPRISE INFORMATION ENVIRONMENT Louise Edmonds Senior Manager Information Management ACT Health.
Sara Bowman Center for Open Science Open Science Framework: Facilitating Transparency and Reproducibility.
April 2, 2013 Longitudinal Data system Governance: Status Report Alan Phillips Deputy Director, Fiscal Affairs, Budgeting and IT Illinois Board of Higher.
A Combat Support Agency Defense Information Systems Agency Delivering Modernized C2 PEO-C2C.
NGAC Interagency Data Sharing and Collaboration Spotlight Session: Best Practices and Lessons Learned Robert F. Austin, PhD, GISP Washington, DC March.
Collaboration between WIPO & the Vancouver Group Technical infrastructure for improved international collaboration on search and examination John Alty.
DATA FOUNDATION TERMINOLOGY WG 4 th Plenary Update THE PLUM GOALS This model together with the derived terminology can be used Across communities and stakeholders.
The Earth System CoG Collaboration Environment Sylvia Murphy and Cecelia DeLuca (NOAA/CIRES), and Luca Cinquini (NASA/JPL) AGU Ocean Sciences February.
The OMII Perspective on Grid and Web Services At the University of Southampton.
CESM Infrastructure Update
Overview of NIPP 2013: Partnering for Critical Infrastructure Security and Resilience October 2013 DRAFT.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
PROJECT NAME: DHS Watch List Integration (WLI) Information Sharing Environment (ISE) MANAGER: Michael Borden PHONE: (703) extension 105.
CCSM Software Engineering Coordination Plan Tony Craig SEWG Meeting Feb 14-15, 2002 NCAR.
Internal Communications: Introducing and Managing Change France Mondoloni Communications and Information Services Branch June 2011.
Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September
CESM/RACM/RASM Update May 15, Since Nov, 2011 ccsm4_0_racm28:racm29:racm30 – vic parallelization – vic netcdf files – vic coupling mods and “273.15”
ESMF Application Status GMAO Seasonal Forecast NCAR/LANL CCSM NCEP Forecast GFDL FMS Suite MITgcm NCEP/GMAO Analysis Climate Data Assimilation.
CESM WG co-chair meeting March Announcements/Updates CSL Usage: Development: 73%/113% for 30/90 day (150%/133% cut off) Production: 128%/179%
Overarching System and NEMS Cecelia DeLuca NOAA Environmental Software Infrastructure and Interoperability (NESII) NOAA ESRL/University of Colorado NGGPS.
CSEG Update Mariana Vertenstein CCSM Software Engineering Group Mariana Vertenstein CCSM Software Engineering Group.
Chapter © 2012 Pearson Education, Inc. Publishing as Prentice Hall.
Improving pS-PS Service Architecture , perfSONAR-PS Developers Meeting Aaron Brown, Andrew Lake, Eric Pouyoul.
Draft – discussion only Advanced Health Models and Meaningful Use Workgroup June 23, 2015 Paul Tang, chair Joe Kimura, co-chair.
CESM/ESMF Progress Report Mariana Vertenstein NCAR Earth System Laboratory CESM Software Engineering Group (CSEG) NCAR is sponsored by the National Science.
The Roadmap to Software Factories Tools, Patterns and Frameworks.
DataNet – Flexible Metadata Overlay over File Resources Daniel Harężlak 1, Marek Kasztelnik 1, Maciej Pawlik 1, Bartosz Wilk 1, Marian Bubak 1,2 1 ACC.
Earth System Modeling Framework Status Cecelia DeLuca NOAA Cooperative Institute for Research in Environmental Sciences University of Colorado, Boulder.
Build the Right Team 1 Organize for Success 2 Build Coalition with Business Partners 3 Maintain Flexibility 4 Key Success Factors KSF 1.1: Relentlessly.
Kuali Rice Evolving the Technology Framework for Kuali Applications Brian McGough (Indiana University) Aaron Godert (Cornell University) Warner Onstine.
EPA Geospatial Segment United States Environmental Protection Agency Office of Environmental Information Enterprise Architecture Program Segment Architecture.
Land Ice Verification and Validation (LIVV) Kit Weak scaling behavior for a large dome- shaped test case. It shows that the scaling behavior of a new run.
SEAL Core Libraries and Services CLHEP Workshop 28 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
INTEGRATED ARCTIC MANAGEMENT Brendan P. Kelly Assistant Director for Polar Sciences Office of Science and Technology Policy
Coupling Facility. The S/390 Coupling Facility (CF), the key component of the Parallel Sysplex cluster, enables multisystem coordination and datasharing.
Interagency Water Resource Meeting, Memphis, TN, November 17,
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
Running CESM An overview
Building Community and Capability through Common Infrastructure: ESMF and the Earth System Curator Cecelia DeLuca MAP Meeting College.
CCSM Software Engineering Update Tony Craig CCSM SEWG Meeting Feb 4, 2003.
State of ESMF: The NUOPC Layer Gerhard Theurich NRL/SAIC ESMF Executive Board / Interagency Working Group Meeting June 12, 2014.
NOAA Environmental Modeling System Cecelia DeLuca NOAA Environmental Software Infrastructure and Interoperability (NESII) NOAA ESRL/University of Colorado.
1 Purpose  To gain executive-level commitment from key market participants to take a leadership role in quickly improving retail transaction processing.
U N I T E D S T A T E S D E P A R T M E N T O F C O M M E R C E N A T I O N A L O C E A N I C A N D A T M O S P H E R I C A D M I N I S T R A T I O N.
SharePoint Fest 2013 Chicago What’s New and Exciting (and not so great) in SharePoint Designer 2013 Workflows Ira Fuchs – SharePoint Technical Specialist,
© 2013 IBM Corporation Accelerating Product and Service Innovation Service Virtualization Testing in Managed Environments Michael Elder, IBM Senior Technical.
A Quick Tour of the NOAA Environmental Software Infrastructure and Interoperability Group Cecelia DeLuca Dr. Robert Detrick visit March 28, 2012
ESMF Governance Cecelia DeLuca NOAA CIRES / NESII April 7, 2017
API Documentation Guidelines
Mariana Vertenstein (CGD)
Mariana Vertenstein CCSM Software Engineering Group NCAR
Metadata Development in the Earth System Curator
Progress of Interactions Among CCSM and Other Modeling Efforts
Presentation transcript:

Common Infrastructure for Modeling the Earth CIME A New Approach for Earth System Modeling – the CESM example https://github.com/ESMCI/cime

Why CIME? Facilitate infrastructure modernization as a collaborative project (e.g. CESM infrastructure) Response to February summit of US Global Change Research Program (USGCRP) / Interagency Group on Integrative Modeling (IGIM) as a positive outcome from the February Summit IGIM is charged with coordinating global change-related modeling activities across the Federal Government and providing guidance to USGCRP on modeling priorities Enable separation of infrastructure (no scientific intellectual property) versus scientific development codes (intellectual property that must be protected) Eliminate duplication of efforts

CIME current steps forward….. ALL CESM infrastructure moved to PUBLIC github repository CIME will facilitate AND encourage outside collaboration frequent feedback on infrastructure development quick problem resolution rapid improvement in the productivity, reliability and extensibility of the CIME infrastructure CIME can be developed and tested as a stand- alone system – independent of prognostic components

Old paradigm – everything in restricted developer repository Infrastructure Restricted Subversion Repository - All model components Restricted Subversion Repository Driver-Coupler Code Share Code Scripts System and Unit Testing Mapping Utilities New Post-Processing and Workflow Tools CAM (prognostic) DATM (data) SATM (stub) XATM (cpl test) ATM Models

New paradigm – all infrastructure is Open Source IP still in place for prognostic components PUBLIC Open Source Github Repository - Only prognostic components Restricted Subversion Repository Driver-Coupler Share Code Scripts Mapping Utilities System/Unit Testing All Data Models All Stub Models All cpl-test Models New Post Processing and Workflow Tools Shared Optimized math and communication utilities CAM CLM CICE POP (MPAS) RTM(MOSART) CISM Prognostic

PUBLIC Open Source Github Repository CIME Infrastructure can be used to facilitate releases and external collaborations Infrastructure PUBLIC Open Source Github Repository Driver-Coupler (ESMF Collaboration) (ACME Collaboration) Share Code Scripts System/Unit testing Mapping Utilities All Data Models All Stub Models All cpl-test Models Prognostic Components e.g. CESM ACME ESMF/NUOPC HYCOM

CIME Status Stand-alone capability New unit testing framework CIME run and tested “stand-alone” with either all data models or all stub-models or all “test-cpl” models New unit testing framework new unit tests in coupler Framework can also be applied to prognostic components Consolidation of separate externals Each current part of CIME was previously developed independently and often led to inconsistencies Now CIME is a SINGLE entity and ensures consistency among its various parts This simplifies and adds robustness to development process Documentation is a work in progress