Curator: Gap Analysis (from a schema perspective) Rocky Dunlap Spencer Rugaber Georgia Tech.

Slides:



Advertisements
Similar presentations
Expanding Regridding Capabilities of the Earth System Modeling Framework Andrew Scholbrock University of Colorado – Boulder Robert Oehmke NOAA/CIRES 1.
Advertisements

Introduction to Maven 2.0 An open source build tool for Enterprise Java projects Mahen Goonewardene.
Earth System Curator Spanning the Gap Between Models and Datasets.
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech.
Feature Analysis of Coupling Technologies for Climate Models Spencer Rugaber, Rocky Dunlap and Leo Mark College of Computing Georgia Institute of Technology.
1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.
Metadata Semantics and the Earth System Curator Rocky Dunlap Earth System Curator Georgia Tech.
Implementation of Web Service Technologies in GFDL's FMS Runtime Environment Y. Malysheva, S. Nikonov, V. Balaji GFDL The 7 th GO-ESSP Workshop September.
Ontology Classifications Acknowledgement Abstract Content from simulation systems is useful in defining domain ontologies. We describe a digital library.
ARCS Data Analysis Software An overview of the ARCS software management plan Michael Aivazis California Institute of Technology ARCS Baseline Review March.
Contributing source code to CSDMS Albert Kettner.
Astrophysics, Biology, Climate, Combustion, Fusion, Nanoscience Working Group on Simulation-Driven Applications 10 CS, 10 Sim, 1 VR.
Interpret Application Specifications
1 Geophysical Fluid Dynamics Laboratory Review June 30 - July 2, 2009.
A Really Brief Crash Course in Semantic Web Technologies Rocky Dunlap Spencer Rugaber Georgia Tech.
Eric Guilyardi (LOCEAN/IPSL and Univ. Reading) and the Metafor team Common Metadata for Climate Modelling Digital Repositories IS-ENES kick-off meeting.
CCSM Portal/ESG/ESGC Integration (a PY5 GIG project) Lan Zhao, Carol X. Song Rosen Center for Advanced Computing Purdue University With contributions by:
1 Eric Guilyardi and the Metafor team Common Metadata for Climate Modelling Digital Repositories Metafor Dissemination Workshop Abingdon, 14 March 2011.
EARTH SCIENCE MARKUP LANGUAGE “Define Once Use Anywhere” INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
The Earth System Curator Metadata Representations Prototype Portal in Collaboration with ESMF and ESG Rocky Dunlap Spencer Rugaber Georgia Tech.
Resource Management and Accounting Working Group Working Group Scope and Components Progress made Current issues being worked Next steps Discussions involving.
Open Access, and more … Leo Mark, Ph.D. School of Computer Science Georgia Tech Blind Orion Searching for the Rising Sun. Nicolas Poussin (1594–1665) “If.
CIM – The Common Information Model in Climate Research
Characterisation Data Model applied to simulated data Mireille Louys, CDS and LSIIT Strasbourg.
Metadata for the Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS) using the Earth System Modeling Framework (ESMF) Peter Bosler University.
NE II NOAA Environmental Software Infrastructure and Interoperability Program Cecelia DeLuca Sylvia Murphy V. Balaji GO-ESSP August 13, 2009 Germany NE.
1 CW 2015, Manchester, 04/ Coupling technology benchmarking in IS-ENES2 Coupling technology benchmarking in IS-ENES2 IS-ENES2 WP10-T3 Evaluation.
.NET Framework Danish Sami UG Lead.NetFoundry
ESMF Code Generation Rocky Dunlap Spencer Rugaber Leo Mark Georgia Tech College of Computing.
The use of modeling frameworks to facilitate interoperability Cecelia DeLuca/NCAR (ESMF) Bill Putman/NASA GSFC (MAPL) David Neckels/NCAR.
The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th.
The european ITM Task Force data structure F. Imbeaux.
DTC HWRF Task AOP2009 & AOP /01/2009 Ligia Bernardet.
“curator” DB design Curator meeting, GFDL, Sep 20.
Earth System Modeling Framework Status Cecelia DeLuca NOAA Cooperative Institute for Research in Environmental Sciences University of Colorado, Boulder.
1 Earth System Modeling Framework Documenting and comparing models using Earth System Curator Sylvia Murphy: Julien Chastang:
Page 1© Crown copyright 2004 FLUME Metadata Steve Mullerworth 3 rd -4 th October May 2006.
Earth System Modeling Framework Python Interface (ESMP) October 2011 Ryan O’Kuinghttons Robert Oehmke Cecelia DeLuca.
Strategic Plan Implementation Cecelia DeLuca/NCAR (ESMF) December 17, 2008 ESMF Board/Interagency Meeting.
ESMF Code Generation with Cupid Update and Demo October 2009 Rocky Dunlap Spencer Rugaber Leo Mark Georgia Tech College of Computing.
NCEP ESMF GFS Global Spectral Forecast Model Weiyu Yang, Mike Young and Joe Sela ESMF Community Meeting MIT, Cambridge, MA July 21, 2005.
Exporting WaterML from the Earth System Modeling Framework Xinqi Wang Louisiana State University NCAR SIParCS Program August 4, 2009.
J.P. Wellisch, CERN/EP/SFT SCRAM Information on SCRAM J.P. Wellisch, C. Williams, S. Ashby.
Page 1© Crown copyright 2004 FLUME Marco Christoforou, Rupert Ford, Steve Mullerworth, Graham Riley, Allyn Treshansky, et. al. 19 October 2007.
FRErator – the Bridge between FRE and Curator DB.
Sarah Callaghan 1, Gerry Devine 2, Eric Guilyardi 3, Bryan Lawrence 1, Charlotte Pascoe 1, Lois Steenman-Clark 2 and the Metafor Project Team 1 NCAS-BADC;
Slide 1 Service-centric Software Engineering. Slide 2 Objectives To explain the notion of a reusable service, based on web service standards, that provides.
1 GFDL Data Portal Current Status, Achievements and Future Development NOAATECH-2006 K.Dixon, V.Balaji, S.Nikonov GFDL, Princeton.
Building Community and Capability through Common Infrastructure: ESMF and the Earth System Curator Cecelia DeLuca MAP Meeting College.
Semantic Web COMS 6135 Class Presentation Jian Pan Department of Computer Science Columbia University Web Enhanced Information Management.
Satisfying Requirements BPF for DRA shall address: –DAQ Environment (Eclipse RCP): Gumtree ISEE workbench integration; –Design Composing and Configurability,
Enhancements for Hydrological Modeling in ESMF Cecelia DeLuca/NCAR (ESMF) December 19, 2008 AGU Fall Meeting.
ESMF and the future of end-to-end modeling Sylvia Murphy National Center for Atmospheric Research
Application of RDF-OWL in the ESG Ontology Sylvia Murphy: Julien Chastang: Luca Cinquini:
Climate-SDM (1) Climate analysis use case –Described by: Marcia Branstetter Use case description –Data obtained from ESG –Using a sequence steps in analysis,
David Adams ATLAS ATLAS Distributed Analysis and proposal for ATLAS-LHCb system David Adams BNL March 22, 2004 ATLAS-LHCb-GANGA Meeting.
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech 5 th GO-ESSP Community Meeting.
GFDL Data Portal Update: Curator DB Approach S.Nikonov, V.Balaji, K.Dixon GFDL The 5 th GO-ESSP Workshop June , LLNL.
Meeting of the Member States Expert Group on Digitisation and Digital Preservation , Luxembourg European Archival Records and Knowledge Preservation.
Solvency II Tripartite template V2 and V3 Presentation of the conversion tools proposed by FundsXML France.
The Earth System Curator Metadata Infrastructure for Climate Modeling Rocky Dunlap Georgia Tech.
Metadata Support for Model Intercomparison Projects Sylvia Murphy: Cecelia DeLuca: Julien.
Embedding Live Access Server into GFDL Data Portal Infrastructure K.O’Brien (PMEL), S.Nikonov (GFDL), R.Schweitzer (PMEL), S.Hankin (PMEL), V.Balaji (GFDL)
Service-centric Software Engineering
System Concept Simulation for Concurrent Engineering
RDF Standard Data Model Exchange
Metadata Development in the Earth System Curator
Overview Activities from additional UP disciplines are needed to bring a system into being Implementation Testing Deployment Configuration and change management.
Contributing source code to CSDMS
Presentation transcript:

Curator: Gap Analysis (from a schema perspective) Rocky Dunlap Spencer Rugaber Georgia Tech

Deliverables What do we want the outcome to be...  At the end of this session today  At the end of this year of Curator  3-5 years from now Let’s think in terms of tangible products

Expected outcomes from Curator one year from now Schema side:  A coherent, upper-level metadata model for describing modeling components, configured and un-configured models, model-generated datasets, and other software resources such as modeling frameworks  But, what form does the product take? Software side (CDP-Curator):  A prototype of an online repository of modeling resources, including a faceted search interface, download mechanism, and basic compatibility checking abilities

Expected outcome at the end of this session

Overview of Schemata NMM Component NMM Potential Model NMM Model Gridspec Component Input and Output (CIAO) (was PMIOD) NMM Application Framework ESG Ontology FMS Runtime Environment (FRE) XML

Other Schemata NetCDF + CF FLUME Metadata PRISM Schemata  SMIOC (Specific Model Input Output Config.)  SCC  AD Legacy Code Markup Language (LCML)

Schemata Links SchemaSourceNotationDescriptionStatus Curator NMMCuratorXSDGeneralized NMM+ Component+ Potential Model+ Model+ Application+ CIAO+ Framework+ Gridspec+ NMM XSDModels+ Curator CompleteCuratorXSDComprehensive Curator schema+ FREGFDLXMLFMS Runtime Environement+ Curator DatabaseGFDLSQLModels and workflow (FRE++)+ ESGESG OntologyESGOWLDatasets? CDPCuratorCommunity Data Portal+ ESMF Component DBESMFSQLModels+ PRISM XSD PMIODPotential Model Input Output Description+ SCCHigh-level configuration- SMIOCModel run (fields)+ ADApplication Description Model Platform- FLUMEMET Ofc.?Flexible Unified Modeling Language- NetCDFNCARTableData format for gridded datasets? CFNCARTableStandard names for physical quantities? LCMLMITXSDLegacy Computing Markup Language- + Will be actively included in Curator - Will not be included as part of Curator ? Extent of incorporation into Curator unknown

NMM Component Describes a single modeling component – not necessarily a complete or runnable model Technical properties (compilers, platforms) Scientific properties (parameterizations) Numerical properties (grids, calendars) Interface (coupling), inputs and outputs

NMM Potential Model Composition of NMM Components that could form an executable model, but is not configured Basic info such as name, version, description, contact info, etc. At its most basic level: just a list of component identifiers Most “interesting” metadata still resides in NMM Component

NMM Model Describes a fully configured and executable model Set of configured components (e.g., actual values used during a model run, or that could be used to perform a run) Parameter settings, input files, output files, grid resolution Pointer back to NMM Potential Model

Gridspec A standard description of the grids used to discretize model output Proposal to add to CF Mosaic made up of tiles Tiles have properties:  Regularity  Uniformity  Coordinate system  Edges, vertices, angles, arc type Exchange grid for moving data between grid tiles

CIAO (Component Input and Output) Describes coupling fields supported/used by a component Basically: a list of fields, where each field has:  Local name, standard name  Units  Data type  I/O direction (Input, Output, In/Out)  Field dependencies

NMM Application “describe an application which ‘bins’ or ‘wraps’ several models into one, for example an ensemble” (NMM Website: cms.nerc.ac.uk/NMM/content/category/6/22/51/) cms.nerc.ac.uk/NMM/content/category/6/22/51/

Framework Schema Description of a software framework used in Earth system modeling Only basics: name, version, etc.

Earth System Grid (ESG) Ontology Class hierarchy used by ESG Example classes:  Activity ClimateModelExperiment, Ensemble, Simulation  Grid LogicallyRectangular, PixelBased, Triangular, Unstruct.  ModelType Atmopshere  Resource Software, Dataset

FMS Runtime Environment XML XML configuration file used to assemble, compile, execute, and post-process an FMS model (used at GFDL) – workflow Directory locations (CVS, output, temp) Batch queues and commands Experiment descriptions (regression tests, production runs, run lengths, number of processors, platforms) Fortran namelists, parameter settings

UML Package Diagram

Conceptual Model of CDP-Curator RDF