Compliance Checker Presented by Luke Campbell (RPS)

Slides:

Advertisements

Similar presentations

OPeNDAP in the Cloud Optimizing the Use of Storage Systems Provided by Cloud Computing Environments OPeNDAP James Gallagher, Nathan Potter and NOAA/NODC.

Advertisements

OPeNDAP in the Cloud OPeNDAP James Gallagher, Nathan Potter and NOAA/NODC Deirdre Byrne, Jefferson Ogata, John Relph 26 June 2013.

DMAC ST and the Activities of the IOOS PO Derrick Snowden DMAC Steering Team

Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.

The NODC Glider Technical Specification Tom Ryan, Dan Seidov, John Relph (NODC) and James Bennett (University of Washington) U.S. IOOS National Glider.

Data Discovery 1.Data discovery systems 2.TDS and metadata 3.NcISO services.

OPeNDAP Present and Future An Overview Encompassing Current Projects & Potential New Directions Dave Fulker and James Gallagher.

TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.

Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.

A Super-Regional Modeling Testbed for Improving Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Cyberinfrastructure.

Customized cloud platform for computing on your terms !

Implementation of Model Data Interoperability for IOOS: Successes and Lessons Learned Rich Signell USGS Woods Hole, MA / NOAA Silver Spring USA Model Data.

Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.

Metadata for the Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS) using the Earth System Modeling Framework (ESMF) Peter Bosler University.

DM_PPT_NP_v01 SESIP_0715_AJ HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann Gerd Heber, John Readey, Joel Plutchak The HDF Group HDF.

Testing the US Integrated Ocean Observing System Data Discovery and Distribution Infrastructure with Real-World Problems Derrick Snowden 1, Rich Signell.

2 3 ROMS/COAWST NcML file 4 5 Exploiting IOOS: A Distributed, Standards-Based Framework and Software Stack for Searching, Accessing, Analyzing and.

IOOS Data Management Integration Standards Plans in the Northeast Eric Bridger (GMRI) Sep

THREDDS Data Server Ethan Davis GEOSS Climate Workshop 23 September 2011.

Coverages and the DAP2 Data Model James Gallagher.

U.S. Department of the Interior U.S. Geological Survey Management of Oceanographic time-series data at the Woods Hole Coastal and Marine Science Center.

Mid-Course Review: NetCDF in the Current Proposal Period Russ Rew

Glider data (*.*bd files) via Iridium or rsync from WHOI, Umaine or UMaryland Disk NetCDF/Acquire WMO ID IOOS Glider DAC ERDDAP OPeNDAP sequence or download.geoJson,.json.nc,.ncCF,.ncCFMA.csv,.tsv,

Enhancements to a Community Toolset for Ocean Model Data Interoperability: Unstructured grids, NCTOOLBOX, and Distributed Search Rich Signell (USGS), Woods.

Tools in Support of a National DMAC Derrick Snowden NERACOOS/ODP Annual Meeting 26 Sep 2012.

Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.

DMAC: Infrastructure to enable delivery of IOOS ® information Presentation to the IOOS Advisory Committee Derrick Snowden, System Architect, U.S. IOOS.

1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.

NODC ↔ Data Consumers Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.

IOOS Coastal Ocean Modeling Testbed (COMT) Cyberinfrastructure Oceans 12 Becky Baltes, IOOS Liz Smith, SURA Rich Signell, USGS Eoin Howlett, Kyle Wilcox,

THREDDS Catalogs Ethan Davis UCAR/Unidata NASA ESDSWG Standards Process Group meeting, 17 July 2007.

1 NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION NCEI-IOOS Project Updates Mathew Biddle May 28th, 2015 IOOS DMAC Meeting, IOOS.

IOOS National Glider Data Assembly Center

UAF/OSMC Presenters: Kevin O’Brien and Eugene Burger Abstract: Kevin O’Brien and Eugene Burger are from NOAA’s Pacific Marine Environmental Laboratory.

The Unified Access Framework for Gridded Data … the 1 st year focus of NOAA’s Global Earth Observation Integrated Data Environment (GEO-IDE) Steve Hankin,

The HDF Group Data Interoperability The HDF Group Staff Sep , 2010HDF/HDF-EOS Workshop XIV1.

You are Here! Navigating SharePoint 1. Sharon Weaver 15 years designing, developing, and managing software 10 years SharePoint experience Six Sigma Black.

National Coastal Data Development Center Status of OPeNDAP at NCDDC 11 September 2003 Susan Starke, Chief of IT Operations

LAS and THREDDS: Partners for Education Roland Schweitzer Steve Hankin Jonathan Callahan Joe Mclean Kevin O’Brien Ansley Manke Yonghua Wei.

DOC / NOAA / NMFS / SWFSC / ERD

Catalog-driven workflows using CSW Rich Signell, USGS, Woods Hole, MA, USA Filipe Fernandes, SECOORA, Brazil Kyle Wilcox, Axiom Data Science, Wickford,

Access to IOOS Data Relevant to OOI Kathleen Bailey NOAA/NOS/IOOS January 6, 2016.

1 09/2003 Processing Library Update CF Checker – Script made available as a web based form on the BADC site -

A Draft Standard for the CF Metadata Conventions Russ Rew, Unidata GO-ESSP 2009 Workshop

IOOS Compliance Checker Luke Campbell, Software Engineer, RPS ASA.

Update on Unidata Technologies for Data Access Russ Rew

U.S. Integrated Ocean Observing System (IOOS ® ) National Glider Data Assembly Center.

TSDS (HPDE DAP). Objectives (1) develop a standard API for time series-like data, (2) develop a software package, TSDS (Time Series Data Server), that.

IOOS National Glider DAC: Demonstration and Update April, 7th 2016 | Becky Baltes and Luke Campbell.

HDF Product Designer: Using Templates to Achieve Interoperability

Data Browsing/Mining/Metadata

Advancing netCDF-CF for the Geoscience Community

IOOS National Glider Data Assembly Center

GDWG Agenda Item: Tools for GRWG activities

IOOS National Glider Data Assembly Center

SDL Web Cloud – My first experience and learnings

Best Webdav Server Windows

IS IT EFFECTIVE TO RUN ONLINE DATING BACKGROUND CHECKS YOURSELF?

Enhancing Cloud Foundry with CLI Plugins

OneStop: Architecture Review

OpenAerialMap A Distributed Commons for Searching and Hosting Free Imagery Kate Chapman

Prepared by: Jennifer Saleem Arrigo, Program Manager

Module 01 ETICS Overview ETICS Online Tutorials

Data Management Overview

Configuration management suite

ExPLORE Complex Oceanographic Data

Future Development Plans

OPeNDAP’s Server4: Building a High Performance Data Server for the DAP

OPeNDAP/Hyrax Interfaces

Adapting an existing web server to S3

Presentation transcript:

Compliance Checker Presented by Luke Campbell (RPS) in collaboration with Derrick Snowden (IOOS), Jennifer Bosch (IOOS), Ajay Krishnan (NOAA)

Background Funded and Supported by IOOS Wanted a tool to improve metadata Community Driven Worked closely with NOAA NetCDF group to interpret standards for CF Recently implemented NCEI 2.0 checkers

Capabilities Implemented Standards ACDD 1.1, 1.3 CF 1.6 NCEI 1.1, 2.0 GliderDAC (Plugin)

Capabilities Attribute Checking Checks attributes exist and are valid

Capabilities Corrective Actions Maximize the quality of metadata

Capabilities Comprehends CF Data Model Understands the differences between discrete geometries Makes the right tests for the right geometry

Using the web interface An online version is available https://data.ioos.us/compliance/ Hosted on AWS Cloud Infrastructure using a docker instance

Using the web interface Select the checker

Using the web interface Drag and Drop File or Paste OPeNDAP URL

Using the web interface Run the test and read the results

Future Capabilities

Future Capabilities Support for unstructured gridded datasets UGrid and SGrid Conventions Plugins Better public API Machine to Machine interface Build a composite report of all checks

Related Projects IOOS Catalog Glider Data Assembly Center OceansMap (oceansmap.com) Environmental Data Server (EDS) NcSOS Implementation of IOOS Standards for USACE

Questions?