Data Discovery 1.Data discovery systems 2.TDS and metadata 3.NcISO services.

Slides:



Advertisements
Similar presentations
Documenting Data to Support Discovery and Use Dave Neufeld Ted Habermann John Kozimor.
Advertisements

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
GEOSS Water Services for Data and Maps Community Recommendations David K. Arctur, Project Lead, GEOSS AIP-6 Water SBA University.
Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.
NOAA Documentation Improvement Ted Habermann How do we measure and visualize improvements in NOAA Documentation? Record Count Completeness (Rubric Scores)
Crossing the Digital Divide
FGDC, Meet the DDI Adding Geospatial Metadata to a Numeric Data Catalog Julie Linden Yale University.
ESRL Global Systems Division NOAA Environmental Information Services (NEIS) -- A framework of layered services designed to help NOAA’s mission by facilitating.
NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.
EuroGEOSS Implementing the GEOSS Data Sharing Action Plan: Forestry.
Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.
Unidata TDS Workshop THREDDS Data Server Overview October 2014.
Introduction Downloading and sifting through large volumes of data stored in differing formats can be a time-consuming and sometimes frustrating process.
Documentation Developments Ted Habermann, NOAA/NESDIS/NGDC Adoption of ISO Metadata Standards - Crossing the Chasm Facilitating the Transition Documentation.
NOAA Data Management Activities Deirdre Jones, EDMC Chair Jeff de La Beaujardière, DM Architect Prepared for DAARWG
Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.
Publishing Digital Content to a LOR Publishing Digital Content to a LOR 1.
January 4, 2012 Christine White, Esri. A long time ago in a galaxy far, far away....
ISO-2 and more NGDC Geoportal January 4 th, 2012.
Crossing the Digital Divide Presented by: Fernando R. Salas David Maidment, Enrico Boldrini, Stefano Nativi, Ben Domenico OGC Technical Meeting – Met/Occean.
Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.
1 The INSPIRE Geoportal Ioannis Kanellopoulos Spatial Data Infrastructures Unit European Commission Joint Research Centre Institute for Environment and.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
DM_PPT_NP_v01 SESIP_0715_AJ HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann Gerd Heber, John Readey, Joel Plutchak The HDF Group HDF.
2 3 ROMS/COAWST NcML file 4 5 Exploiting IOOS: A Distributed, Standards-Based Framework and Software Stack for Searching, Accessing, Analyzing and.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
IOOS Data Management Integration Standards Plans in the Northeast Eric Bridger (GMRI) Sep
THREDDS Data Server Ethan Davis GEOSS Climate Workshop 23 September 2011.
Sept 19,  Provides a common set of terminology and definitions  A framework for describing resources and processes  Enables computer based interoperability.
ATMOSPHERIC SCIENCE DATA CENTER ‘Best’ Practices for Aggregating Subset Results from Archived Datasets Walter E. Baskin 1, Jennifer Perez 2 (1) Science.
U.S. Department of the Interior U.S. Geological Survey Management of Oceanographic time-series data at the Woods Hole Coastal and Marine Science Center.
Enhancements to a Community Toolset for Ocean Model Data Interoperability: Unstructured grids, NCTOOLBOX, and Distributed Search Rich Signell (USGS), Woods.
Tools in Support of a National DMAC Derrick Snowden NERACOOS/ODP Annual Meeting 26 Sep 2012.
Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.
Architecture Renovation Yoshiyuki Kudo (JAXA) WGISS-37.
IOOS Model Data Interoperability Design ROMS POM WW3 WRF ECOM NcML Common Data Model OPeNDAP+CF WCS NetCDF Subset THREDDS Data Server Standardized (CF)
1PeopleDocumentsData Catalog Generation Tools Analysis and Visualization Tools Data Services Discovery and Publication Tools Discovery and Publication.
GI-cat / THREDDS notes. GI-cat/THREDDS system
Documentation from NcML to ISO Ted Habermann, NOAA NESDIS NGDC.
Opendap dev - meeting, Boulder, Feb 2007 OPeNDAP infrastructure in European Operational Oceanography T Loubrieu (IFREMER) T Jolibois (CLS)
IOOS Modeling Testbed Cyberinfrastructure Rich Signell, USGS, Woods Hole, MA IOOS-RA-Briefing, Feb 14, 2012.
Unidata TDS Workshop THREDDS Data Server Overview
Recent developments with the THREDDS Data Server (TDS) and related Tools: covering TDS, NCML, WCS, forecast aggregation and not including stuff covered.
IOOS Data Services with the THREDDS Data Server Rich Signell USGS, Woods Hole IOOS DMAC Workshop Silver Spring Sep 10, 2013 Rich Signell USGS, Woods Hole.
THREDDS Catalogs Ethan Davis UCAR/Unidata NASA ESDSWG Standards Process Group meeting, 17 July 2007.
Unidata’s TDS Workshop TDS Overview – Part I July 2011.
Copyright © 2006 Pilothouse Consulting Inc. All rights reserved. Search Overview Search Features: WSS and Office Search Architecture Content Sources and.
Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center.
Creating Good Documentation NOAA National Geophysical Data Center
GI-cat / THREDDS notes. GI-cat/THREDDS system
ADC Portal & Clearinghouse GEO Architecture and Data Committee 2-3 March 2006 George Percivall OGC Chief Architect
Metadata Training for SEFSC Science Staff Part Two.
Data Interoperability at the IRI: translating between data cultures Benno Blumenthal International Research Institute for Climate Prediction Columbia University.
Convergence And Trust in Earth and Space Science Data Systems Ted Habermann, NOAA National Geophysical Data Center Documentation: It’s not just discovery...
ORNL DAAC SPATIAL DATA ACCESS TOOL Open Geospatial Consortium (OGC) Services Bruce E. Wilson Suresh K. Santhana Vannan Yaxing Wei Tammy W. Beaty National.
New Dog You Met Conventions Ted Habermann NOAA EDMC May 2012 Data needs to be in tools Document.
Rich Signell Roland Viger Curtis Price USGS Community for Data Integration Feb 15, 2012.
Update on Unidata Technologies for Data Access Russ Rew
THREDDS Data Server (TDS) and Data Discovery John Caron Unidata/UCAR May 15, 2006.
R2R ↔ NODC Steve Rutz NODC Observing Systems Team Leader May 12, 2011 Presented by L. Pikula, IODE OceanTeacher Course Data Management for Information.
GEOSS Component and Service Registry (CSR)
NASA GESDISC Mahabal Hegde ADNET Systems/NASA GESDISC
ODP Interoperability Package
(Former GEOSS Common Infrastructure)
INSPIRE Geoportal Thematic Views Application
NASA's Earth Science Gateway ESIP Meeting at College Park, Nov
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
From Collection to Granule in
4/5 May 2009 The Palazzo dei Congressi di Stresa Stresa, Italy
Esri Geoportal Server Implementing a Spatial Data Infrastructure
Presentation transcript:

Data Discovery 1.Data discovery systems 2.TDS and metadata 3.NcISO services

Data Discovery 1.Data discovery systems TDS does not support searching features. We look for data browsing through catalogs. Data discovery systems harvest metadata from TDS catalogs and expose it through interfaces that TDS itself does not support (Brokers). Data discovery systems enable searches on TDS servers! Harvest data from other sources (OGC services, ISO metadata standards), federated systems GI-Cat, Geoportal, GeoNetwork

1.2 Issues harvesting metadata Data Discovery 1.Data discovery systems TDS instances don't provide too much metadata. Crawl at dataset level. Don't harvest metadata at collection level. Manage large numbers of datasets. Provide access to datasets rather than to actual data. Data display that is useful, meaningful and satisfactory for multi-disciplinary users.

1.3 GI-Cat & Geoportal demo Data Discovery 1.Data discovery systems Running instances: * EURO GEOSS (GI-Cat): * NGDC geoportal: * NODC geoportal:

2.1 Metadata matters Data Discovery 2.THREDDS and metadata - METADATA ENABLES DATA DISCOVERY - BETTER INTEROPERABILITY - IMPROVES DATA EXCHANGE

2.2 We are data providers... Data Discovery 2.THREDDS and metadata

2.3 TDS metadata Data Discovery 2.THREDDS and metadata TDS provides several kinds of metadata: access, spatial and time coverage, contact, title, summary, keywords, variables.... Feature Collections get metadata from files (CF- conventions, GRIB...) Attribute Conventions Dataset Discovery (ACDD) very_(ACDD)

2.4 Adding metadata to catalogs Data Discovery 2.THREDDS and metadata Metadata tags: - Documentation, metadata, property... - Reference: ogSpec.html#metadataElement Inheritance: inherited=”true” ACDD recommendations: (ACDD)

3.1 What is NcISO? Metadata & ncISO services 3.NcISO services Developed by NGDC (National Geophysical Data Center) NcISO provides a set of services for managing our metadata: - NCML: information of our datasets in ncml - UDDC(*): assesses our metadata service - ISO: translate catalogs into ISO documents (*) UDDC former acronym for ACDD

3.2 Enabling ncISO Data Discovery 3.NcISO services ThreddsConfig.xml: true ncISO for datasets in your catalogs:

3.3 ncISO exercise Data Discovery 3.NcISO services 1. Enable ncISO 2. Check your UDDC(*) score 3. Add metadata and improve the UDDC score (*) UDDC former acronym for ACDD