WGISS WGISS Connected Data Assets Status Report October, 2019 CWIC Team Eugene Yu (GMU), Archie Warnock (A/WWW), Li Lin (GMU)

Slides:



Advertisements
Similar presentations
Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.
Advertisements

CWIC Exception & Error Handling Archie Warnock Lingjun Kang Genyong Yu
Ball State University Libraries A destination for research, learning, and friends Using Google Analytics Data to Expand Discovery and Use of Digital Archival.
Support for Client Partners Eugene G. Yu Lingjun Kang Archie Warnock
WGISS CNES SIT-30 Agenda Item 10 CEOS Action / Work Plan Reference 30 th CEOS SIT Meeting CNES Headquarters, Paris, France 31 st March – 1 st April 2015.
Slide: 1 CWIC Status Report Yonsook Enloe WGISS-39, Tsukuba May 13, 2015.
CWIC Developers Meeting January 29 th 2014 Calin Duma Service Level Agreements High-Availability, Reliability and Performance.
CWIC/IDN synchronization Lingjun Kang Michael Morahan
GCMD/IDN STATUS AND PLANS Stephen Wharton CWIC Meeting February19, 2015.
Page 1 CSISS Center for Spatial Information Science and Systems Design and Implementation of CWIC Metrics Weiguo Han, Liping Di, Yuanzheng Shao, Lingjun.
Page 1 CSISS Center for Spatial Information Science and Systems WGISS-37 meeting,2014 CWIC OpenSearch Implementation Yuanzheng Shao, Lingjun Kang, Archie.
Slide: 1 WGISS-37, April 2014 Yonsook Enloe Martin Yapur CWIC Report.
Slide: 1 27 th CEOS Plenary |Montréal | November 2013 Agenda item: 31 Satoko Horiyama MIURA WGISS Report and Actions.
WGISS Richard MORENO CNES CEOS SIT-29 Meeting CNES, Toulouse, France 9 th -10 th April 2014.
WGISS-40, Harwell, Oxfordshire, UK, Sept. 28-Oct. 2, 2015 GEO/CWIC Interactions Ken McDonald/NOAA CWIC Session, WGISS–40 October 1, 2015.
What is CWIC? Authors: Doug Newman Andrew Mitchell
WGISS-40: IDN Report Michael Morahan WGISS-40 Fall meeting / Harwell, United Kingdom
Page 1 CSISS Center for Spatial Information Science and Systems CWIC Metrics: Current and Future Weiguo Han, Liping Di, Yuanzheng Shao, Lingjun Kang Center.
CWIC + OPENSEARCH: IT WORKS WITH BROWSERS, TOO Archie Warnock Lingjun Kang Genyong Yu
WGISS Richard MORENO CNES SIT Workshop Agenda Item #8 CEOS SIT Technical Workshop CNES, Montpellier, France 17 th -18 th September 2014.
25th CEOS Plenary | Lucca, Italy| 8-9 November 2011 CEOS Support to GCI Agenda Item 8 Ivan Petiteville, ESA.
CWIC/Opensearch CCMEO Status WGISS 40 Patrick King Brian McLeod Canada Centre for Mapping and Earth Observation.
Slide: 1 CWIC Status Report Yonsook Enloe WGISS-40, Harwell UK Oct 1, 2015.
Report of the Architecture and Data Committee (ADC) R.Shibasaki (ADC, Japan)
Page 1 Federated Earth Observation (FedEO) Status CEOS WGISS Meeting #40 28 Sep – 02 Oct, 2015 Harwell, UK Hosted by UKSA M.Albani, P.Mougnaud, A.Della.
CWIC Open Search Best Practices Doug Newman (NASA ECHO) CEOS WGISS-37 April 15th 2014 Presenter: Archie Warnock (A/WWW Enterprises)
Quality Service Assurance: Monitoring, Testing, and Metrics Eugene G. Yu Lingjun Kang
GCI Overview Steve Browdy with input from Doug Nebert May 2012.
GEOSS Common Infrastructure (GCI) The GEOSS Common Infrastructure allows Earth Observations users to search, access and use the data, information, tools.
CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.
GCI Architecture GEOSS Information System Meeting 20 September 2013, ESA/ESRIN (Frascati, Italy) M.Albani (ESA), D.Nebert (USGS/FGDC), S.Nativi (CNR)
ESA-FAO GEOPortal STATUS & PLANS
CWIC Status Report Yonsook Enloe yonsook. k.
M. Albani, P. Mougnaud, A. Della Vecchia (ESA)
CEOS Work Plan Andrew Mitchell - NASA WGISS-43
CEOS OpenSearch Project II
WGISS Connected Data Assets
CWIC Status Report Yonsook Enloe yonsook. k.
EUMETSAT CWIC Status Report
WGISS Connected Data Assets
High Level Architecture
WGISS Report Andrew Mitchell - NASA CEOS Plenary 2016
WGISS Connected Data Assets Sept 26, 2017 Yonsook Enloe
The CEOS WGISS Atmospheric Composition Portal
Core Task Status, AR Doug Nebert September 22, 2008.
OpenSearch: the data search API for everyone
WGISS-41: IDN Report Michael Morahan CEOS WGISS-41 Meeting
CWIC Status Report Yonsook Enloe yonsook. k.
CWIC Status Report Yonsook Enloe yonsook. k.
A. Della Vecchia, D. Guerrucci, M. Albani (ESA)
Enhanced GEOSS Portal Joost van Bemmelen / Guido Colangeli ESA/ESRIN
WGISS Connected Data Assets April 5, 2017 Yonsook Enloe
CEOS and GEO Workplan Review
Topics NOAA support for: CWIC Infrastructure NOAA as a Data Provider
Search Relevancy in GEO Data Access Broker
WGISS Connected Data Assets April 9, 2018 Yonsook Enloe
CEOS OpenSearch Project II
CEOS WGISS INTEGRATED CATALOG (CWIC)
M. Albani, P. Mougnaud, A. Della Vecchia (ESA)
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
JAXA data portal report
WGISS Connected Data Assets Client Guide Oct 23, 2018 Archie Warnock
CWIC Community Client Development Martin Yapur & Ken McDonald WGISS-41
M. Albani, P. Mougnaud, A. Della Vecchia (ESA)
Working Group on Information Systems and Services (WGISS)
A. Della Vecchia, D. Guerrucci (ESA)
WGISS Connected Data Assets Session Today
Data Discovery and Access Session Summary of Actions
ESA EO Thesauri Andrea Della Vecchia (Randstad), Yves Coene (Spacebel)
Federated Earth Observation (FedEO)
Presentation transcript:

WGISS WGISS Connected Data Assets Status Report October, 2019 CWIC Team Eugene Yu (GMU), Archie Warnock (A/WWW), Li Lin (GMU)

From the WGISS Workplan Discovery and Access The WGISS Connected Data Assets include the International Directory Network (IDN), FedEO (Federated Earth Observation Gateway), and CWIC (CEOS WGISS Integrated Catalog). WGISS- supported standards are now used to search and access data from thousands of collections and hundreds of millions of inventory records, with additional data collections and inventory records from CEOS Agencies being added daily to this integrated system. The WGISS Connected Data Assets also provide access to CEOS Agency datasets through their integration with the GEOSS (Global Observation System of Systems) Common Infrastructure (GCI). More and more, CEOS Agencies continue to adopt the WGISS-supported standards and make their data discoverable via the WGISS Connected Data Assets. The WGISS Connected Data Assets System Level Team provides coordination and oversight of the operations and evolution of this integrated system and also provides technical support for CEOS partners that offer access to data and to client partners that connect to the data sources

Architecture WGISS Data Assets

Current WCDA WGISS Connected Data Assets Status Page http://ceos.org/wgiss-connected-data-assets-status/ Automated updated (daily) metrics for WCDA searchable collections/granules Sharing of test scripts (CWIC Synchronization document) Single document, WCDA Client Guide, gives details on how to search for all the data collections/granules in the WCDA Error handling approach agreement Detailed dataset & granule counts for CWIC and FedEO are available

CWIC Metrics Use specially designed logging and analysis tool Operations up to OSDD, OpenSearch query, and OpenSearch-specific-ID on metadata Get the statistics of visits to CWIC services by operations, countries/regions, data providers, datasets Get an overview of performance and quality of services by providers: success ratio, service time Database of requests up to specific IPs Google Metrics for portal page access By content types, locations, popularities Inventories of resources IDN collections

CWIC Metrics Data access: No indicators to tell if users actually accessed the data The metrics only tell if users did metadata search up to metadata records Granule links are directly to the remove provider, so CWIC is unaware of data access Users: No detail information about users and their usage of the results The regions of users are determined through the visiting IP by using the updated geoip database.

CWIC Metrics Purpose Users Metrics Basics General users Number of collections Spatiotemporal coverage Number of granules by collection Quantitative collection metrics Quantitative product metrics Qualitative collection metrics Usage analytics Management Usages by time By product By IP By location (user) By AOI (product) By scientific term (content) By platform/instrument/provider Quality of Service System Administrators Reliability ( success rate ) Availability (up time) Integrity (correctness) Performance (speed) Exception handling ( exception types) Troubleshooting Developers Exceptions Availability Specific metrics up to specific IP, dataset, time

CWIC Update CWIC Synchronization document completed – gives description and details (test scripts) of the daily dataset accessibility testing that is performed automatically. FedEO team implemented the test scripts also CWIC Data Partner Guides updated and completed Testing with NOAA One-Stop continues Ingesting updated NOAA collection metadata into IDN Testing for granule search NOAA One-Stop system will contain NOAA’s current and heritage EO data collections