Data Stewardship Interest Group WGISS-45 Meeting

Slides:



Advertisements
Similar presentations
Global Change Master Directory (GCMD) Strategic Plan Wyn Cudlip BNSC/QinetiQ Presentation to IDN Task Team, WGISS25.
Advertisements

Product Quality and Documentation – Recent Developments H. K. Ramapriyan Assistant Project Manager ESDIS Project, Code 423, NASA GFSC
NASA Earth Science Data Preservation Content Specification H. K. (Rama) Ramapriyan John Moses 10 th ESDSWG Meeting – November 2, 2011 Newport News, VA.
ESA UNCLASSIFIED – For Official Use Data Stewardship Interest Group Session LTDP Activities & DSIG Introduction WGISS-37 Meeting Cocoa Beach (Florida-US)
NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.
Agenda: DMWG SM policy status ESIP meeting recap Reminder - DM Webinar Series New and updated web pages on DM website Metadata Training Sessions CDI meeting.
ESA UNCLASSIFIED – For Official Use Data Stewardship Interest Group WGISS-39 Meeting Data Purge Alert Procedure Tsukuba, Japan – May, 2015 Mirko.
World Data Center for Human Interactions in the Environment Conducting a Self-Assessment of a Long-Term Archive for Interdisciplinary Scientific Data as.
NOAA Administrative Order : Management of Environmental and Geospatial Data and Information Jeff Arnfield NOAA’s National Climatic Data Center Version.
ESA UNCLASSIFIED – For Official Use ESA AVHRR Data Holdings and Ongoing Curation Activities Mirko Albani, Sergio Folco.
WGISS-39, Tsukuba, Japan, May 11-15, 2015 GEO Community Portals Ken McDonald/NOAA CWIC Session, WGISS–39 May 13, 2015.
U.S. Department of the Interior U.S. Geological Survey CDI Webinar Series 2013 Data Management at the National Climate Change and Wildlife Science Center.
Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.
DRAFT EDMC Procedural Directives NOAA Environmental Data Management Committee 12/3/2015 1
ESIP Vision: “Achieve a sustainable world” by Serving as facilitator and advisor for the Earth science information community Promoting efficient flow of.
Improving Information Quality for Earth Science Data and Products – An Overview H. K. (Rama) Ramapriyan Science Systems and Applications, Inc. & NASA Goddard.
Task XX-0X Task ID-01 GEO Work Plan Symposium April 2014 Task ID-01 “ Advancing GEOSS Data Sharing Principles” Experiences related to data sharing.
Data Systems Integration Committee of the Earth Science Data System Working Group (ESDSWG) on Data Quality Robert R. Downs 1 Yaxing Wei 2, and David F.
SEDAC Long-Term Archive Development Robert R. Downs Socioeconomic Data and Applications Center Center for International Earth Science Information Network.
Presented by Eliot Christian, USGS Accessibility, usability, and preservation of government information (Section 207 of the E-Government Act) April 28,
Providing access to your data: Determining your audience Robert R. Downs, PhD NASA Socioeconomic Data and Applications Center (SEDAC) Center for International.
ESO and the CMR Life Cycle Process Winter ESIP, Jan 2015 ESDIS Standards Office (ESO) Yonsook Enloe Allan Doyle Helen Conover.
CLASS Metadata and Remote Sensing Extensions CLASS Data Provider’s Conference September 2005 Anna Milan, Ted.Habermann,
ESA UNCLASSIFIED – For Official Use Data Stewardship Interest Group ESA – EO Data Stewardship Maturity Matrix WGISS#41 Meeting, Canberra, (AUS) 14–18 March,
GEO Data Management Principles Implementation : World Data System–Data Seal of Approval (WDS-DSA) Core Certification of Digital Repositories Dr Mustapha.
CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.
Report from USGS 17th GSICS Executive Panel, Biot, 2-3 June 2016 Thomas Stone U.S. Geological Survey, Flagstaff, Arizona USA GSICS-EP-17, Biot, 2-3 June.
Status Report to the President under EO EPA ACTIONS 1 Executive Order: Improving Chemical Facility Safety & Security.
Data Stewardship Interest Group WGISS-43 Meeting
NASA Earth Science Data Stewardship
A Liaison Report from ISO TC211 to CEOS WGISS-44
Data Stewardship Interest Group WGISS-42 Meeting
Digital Repository Certification Schema A Pathway for Implementing the GEO Data Sharing and Data Management Principles Robert R. Downs, PhD Sr. Digital.
Data Stewardship Interest Group WGISS-43 Meeting
Ensuring and Improving Information Quality for Earth Science Data and Products – Role of the ESIP Information Quality Cluster H. K. (Rama) Ramapriyan,
Developing Criteria to Establish Trusted Digital Repositories
Trustworthiness of Preservation Systems
Global Coordination Platform
Persistent Identifiers Implementation in EOSDIS
DOI Overview to Support its Use in GSICS
Programme Board 6th Meeting May 2017 Craig Larlee
TechStambha PMP Certification Training
AGU Paper Number: IN43B-1697 Evolving a NASA Digital Object Identifiers System with Community Engagement Lalit Wanchoo1 and Nathan.
Data Stewardship Interest Group WGISS-44 Meeting
Global Coordination Platform
GIRO usage and GSICS Lunar Observation Dataset Policy S. Wagner
Exploitation of ISS Scientific data - sustainability
Agency Requirements: NOAA Administrative Order Management of environmental and geospatial data and information This training module is part of.
ESMF Governance Cecelia DeLuca NOAA CIRES / NESII April 7, 2017
GEOSS EVOLVE Osamu Ochiai GEO Secretariat CEOS WGISS-43
Data stewardship life cycle
The Joint CEOS/CGMS Working Group on Climate
INPE, São José dos Campos (SP), Brazil
WGISS-WGCV Joint Session
Sophia Lafferty-hess | research data manager
WGISS-WGCV Joint Session Standardization and Best Practices
Data Stewardship Interest Group WGISS-45 Meeting
Support for the AASHTO Committee on Planning (COP) and its Subcommittees in Responding to the AASHTO Strategic Plan Prepared for NCHRP 8-36, TASK 138.
WGISS-WGCV Joint Activity Standardisation and Best Practices
The Case for Data Management: Agency Requirements
Prepared by: Jennifer Saleem Arrigo, Program Manager
Presented to the CEOS WGISS October 22, 2018
WGCapD Perspectives of Work Plan –
A Case Study for Synergistically Implementing the Management of Open Data Robert R. Downs NASA Socioeconomic Data and Applications.
Bird of Feather Session
Working Group on Information Systems and Services (WGISS)
Presented to the CEOS WGISS October 10, 2019
Working Group on Information Systems and Services (WGISS)
AUC’s Role In Facilitating Access To Knowledge In The Arab World
Fundamental Science Practices (FSP) of the U.S. Geological Survey
Presentation transcript:

Data Stewardship Interest Group WGISS-45 Meeting WGISS EO Data Management and Stewardship Maturity Matrix: AVHRR Reprocessing project INPE, São José dos Campos (SP), Brazil 09–12 April, 2018 ESA UNCLASSIFIED – For Official Use

Outline WGISS EO Data Management and Stewardship Maturity Matrix Updates Application in AVHRR Reprocessing Project Way Forward and Achievement ESA UNCLASSIFIED – For Official Use

WGISS Data Management and Stewardship Maturity Matrix - White Paper Data stewardship “encompasses all activities that preserve and improve the information content, accessibility, and usability of data and metadata” (National Research Council 2007).   Data management includes all activities for “planning, execution and oversight of policies, practices and projects that acquire, control, protect, deliver and enhance the value of data and information assets.” (Mosely et al. 2009). In addition to data preservation, accessibility, and usability, WGISS MM also covers discoverability, use and services capabilities, program budget, data policy, etc. Cit. Ge Peng ESA UNCLASSIFIED – For Official Use

WGISS Data Management and Stewardship Maturity Matrix AVHRR Reprocessing Project Application ESA UNCLASSIFIED – For Official Use

AVHRR Reprocessing Project: SoW Requirements ESA UNCLASSIFIED – For Official Use

AVHRR Reprocessing Project: Measurement ESA UNCLASSIFIED – For Official Use

AVHRR Reprocessing Project: Gap between SoW and ongoing project Status ESA UNCLASSIFIED – For Official Use

AVHRR Reprocessing Project: Work Logic and Strategy ESA UNCLASSIFIED – For Official Use

DMP-1: METADATA FOR DISCOVERY Probably, there is a public available information on ESA webpage on data policy. The link or document should be referenced in a short intro file visible at the first search activity of an user. ESA UNCLASSIFIED – For Official Use

DMP-2: ONLINE ACCESS I do not know if ESA is generating this information - I think so ... then the green highlighted bar may be shifted to 4) ESA UNCLASSIFIED – For Official Use

DMP-3: DATA ENCODING With the decision to use standard NOAA format (1A, 1B) we fulfill these requirements. ESA UNCLASSIFIED – For Official Use

DMP-4: DATA DOCUMENTATION We rely on mission documentation stored at NOAA and EUMETSAT. NOAA- and MetOp-satellites, sensor description, calibration, etc. But the external links may change over time. Is there a need to copy all (which one?) information from external sites to ESA. If so - who will maintain and update this information? I would recommend to keep it simple and reference to NOAA- and EUMETSAT pages. ESA UNCLASSIFIED – For Official Use

Should we have to exchange the order of these two requirements? DMP-5: TRACEABILITY Receiving station and owner is available in the meta-file. Should we have to exchange the order of these two requirements? ESA UNCLASSIFIED – For Official Use

? DMP-6: QUALITY We should clarify it in the white paper? Working with AVHRR data, we distinguish between the following procedures (wording): - re-formatting, harmonization - pre-processing (includes calibration and geocoding; needed before a product can be retrieved) - product generation - post-processing (check for errors in the products; e.g. spikes in temperature etc.) "1) quality indicator post-processing available" has to be clearly defined to avoid any confusion by scientists involved in satellite data processing. ? We should clarify it in the white paper? ESA UNCLASSIFIED – For Official Use

DMP-7: PRESERVATION ESA UNCLASSIFIED – For Official Use

DMP-8: VERIFICATION ESA UNCLASSIFIED – For Official Use

DMP-9: REPROCESSING Reprocessing for calibration is a good point but it's a new data level. Due to missing on-board calibration of VIS-NIR channels of AVHRR and some noise in TIR, the whole procedure is work in progress with updates from different teams, which may be tested and included in the re-processing DMP-9. Before starting calibration of AVHRR a roundrobin should be organized with specialists of University of Wisconsin (Heidinger), UniBern (Neuhaus) and UnReading (Mittaz) to define the best procedure and test the different methods and approaches. ? ESA UNCLASSIFIED – For Official Use

DMP-10: PERSISTENT IDENTIFIER DOI can help to acknowledge the receiving and archiving teams. If possible should be included in meta data file. ESA UNCLASSIFIED – For Official Use

Scope of the Data Management and Stewardship Maturity Matrix A way to measure the Data Stewardship processes A way to plan the goals of your Data Stewardship processes and projects ESA UNCLASSIFIED – For Official Use

Interested Organizations CMMI Standards for Establishing Trusted Repositories for USGS Digital Assets A Provenance MM CDR Data Stewardship in the Earth Sciences The DMM model Editorial Board will recommend strategies for adapting and deploying a DMM model to the Earth and space sciences create guidance documents to assist in its implementation, and provide input on a pilot appraisal process. The ASF SAR DAAC participates in ESIP to further its goals of supporting national and international Earth science research, field operations, and remote-sensing applications that benefit society. These goals complement ESIP’s focus on “the collection, stewardship and use of Earth science data, information, and knowledge that is responsive to societal needs.” 5.4 Future Work In the meantime, the ESIP Data Stewardship Committee continues to work towards advancing the state of the art in data stewardship through the establishment of a series of liaisons with other groups working in this area. For example, several of the Research Data Alliance (RDA) Working Groups and Interest Groups have members who act as liaisons between those RDA communities and ESIP. In addition, ESIP has members on the FORCE11 DCIG group, on CODATA groups, and on other groups that are conducting related activities. ESIP teams also are contributing to the development of standards and best practices within the Earth science community. For example, we have started developing example data citation guidelines for reviewers, editors, and authors to help journals and scientific organizations that are considering updating their guidelines to include data related topics. To characterize the state of preservation of Earth Science data, we are beginning to test the Data Stewardship Maturity Matrix, originally developed by Ge Peng, of NOAA [46], on data that are external to the NOAA environment. The hope is that the Matrix can be generalized enough to work for Earth Science data more broadly, so that the Matrix can be applied in a uniform fashion by data centers and other data-holding organizations to express the state of any particular data set within their care. In assessing such tools, resources that offer similar utility also will need to be considered. ESIP community discussions are open to individuals and organizational representatives. Individuals may join discussions by perusing the ESIP wiki and attending any of the listed teleconferences or by adding their names to the posted mailing lists. Organizations are encouraged to join the ESIP Federation by completing a membership application. Organizational membership is free, subject to review of application and approval by the Federation Assembly. ISO 16363 Data Management Maturity Other Organizations ESA UNCLASSIFIED – For Official Use

Way Forward and Achievements Data Management and Stewardship Maturity Matrix Verification: Collection of Lessons Learned Analysis and Tuning of the White Paper Collaboration with: ESDIS as Joint activities Waiting possible input from NCEI/CICS-NC Scientific Data Stewardship Maturity Matrix (DSMM) Group managed by Ge Peng. Publication in the Journal of Global Change Data & Discovery by Liu Chuang (Institute of Geographic Sciences and Natural Resources Research) ESA UNCLASSIFIED – For Official Use

ESA UNCLASSIFIED – For Official Use