Report from the Data Management Technical Advisory Group: DM-TAG Members: Ken Casey, Edward Armstrong, Helen Beggs, Craig Donlon, Robert Evans, Chelle.

Slides:



Advertisements
Similar presentations
Peter Griffith and Megan McGroddy 4 th NACP All Investigators Meeting February 3, 2013 Expectations and Opportunities for NACP Investigators to Share and.
Advertisements

Integrated Ocean Observing System (IOOS) Data Management and Communication (DMAC) Standards Process Julie Bosch NOAA National Coastal Data Development.
UWG 2013 Meeting Science Direction Discussion. Thrusts Invigorate outreach Deploy DM infrastructure Modernize data access tools Enhance web presence Integrate.
The NODC Glider Technical Specification Tom Ryan, Dan Seidov, John Relph (NODC) and James Bennett (University of Washington) U.S. IOOS National Glider.
1 Overview LTSRF Status GHRSST Reanalysis Example L4 Analyses Future Activities GlobColour Connection Villefranche sur mer,
6-7 May 2002 CEOS GRID Workshop 1 “CEOS GRID Proposals” roundtable: Introduction ESRIN, 6-7 May 2002 CEOS Workshop on GRID.
1 NODC, Russia GISC & DCPC developers meeting Langen, 29 – 31 March E2EDM technology implementation for WIS GISC development S. Sukhonosov, S. Belov.
Office of Inspector General (OIG) Internal Audit
1 Overview LTSRF Status GHRSST Reanalysis Example L4 Analyses Future Activities Beijing, October 2006 The GODAE High Resolution.
MISST FY1 team meeting April 5-6, Miami, FL NOAA: Gary Wick, Eric Bayler, Ken Casey, Andy Harris, Tim Mavor Navy: Bruce Mckenzie, Charlie Barron NASA:
User Working Group 2013 Data Management System – Status 12 March 2013
GODAE High Resolution Sea Surface Temperature Pilot Project GHRSST-PP and the NOAA-NASA Collaboration for Data Management and Reanalysis Kenneth Casey.
WGClimate John Bates NOAA SIT Workshop Agenda Item #8 WGClimate Work Plan progress & Issues CEOS SIT Technical Workshop CNES, Montpellier, France 17 th.
CEOS VC/WG working day – Report on the integrated ocean surface products discussion Julia Figa-Saldaña, Hans Bonekamp EUMETSAT SIT Workshop Agenda Item.
UWG 2013 Meeting PO.DAAC Data Stewardship Status.
GHRSST, V1, CGMS 41 July 2013 Coordination Group for Meteorological Satellites - CGMS Add CGMS agency logo here (in the slide master) Coordination Group.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
Opendap dev - meeting, Boulder, Feb 2007 OPeNDAP infrastructure in European Operational Oceanography T Loubrieu (IFREMER) T Jolibois (CLS)
AN ENHANCED SST COMPOSITE FOR WEATHER FORECASTING AND REGIONAL CLIMATE STUDIES Gary Jedlovec 1, Jorge Vazquez 2, and Ed Armstrong 2 1NASA/MSFC Earth Science.
MPARWG Business & Disposition of Action Items from MPARWG October 2009 H. K. (Rama) Ramapriyan NASA/GSFC Metrics Planning and Reporting (MPAR) WG 9 th.
GCOS SST WG plans Nick Rayner OOPC-12, 2 nd May 2007.
1 Agenda Review Issues Melbourne, May 2007 Kenneth S. Casey NOAA National Oceanographic Data Center May 2007 Gary Wick, Rapporteur GHRSST-8 Session-8 Reanalysis.
Application of in situ Observations to Current Satellite-Derived Sea Surface Temperature Products Gary A. Wick NOAA Earth System Research Laboratory With.
Archival Workshop on Ingest, Identification, and Certification Standards Certification (Best Practices) Checklist Does the archive have a written plan.
GEO ADC meeting, Washington DC, USA, Sep Slide # 1 DA DA Virtual Constellations Ivan Petiteville, CEOS GEO ADC Meeting, Washington DC,
ESO Developing and Emerging Standards, Practices, and Technologies Yonsook Enloe, Helen Conover, Allan Doyle ESDIS Standards Office 7/14/ Summer.
2014 Aquarius / SACD Science Team Meeting Agenda and Objectives Summarize the completion of NASA’s Aquarius 3-year prime salinity measurement mission (November.
Integrated ocean surface products Julia Figa-Saldaña, Hans Bonekamp EUMETSAT CEOS WG/VC working day EUMETSAT, Darmstadt, Germany 16 th September 2015.
1 Overview LTSRF Status GHRSST Reanalysis Example L4 Analyses Future Activities D.C., Nov 2006 Long Term Stewardship and Reanalysis.
Future needs and plans for ocean observing in the Arctic AOOS Arctic Town Hall Futur Zdenka Willis Integrated Ocean Observing System National Program Office.
The GODAE High Resolution SST Project as an NDE Customer Presented By Ken Casey (NESDIS/NODC)
Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.
Internal Audit Section. Authorized in Section , Florida Statutes Section , Florida Statutes (F.S.), authorizes the Inspector General to review.
February 12, 2002Tom McGlynn ADEC Interoperability Technical Working Group Report.
Update on the GHRSST Users Manual GDS2.0 rev04.4 Book Captains: Chris Jeffery 1 and Jorge Vazquez Content Brief overview of the GHRSST project Background.
GDS-2.0 Breakout Session Craig Donlon GHRSST-PO Presented at the GHRSST IX Workshop, Perros Guirrec, France, 9-13 th June 2008.
Summary of the G10 meeting C Donlon.
How to Access Data from the Group for High Resolution Sea Surface Temperature (GHRSST) at the Global Data Assembly Center (GDAC) and the Long Term Stewardship.
CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.
GDS-2.0 Breakout C Donlon & C. Gentemann GHRSST-X, Santa Rosa, Ca. USA, 1-5 th June 2009.
1 Santa Rosa, CA, June 2009 Kenneth S. Casey, Tess Brandon NOAA National Oceanographic Data Center Nick Rayner Met Office Hadley Centre June 2010 GHRSST.
GHRSST Advisory Council meeting Hans Bonekamp. AC Attendance Hans Bonekamp EUMETSAT (Chair) Nigel Houghton (ESA) Gary Wick NOAA (MISST) Ken Casey NOAA.
10 th GHRSST Science Team Meeting Santa Rosa, CA 3 June 2009.
Data Assembly & Systems Technical Advisory Tag (DAS-TAG) Breakout Session Tues 22 nd June.
Sea Surface Temperature Distribution from the Physical Oceanography DAAC Ed Armstrong JPL PO.DAAC MODIS Science Team Meeting.
10 th GHRSST Science Team Meeting Santa Rosa, CA 3 June 2009.
Summary of the GHRSST 9 th Meeting Dr. Craig Donlon Director of the International GHRSST Project Office Presented at the GHRSST.
Status Report – CEOS-CGMS Working Group on Climate Presented to CGMS-43 Plenary session, agenda item G.1.
NDMC NASA –JPL Project Activities Update: Objectives and Deliverables
Implementing the New JCOMM Marine Climate Data System (MCDS)
Global Grid Forum GridForge
Safeguards- Feedback on Safeguards ED-2 and Task Force Proposals
Snow Watch Team Terms of Reference
MODIS SST Processing and Support for GHRSST at OBPG
S2S sub-project on verification (and products)
VC-WG working day on Sept 16th 2015
GIRO usage and GSICS Lunar Observation Dataset Policy S. Wagner
5g. Repository For GSICS Work Use of github for codes etc
The Joint CEOS/CGMS Working Group on Climate
Site classifications, definitions, and updates to Landnet
CEOS/CGMS Working Group Climate
Committee on Earth Observation Satellites
Prepared by: Jennifer Saleem Arrigo, Program Manager
Systems Engineering for Mission-Driven Modeling
The WIGOS Pre-Operational Phase
GODAE Final Symposium, 12 – 15 November 2008, Nice, France
Roles and Responsibilities
Sea Surface Temperature – Virtual Constellation
Planning Services Meeting Client Communications
Recent Activities of the OST-VC
Presentation transcript:

Report from the Data Management Technical Advisory Group: DM-TAG Members: Ken Casey, Edward Armstrong, Helen Beggs, Craig Donlon, Robert Evans, Chelle Gentemann, Andy Harris, Pierre Leborgne, Jean-Francois Piolle, Richard Reynolds, Doug May, Bruce Mackenzie, Peter Cornillon

Accomplishments Revision GDS-1.7 –Level 4 specifications –Level 2P specifications NASA ROSES 2007 call targeting use of GHRSST data Discussion on Level 3 specifications (led by Ken Casey) and based on Pierre LeBorgne’s document. Addition of “Data Access Tutorial” written by Ken Casey. Accessible through both LSTRF and GDAC web sites. Formation of SSES working group Data Policy Draft Document

LEVEL 3 discussions Initiated based on paper by Pierre LeBorgne MERSEA IP Marine Environment and Security for the European Area - Integrated Project Implementation of a fine scale SST analysis over the Atlantic Ocea P. Le Borgne, A. Marsouin, F. Orain and H. Roquet (Météo-France, DP/CMS) A. Coat and Y. Guichoux (Actimar)

Level 3 issues: continued Several issues of discussion raised. Major topics include: · Filenaming conventions · Collated and super collated data sets · Origins of L3 products · Gridded versus swath products · More later as these discussions develop

CF Issues Discussions with Steve Hankin on CF specifications driven by GHRSST (led by Edward Armstrong). Issues raised by Steve Hankin include: –No major show stoppers, main issues appear to be no explicit standard for codes in CF and incorporation of swath data. One goal of the meeting is to write a report to Steve Hankin on needs of GHRSST with respect to CF standards. –Eg: Ed Armstrong had a discussion with CF developers to add time_offset to COARDS attributes. –Area for discussion? How do we move forward with this? What is the process for petitioning the CF for new attributes? Who is the right person? –Ed Armstrong petitioned CF community to submit CF/COARDS to the NASA Standards Process Group

CONTINUED Official letter endorsing the integration of the GDAC into the Physical Oceanography Distributed Active Archive Center (PO.DAAC). Endorsement came from the PO.DAAC User Working Group (UWG) Joint Assembly 2007 Acapulco, Mexico –Chairs Jorge Vazquez, Craig Donlon, Ken Casey, Zdenka Willis –Specifically targeting using GHRSST and other Remotely Sensed Climate Data Records (CDR).

NASA’s Research Opportunities in Space and Earth Sciences 2007:Appendix A6 Physical Oceanography Call ROSES 2007 Headquarters Program Manager Eric Lindstrom. Emphasis placed on SST and salinity. Gary Lagerloef and Jorge Vazquez mentioned as points of contact for salinity and SST respectively. –“NASA is playing a central role in providing the next generation of data products for sea surface temperature through the Global Ocean Data Assimilation Experiment (GODAE) High-Resolution Sea Surface Temperature (GHRSST) pilot project ( Products”. –Expected to lead to a large increase in users

ROSES 2007: continued “Proposals are sought which characterize and/or reduce uncertainties in these data products, utilize prototype products to constrain ocean general- circulation models or interact directly with the GHRSST project to prepare for exploitation of data.”

SSES Working Group Data Policy document-more discussion on this later. Formation of Single Sensor Error Characteristics (SSES) Working Group (led by Pierre LeBorgne, Group includes; –Robert Evans –Gary Cortlett –Gary Wick –Peter Minnett –Bryan Franz –Doug May –Chelle Gentermann –John Stark –Jorge Vazquez

Single Sensor Error Characteristics Working Group Formed: Issues Discussion chaired by Pierre LeBorgne Initial questions proposed for discussion -Are SSES exclusively defined against buoys measurements -if so how to make a partition of the MDB? -Any alternative to use the confidence levels to partition the MDB? -How to define the confidence levels? -Can we agree on a range of errors per confidence level?

NASA’s MEaSURE Proposal Call Making Earth System Data Records for Use in Research Environments (MEaSURE) Focus on product development –Several proposals submitted in support of GHRSST activities. Decisions should be known by the Fall of this year. Several of these proposals will have an impact on possible future GHRSST products –

Data Policy Document The PO.DAAC has implemented new Data Acceptance Procedures which should be compatible with GHRSST data policy. Draft GHRSST data policy document has been written in collaboration with DM-TAG members and led by Ken Casey.

Data Policy Document: Continued Issues for discussion –For GDAC purposes GHRSST is treated as a mission. This means final authority for data acceptance rests with the GHRSST Science Team. –What are the requirements for GHRSST acceptance. Starting reference point should be the draft Data Policy document. The following 8 points have been identified by the GHRSST Team and are open for discussion

Data Policy: Continued 1.Agree to provide all data and metadata in a free and open manner to the GDAC, without usage restrictions. 2.Agree to allow all data and metadata to be provided by the LTSRF in a free and open manner in perpetuity, without usage restrictions. 3.Routinely review and report to the chair of the DM-TAG on data and metadata compliance to the current version of the GHRSST Data Specification (GDS) using the GHRSST Data Compliance Checker and GHRSST Metadata Compliance Checker [these would need to be written and maintained]..

Data Policy: continue 4.Annually review and report to the chairs of DM-TAG and RAN-TAG with anticipated data streams and data volume rates for the coming year. 5.DM-TAG and RAN-TAG will provide the results of the above review and report to the GDAC(s) for their planning and support preparation. 6. Bring all existing product streams into compliance within 6 months of issuance of new versions of the GDS. 7. Routinely monitor product quality and completeness and report any anomalies to the GDAC, LTRSF, and GHRSST Project Office. 8. Agree to bring two bottles of nice wine from their local region to each Science Team meeting: one as a gift for the local host, and one for sharing at the Meeting Dinner. In addition, send additional bottles of wine, and at least ¼ Kilo of top quality chocolate to the GDAC(s).

Issue for discussion Based on Action Item 28 from GHRSST 7 meeting in Boulder. –"Establish how GHRSST-PP data sets can be made visible to the THREDDS community in a coordinated manner by linking to the GHRSST-PP MMR system." THREDDS catalogs are XML descriptions of data. Format issues for GDS_v2.0,beta netcdf4, HDF5, bzip2

Conclusions There is no expectation that all of these issues will be resolved at this meeting. Hopefully discussions will provide the basis for a decision making process that can be achieved via or teleconferencing. Soon to be published BAMS article will lead to a marked increase in the number of users. We need to provide a period of stability within the context of GDS v2.0 of data products and be prepared to listen to our users.