Rolling Deck to Repository: Transforming the United States Academic Fleet Into an Integrated Global Observing System Suzanne M. Carbotte, Robert Arko,

Slides:



Advertisements
Similar presentations
SAMOS Data Management System
Advertisements

Data Publishing Service Indiana University Stacy Kowalczyk April 9, 2010.
Better Data, Better Science! [ Better Science through Better Data Management ] Todd D. OBrien NOAA – NMFS - COPEPOD.
Prototype Phase SIO Accomplishments
Rolling Deck to Repository (R2R) Technical Overview 1 of 14 May 4, 2009 (Arko) Rolling Deck to Repository Technical Overview Suzanne Carbotte, Vicki Ferrini,
Data Provenance and Attribution for Published Datasets The Challenge and the reality check April 9-10, 2009 National Academy of Sciences, Woods Hole, MA.
Rolling Deck to Repository (R2R) Motivation May 4, 2009 Rolling Deck to Repository A direct pipeline from ship to archive for oceanographic research Suzanne.
Pulling it all together… with thanks to Sheila Anderson.
Joint CASC/CCI Workshop Report Strategic and Tactical Recommendations EDUCAUSE Campus Cyberinfrastructure Working Group Coalition for Academic Scientific.
Ocean Data Interoperability Platform EU-US-Australia collaborative project Grant Number: Call: FP7-INFRASTRUCTURES INFSO Activity: INFRA :
Symposium on Digital Curation in the Era of Big Data: Career Opportunities and Educational Requirements: A Data Scientist Perspective Dr. Vicki Lynn Ferrini.
A Framework for Earth Science Search Interface Development Designing and Implementing S2S Eric Rozell, Tetherless World Constellation, RPI.
Biological and Chemical Oceanography Data Management Office 1 of 12 An Introduction to the Biological and Chemical Oceanography Data Management Office.
OER End-to-end Data Management Sharon Mesick, IPT Chair June
An Oceanographic Event Logger James R. Wilkinson and Karen S. Baker Scripps Institution of Oceanography, University of California San Diego Field Practices.
Field Project Planning, Operations and Data Services Jim Moore, EOL Field Project Services (FPS) Mike Daniels, EOL Computing, Data and Software (CDS) Facility.
Data Management Practices: BCO-DMO’s Successes and Challenges Bob Groman BCO-DMO Woods Hole Oceanographic Institution NERACOOS/NeCODP Data Management Workshop.
The Marine Metadata Interoperability Project A Model for Community Collaboration September 23, 2010 Nan Galbraith WHOI.
Helen Glaves (NERC- BGS), Dick Schaap (MARIS), Robert Arko (LDEO) and Roger Proctor (IMOS)
World Data Center for Human Interactions in the Environment Conducting a Self-Assessment of a Long-Term Archive for Interdisciplinary Scientific Data as.
U.S. Department of the Interior U.S. Geological Survey Management of Oceanographic time-series data at the Woods Hole Coastal and Marine Science Center.
1 Integrated Services Program The Virginia Metadata Training Workshop Summer, 2006 Lyle Hornbaker Integrated Services Program
Mind the Gap: Finding Data Across Decades and Disciplines with the SSDB Stephen P. Miller 1, P. Dru Clark 1, Jacob M. Perez 1, Aaron D. Sweeney 1, John.
Local global disambiguation of terms and concepts The BCO-DMO metadata database uses controlled vocabularies to record many of the important pieces of.
Mind the Gap: Finding Data Across Decades and Disciplines with the SSDB Stephen P. Miller 1, P. Dru Clark 1, Jacob M. Perez 1, Aaron D. Sweeney 1, John.
M u l t I b e a m III W o r k s h o p M u l t I b e a m III W o r k s h o p National Geophysical Data Center / World Data Centers NOAA Slide 1 End-to-End.
Automated Weather Observations from Ships and Buoys: A Future Resource for Climatologists Shawn R. Smith Center for Ocean-Atmospheric Prediction Studies.
Planning the Maiden Voyage of Discovery for NOAA’s Dedicated Ocean Exploration Vessel, Okeanos Explorer May 9-11, 2007 National Geographic Society. Washington,
NOAA National Geophysical Data Center & collocated World Data Centers, Boulder CO USA World Data Center for Marine Geology and Geophysics, Boulder, CO.
Rolling Deck to Repository II: Getting Control of Provenance and Quality AGU Poster IN43A-1169 AGU Fall Meeting December 17, Stephen.
Biological and Chemical Oceanography Data Management Office slide 1 of 19 CAMEO Data Management Bob Groman Biological and Chemical Oceanography Data Management.
Data Management during GEOTRACES Data Management sub-committee: Reiner Schlitzer, Jing Zhang, Bill Jenkins, Chris Measures Scientific.
WHOI and SIO (II): Next Steps Towards Multi-Institution Archiving of Shipboard and Deep Submergence Vehicle Data (IN51A-0306) The Woods Hole Oceanographic.
GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma
NOAA/NESDIS/National Oceanographic Data Center Following the Flow of Two Underway Data Streams Within the U. S. National Oceanographic Data Center Steven.
Science Data in the Science Mission Directorate (SMD) Jeffrey J.E. Hayes Program Executive for MO & DA, Heliophysics Division August 17, 2011.
November 16, 2009 Page 1 of 28 Data and Data Management: Introduction to the BCO-DMO Presented to Professor Keiichi Uchida November 16, 2009 Robert C.
Shipboard Automated Meteorological and Oceanographic System (SAMOS) Initiative: A Key Component of an Ocean Observing System Shawn R. Smith Center for.
Aquatic Commons Initiative: the year in review Presented for the Aquatic Commons Implementation Task Force by Stephanie Haas, University of Florida IAMSLIC:
Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.
1 1 NOAA Office of Ocean Exploration End-to-End Data Management: A Success Story NOAA Tech Conference November 2005 Susan Gottfried National Coastal Data.
SIOExplorer Stephen Miller Scripps Institution of Oceanography USA International Data Exchange Workshop Building a Global Data Network for Studies of Earth.
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
Project number: ENVRI and the Grid Wouter Los 20/02/20161.
SEDAC Long-Term Archive Development Robert R. Downs Socioeconomic Data and Applications Center Center for International Earth Science Information Network.
Data Management System to Collect, Quality Control, Distribute, and Archive Near Real-time Marine Data Jeremy J. Rolph, Jacob T. Rettig, Mark A. Bourassa,
Semantic Concepts in Expedition Metadata Semantic Concepts in Expedition Metadata Bob Arko Lamont-Doherty Earth Observatory OOSSI Workshop Nov. 18, 2008.
US GLOBEC Georges Bank Phase 4B Scientific Investigators’ Meeting 1 Presentation to the US GLOBEC Georges Bank Phase 4B Scientific Investigators October.
RDA/US Adoption Seed Projects RDA/US is partnering with four groups as part of the MacArthur 2016 Adoption Seeds program Bringing visibility to food security.
Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.
Working prototype Multi-Institution Testbed for Scalable Digital Archiving Three institutions are working together to rescue at-risk media, establish interoperability,
Rolling Deck to Repository (R2R): How to Systematically Document Quality for the New Era of Data Re-Usability? AGU Poster IN21B-1048 AGU Fall Meeting December.
Helen Glaves 1 and Dick Schaap 2 1 British Geological Survey, United Kingdom 2 MARIS, The Netherlands.
1. 2 NOAA’s Mission To describe and predict changes in the Earth’s environment. To conserve and manage the Nation’s coastal and marine resources to ensure.
Biological and Chemical Oceanography Data Management Office slide 1 of 10 U.S. GEOTRACES Data Management Cyndy Chandler BCO-DMO ~ WHOI 23 September 2008.
Biological and Chemical Oceanography Data Management Office slide 1 of 22 Introduction to Data Management for Ocean Science Research Cyndy Chandler Biological.
NOAA EDMC Ocean Observatories Initiative Cyberinfrastructure Karen Stocks OOI CI Data Curator University of California, San Diego Ocean Observatories.
Knowledge base for growth and innovation in ocean economy: assembly and dissemination of marine data for seabed mapping LOT 5 – BIOLOGY WP4 Data archaeology.
LEGACY MEETING – SUMMARY NOTES LEGACY MEETING SUMMARY NOTES September 3-5, 2008 Palisades, NY.
Biological and Chemical Oceanography Data Management Office slide 1 of 10 The Biological and Chemical Oceanography Data Management Office (BCO-DMO) Cyndy.
Marine Sediment Chapter 4.
A Fleet-wide Approach to Optimizing Data Quality Vicki Ferrini, Suzanne O’Hara (LDEO) Paul Johnson, Kevin Jerram (UNH)
SAMOS Data Management System
Ocean Observatories Initiative: Cyberinfrastructure (OOI CI)
British Oceanographic Data Centre, Liverpool, England, United Kingdom
Linked Data for Field Deployments
Data and Data Management: Introduction to the BCO-DMO
Bird of Feather Session
  1-A) How would Arctic science benefit from an improved GIS?
Research data lifecycle²
Presentation transcript:

Rolling Deck to Repository: Transforming the United States Academic Fleet Into an Integrated Global Observing System Suzanne M. Carbotte, Robert Arko, Vicki L. Ferrini, Stephen P. Miller, Karen Stocks, Cyndy L. Chandler, Andrew R. Maffei, Shawn R. Smith, Mark A. Bourassa Lamont-Doherty Earth Observatory, Scripps Institute of Oceanography, Woods Hole Oceanographic Institution, Florida State University

UNOLS Fleet Mobile platforms Short term obs. Global range Ocean exploration Infrastructure for ocean sciences OOI ~Stationary platforms Long-term obs. Regional/Local range IODP Sampling Deep time

The Objective: Well-documented high-quality publicly available data Support published literature Enable global syntheses Provide ground-truth for a variety of scientific applications Enable data reuse and new discovery Make publicly-funded data available to the public Enable informed policy and decision making

Research cruises include multiple investigators and yield heterogeneous data sets Data documentation difficult or sparse Little routine QA/QC is conducted and has varied historically depending on operator priorities/capabilities Data are not systematically archived at U.S. National Data Centers The Challenge:

US NOAA National DC Program/Disciplinary DC US NOAA National DC Program/Disciplinary DC Ships R2R Evolution of the Data Preservation Pipeline US NOAA National DC Program / Disciplinary DC US NOAA National DC Program / Disciplinary DC Ships Science Party ??

Shipboard Data Operational/Underway (e.g. bathymetry, MET, ADCP, subbottom etc) US National Facility (e.g. NDSF, NMSF, OBSIP) Science party instrumentation (e.g. current meter, sediment traps, chemical/physical probes etc)

Rolling Deck to Repository (R2R) Data Stewardship Plan **Data will be distributed only after it is cleared of proprietary holds

R2R Deliverables & Services: 5 Standard Products 1. Cruise Metadata Record 2. Scientific Sampling Event Log 3. Quality-controlled Ship Track 4. Real-time quality-controlled MET and TSG data 5. Operations Report (Formatted document containing standard products & appendices)

R2R Deliverables & Services Data Documentation and Delivery Data Catalog (dataset, and file level metadata) Routine and consistent data delivery to NDCs Routine and consistent data accessibility to DACs Quality Assessment Feedback to Operators Quality Assessment Certificates (QACs) Describe data delivered to NDCs

Training Guides – publish community best practices for data acquisition & reduction Tools – make available software tools for QA that can be used by operators and/or scientists Data Recovery Service – original field data distribution Clearance Service – support preparation of data to foreign nations Additional R2R Services

Cruise Catalog Basic cruise metadata for >1,300 cruises from 13 ships /

Complete Data Inventory

Vessel profile - device inventory

Data Delivery to US National Data Centers

Alex Dorsk (WHOI) Prototype Application Community Input (Operators, Scientists, Data Managers) Tested on several cruises Implementation plan operator installs application onboard science party maintains log underway results loaded in rvdata.us database for dissemination Scientific Sampling Event Log

The Academic Fleet as an Integrated Global Observing System Routine long-term preservation of shipboard data and documentation of ship-based scientific sampling Complement existing data management efforts Provide rapid QA feedback to Operators Improve data accessibility through routine data submission to NDCs Improve data re-use via routine QA UNOLS Fleet OOI IODP

#32 R2R: Managing Dataflow from a National Fleet of Research Vessels (Clark et al.) (POSTER) #28 Shipboard Data Stewardship: From Ship to Shore to Archive (Chandler et al.) (POSTER) #25 The Shipboard Automated Meteorological and Oceanographic System (SAMOS) Initiative (Smith et al.) (POSTER) Other presentations