Esperanto, Klingon, or Other: Implications for Global Marine Observations John Graybeal Marine Metadata Interoperability Project Monterey Bay Aquarium.

Slides:



Advertisements
Similar presentations
ECOOP Data Management System (T2.2/WP2) Declan Dunne 13 th February 2008, Athens.
Advertisements

Ira van den Broek Taco de Bruin - NIOZ Royal Netherlands Institute for Sea Research - Netherlands National Polar Data Centre Joint SCADM/SCAGI meeting,
Integrated Ocean Observing System (IOOS) Data Management and Communication (DMAC) Standards Process Julie Bosch NOAA National Coastal Data Development.
Marine Metadata Interoperability Initiative Congreso Colombiano de Computación - CCC 2007 Abril 18 al 20 de 2007 Pontificia Universidad Javeriana, D.C.
MMI: Defining & Doing Marine Metadata Interoperability John Graybeal & Luis Bermudez Marine Metadata Interoperability Project
QARTOD III November 2-4, 2005 QARTOD – IOOS DMAC Relationship Julie Bosch NOAA Coastal Data Development Center QARTOD III November 2–4, 2005.
Building the GCOOS: Integration of Data Dr. Matthew Howard GCOOS-RA Annual Meeting of the Parties & Board of Directors February 2009 Orlando, FL.
QARTOD III November 2-4, 2005 Metadata in the IOOS Community Julie Bosch NOAA Coastal Data Development Center QARTOD III November 2–4, 2005.
Progress on Metadata Issues for Ocean Observing Stephanie Watson, CeNCOOS Julie Bosch, NOAA NCDDC Presented at the QARTOD II Workshop, 2/28-3/2/05.
Integrated Ocean Observing System Data Management and Communications March 2004 The US Integrated Ocean Observing System (IOOS) Plan for Data Management.
Why are Ontologies Important ? Luis Bermudez QARTOD III November 2-4, 2005.
The MMI Workshop Advancing Domain Vocabularies August 9-11, Boulder, Colorado.
Ontology Semantic Mediation in the Big Picture MMI Workshop - August 2005.
Marine Metadata Interoperability Making Data Management Easier Prepared for SeaDataNet First Annual Meeting by John Graybeal Lead Principal Investigator,
Dawn Wright Oregon State University Ned Dwyer Coastal & Marine Resources Centre, Ireland The International Coastal Atlas Network (ICAN) FGDC Marine & Coastal.
November 7th, 2012 Mike Daniels EOL Data Services update: Legacy Data, EarthCube and the Earth Science Information Partners (ESIP)
From Data Integration to Integrated Solutions Tom Shyka, GMRI Paul Currier, NH DES Water Quality Workshop MACOORA - NERACOOS -SECOORA IOOS, USGS, EPA,
05 December, 2002HDF & HDF-EOS Workshop VI1 SEEDS Standards Process Richard Ullman SEEDS Standards Formulation Team Lead
Quick Unidata Overview NetCDF Workshop 25 October 2012 Russ Rew.
Metadata Guides for Smarties Marine Metadata Initiative URL:
The Marine Metadata Interoperability Project
The Marine Metadata Interoperability Project A Model for Community Collaboration September 23, 2010 Nan Galbraith WHOI.
Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.
Speeding up ontology creation of scientific terms. Luis Bermudez, John Graybeal, Montery Bay Aquarium Research Institute December.
An Ontology for Marine Observables May 2006 Luis Bermudez John Graybeal Rob Raskin Robert Arko Kevin O’Neill Roy Lowry Marilyn Drewry An Ontology for Marine.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
IOOS Data Management Integration Standards Plans in the Northeast Eric Bridger (GMRI) Sep
L E Bermudez 1, P Bogden 2, G Creager 3, J Graybeal 4, Dec 2008 L E Bermudez 1, P Bogden 2, G Creager 3, J Graybeal 4, Dec
U.S. Department of the Interior U.S. Geological Survey Management of Oceanographic time-series data at the Woods Hole Coastal and Marine Science Center.
Marine Data Interoperability: What Will It Take? John Graybeal (MBARI) Marine Metadata Interoperability Project.
1 Global Systems Division (GSD) Earth System Research Laboratory (ESRL) NextGen Weather Data Cube Chris MacDermaid October, 2010.
Integrated Model Data Management S.Hankin ESMF July ‘04 Integrated data management in the ESMF (ESME) Steve Hankin (NOAA/PMEL & IOOS/DMAC) ESMF Team meeting.
1 NOAA IOOS Program Data Integration Framework (DIF) Project Overview Adapted from a brief to the NOAA Data Management Committee August 6, 2008 by Jeff.
EarthCube Building Block for Integrating Discrete and Continuous Data (DisConBB) David Maidment, University of Texas at Austin (Lead PI) Alva Couch, Tufts.
The Marine Metadata Interoperabillity Luis Bermudez SECOORA March 10, 2005.
Are Standards Really Standards Any More? Mélanie F. Meaux NASA / GCMD In response to Wyn Cudlip with regards to an IDN profile of ISO …
Construction of Marine Vocabularies in the Marine Metadata Interoperability Project Luis Bermudez, John Graybeal, MBARI Anthony Isenor, Defence R&D Canada.
Bob Keeley Marine Environmental Data Service Dept. of Fisheries and Oceans Ottawa, Canada Jun, 2006 SeaDataNet Meeting.
Metadata with MMI Opening the Door to Collaboration John Graybeal, Luis Bermudez, Philip Bogden, Steven Miller, Stephanie Watson.
A Prototype Ontology Tool and Interface for Coastal Atlas Interoperability Dawn J. Wright 1, Luiz Bermudez 2 (presenter), Liz O’Dea 3, Yassine Lassoued.
Cyberinfrastructure What is it? Russ Hobby Internet2 Joint Techs, 18 July 2007.
June 20, 2007ESRI Intl. User Conference Dawn Wright - Oregon State University Val Cummins - Coastal & Marine Resources Centre, IRELAND Liz O’Dea - Coastal.
Marine Metadata Interoperability - Web Services Marine scientists face an opportunity and a challenge in the volume of data available from various ocean.
A Resource Discovery Service for the Library of Texas Requirements, Architecture, and Interoperability Testing William E. Moen, Ph.D. Principal Investigator.
An Introduction to the Argo Data Sytem South Pacific Workshop 11 – 14 October 2005 Mark Ignaszewski FNMOC.
Marine Metadata Interoperability Acknowledgements Ongoing funding for this project is provided by the National Science Foundation.
Cyberinfrastructure Overview Russ Hobby, Internet2 ECSU CI Days 4 January 2008.
Cyberinfrastructure: Many Things to Many People Russ Hobby Program Manager Internet2.
Implementing Marine XML for NOAA Observing Data Nazila Merati and Eugene Burger NOAA/Pacific Marine Environmental Laboratory Seattle, WA.
Making SOAP web services semantically understandable Luis Bermudez OOSTech Baltimore Oct,
Fire Emissions Network Sept. 4, 2002 A white paper for the development of a NSF Digital Government Program proposal Stefan Falke Washington University.
Kevin Gomes, MBARI MBARI Data Architecture OOI Cyberinfrastructure: Data Product Generation Workshop San Diego May 20-21, 2008.
Integrating Distributed Data Systems Using Ontologies, Web Services and Standards: An MMI Case Study John Graybeal, Luis Bermudez, Kevin Gomes, Michael.
The Marine Metadata Interoperability Project. Lessons from WHOI.
NESC Worshop – 07 September 2005 Development of a Marine Metadata Standard Greg Reed Executive Officer Australian Ocean Data Centre Joint Facility.
Convergence And Trust in Earth and Space Science Data Systems Ted Habermann, NOAA National Geophysical Data Center Documentation: It’s not just discovery...
A Draft Standard for the CF Metadata Conventions Russ Rew, Unidata GO-ESSP 2009 Workshop
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
Marine Metadata Interoperability The Marine Metadata Interoperability Project Overview and Roadmap
Interoperability Day Introduction Standards-based Web Services Interfaces to Existing Atmospheric/Oceanographic Data Systems Ben Domenico Unidata Program.
NOAA IOOS SOS Implementations in 2008 Jeff de La Beaujardière, PhD NOAA IOOS Program DIF Sr Systems Architect.
ISWG / SIF / GEOSS OOS - August, 2008 GEOSS Interoperability Steven F. Browdy (ISWG, SIF, SCC)
EarthCube Integrative Activities: Cross-Domain Observational Metadata Environmental Sensing Network (X-DOMES) September 2015 – August 2017 Focusing on.
Federation of Earth Science Information Partners EGIDA Workshop May 9-11, 2011, Bonn, Germany.
The Arctic Observing Network and its Data Management Challenges Florence Fetterer (NSIDC/CIRES/CU), James A. Moore (NCAR/EOL), and the CADIS team Photo.
Data Browsing/Mining/Metadata
MERRA Data Access and Services
Common Framework for Earth Observation Data
Distributed Marine Data System:
ExPLORE Complex Oceanographic Data
Presentation transcript:

Esperanto, Klingon, or Other: Implications for Global Marine Observations John Graybeal Marine Metadata Interoperability Project Monterey Bay Aquarium Research Institute Insert Cool Graphic Here

MMI Progress on “The Metadata Problem”

MMI: A Brief History 2002: Standard Names exercise

2003: Marine Metadata workshop (S Watson) MMI: A Brief History

2004: MMI proposal, award, web site MMI: A Brief History

2005: Hire, tools, workshop, 2nd proposal MMI: A Brief History

2006: NOAA & 2nd NSF awards OOSTethys prototype, OGC participation Involvement in ORION, IOOS data committees Increased international participation More funding and distribution of US participation Sensor Metadata Interoperability Workshop Strategic Planning Meeting, Advisory Panels MMI: A Brief History

MMI: You Are Here

Doing Science: The Way It Has Been Done Hey Francisco, you still running that mooring in Monterey? Yeah, John, what do you need? Is it collecting current data? Yeah, you looking for profiles? Yup, are you doing that with an ADCP? Yes, we’ll probably start profiling soon, too. No, don’t need that. How do I get the data? You want the raw data or QCd? Real-time?. Oh, the QC’d, delayed mode data, definitely, last 3 years worth. That’d be off our dods site, here’s the address.. Documentation come with that? We got some, I’ll have to get one of my techs to send it to you…

Doing Science: The New Way

MOQuA: Metadata Oriented Query Assistant (Mike Godin, MBARI)

Big Picture: IOOS Users Archive Centers Modeling On-line Browse Products Forecasts Maps Regional Data Management Systems International Data Management Systems Terrestrial and Atmospheric Data Management Systems Metadata, Data Discovery and Data Transport Standards and Protocols Ships Satellites Primary Data Assembly & QC Hand Measurements Moorings Floats

Big Picture: ORION

What Will It Take? (from ORION Cyberinfrastructure Concept of Operations) What will it take for a science researcher to access all the data from MBARI, NDBC, and ORION, assess the data that is useful for his or her project, bring it into an analysis program, and produce the first visualization all in a single day, and still have time to call one of the data producers and ask about the details of the latest quality control process?

What It Will Take Communities Creating Marine Data and Metadata Interoperability

What’s needed for marine metadata interoperability? Several areas of community agreement. The way to transfer the metadata: Transport Protocol What data to transfer: Content Standard What the contents mean: Vocabulary Transport Protocol Content Standard Vocabulary

We have some of these— so where’s the problem? EML ISO DCMI FGDC MarineXML GML ADL NetCDF ASCII ContentContent ProtocolProtocol ESML OPeNDAP REST SOAPZ39.50 DFDL THREDDS LAS WxS HTTP HDF TIF JPEG MetadataData Coards/CF

Identifying technical gaps— Vocabularies Few formal marine vocabularies existed There was no agreed format or location Most weren’t comprehensive or detailed There was no way to connect them There was no architecture to nurture them –Like children, they need encouragement to grow healthy and strong, and to play well with others Water Temperature sea_water_ temperature TEMP BODC GCMD CF

Vocabularies: Discovery and Harmonization DTD CommaSeparatedValues HTML TabSeparatedValues RelationalDatabase XML/XSD RDF OWL

~ 60 Ontologies Available

Relating Vocabularies: Mapping tool: Got VINE? Vocabulary INtegration Environment

International Challenges Technical Needs –Address a Range of Sophistication –Leverage Existing Technologies –Provide Localization Cultural Challenges –Language –Nationality Making Collaborations Valuable

MMI Strategies for International Success

For Any Collaboration Problem— There Are 3 Options Create a committee to develop (or anoint) a consensus standard Find a wizard (or giant) who will create a compelling standard Build translators

A Parable About Standards: The Birth of TCP/IP A New Way to Look at Networking Van Jacobson, XEROX PARC –speaking at Google –Find at video.google.com/videosearch?q=van+jacobson ARPANet: new endpoint-oriented protocol –Worked really well, so everyone built one –BUT! None of them worked with each other

ARPANet ~ 1971 Credits: © Martin Dodge, 2004 ( ; Casting the Net, 1995, Peter H Salus

MMI Strategies for International Success

Progress in Key Places Transport Protocol Content Standard Vocabulary Expect all 3 approaches to be part of the landscape

Sensor Metadata Interoperability Workshop October 19-20, 2006 in Portland, Maine Learning about sensor metadata content standards Unknown if any anointing will occur!

MMI Steering Committee Robert Arko, LDEO Julie Bosch, NOAA Taco de Bruin, NIOZ (Netherlands) Francisco Chavez, MBARI Ben Domenico, Unidata Stephen Miller, SIO Lola Olsen, NASA Goddard Greg Reed, AODCJF (Australia) Dawn Wright, Oregon State University Steering Committee Executive Committee John Graybeal, MBARI (Lead PI) Philip Bogden, SURA/SCOOP Matthew Howard, Texas A&M Andrew Maffei, WHOI Karen Stocks, UCSD

MMI: Your Handy Reference Guide MMI: Sensor Metadata Workshop: Events: Help Line: Get info re site: Ontologies: