ORNL is Operated by UT-Battelle for DOE

Slides:



Advertisements
Similar presentations
Retrieval of Information from Distributed Databases By Ananth Anandhakrishnan.
Advertisements

The North American Carbon Program Google Earth Collection Peter C. Griffith, NACP Coordinator; Lisa E. Wilcox; Amy L. Morrell, NACP Web Group Organization:
Geospatial One-Stop A Federal Gateway to Federal, State & Local Geographic Data
Matthew Cechini Raytheon - EED ID: IN31C-07.  ECHO Metadata Overview  Introduction  Problem Space  Solutions ISO Lessons Learned – Perceived.
Chapter 2. Slide 1 CULTURAL SUBJECT GATEWAYS CULTURAL SUBJECT GATEWAYS Subject Gateways  Started as links of lists  Continued as Web directories  Culminated.
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
Planned Title: Review of Evaluation of Geospatial Search Allan Doyle.
The SAFARI 2000 Data Distribution System Jeffrey L. Privette NASA’s Goddard Space Flight Center Many others from NASA, Wits, NDMC, ORNL 28 August 2001.
Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.
SAFARI 2000 Data Activities at the ORNL DAAC Bob Cook, Les Hook, Stan Attenberger, Dick Olson, and Tim Rhyne Oak Ridge National Laboratory.
Chapter 16 The World Wide Web Chapter Goals Compare and contrast the Internet and the World Wide Web Describe general Web processing Describe several.
DATA COMMUNICATION DONE BY: ALVIN SAMPATH CARLVIN SAMPATH.
Inter-American Workshop on Environmental Data Access Panel discussion on scientific and technical issues Merilyn Gentry, LBA-ECO Data Coordinator NASA.
SOCAT Surface Ocean CO 2 ATlas Are Olsen 1, Benjamin Pfeil 1, Dorothee Bakker 2, Maria Hood 3, Nicolas Metzl 4, Christopher Sabine 5, Alex Kozyr 6
Metadata and Geographical Information Systems Adrian Moss KINDS project, Manchester Metropolitan University, UK
Enhancing Linkages Between Projects and Datasets: Examples from LBA-ECO for NACP Lisa Wilcox, Amy L. Morrell,
CDIAC Global Ocean CO 2 Data Management Alex Kozyr Carbon Dioxide Information Analysis Center, Oak Ridge National Laboratory.
Global map layers Additional global data sets such as Hydrology data (Hydrosheds), new and updated Landcover data (Globcover), demographic data and others.
Design of a Search Engine for Metadata Search Based on Metalogy Ing-Xiang Chen, Che-Min Chen,and Cheng-Zen Yang Dept. of Computer Engineering and Science.
INTEGRATED OCEAN DRILLING PROGRAM MANAGEMENT INTERNATIONAL International Data Exchange Workshop – Kiel, Germany – May 9-11, 2007 SEDIS Scientific Earth.
ISpheresImage iSpheresImage Feature Overview and Progress Summary.
U.S Geological Survey National Biological Information Infrastructure Technical Overview: NBII Metadata Clearinghouse May 2008 Mike Frame.
August 2003 At A Glance VMOC-CE is an application framework that facilitates real- time, remote cooperative work among geographically dispersed mission.
WDC-MARE – World Data Center for Marine Environmental Sciences Data portal based on Open Archives Initiative Protocols and Apache Lucene Uwe Schindler,
Opendap dev - meeting, Boulder, Feb 2007 OPeNDAP infrastructure in European Operational Oceanography T Loubrieu (IFREMER) T Jolibois (CLS)
1 A Very Large Digital Library Technology Demonstration William Y. Arms Cornell University.
Web Page Design Introduction. The ________________ is a large collection of pages stored on computers, or ______________ around the world. Hypertext ________.
National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Pasadena, California EDGE: The Multi-Metadata.
Managed by UT-Battelle for the Department of Energy Mercury – Distributed Metadata Tool for Finding and Retrieving CDIAC Data CDIAC UWG Meeting September.
DataONE: Preserving Data and Enabling Data-Intensive Biological and Environmental Research Bob Cook Environmental Sciences Division Oak Ridge National.
CA-OES CAL(IT)2 Feb. 20, 2002 Internet GIServices
GBIF Data Access and Database Interoperability 2003 Work Programme Overview Donald Hobern, GBIF Programme Officer for Data Access and Database Interoperability.
Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.
Registering Earth Science Data and Data Related Services Using NASA’s Global Change Master Directory (GCMD) Tyler Stevens (GIS/Services Coordinator) ESIP.
Metadata and OAI DLESE OAI Workshop April 29-30, 2002 Katy Ginger Presentation available at:
Barry Weiss 1/4/ Jet Propulsion Laboratory, California Institute of Technology Quality Elements in ISO Metadata Design for Proposed SMAP Data.
U.S. Environmental Protection Agency Central Data Exchange Pilot Project Promoting Geospatial Data Exchange Between EPA and State Partners. April 25, 2007.
The World Wide Web. What is the worldwide web? The content of the worldwide web is held on individual pages which are gathered together to form websites.
The library is open Digital Assets Management & Institutional Repository Russian-IUG November 2015 Tomsk, Russia Nabil Saadallah Manager Business.
The Proliferation of Metadata Standards and the Evolution of NASA’s Global Change Master Directory (GCMD) Standard for Uses in Earth Science Data Discovery.
Mercury and the Metadata Editor Robert Cook and Tim Rhyne Oak Ridge National Laboratory Distributed Active Archive Center June 2000.
Glossary WMS – OGC Web Mapping Services WFS – OGC Web Feature Services XML- Extensible Markup Language OGC – Open GIS Consortium ADN –
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
ORNL DAAC SPATIAL DATA ACCESS TOOL Open Geospatial Consortium (OGC) Services Bruce E. Wilson Suresh K. Santhana Vannan Yaxing Wei Tammy W. Beaty National.
Distributed Data Servers and Web Interface in the Climate Data Portal Willa H. Zhu Joint Institute for the Study of Ocean and Atmosphere University of.
The Earth Information Exchange. Portal Structure Portal Functions/Capabilities Portal Content ESIP Portal and Geospatial One-Stop ESIP Portal and NOAA.
Web Design Terminology Unit 2 STEM. 1. Accessibility – a web page or site that address the users limitations or disabilities 2. Active server page (ASP)
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
The Web Web Design. 3.2 The Web Focus on Reading Main Ideas A URL is an address that identifies a specific Web page. Web browsers have varying capabilities.
The World Wide Web.
The CUAHSI Hydrologic Information System Spatial Data Publication Platform David Tarboton, Jeff Horsburgh, David Maidment, Dan Ames, Jon Goodall, Richard.
SharePoint 2007 Business Intelligence
Data Browsing/Mining/Metadata
GeoNetwork OpenSource: Geographic data sharing for everyone
Sharing Hydrologic Data with the CUAHSI* Hydrologic Information System
HTML, XHTML, and the World Wide Web
Cloud based linked data platform for Structural Engineering Experiment
Special Topics in CCIT: Databases
Flanders Marine Institute (VLIZ)
WHAT DOES THE FUTURE HOLD? Ann Ellis Dec. 18, 2000
Accessing Spatial Information from MaineDOT
HydroDesktop: A Key Component of the CUAHSI/CZO HIS for Hydrologic Data Discovery, Visualization, and Analysis Daniel P. Ames, Ph.D. P.E. Idaho State University.
Content Management Systems
Prepared by: Jennifer Saleem Arrigo, Program Manager
The New Face of Information Retrieval: The Ankara University Open Access Platform Prof. Dr. Sekine Karakaş Prof. Dr. Doğan.
Unit# 5: Internet and Worldwide Web
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
BUILDING A DIGITAL REPOSITORY FOR LEARNING RESOURCES
Using CuCMS: a workshop
Tutorial 7 – Integrating Access With the Web and With Other Programs
Presentation transcript:

ORNL is Operated by UT-Battelle for DOE Mercury Distributed Metadata Management, Data Discovery and Access System Alex Kozyr and Tommy Nelson Oak Ridge National Laboratory ORNL is Operated by UT-Battelle for DOE 2/5/2019

Introduction to Mercury Developed by ORNL for NASA to address recurring data access problems Mercury is a Web-based system to search for metadata and retrieve associated data. Mercury incorporates a number of important features: DBA – Data Base Administrator ORNL is Operated by UT-Battelle for DOE 2/5/2019

Key Features of Mercury Provides a single portal to distributed data Supports spatial searches Supports temporal searches Supports fielded searches Based on international metadata and Internet standards Z39.50, FGDC, GILS, Dublin Core, XML… Has a very "light touch" Business as usual for PI’s and other data contributors Accessed via web browsers – no special software Data providers and users can use any hardware/software platform Standards - Z39.50, FGDC, GILS, Dublin Core, XML PIs contact ORNL and provide the URL of the locator file on their machine – no additional interaction is necessary – EVER! ORNL is Operated by UT-Battelle for DOE 2/5/2019

ORNL is Operated by UT-Battelle for DOE ….and More Stale information is removed with each index update Rapid implementation – weeks or months not years Inexpensive to operate (automated) Full support of XML – eXtensible Markup Language Adaptable template metadata collection tools exist ORNL Metadata Editor - OME Harvests information from many different file formats pdf, word, excel, access, gif, jpg, etc. XML is THE evolving global standard for encoding metadata Mercury can harvest information from many different file formats even without metadata ORNL is Operated by UT-Battelle for DOE 2/5/2019

Mercury Projects CDIAC South Africa Brazil Project Office DOE, NASA, EPA, USGS Many mature applications of Mercury in scientific/environmental arena Earth Science Information Partners System Wide Interoperability Layer LBA-Hydrometeorology Project Office

Present Status of Underway pCO2 Data Many different measurements (xCO2, fCO2, pCO2) Many different data formats Many different storage locations PI sites Data centers Highly variable documentation No metadata standard ORNL is Operated by UT-Battelle for DOE 2/5/2019

ORNL is Operated by UT-Battelle for DOE 2/5/2019

CDIAC / WOCE Bottle Data Inventory ORNL is Operated by UT-Battelle for DOE 2/5/2019

What Can Mercury Do for Us? Allow PIs to distribute their data while maintaining complete control Provide a single portal to all underway pCO2 data Provide fielded, spatial, and temporal search capabilities Provide tools to create proper metadata - OME Encourage proper documentation Mercury implementation would cost nothing to the participating PIs While fielded search capabilities are not equal to what a RDBMS can provide, they are far superior to the capabilities a simple search engine like Google and are more than adequate for succinctly locating available data sets. ORNL is Operated by UT-Battelle for DOE 2/5/2019

Distributed Data Discovery and Access System A Virtual Internet Database via Mercury 1. PI’s create metadata and data files using local applications or OME 2. Mercury collects metadata and key data from the PI’s servers distributed around the world and builds a centralized index P.I. Name Dataset Experiment Cruise Variable Measurement Type etc. 5. Remote users select link(s) to data of interest Index 6. The data files and highly detailed documentation are downloaded directly from the PI’s server or chosen data repository 3. Remote users query the index via a web-based browser Underway Measurement Summary Cruise: WOCE A10 R/V Meteor Ocean: Atlantic PI: D.W.R. Wallace Begin: 1992-12-27  - End: 1993-01-31 Cruise: WOCE P10 R/V Thomas G Thompson Ocean: Pacific PI: C. L. Sabine Begin: 1993-10-05  - End: 1993-11-10 Users 4. Metadata summaries are returned to the remote users, including links back to detailed information and data at the PIs’ server or chosen data repository

ORNL is Operated by UT-Battelle for DOE Mercury Providing a Portal to Distributed Data Mercury was developed at ORNL to quickly gather research information from around the world ORNL is Operated by UT-Battelle for DOE 2/5/2019

ORNL is Operated by UT-Battelle for DOE Mercury Search Screen ORNL is Operated by UT-Battelle for DOE 2/5/2019

ORNL is Operated by UT-Battelle for DOE Mercury Oceans Search Screen All Datasets All Datasets Dataset Name Experiment Name Cruise Name PI Name Discrete Measure Underway Measure Time Series Select Ocean ORNL is Operated by UT-Battelle for DOE 2/5/2019

ORNL is Operated by UT-Battelle for DOE Mercury Oceans Search Screen Underway Measure pCO2 fCO2 xCO2 N2O TCO2 TALK Select Ocean ORNL is Operated by UT-Battelle for DOE 2/5/2019

ORNL is Operated by UT-Battelle for DOE Mercury Oceans Search Screen Underway Measure xCO2 “xCO2” All Datasets Dataset Name Experiment Name Cruise Name Discrete Measure Time Series Underway Measure PI Name Select Ocean ORNL is Operated by UT-Battelle for DOE 2/5/2019

ORNL is Operated by UT-Battelle for DOE Mercury Oceans Search Screen Underway Measure xCO2 Dickson, A. L. Feely, R. A. Goyet, C. Johnson, K. M. Key, R. M. Millero, F. J. Nojiri, Y. Takahashi, T. Wallace, D. W. R. Wanninkhof, R. Weiss, R. F. Winn, C. D. Sabine, C. L. “xCO2” PI Name Select Ocean ORNL is Operated by UT-Battelle for DOE 2/5/2019

ORNL is Operated by UT-Battelle for DOE Mercury Oceans Search Screen Underway Measure xCO2 “xCO2” PI Name C. L. Sabine C. L. Sabine Select Ocean All Oceans Pacific North Pacific South Pacific Atlantic North Atlantic South Atlantic Indian Southern ORNL is Operated by UT-Battelle for DOE 2/5/2019

ORNL is Operated by UT-Battelle for DOE Mercury Oceans Search Screen Underway Measure xCO2 “xCO2” PI Name C. L. Sabine C. L. Sabine 26.415 30.320 116.609 Select Ocean Indian -64.874 ORNL is Operated by UT-Battelle for DOE 2/5/2019

Mercury Oceans Search Results ORNL is Operated by UT-Battelle for DOE 2/5/2019

Mercury Oceans Metadata ORNL is Operated by UT-Battelle for DOE 2/5/2019

Mercury Oceans Product Link ORNL is Operated by UT-Battelle for DOE 2/5/2019

Mercury Oceans Data Link ORNL is Operated by UT-Battelle for DOE 2/5/2019

ORNL is Operated by UT-Battelle for DOE XML Encoded Metadata ORNL is Operated by UT-Battelle for DOE 2/5/2019

ORNL is Operated by UT-Battelle for DOE ORNL Metadata Editor ORNL is Operated by UT-Battelle for DOE 2/5/2019

ORNL is Operated by UT-Battelle for DOE ORNL Metadata Editor ORNL is Operated by UT-Battelle for DOE 2/5/2019

Application Broker Technology LAS Mercury USERS ODV RDB ORNL is Operated by UT-Battelle for DOE 2/5/2019

Live Access Server for GLODAP Data http://cdiac.ornl.gov/oceans/glodap/Glodap_home.htm ORNL is Operated by UT-Battelle for DOE 2/5/2019