Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012.

Slides:

Advertisements

Similar presentations

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.

Advertisements

The Live Access Server (Access to observational data) Jonathan Callahan (University of Washington) Steve Hankin (NOAA/PMEL – PI) Roland Schweitzer, Kevin.

System Science Applications, Inc. EASy: An Environmental System for Mapping and Modeling Aquatic Systems.

Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.

National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Pasadena, California Metadata-Centric Discovery.

D A Kiefer, D P Harrison, M G Hinton, S Kohin, E M Armstrong, S Snyder, F J O’Brien Pelagic Habitat Analysis Module (PHAM) for GIS Based Fisheries Decision.

Aug. 20, JPL, SoCalBSI '091 The power of bioinformatics tools in cancer research Early Detection Research Network, JPL Mentors: Dr. Chris Mattmann,

NCAR GIS Program : Bridging Gaps

Planned Title: Review of Evaluation of Geospatial Search Allan Doyle.

Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.

The GEON Integrated Data Viewer (IDV) and IRIS DMC Services: CyberInfrastructure Support for Seismic Data Visualization and Interpretation Charles Meertens.

Storm Tracker – a Web-Based Tool for Working with the Automated Tracking of Thunderstorm Clusters Bob Rabin NOAA / NSSL / CIMSS Tom Whittaker Space Science.

Observing System Monitoring Center Integrating data and information across observing system networks.

Presented by The Earth System Grid: Turning Climate Datasets into Community Resources David E. Bernholdt, ORNL on behalf of the Earth System Grid team.

Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.

Unidata’s TDS Workshop TDS Overview – Part II October 2012.

C. Mattmann 1, C. Goodale 1, J. Kim 2, D.E. Waliser 1,2, D. Crichton 1, A. Hart 1, P. Zimdars 1 and Peter Lean* The International Workshop on CORDEX-East.

Testing the US Integrated Ocean Observing System Data Discovery and Distribution Infrastructure with Real-World Problems Derrick Snowden 1, Rich Signell.

1 OPeNDAP/ECHO Demo Integrating and Chaining services September, 2006 CEOS WGISS 22 Annapolis, MD.

Web Services for Earth Science Data Edward Armstrong, Thomas Huang, Charles Thompson, Nga Quach, Richard Kim, Zhangfan Xing Winter ESIP 2014 Washington.

Global Land Cover Facility The Global Land Cover Facility (GLCF) is a member of the Earth Science Information Partnership (ESIP) Federation providing data,

Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.

ESP workshop, Sept 2003 the Earth System Grid data portal presented by Luca Cinquini (NCAR/SCD/VETS) Acknowledgments: ESG.

Page 1 Informatics Pilot Project EDRN Knowledge System Working Group San Antonio, Texas January 21, 2001 Steve Hughes Thuy Tran Dan Crichton Jet Propulsion.

Discovery and Web Services in Support of SST Datasets at the PO.DAAC Edward Armstrong, Jorge Vazquez Toshio M. Chin, Charles Thompson Jet Propulsion Laboratory/California.

NcBrowse A Graphical netCDF/OPeNDAP Browser Donald Denbo 1 & John Osborne 2 1 UW/JISAO-NOAA/PMEL, 2 OceanAtlas Software

Shakeh Elisabeth Khudikyan NASA Jet Propulsion Laboratory, California Institute of Technology A Look at Apache OODT Balance Framework.

1 NOAA IOOS Program Data Integration Framework (DIF) Project Overview Adapted from a brief to the NOAA Data Management Committee August 6, 2008 by Jeff.

Opendap dev - meeting, Boulder, Feb 2007 OPeNDAP infrastructure in European Operational Oceanography T Loubrieu (IFREMER) T Jolibois (CLS)

Using Datacasting to Acquire Only the GHRSST Products You Care About Using Datacasting.

Observing System Monitoring Center (OSMC) Status Update April 2005 Steve Hankin – PMEL (co-PI) Kevin Kern – NDBC (co-PI)

GIS System Design for the Coastal Storms Initiative Nazila Merati OAR/PMEL & OAR Representative to NOAA Enterprise GIS Chris Moore – OAR/PMEL Tiffany C.

Web Portal Design Workshop, Boulder (CO), Jan 2003 Luca Cinquini (NCAR, ESG) The ESG and NCAR Web Portals Luca Cinquini NCAR, ESG Outline: 1.ESG Data Services.

National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Pasadena, California EDGE: The Multi-Metadata.

Unidata’s TDS Workshop TDS Overview – Part I July 2011.

User Working Group 2013 Data Access Mechanisms – Status 12 March 2013

GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma

Kevin O’Brien University of Washington/JISAO NOAA/PMEL The Observing System Monitoring Center Steve Hankin, PMEL Ted Habermann, NGDC David Neufeld, NGDC.

UAF/OSMC Presenters: Kevin O’Brien and Eugene Burger Abstract: Kevin O’Brien and Eugene Burger are from NOAA’s Pacific Marine Environmental Laboratory.

NQuery: A Network-enabled Data-based Query Tool for Multi-disciplinary Earth-science Datasets John R. Osborne.

Discovering Earth Science Data and Services Using NASA’s Global Change Master Directory: The Value for Earth Science Teachers Tyler Stevens NASA’s Global.

Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.

1 NASA CEOP Final Summary CEOS WGISS-26 Boulder, Colorado September 23, 2008 Yonsook Enloe

Improving Data Catalogs with Free and Open Source Software Kevin O’Brien University of Washington Joint Institute for the Study of the Atmosphere and Ocean.

The Unified Access Framework for Gridded Data … the 1 st year focus of NOAA’s Global Earth Observation Integrated Data Environment (GEO-IDE) Steve Hankin,

A Climate Data Portal Focused on realtime and retrospective in situ data Nancy Soreide, Don Denbo, Willa Zhu, NOAA/PMEL Charles Sun, NOAA/NODC Bernie Kilonsky,

Satellite & Model Product Evaluation Center (SPEC): A Software System Providing Ready Access To Co-located Data Subsets From Satellite, In-situ, and Model.

Observing System Monitoring Center (OSMC) Work in progress in brief June 2005 Steve Hankin, Kevin O’Brien – PMEL.

1 OceanShare: Interactive Access to Distributed In Situ Data in a Collaborative Tool Environment D.W. Denbo C.R. Windsor NOAA/Pacific Marine Environmental.

CUAHSI HIS: Science Challenges Linking small integrated research sites (

National Coastal Data Development Center (National Oceanographic Data Center – OC6) Data Management and Visualization Brief CLIMATE AND MARINE PROTECTED.

U.S. INTEGRATED OCEAN OBSERVING SYSTEM DATA ACCESS SERVICES Coastal Geotools: Advances in Federal Data Access Services Hassan Moustahfid, Chris Duncombe.

LAS and THREDDS: Partners for Education Roland Schweitzer Steve Hankin Jonathan Callahan Joe Mclean Kevin O’Brien Ansley Manke Yonghua Wei.

National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Pasadena, California Part of the AIST Framework.

Data Stewardship at the NOAA Data Centers Sub Topic - Value Added Products ESIP Federation Meeting, Washington, DC January 6-8, 2009.

ORNL DAAC SPATIAL DATA ACCESS TOOL Open Geospatial Consortium (OGC) Services Bruce E. Wilson Suresh K. Santhana Vannan Yaxing Wei Tammy W. Beaty National.

3-D rendering of jet stream with temperature on Earth’s surface ESIP Air Domain Overview The Air Domain encompasses a variety of topic areas, but its focus.

Access to IOOS Data Relevant to OOI Kathleen Bailey NOAA/NOS/IOOS January 6, 2016.

A Climate Data Portal Focused on realtime and retrospective in situ data Nancy Soreide, Don Denbo, Willa Zhu, PMEL Charles Sun, NODC Bernie Kilonsky, U.

The Earth Information Exchange. Portal Structure Portal Functions/Capabilities Portal Content ESIP Portal and Geospatial One-Stop ESIP Portal and NOAA.

1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)

Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.

D A Kiefer, E M Armstrong, D P Harrison, M G Hinton, S Kohin, S Snyder, F J O’Brien Overview of fisheries habitat prediction using the Pelagic Habitat.

How to Access Data from the Group for High Resolution Sea Surface Temperature (GHRSST) at the Global Data Assembly Center (GDAC) and the Long Term Stewardship.

NQuery: A Network-enabled Data-based Query Tool for Multi-disciplinary Earth-science Datasets John R. Osborne 1, Kevin T. McHugh 2, and Donald W. Denbo.

The Arctic Observing Network and its Data Management Challenges Florence Fetterer (NSIDC/CIRES/CU), James A. Moore (NCAR/EOL), and the CADIS team Photo.

NcBrowse: OPeNDAP Server Access and 3-D Graphics Presented by Nancy N. Soreide NOAA/PMEL Donald W. Denbo UW/JISAO-NOAA/PMEL.

Sea Surface Temperature Distribution from the Physical Oceanography DAAC Ed Armstrong JPL PO.DAAC MODIS Science Team Meeting.

Data Browsing/Mining/Metadata

Flanders Marine Institute (VLIZ)

Presentation transcript:

Ed Armstrong – PI Luca Cinquini Chris Mattmann NASA Jet Propulsion Laboratory Frank O’Brien Zach Siegrist System Science Applications, Inc. 18 July 2012 ESIP Summer 2012 Madison, WI Overview and demo of the Coastal Marine Discovery Service (NASA ACCESS 2009)

Overview... AKA “Coastal Marine Discovery Service” (CMDS) – 1: a discovery portal for remote coastal datasets including satellite, in situ, ocean model, GIS layers. No data stored in CMDS; only harvested metadata and URLs – 2: a visualization and data interrogation system for datasets in the CMDS repository “on the fly” visualization and georeferencing Dataset overlay and download Client web interface. No software necessary to download.

Overview CMDS blends proven software technologies of open source Solr/Lucene database and search interface with OODT and EASy GIS Netviewer from System Science Applications (SSA, see – Discovery through a faceted and free text search interface – OODT is used extensively (profile servers, profile handlers) to parse and ingest the remote datasets – OODT harvests Catalog.xml from THREDDS servers – Visualization and interrogation via EASy Netviewer Web client Interacts directly with search results from CMDS (URLs) to access and download data

CMDS accessible data Satellite: Level 2,3 and 4 products for SST, Chl A, Turbidity, Wind, SSH, Salinity Ocean Models: 3D Salinity, Depth, Temperature and Currents Currents: Coastal HF Radar In situ data: Ship, buoy, and glider observations of SST, Wind and Currents Historical: CalCOFI reports, fish surveys, scientific cruises GIS coverages and other point data: Bathymetry, marine sanctuary boundaries, socio-economic

Architecture (from proposal)

Metadata harvesting/ingestion pipeline

CMDS web site (public)

CMDS search interface Facet/free text driven to over 160 data sets To date focused on coastal datasets from CoastWatch, NOAA ERDDAP, NASA PO.DAAC, NOAA NODC, NVODS, US NAVY on THREDDS (OPeNDAP) servers Interface built on the earth system grid federation software

Visualization and data interrogation – the EASy NetViewer client Reads and displays any OPeNDAP URL from CMDS catalog Data interrogation of pixel values ROI statistics GIS like queries (filtering, stats) between multiple layers Hardwired shapefile layers Data export to netCDF3

Integration Future deployment at PO.DAAC “labs” site Aug 2012: Site for exposure of new tools and services Based on user feedback will be elevated to a standard PO.DAAC service

Acknowledgements The work described was performed at the Jet Propulsion Laboratory, California Institute of Technology, under contract to the National Aeronautics and Space Administration for ROSES ACCESS 2009.

Current architecture

Issues Latency to periodically recrawl previously indexed data repositories Many THREDDS repositories have extremely limited granule metadata Free text search interface suffers

Example of a NVODS dataset with limited metadata