LAS & NVODS S.Hankin -- Sep. 2003 NVODS and the Live Access Server (LAS) Steve Hankin, PI (NOAA/PMEL) Jon Callahan (U of WA/JISAO) Ansley Manke (NOAA/PMEL)

Slides:

Advertisements

Similar presentations

GEOSS ADC Architecture Workshop Clearinghouse, Catalogues, Registries Doug Nebert U.S. Geological Survey February 5, 2008.

Advertisements

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.

The Live Access Server (Access to observational data) Jonathan Callahan (University of Washington) Steve Hankin (NOAA/PMEL – PI) Roland Schweitzer, Kevin.

Weathertop Consulting, LLC Server-side OPeNDAP Analysis - A General Approach Utilizing Legacy Applications through TDS Roland Schweitzer Weathertop Consulting,

Unidata Seminar Series - 30 January 2004 OPeNDAP and THREDDS: Access and Discovery of Distributed Scientific Data Yuan Ho Ethan Davis UCAR Unidata.

Spatial Data Infrastructure: Concepts and Components Geog 458: Map Sources and Errors March 6, 2006.

Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.

® OGC Web Services Initiative, Phase 9 (OWS-9): Innovations Thread - OPeNDAP James Gallagher and Nathan Potter, OPeNDAP © 2012 Open Geospatial Consortium.

GrADS 1.9 and the GrADS-DODS Server Jennifer Adams, Brian Doty, Joe Wielgosz Center for Ocean-Land-Atmosphere Studies (COLA) AMS/IIPS 13 January 2004.

Integrated Ocean Observing System Data Management and Communications March 2004 The US Integrated Ocean Observing System (IOOS) Plan for Data Management.

Data Grid Web Services Chip Watson Jie Chen, Ying Chen, Bryan Hess, Walt Akers.

HYCOM Data Service New Datasets, Functionality and Future Development Ashwanth Srinivasan, (FSU) Steve Hankin (NOAA/PMEL) Major contributors: Jon Callahan.

Tools for accessing distributed in-situ data collections Donald W. Denbo, NOAA/PMEL-JISAO Jason E. Fabritz, NOAA/PMEL-JISAO Bernard J. Kilonsky, Sea Level.

A Super-Regional Modeling Testbed for Improving Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Cyberinfrastructure.

CEOS/WGISS 20, Kyev, September 12-16, WTF-CEOP Implementation Plan #1 Status (WTF-CEOP first prototype, by JAXA) September 12, 2005 Osamu Ochiai.

Coordinated Energy and water-cycle Observations Peroject A Well Organized Data Archive System Data Integrating/Archiving Center at University of Tokyo.

OPeNDAP and the Data Access Protocol (DAP) Original version by Dave Fulker.

GDT V5 Web Services. GDT V5 Web Services Doug Evans and Detlef Lexut GDT 2008 International User Conference August 10 – 13  Lake Las Vegas, Nevada GDT.

MapServer-OGR-OPeNDAP: An Integrated System for Uniform Access to Land and Oceanographic Datasets Frank Warmerdam Consultant Thomas E. Burk University.

Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.

Weathertop Consulting, LLC Wednesday, January 14, 2009 IIPS 11A.2 1 A General Purpose System for Server-side Analysis of Earth Science Data Roland Schweitzer.

1 AJAX and Dapper: The Good, the Bad, and the Ugly Joe Sirott PMEL/NOAA.

Peter Cornillon Graduate School of Oceanography University of Rhode Island Presented at the NSF Sponsored Cyberinfrastructure Meeting 31 October 2002 OPeNDAP:

AR5 Data and Product Access Architecture Concepts for Discussion Steve Hankin (NOAA/PMEL) (Not including metadata architecture or security)

Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.

Integrated Model Data Management S.Hankin ESMF July ‘04 Integrated data management in the ESMF (ESME) Steve Hankin (NOAA/PMEL & IOOS/DMAC) ESMF Team meeting.

Web Services BOF This is a proposed new working group coming out of the Grid Computing Environments Research Group, as an outgrowth of their investigations.

1 Dapper and Argo Joe Sirott PMEL/NOAA. 2 What is Dapper? Web server that provides distributed access to in-situ data via OPeNDAP protocol Clients include.

DAP4 James Gallagher & Ethan Davis OPeNDAP and Unidata.

1ECOOP Plenary Meeting Athens 2008 EUROMISS EUROpean Marine Information System of Systems S Pouliquen, Thomas Loubrieu ECOOP plenary meeting.

1 HYCOM Data Service HYCOM Data Service An overview Ashwanth Srinivasan, (FSU) Steve Hankin (NOAA/PMEL)

A/WWW Enterprises 28 Sept 1995 AstroBrowse: Survey of Current Technology A. Warnock A/WWW Enterprises

Easily Serving and Accessing HDF-EOS2 Datasets Using DODS Technologies Richard Chinman, UCAR-IITA, DODS Project Manager

Peter Cornillon University of Rhode Island Presented at the 12 September 2003 NVODS Workshop Washington DC NVODS: Summary.

Recent developments with the THREDDS Data Server (TDS) and related Tools: covering TDS, NCML, WCS, forecast aggregation and not including stuff covered.

1 DAPPER: An OPENDAP Server for In-Situ Data Joe Sirott Donald W. Denbo, Willa H Zhu University of Washington PMEL/NOAA.

Metadata Mòrag Burgon-Lyon University of Glasgow.

UAF/OSMC Presenters: Kevin O’Brien and Eugene Burger Abstract: Kevin O’Brien and Eugene Burger are from NOAA’s Pacific Marine Environmental Laboratory.

NQuery: A Network-enabled Data-based Query Tool for Multi-disciplinary Earth-science Datasets John R. Osborne.

A Data Access Framework for ESMF Model Outputs Roland Schweitzer Steve Hankin Jonathan Callahan Kevin O’Brien Ansley Manke.

Configuring NVODS Datasets in LAS Joseph McLean TMAP/PMEL/NOAA and JISAO/UW OAR WebShop 2002.

1-2-3 February 2006 –Page 1 Mersea Integrated System How to improve Access/Downloading services ? How far do we go in terms of standardization ?

The Unified Access Framework for Gridded Data … the 1 st year focus of NOAA’s Global Earth Observation Integrated Data Environment (GEO-IDE) Steve Hankin,

Recent developments and trends in Network Access to Oceanographic In-situ Data Nancy Soreide, NOAA/PMEL John “Oz” Osborne, NOAA/PMEL - OceanAtlas Software.

Information Technology: GrADS INTEGRATED USER INTERFACE Maps, Charts, Animations Expressions, Functions of Original Variables General slices of { 4D Grids.

Product-Generation in ESG: some explorations of the user experience Steve Hankin – March, 2007.

GrADS-DODS Server An open-source tool for distributed data access and analysis Joe Wielgosz, Brian Doty, Jennifer Adams COLA/IGES - Calverton, MD

Product-Generation in ESG: some explorations of the user experience and discussion of implications for the design of ESG Steve Hankin & Roland Schweitzer.

National Coastal Data Development Center Status of OPeNDAP at NCDDC 11 September 2003 Susan Starke, Chief of IT Operations

April 2008ESG All-Hands meeting ESG Product Services Overview of components Issues in need of discussion Steve Hankin, NOAA/PMEL Roland Schweitzer, Weathertop.

Weathertop Consulting, LLC Server-side OPeNDAP Analysis – Concrete steps toward a generalized framework via a reference implementation using F-TDS Roland.

LAS and THREDDS: Partners for Education Roland Schweitzer Steve Hankin Jonathan Callahan Joe Mclean Kevin O’Brien Ansley Manke Yonghua Wei.

OPeNDAP Developer’s Workshop Feb Server-side Functions for Geo-spatial Selection James Gallagher 22 Feb 2007.

Sun Earth Connection Distributed Data Services Presented at the Principle Investigator's Meeting NASA's Applied Information Systems Research Program 5.

Enabling the Transition of CPC Products to GIS Format Brian Doty Jennifer Adams Michael Halpert Viviane Silva.

1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)

GO-ESSP The Earth System Grid The Challenges of Building Web Client Geo-Spatial Applications Eric Nienhouse NCAR.

9/21/04 James Gallagher Server-Side: The Basics This part of the workshop contains an overview of the two servers which OPeNDAP has developed. One uses.

THREDDS Data Server (TDS) and Data Discovery John Caron Unidata/UCAR May 15, 2006.

TSDS (HPDE DAP). Objectives (1) develop a standard API for time series-like data, (2) develop a software package, TSDS (Time Series Data Server), that.

NQuery: A Network-enabled Data-based Query Tool for Multi-disciplinary Earth-science Datasets John R. Osborne 1, Kevin T. McHugh 2, and Donald W. Denbo.

Installing the THREDDS and Aggregation Servers ● Install and verify the Tomcat servlet engine ● Install and verify the THREDDS servlet (which also contains.

Data Browsing/Mining/Metadata

DAP+NETCDF Using the netCDF-4 Data Model

HYCOM CONSORTIUM Data and Product Servers

The Server-Side with F-TDS

Access HDF5 Datasets via OPeNDAP’s Data Access Protocol (DAP)

Remote Data Access Update

OPeNDAP: Accessing Data in a Distributed, Heterogeneous Environment

Live Access Server (LAS)

Presentation transcript:

LAS & NVODS S.Hankin -- Sep NVODS and the Live Access Server (LAS) Steve Hankin, PI (NOAA/PMEL) Jon Callahan (U of WA/JISAO) Ansley Manke (NOAA/PMEL) Joe Mclean (U of WA/JISAO) Kevin O’Brien (U of WA/JISAO) Richard Rogers (U of WA/JISAO) Roland Schweitzer (U of CO/CIRES) Joe Sirott (contractor) NVODS National Workshop, Sep , 2003

LAS & NVODS S.Hankin -- Sep Our goal: Provide a uniform, minimum guaranteed level of geo- and time-referenced on-line browse access for all NVODS data Provide a uniform, minimum guaranteed level of geo- and time-referenced on-line browse access for all NVODS data

LAS & NVODS S.Hankin -- Sep Why is this important to NVODS? On-line browse is the bridge to desktop access: discover  browse  access On-line browse is the bridge to desktop access: discover  browse  access Broadens the reach of the data Broadens the reach of the data –educators, recreationalists, policy makers … Increases visibility and tangible success Increases visibility and tangible success

LAS & NVODS S.Hankin -- Sep Metadata (XML) contains the “intelligence” Back end applications do the real work OPeNDAP provides remote data access LAS is an “Information Product Server”

Tour of NVODS on-line browse via LAS …

e.g. convert to Fahrenheit

(new in v6.2) customizable interfaces

basic transformations

“Sequence” (in-situ) data

configurable constraints

OPeNDAP output

discover  browse  access

LAS & NVODS S.Hankin -- Sep LAS “sisters” share metadata to form a unified (virtual) site. OPeNDAP allows LAS to difference distributed fields. Scalability and robust comparison

LAS & NVODS S.Hankin -- Sep FDS – Ferret DODS (“Data”) Server Under development (NOAA/HPCC funded) Supplies OPeNDAP output from LAS (via Ferret) Supplies OPeNDAP output from LAS (via Ferret) Based upon COLA’s “anagram” (GDS) Based upon COLA’s “anagram” (GDS) Acts as an OPeNDAP “AIS” (e.g. fix mangled coordinates) Acts as an OPeNDAP “AIS” (e.g. fix mangled coordinates) Inputs include (tab-)delimited, OPeNDAP, FORTRAN, … Inputs include (tab-)delimited, OPeNDAP, FORTRAN, … “Constraint-free” server-side data transformations “Constraint-free” server-side data transformations

LAS & NVODS S.Hankin -- Sep Query available data sets: Query variables in data set “model_1”: Query space-time domain: Request a subset of data as a file: (“asc” for ASCII format) “Batch” access to products >lasls >lasls model_1 >lasls model_1 sst >lasget -x 20:60 -y 20:60 -t 11-Dec f asc model_1 sst

LAS & NVODS S.Hankin -- Sep “Web Service” access to products XML request protocol implemented and documented XML “package” out implemented and documented XML query protocol under development formal SOAP interface under development

LAS & NVODS S.Hankin -- Sep Summary: LAS has gone a considerable way towards achieving its goal of providing on-line browse access to all NVODS data Pressing Challenges Use new OPeNDAP aggregation capabilities (GoMOOS, NDBC and NAVO are in our development server now) Use new OPeNDAP aggregation capabilities (GoMOOS, NDBC and NAVO are in our development server now) Use OPeNDAP Translation to access add’l HDF data Use OPeNDAP Translation to access add’l HDF data Use v6.2 configurability (esp. clickable map interfaces) Use v6.2 configurability (esp. clickable map interfaces) Easier configuration of new data sets (AIS!) Easier configuration of new data sets (AIS!) Improved sychronization (real-time updates and sister servers) Improved sychronization (real-time updates and sister servers) Fusion of Sequence and gridded data Fusion of Sequence and gridded data Incorporation of FDS – full bi-directional OPeNDAP Incorporation of FDS – full bi-directional OPeNDAP

Questions?