LAS and THREDDS: Partners for Education Roland Schweitzer Steve Hankin Jonathan Callahan Joe Mclean Kevin O’Brien Ansley Manke Yonghua Wei.

Slides:



Advertisements
Similar presentations
1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
Advertisements

CAP Support in Esris Open Source Geoportal Server WMO Information System (WIS) CAP Implementation Workshop Geneva, 6-7 April 2011 Clive Reece
The Live Access Server (Access to observational data) Jonathan Callahan (University of Washington) Steve Hankin (NOAA/PMEL – PI) Roland Schweitzer, Kevin.
Weathertop Consulting, LLC Server-side OPeNDAP Analysis - A General Approach Utilizing Legacy Applications through TDS Roland Schweitzer Weathertop Consulting,
Unidata Seminar Series - 30 January 2004 OPeNDAP and THREDDS: Access and Discovery of Distributed Scientific Data Yuan Ho Ethan Davis UCAR Unidata.
OPeNDAP in the Cloud Optimizing the Use of Storage Systems Provided by Cloud Computing Environments OPeNDAP James Gallagher, Nathan Potter and NOAA/NODC.
OPeNDAP in the Cloud OPeNDAP James Gallagher, Nathan Potter and NOAA/NODC Deirdre Byrne, Jefferson Ogata, John Relph 26 June 2013.
A Common Data Model In the Middle Tier Enabling Data Access in Workflows … HDF/HDF-EOS Workshop XIV September 29, 2010 Doug Lindholm Laboratory for Atmospheric.
Streaming NetCDF John Caron July What does NetCDF do for you? Data Storage: machine-, OS-, compiler-independent Standard API (Application Programming.
® OGC Web Services Initiative, Phase 9 (OWS-9): Innovations Thread - OPeNDAP James Gallagher and Nathan Potter, OPeNDAP © 2012 Open Geospatial Consortium.
GrADS 1.9 and the GrADS-DODS Server Jennifer Adams, Brian Doty, Joe Wielgosz Center for Ocean-Land-Atmosphere Studies (COLA) AMS/IIPS 13 January 2004.
LAS & NVODS S.Hankin -- Sep NVODS and the Live Access Server (LAS) Steve Hankin, PI (NOAA/PMEL) Jon Callahan (U of WA/JISAO) Ansley Manke (NOAA/PMEL)
TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.
Unidata TDS Workshop THREDDS Data Server Overview October 2014.
Introduction Downloading and sifting through large volumes of data stored in differing formats can be a time-consuming and sometimes frustrating process.
HYCOM Data Service New Datasets, Functionality and Future Development Ashwanth Srinivasan, (FSU) Steve Hankin (NOAA/PMEL) Major contributors: Jon Callahan.
CEOS/WGISS 20, Kyev, September 12-16, WTF-CEOP Implementation Plan #1 Status (WTF-CEOP first prototype, by JAXA) September 12, 2005 Osamu Ochiai.
VrRBO with THREDDS data store. Paths & URLs THREDDS server THREDDS data directory.
GADS: A Web Service for accessing large environmental data sets Jon Blower, Keith Haines, Adit Santokhee Reading e-Science Centre University of Reading.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
THREDDS Data Server Ethan Davis GEOSS Climate Workshop 23 September 2011.
Weathertop Consulting, LLC Wednesday, January 14, 2009 IIPS 11A.2 1 A General Purpose System for Server-side Analysis of Earth Science Data Roland Schweitzer.
ESP workshop, Sept 2003 the Earth System Grid data portal presented by Luca Cinquini (NCAR/SCD/VETS) Acknowledgments: ESG.
U.S. Department of the Interior U.S. Geological Survey Management of Oceanographic time-series data at the Woods Hole Coastal and Marine Science Center.
1 AJAX and Dapper: The Good, the Bad, and the Ugly Joe Sirott PMEL/NOAA.
Contrasting styles of Web UI Development: GWT vs Native JavaScript Roland Schweitzer Weathertop Consulting, LLC Jeremy Malczyk JISAO.
Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.
Integrated Model Data Management S.Hankin ESMF July ‘04 Integrated data management in the ESMF (ESME) Steve Hankin (NOAA/PMEL & IOOS/DMAC) ESMF Team meeting.
1 Dapper and Argo Joe Sirott PMEL/NOAA. 2 What is Dapper? Web server that provides distributed access to in-situ data via OPeNDAP protocol Clients include.
Opendap dev - meeting, Boulder, Feb 2007 OPeNDAP infrastructure in European Operational Oceanography T Loubrieu (IFREMER) T Jolibois (CLS)
1 HYCOM Data Service HYCOM Data Service An overview Ashwanth Srinivasan, (FSU) Steve Hankin (NOAA/PMEL)
Unidata TDS Workshop THREDDS Data Server Overview
Easily Serving and Accessing HDF-EOS2 Datasets Using DODS Technologies Richard Chinman, UCAR-IITA, DODS Project Manager
1 NASA CEOP Status & Demo CEOS WGISS-24 Oberpfaffenhofen, Germany October 15, 2007 Yonsook Enloe.
TPAC Tasmanian Partnership for Advanced Computing Partner in APAC (Australian Partnership for Advanced Computing) Expertise centre for Earth Systems Science.
Recent developments with the THREDDS Data Server (TDS) and related Tools: covering TDS, NCML, WCS, forecast aggregation and not including stuff covered.
1 DAPPER: An OPENDAP Server for In-Situ Data Joe Sirott Donald W. Denbo, Willa H Zhu University of Washington PMEL/NOAA.
Web Portal Design Workshop, Boulder (CO), Jan 2003 Luca Cinquini (NCAR, ESG) The ESG and NCAR Web Portals Luca Cinquini NCAR, ESG Outline: 1.ESG Data Services.
THREDDS Catalogs Ethan Davis UCAR/Unidata NASA ESDSWG Standards Process Group meeting, 17 July 2007.
Unidata’s TDS Workshop TDS Overview – Part I July 2011.
Remote Data Access with OPeNDAP Dr. Dennis Heimbigner Unidata netCDF Workshop October 25, 2012.
User Working Group 2013 Data Access Mechanisms – Status 12 March 2013
UAF/OSMC Presenters: Kevin O’Brien and Eugene Burger Abstract: Kevin O’Brien and Eugene Burger are from NOAA’s Pacific Marine Environmental Laboratory.
A Data Access Framework for ESMF Model Outputs Roland Schweitzer Steve Hankin Jonathan Callahan Kevin O’Brien Ansley Manke.
Configuring NVODS Datasets in LAS Joseph McLean TMAP/PMEL/NOAA and JISAO/UW OAR WebShop 2002.
1 NASA CEOP Final Summary CEOS WGISS-26 Boulder, Colorado September 23, 2008 Yonsook Enloe
Improving Data Catalogs with Free and Open Source Software Kevin O’Brien University of Washington Joint Institute for the Study of the Atmosphere and Ocean.
The Unified Access Framework for Gridded Data … the 1 st year focus of NOAA’s Global Earth Observation Integrated Data Environment (GEO-IDE) Steve Hankin,
An Update on COLA’s Software Development Jennifer M. Adams and Brian Doty.
NOAAServer: Unified access to distributed NOAA data Ernest Daddio, NOAA/ESDIM Steve Hankin, NOAA/PMEL Donald Denbo, NOAA/PMEL/JISAO Nancy Soreide, NOAA/PMEL.
LAS-XML, Validation, and RELAX NG Jon Callahan (standing in for Roland Schweitzer)
1 Adventures in Web Services for Large Geophysical Datasets Joe Sirott PMEL/NOAA.
GrADS-DODS Server An open-source tool for distributed data access and analysis Joe Wielgosz, Brian Doty, Jennifer Adams COLA/IGES - Calverton, MD
Product-Generation in ESG: some explorations of the user experience and discussion of implications for the design of ESG Steve Hankin & Roland Schweitzer.
Weathertop Consulting, LLC Server-side OPeNDAP Analysis – Concrete steps toward a generalized framework via a reference implementation using F-TDS Roland.
Distributed Data Servers and Web Interface in the Climate Data Portal Willa H. Zhu Joint Institute for the Study of Ocean and Atmosphere University of.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
GO-ESSP The Earth System Grid The Challenges of Building Web Client Geo-Spatial Applications Eric Nienhouse NCAR.
Update on Unidata Technologies for Data Access Russ Rew
Installing the THREDDS and Aggregation Servers ● Install and verify the Tomcat servlet engine ● Install and verify the THREDDS servlet (which also contains.
Product Designer Hub – Taking HPD to the Web
Data Browsing/Mining/Metadata
The Server-Side with F-TDS
Access HDF5 Datasets via OPeNDAP’s Data Access Protocol (DAP)
Remote Data Access Update
Accessing Remote Datasets through the netCDF interface.
Live Access Server (LAS)
OPeNDAP/Hyrax Interfaces
Adapting an existing web server to S3
Presentation transcript:

LAS and THREDDS: Partners for Education Roland Schweitzer Steve Hankin Jonathan Callahan Joe Mclean Kevin O’Brien Ansley Manke Yonghua Wei

The LAS, The THREDDS and The Wardrobe Roland Schweitzer Steve Hankin Jonathan Callahan Joe Mclean Kevin O’Brien Ansley Manke Yonghua Wei

25 May DLESE Data Services Workshop 3 What’s in Store The Live Access Server (LAS) The Live Access Server (LAS) What is LAS?What is LAS? ObjectivesObjectives ArchitectureArchitecture CustomizationCustomization THREDDS and LAS THREDDS and LAS Current capabilitiesCurrent capabilities Future plansFuture plans

25 May DLESE Data Services Workshop 4 Lost in a cloud of data?

25 May DLESE Data Services Workshop 5 LAS and THREDDS can help

25 May DLESE Data Services Workshop 6 The Live Access Server (LAS) A highly configurable Web server designed to provide flexible access to geo-referenced scientific data

25 May DLESE Data Services Workshop 7 Objectives for LAS Web-based interface to diverse data and the capabilities of intelligent “back-end” visualization software Web-based interface to diverse data and the capabilities of intelligent “back-end” visualization software Single interface for sub-setting, download, visualization, comparison Single interface for sub-setting, download, visualization, comparison Easy access to metadata and documentation Easy access to metadata and documentation Unified access to distributed data holdings Unified access to distributed data holdings Customizable user interface Customizable user interface LAS accommodates many data providers and educators.

25 May DLESE Data Services Workshop 8 LAS Architecture browser UI (java/script) gif,netCDF,etc. servers LAS UI server LAS product server LAS XML configuration metadata browser interface back end (Ferret or GrADS or others) product request (XML) scripts/commands products data

25 May DLESE Data Services Workshop 9 LAS uses OPeNDAP Data OPeNDAP is a technology that allows clients to use remote data via a local file API OPeNDAP is a technology that allows clients to use remote data via a local file API Servers exists for binary, GRIB, netCDF and HDF data files Servers exists for binary, GRIB, netCDF and HDF data files LAS installations can be configured to use both local data and data served from a remote OPeNDAP server LAS installations can be configured to use both local data and data served from a remote OPeNDAP server

25 May DLESE Data Services Workshop 10 browser UI (java/script) gif,netCDF,etc. servers LAS UI server LAS product server LAS XML configuration metadata browser interface back end (Ferret or GrADS or others) product request (XML) scripts/commands products data LAS Architecture with OPeNDAP OPeNDAP OPeNDAP Server

25 May DLESE Data Services Workshop 11 Customization Features Expanded hierarchies Expanded hierarchies Custom HTML headers Custom HTML headers Custom pages for data set and variable selection Custom pages for data set and variable selection Custom back-end operations (products) Custom back-end operations (products) Use of “product server” with user’s own interface client Use of “product server” with user’s own interface client

25 May DLESE Data Services Workshop 12 Example (Expanded Hierarchy) The NVODS Server (

25 May DLESE Data Services Workshop 13 Example (Custom Headers) The NVODS Server (

25 May DLESE Data Services Workshop 14 Example (Custom Selection) Experimental Development Server

25 May DLESE Data Services Workshop 15 Example (Custom Backend) NGDC (

25 May DLESE Data Services Workshop 16 Example (User’s Own Interface) Marine Environmental Prediction System funded by the Canadian Foundation for Climate and Atmospheric Sciences (

17 Behind the Wardrobe The magic land of the future!

25 May DLESE Data Services Workshop 18 Ferret Data Server (FDS) FDS is an OPeNDAP server implementation (based on Anagram) FDS is an OPeNDAP server implementation (based on Anagram) FDS has some extended capabilities (similar to GDS). FDS has some extended capabilities (similar to GDS).

25 May DLESE Data Services Workshop 19 Extended Capabilities of FDS Create and serve data sets as result of an analysis operation on-the-fly Create and serve data sets as result of an analysis operation on-the-fly Add or modify inadequate metadata Add or modify inadequate metadata Fix coordinate system deficiencies Fix coordinate system deficiencies Missing axesMissing axes Axes reorderingAxes reordering Corrupted coordinatesCorrupted coordinates Aggregate time-series files into one URL Aggregate time-series files into one URL Embed analysis requests into URL Embed analysis requests into URL

25 May DLESE Data Services Workshop 20 LAS and THREDDS Every LAS installation can present a Dataset Inventory Catalog of the underlying data sets Every LAS installation can present a Dataset Inventory Catalog of the underlying data sets (Needs to be upgraded to 1.0 Schema) (Needs to be upgraded to 1.0 Schema) (Needs correct service type for both LAS operations and FDS services) (Needs correct service type for both LAS operations and FDS services)

25 May DLESE Data Services Workshop 21 LAS, THREDDS and FDS All of the data behind an LAS installation has been “regularized” All of the data behind an LAS installation has been “regularized” LAS will have an FDS OPeNDAP URL as an output product LAS will have an FDS OPeNDAP URL as an output product Subsets can be defined via geographic and time constraints Subsets can be defined via geographic and time constraints Any sub-set of any LAS data set can become an OPeNDAP data set. Any sub-set of any LAS data set can become an OPeNDAP data set.

25 May DLESE Data Services Workshop 22 More Information Subscribe to the LAS User’s mailing list Subscribe to the LAS User’s mailing list

25 May DLESE Data Services Workshop 23 The End