NetCDF and Scientific Data Standard

Slides:

Advertisements

Similar presentations

Romanian National Meteorological Administration | Presenter: Oana Nicola Authors: Oana Nicola, Andrei Diamandi, Alina Ristea Using ADAGUC for NWCSAF products.

Advertisements

The NCAR Command Language (NCL) and the NetCDF Data Format Research Tools Presentation Matthew Janiga 10/30/2012.

John Dennis Dave Brown Kevin Paul Sheri Mickelson

7 +/- 2 Maybe Good Ideas John Caron June (1) NetCDF-Java (aka CDM) has lots of functionality, but only available in Java – NcML Aggregation – Access.

The Future of NetCDF Russ Rew UCAR Unidata Program Center Acknowledgments: John Caron, Ed Hartnett, NASA’s Earth Science Technology Office, National Science.

NCL NCL stands for NCAR Command Language. It is similar to IDL and MATLAB. It is most convenient for reading NetCDF files and plotting maps, but there.

NetCDF An Effective Way to Store and Retrieve Scientific Datasets Jianwei Li 02/11/2002.

Introduction to NetCDF Ernesto Munoz. Outline Overview of NetCDF Overview of NetCDF NetCDF file information NetCDF file information CDL utilities: ncdump,

Collaboration Tools and Techniques for ROMS Rich Signell,USGS Woods Hole, MA.

Introduction to NetCDF Russ Rew, UCAR Unidata ICTP Advanced School on High Performance and Grid Computing 13 April 2011.

The NCAR Command Language (NCL) Ethan Alpert Visualization and Enabling Technologies Section, SCD, NCAR.

1 NetCDF and Self-Describing Data Kate Hedstrom January 2010

Netcdf course Intro CF convention Netcdf excercises.

NetCDF-4 The Marriage of Two Data Formats Ed Hartnett, Unidata June, 2004.

Unidata’s TDS Workshop TDS Overview – Part II October 2012.

NcML Aggregation vs Feature Collections. NcML functionality 1.Modify the objects found in CDM files – Especially Attributes – Don’t have to rewrite the.

Mid-Course Review: NetCDF in the Current Proposal Period Russ Rew

The netCDF-4 data model and format Russ Rew, UCAR Unidata NetCDF Workshop 25 October 2012.

Deutscher Wetterdienst

Accessing Remote Datasets using the DAP protocol through the netCDF interface. Dr. Dennis Heimbigner Unidata netCDF Workshop August 3-4, 2009.

Climate Data Formats Deniz Bozkurt

NetCDF Data Model Issues Russ Rew, UCAR Unidata NetCDF 2010 Workshop

November 30, 2005HDF & HDF-EOS Workshop IX Peter Cao, NCSA November 30, 2005 HDF5 Tools.

The HDF Group Introduction to netCDF-4 Elena Pourmal The HDF Group 110/17/2015.

The HDF Group HDF Group Support for NPP/JPSS Mike Folk, Elena Pourmal, Larry Knox, Albert Cheng The HDF Group DEWG Meeting June 19, 2012.

Post Processing Tools Sylvia Murphy National Center for Atmospheric Research.

Data File Formats: netCDF by Tom Whittaker University of Wisconsin-Madison SSEC/CIMSS 2009 MUG Meeting June, 2009.

SCD User Briefing NCL and PyNGL Visualization for the Geosciences Don Middleton with presentation material developed by Luca Cinquini, Mary Haley, Fred.

SCD Research Data Archives; Availability Through the CDP About 500 distinct datasets, 12 TB Diverse in type, size, and format Serving 900 different investigators.

An introduction to CDO, NCL and PRECIS utilities

NCAS Computational Modelling Service (CMS) Group providing services to the UK academic modelling community Output of UM Diagnostics Directly in CF NetCDF;

Weathertop Consulting, LLC Server-side OPeNDAP Analysis – Concrete steps toward a generalized framework via a reference implementation using F-TDS Roland.

SDM Center Parallel I/O Storage Efficient Access Team.

NASA HDF-EOS File Format Overview Joseph M Glassy, Director, MODIS Software Development at NTSG School of Forestry, Numerical Terradynamics Simulation.

CF 2.0 Coming Soon? (Climate and Forecast Conventions for netCDF) Ethan Davis ESO Developing Standards - ESIP Summer Mtg 14 July 2015.

Update on Unidata Technologies for Data Access Russ Rew

Testing of Objective Analysis of Precipitation Structures (Snowbands) using the NCAR Developmental Testbed Center (DTC) Model Evaluation Tools (MET) Software.

Utilities for netCDF-4 Dr. Dennis Heimbigner Unidata Advanced netCDF Workshop July 25, 2011.

Unidata Infrastructure for Data Services Russ Rew GO-ESSP Workshop, LLNL

1. Gridded Data Sub-setting Services through the RDA at NCAR Doug Schuster, Steve Worley, Bob Dattore, Dave Stepaniak.

HDF/HDF-EOS Meeting Oct th 2008, Aurora CO Proposal for adding Named Dimensions to HDF5 Arrays Daniel Kahn Science Systems and Applications, Inc.

Inter-system biases estimation in multi-GNSS relative positioning with GPS and Galileo Cecile Deprez and Rene Warnant University of Liege, Belgium

The ABCD matrix for parabolic reflectors and its application to astigmatism free four-mirror cavities.

IRI/LDEO Climate Data Library M.Benno Blumenthal, Michael Bell, and John del Corral International Research Institute for Climate and Society Columbia University.

Richard Anantua (UC Berkeley)

Adding CF Attributes to an HDF5 File

DAP+NETCDF Using the netCDF-4 Data Model

Transition from HDF4 to HDF5: Issues

Moving from HDF4 to HDF5/netCDF-4

NetCDF 3.6: What’s New Russ Rew

What’s the difference between the Ribbon and the Quick Access Toolbar?

Lawrence Livermore National Laboratory

Efficiently serving HDF5 via OPeNDAP

DATA MINING Python.

USB Project (15th July) Ian Coulter.

MATLAB, netCDF, and OPeNDAP

Tad Scheiblich RSI December 2, 2005

National Scientific Library at Tbilisi State University

Parallel NetCDF + MASS Development

Unidata Advanced netCDF Workshop

Access HDF5 Datasets via OPeNDAP’s Data Access Protocol (DAP)

MATLAB/SIMULINK Professor Walter W. Olson

Populating a Data Warehouse

Quick Access to HDF and HDFEOS data with NCL

Genome Workbench Chuong Huynh NIH/NLM/NCBI New Delhi, India

HDF5 Performance Enhancements with the Elimination of Unlimited Dimension Debbie Mao, Daniel Ziskin, Merritt Deeter, Sara Martinez-alonso MOPITT is an.

HDF-EOS Workshop XXI / The 2018 ESIP Summer Meeting

Tour of NCL Website Modified by R. Grotjahn

NCL variable based on a netCDF variable model

Presentation transcript:

NetCDF and Scientific Data Standard Array of Data file amenable to array operations and good data viewers

Historical View of Problem

The need for Metadata

NetCDF and HDF

Programs - ncdump

ncgen

Use NCAR Command Language (NCL)

NetCDF Operators (NCO)

netCDF Library & Programming Model Modes: definition mode, data mode IDs: dataset ID, dimension ID, variable ID, attribute number Create & Write Read by name Read sequencially Add dim,var,att

Why Do this? Converting to NetCFG is always worth the trouble Portability Use of tools (ncdump, nco, etc) New interfaces from scripting languages make it simple to use (available on ACISS) Makes for great and rapid ability for data visualization using appropriate viewers