Session 3: Using OPeNDAP-enabled Applications to Access Australian Data Services and Repositories eResearch Australasia 2011, ½ Day Morning Workshop, Thursday.

Slides:



Advertisements
Similar presentations
University of Chicago Department of Energy The Parallel and Grid I/O Perspective MPI, MPI-IO, NetCDF, and HDF5 are in common use Multi TB datasets also.
Advertisements

MATLAB – What is it? Computing environment / programming language Tool for manipulating matrices Many applications, you just need to get some numbers in.
© 2006 IBM Corporation JFS tests process on System z.
The Model Output Interoperability Experiment in the Gulf of Maine: A Success Story Made Possible By CF, NcML, NetCDF-Java and THREDDS Rich Signell (USGS,
The HDF Group HDF/HDF-EOS Workshop XIV1 Easy Remote Access via OPeNDAP Kent Yang and Joe Lee The HDF Group The 14 th HDF/HDF-EOS Workshop.
® Page 1 Intel Compiler Lab – Intel Array Visualizer HDF Workshop VI December 5, 2002 John Readey
The HDF Group November 3-5, 2009HDF/HDF-EOS Workshop XIII1 Using visualization tools to access HDF data via OPeNDAP Joe Lee and Kent Yang.
Chapter 5 Operating Systems. 5 The Operating System When working with multimedia, the operating system is perhaps the most important, the most complex,
Using OPeNDAP-enabled Applications to Access Australian Data Services and Repositories eResearch Australasia 2011, ½ Day Morning Workshop, Thursday 10.
An Update on GrADS and the GDS and their Application to a Searchable Metadata Catalog Jennifer Miletta Adams IGES/COLA.
Soft Computing 1 Matlab Tutorial Kai Goebel, Bill Cheetham RPI/GE CRD
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
OPeNDAP Present and Future An Overview Encompassing Current Projects & Potential New Directions Dave Fulker and James Gallagher.
Support EOS: Review and Discussions Kent Yang and Joe Lee The HDF Group October 16, 2012 Oct. 16, 2012Annual HDF Briefing to ESDIS1.
Numerical Grid Computations with the OPeNDAP Back End Server (BES)
The HDF Group HDF/HDF-EOS Workshop XIV1 Easy Access of NASA HDF data via OPeNDAP Kent Yang and Joe Lee The HDF Group September 28,2010.
Unidata TDS Workshop THREDDS Data Server Overview October 2014.
Session 2: Using OPeNDAP-enabled Applications to Access Australian Data Services and Repositories eResearch Australasia 2011, ½ Day Morning Workshop, Thursday.
® Page 1 Intel Compiler Lab – Intel Array Visualizer HDF Workshop VIII October 27, 2004 John Readey
Users’ reviews of TuneUp Utilities 2011 A brief Introduction of types of software Install Internet Information Services Install Microsoft Office 2010.
1 An Introduction – UCF, Methods in Ecology, Fall 2008 An Introduction By Danny K. Hunt & Eric D. Stolen Getting Started with R (with speaker notes)
OPeNDAP and the Data Access Protocol (DAP) Original version by Dave Fulker.
The HDF Group ESIP Summer Meeting HDF OPeNDAP update Kent Yang The HDF Group 1 July 8 – 11, 2014.
Objectives Understand what MATLAB is and why it is widely used in engineering and science Start the MATLAB program and solve simple problems in the command.
WRF Domain Wizard A tool for the WRF Preprocessing System Jeff Smith Paula McCaslin July 17, 2008.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
Warmup A programmer’s wife tells him, “Would you mind going to the store and picking up a loaf of bread? Also, if they have eggs, get a dozen.” The programmer.
Animation of DSM2 Outputs in ArcMap Siqing Liu Bay Delta Office Department of Water Resources 2/17/2015.
Logging into the linux machines This series of view charts show how to log into the linux machines from the Windows environment. Machine name IP address.
1 Computer Programming (ECGD2102 ) Using MATLAB Instructor: Eng. Eman Al.Swaity Lecture (1): Introduction.
Tools for Interoperability between HDF and NetCDF Mike Folk and MuQun Yang The HDF Group The HDF Group provides the following tools for the NASA HDF and.
NcBrowse A Graphical netCDF/OPeNDAP Browser Donald Denbo 1 & John Osborne 2 1 UW/JISAO-NOAA/PMEL, 2 OceanAtlas Software
WRF Domain Wizard The WRF Preprocessing System GUI Jeff S Smith Paula McCaslin and Mark Govett AMS 2008 Presentation.
The HDF Group November 3-5, 2009 HDF-OPeNDAP Project Update HDF/HDF-EOS Workshop XIII1 Joe Lee and Kent Yang The HDF Group James Gallagher.
Unidata TDS Workshop THREDDS Data Server Overview
MATLAB Environment ELEC 206 Computer Applications for Electrical Engineers Dr. Ron Hayne.
Recent developments with the THREDDS Data Server (TDS) and related Tools: covering TDS, NCML, WCS, forecast aggregation and not including stuff covered.
Introduction to Web Services. Examples Using a Web Service Creating a new Web Service.
CKD Workshop  30 March 2011  Jim Kinter  Data Lessons from Project Athena GrADS Station Data Model Used for in situ observational data Individual reports.
Space Research Software Pedro Vicente Space Research Software, Inc. HDF-EOS Workshop VI Dec. 4-5, 2002 San Francisco, CA HDF.
Remote Data Access with OPeNDAP Dr. Dennis Heimbigner Unidata netCDF Workshop October 25, 2012.
WDO-It! 102 Workshop: Using an abstraction of a process to capture provenance UTEP’s Trust Laboratory NDR HP MP.
Introduction to Computer Operating Systems
1 Perl Note, I am hoping that we can accomplish all we need to with CSS accounts, Linux, and the NoMachine client -- since these already have Perl installed.
How to use WS_FTP A Step by Step Guide to File Transfer.
訊號與系統 廖文淵 德霖技術學院資訊工程系 Introduction to MATLAB.
11/8/2007HDF and HDF-EOS Workshop XI, Landover, MD1 Software to access HDF5 Datasets via OPeNDAP MuQun Yang, Hyo-Kyung Lee The HDF Group.
LAS and THREDDS: Partners for Education Roland Schweitzer Steve Hankin Jonathan Callahan Joe Mclean Kevin O’Brien Ansley Manke Yonghua Wei.
OPeNDAP Developer’s Workshop Feb Server-side Functions for Geo-spatial Selection James Gallagher 22 Feb 2007.
ERDDAP The Next Generation of Data Servers Bob Simons DOC / NOAA / NMFS / SWFSC / ERD Monterey, CA Disclaimer: The opinions expressed.
Java OceanAtlas A Cross-Platform Application for Visualization and Selection of Oceanographic Profile Data John R. Osborne ftp://odf.ucsd.edu/pub/OceanAtlas/
Introduction to Programming on MATLAB Ecological Modeling Course Sep 11th, 2006.
A Collaboration Tool to Support Modeling Groups Donald W. Denbo JISAO/UW-NOAA/PMEL 20 th IIPS/AMS, 12 – 15 January, 2004,
9/21/04 James Gallagher Server-Side: The Basics This part of the workshop contains an overview of the two servers which OPeNDAP has developed. One uses.
NcBrowse: A Graphical netCDF File Browser Donald Denbo NOAA-PMEL/UW-JISAO
Other Projects Relevant (and Not So Relevant) to the SODA Ideal: NetCDF, HDF, OLE/COM/DCOM, OpenDoc, Zope Sheila Denn INLS April 16, 2001.
Chapter 5 Operating Systems.
Clients.
IBM Tivoli Provisioning Manager Red Hat 5 patch management
MATLAB Basics Nafees Ahmed Asstt. Professor, EE Deptt DIT, DehraDun.
Unpack the Matlab GUI cd to your home directory > cd
MATLAB DENC 2533 ECADD LAB 9.
Introduction to R.
Access HDF5 Datasets via OPeNDAP’s Data Access Protocol (DAP)
Logging into the linux machines
HDF-EOS Workshop XXI / The 2018 ESIP Summer Meeting
Introduction to Matlab
OPeNDAP Community Working Groups October 18, 2007
Web Servers (IIS and Apache)
Adapting an existing web server to S3
Presentation transcript:

Session 3: Using OPeNDAP-enabled Applications to Access Australian Data Services and Repositories eResearch Australasia 2011, ½ Day Morning Workshop, Thursday 10 th November 2011

GENERAL INFORMATION This is a half-day workshop (9am to 12:30pm) 9:00am Introductions and Participants Goals 9:15am Session 1: Discovering OPeNDAP data access services 10:00am Session 2: Applicable use cases of OPeNDAP data services −10:30am Tea Break for 15 minutes 11:00am Session 3: OPeNDAP service protocols and features 11:45am Session 4: Accessing complementary features and services 12:30pm End of Workshop 11:00am Session 3: OPeNDAP service protocols and features

Session 3 OPeNDAP service protocols and features to support meta-data discovery and efficient data access and extraction. A short tutorial on meta-data and data access and extraction using an OPeNDAP-enable client application. 45 minutes in length

MATLAB MATLAB® is commercial software, that is a high-level technical computing language and interactive environment for algorithm development, data visualization, data analysis, and numerical computation To support OPeNDAP remote data access, do the following: 1.Get a matlab-macos.zip or matlab-windows.zip from Tim 2.Install in users home directory and unzip 3.Modify the startup.m paths to suit each user 4.Startup MATLAB and check whether the startup.m file was read, and the paths are correct.

MATLAB demo >> addpath /usr/local/bin >> url = ' >> ce='time’ >> loaddap('-V') loaddap: >> loaddap([url '?' ce]) … the vector ‘time’ is loaded into the workspace >> ce1=’lsp’ >> loaddap([url '?' ce1]) Creating matrix lsp (62 x 73 x 144) with elements. Creating vector time with 62 elements. Creating vector latitude with 73 elements. Creating vector longitude with 144 elements. >> addpath /usr/local/bin >> url = ' >> ce='time’ >> loaddap('-V') loaddap: >> loaddap([url '?' ce]) … the vector ‘time’ is loaded into the workspace >> ce1=’lsp’ >> loaddap([url '?' ce1]) Creating matrix lsp (62 x 73 x 144) with elements. Creating vector time with 62 elements. Creating vector latitude with 73 elements. Creating vector longitude with 144 elements.

MATLAB demo, cont >> ce2='lsp[61][0:72][0:143]’ >> loaddap([url '?' ce2]) Creating matrix lsp (1 x 73 x 144) with elements. Creating vector time with 1 elements. Creating vector latitude with 73 elements. Creating vector longitude with 144 elements. >> ce3='grid(lsp,"time=899202")’ >> loaddap([url '?' ce3]) Creating matrix lsp (1 x 73 x 144) with elements. Creating vector time with 1 elements. Creating vector latitude with 73 elements. Creating vector longitude with 144 elements. >> ce2='lsp[61][0:72][0:143]’ >> loaddap([url '?' ce2]) Creating matrix lsp (1 x 73 x 144) with elements. Creating vector time with 1 elements. Creating vector latitude with 73 elements. Creating vector longitude with 144 elements. >> ce3='grid(lsp,"time=899202")’ >> loaddap([url '?' ce3]) Creating matrix lsp (1 x 73 x 144) with elements. Creating vector time with 1 elements. Creating vector latitude with 73 elements. Creating vector longitude with 144 elements.

MATLAB and SNCtools demo % ex_snctools_opendap.m % Read from a remote OPeNDAP server with the same file % ncRef = ' 06-ABOM-L4LRfnd-GLOB-v01-fv01.nc' nc_dump( ncRef ); pause temp = nc_varget( ncRef, 'analysed_sst'); lon = nc_varget( ncRef, 'lon'); lat = nc_varget( ncRef, 'lat'); imagesc(lat, lon, temp); axis xy % ex_snctools_opendap.m % Read from a remote OPeNDAP server with the same file % ncRef = ' 06-ABOM-L4LRfnd-GLOB-v01-fv01.nc' nc_dump( ncRef ); pause temp = nc_varget( ncRef, 'analysed_sst'); lon = nc_varget( ncRef, 'lon'); lat = nc_varget( ncRef, 'lat'); imagesc(lat, lon, temp); axis xy

MATLAB and NJTbx demo % ex_njtbx.m % Read from a remote OPeNDAP server with the same file % ncRef = ' 06-ABOM-L4LRfnd-GLOB-v01-fv01.nc' nj_info( ncRef ) pause [temp, grid] = nj_grid_varget(ncRef,'analysed_sst'); imagesc(grid.lon, grid.lat, temp); axis xy; colorbar % ex_njtbx.m % Read from a remote OPeNDAP server with the same file % ncRef = ' 06-ABOM-L4LRfnd-GLOB-v01-fv01.nc' nj_info( ncRef ) pause [temp, grid] = nj_grid_varget(ncRef,'analysed_sst'); imagesc(grid.lon, grid.lat, temp); axis xy; colorbar

Panoply Panoply is a cross-platform application which plots geo-gridded arrays from netCDF, HDF and GRIB datasets. To install Panoply on Windows, go to To install Panoply on Mac OS X, go to To install Panoply on Linux and other systems, go to

Panoply demo 1.Load the catalog and navigate it to the data set of interest 2.Select a data set and view the metadata 3.Graph some data 4.Select velocity data and plot vectors

Tutorial: Pick a demo to try Please select from MATLAB or Panoply demos 1.Install the software on your machine 2.Run a test case and see if the software is installed correctly 3.Access a different file from a TDS or Hyrax data service 4.Get the metadata information 5.Access some data and graph it

Thank you Authors: Tim F. Pugh 1, James Gallagher 2, Dave Fulker 3 1 Australian Bureau of Meteorology, Melbourne, Australia, 2 OPeNDAP, Butte, Montana, USA, 3 OPeNDAP, Boulder, Colorado, USA,