Lab Activity 5: Analyze Data from Gulf of Mexico Model Run Data from Xu et al. (2011) model (or a very similar model run) is stored on plumeri: /data/users-tmp/ckharris/MCH2mod/RESULTS/XU_etal_2011_Paper.

Slides:



Advertisements
Similar presentations
1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
Advertisements

GRIB in TDS 4.3. NetCDF 3D Data dimensions: lat = 360; lon = 720; time = 12; variables: float temp(time, lat, lon); temp:coordinates = “time lat lon”;
Recent Work in Progress
The Model Output Interoperability Experiment in the Gulf of Maine: A Success Story Made Possible By CF, NcML, NetCDF-Java and THREDDS Rich Signell (USGS,
The NCAR Command Language (NCL) and the NetCDF Data Format Research Tools Presentation Matthew Janiga 10/30/2012.
MS698: Implementing an Ocean Model Benchmark tests. Dealing with big data files. – (specifically big NetCDF files). Signell paper. Activity: – nctoolbox.
Streaming NetCDF John Caron July What does NetCDF do for you? Data Storage: machine-, OS-, compiler-independent Standard API (Application Programming.
7 +/- 2 Maybe Good Ideas John Caron June (1) NetCDF-Java (aka CDM) has lots of functionality, but only available in Java – NcML Aggregation – Access.
The Future of NetCDF Russ Rew UCAR Unidata Program Center Acknowledgments: John Caron, Ed Hartnett, NASA’s Earth Science Technology Office, National Science.
Modeling the M 2 and O 1 Barotropic and Baroclinic Tides in the Gulf of Mexico Using the HYbrid Coordinate Ocean Model (HYCOM) Flavien Gouillon 1 ; B.
Collaboration Tools and Techniques for Large Model Data Sets Rich Signell,USGS Woods Hole, MA.
NCL NCL stands for NCAR Command Language. It is similar to IDL and MATLAB. It is most convenient for reading NetCDF files and plotting maps, but there.
Collaboration Tools and Techniques for ROMS Rich Signell,USGS Woods Hole, MA.
Annapolis: July 18, 2006 Outline of talk: Objective: Improve BBL in 3D model. Estimates of shear stress. Evaluate bottom boundary layer.
1 The NOAA Weather and Climate Toolkit Steve Ansari, Stephen Del Greco (NOAA / NCDC) Mark Phillips (UNC-Asheville / NEMAC) Bill Hankins (STG Inc.)
Status of netCDF-3, netCDF-4, and CF Conventions Russ Rew Community Standards for Unstructured Grids Workshop, Boulder
Session 2: Using OPeNDAP-enabled Applications to Access Australian Data Services and Repositories eResearch Australasia 2011, ½ Day Morning Workshop, Thursday.
US IOOS Modeling Testbed Leadership Teleconference May 3, 2011 FVCOM Development Team Robert C. Beardsley and Changsheng Chen
A Super-Regional Modeling Testbed for Improving Forecasts of Environmental Processes for the U.S. Atlantic and Gulf of Mexico Coasts Cyberinfrastructure.
VrRBO with THREDDS data store. Paths & URLs THREDDS server THREDDS data directory.
Volumetric Visualization. Outline Announcements –PS III due Friday –Last day for self-motivated assignment Belated CookiePresentation What is VV? Slices.
Implementation of Model Data Interoperability for IOOS: Successes and Lessons Learned Rich Signell USGS Woods Hole, MA / NOAA Silver Spring USA Model Data.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
DM_PPT_NP_v01 SESIP_0715_AJ HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann Gerd Heber, John Readey, Joel Plutchak The HDF Group HDF.
2 3 ROMS/COAWST NcML file 4 5 Exploiting IOOS: A Distributed, Standards-Based Framework and Software Stack for Searching, Accessing, Analyzing and.
THREDDS Data Server Ethan Davis GEOSS Climate Workshop 23 September 2011.
1 The NOAA Weather and Climate Toolkit Steve Ansari, Stephen Del Greco, Neal Lott (NOAA / NCDC)
U.S. Department of the Interior U.S. Geological Survey Management of Oceanographic time-series data at the Woods Hole Coastal and Marine Science Center.
NcML Aggregation vs Feature Collections. NcML functionality 1.Modify the objects found in CDM files – Especially Attributes – Don’t have to rewrite the.
Mid-Course Review: NetCDF in the Current Proposal Period Russ Rew
Animation of DSM2 Outputs in ArcMap Siqing Liu Bay Delta Office Department of Water Resources 2/17/2015.
Enhancements to a Community Toolset for Ocean Model Data Interoperability: Unstructured grids, NCTOOLBOX, and Distributed Search Rich Signell (USGS), Woods.
IOOS Model Data Interoperability Design ROMS POM WW3 WRF ECOM NcML Common Data Model OPeNDAP+CF WCS NetCDF Subset THREDDS Data Server Standardized (CF)
1 Web-Based Data Archive, Monitoring, and Mining Tool Jeffrey A. Melby, PhD USACE ERDC Coastal and Hydraulics Lab
Session 3: Using OPeNDAP-enabled Applications to Access Australian Data Services and Repositories eResearch Australasia 2011, ½ Day Morning Workshop, Thursday.
IOOS Modeling Testbed Cyberinfrastructure Rich Signell, USGS, Woods Hole, MA IOOS-RA-Briefing, Feb 14, 2012.
Accessing Remote Datasets using the DAP protocol through the netCDF interface. Dr. Dennis Heimbigner Unidata netCDF Workshop August 3-4, 2009.
Recent developments with the THREDDS Data Server (TDS) and related Tools: covering TDS, NCML, WCS, forecast aggregation and not including stuff covered.
PaPCo, Das2, and Autoplot Jeremy Faden, University of Iowa.
IOOS Data Services with the THREDDS Data Server Rich Signell USGS, Woods Hole IOOS DMAC Workshop Silver Spring Sep 10, 2013 Rich Signell USGS, Woods Hole.
Plot the value of a single variable along an aquifer at different times.
Remote Data Access with OPeNDAP Dr. Dennis Heimbigner Unidata netCDF Workshop October 25, 2012.
An Update on COLA’s Software Development Jennifer M. Adams and Brian Doty.
The HDF Group Introduction to netCDF-4 Elena Pourmal The HDF Group 110/17/2015.
OPeNDAP Hyrax Harnessing the power of the BES OPeNDAP Hyrax Back-End Server Patrick West
Data File Formats: netCDF by Tom Whittaker University of Wisconsin-Madison SSEC/CIMSS 2009 MUG Meeting June, 2009.
Catalog-driven workflows using CSW Rich Signell, USGS, Woods Hole, MA, USA Filipe Fernandes, SECOORA, Brazil Kyle Wilcox, Axiom Data Science, Wickford,
Surface complexation retards Pb ++ transport relative to nonreactive tracer Br −. Use Xtplot to display the concentration of several species along the.
Unidata Technologies Relevant to GO-ESSP: An Update Russ Rew
Pulse of Benzene contaminated water is attenuated by biodegradation. X1t models reactive transport in groundwater flows in one linear, radial, or spherical.
NetCDF: Data Model, Programming Interfaces, Conventions and Format Adapted from Presentations by Russ Rew Unidata Program Center University Corporation.
Update on Unidata Technologies for Data Access Russ Rew
TSDS (HPDE DAP). Objectives (1) develop a standard API for time series-like data, (2) develop a software package, TSDS (Time Series Data Server), that.
Unidata Infrastructure for Data Services Russ Rew GO-ESSP Workshop, LLNL
Posted by Irina Overeem, May 2016
NetCDF-Java version 2.2 Common Data Model John Caron Unidata/UCAR Dec 10, 2004.
DAP+NETCDF Using the netCDF-4 Data Model
Clients.
The Marine System Modelling group (MSM) at the UK's National Oceanography Centre (NOC) maintains and runs various NEMO configurations. Global, ocean-only,
CEE 6440 GIS in Water Resources Fall 2004 Term Paper Presentation
NetCDF and Scientific Data Standard
Remote Data Access Update
MIT MSEAS Software Software reads and displays any model output for MOOS-IVP Provides ocean images on which vehicle simulations are superimposed Snapshots.
ROMS/TOMS Web Sites & ROMS: NetCDF and Matlab
Nathan F. Putman, Katherine L. Mansfield  Current Biology 
HDF-EOS Workshop XXI / The 2018 ESIP Summer Meeting
ExPLORE Complex Oceanographic Data
NCL variable based on a netCDF variable model
Future Development Plans
Adapting an existing web server to S3
Presentation transcript:

Lab Activity 5: Analyze Data from Gulf of Mexico Model Run Data from Xu et al. (2011) model (or a very similar model run) is stored on plumeri: /data/users-tmp/ckharris/MCH2mod/RESULTS/XU_etal_2011_Paper Use the tools that Dave and Julia suggest to do the following: – Plot the model grid and model bathymetry. – Plot a time series of wave heights for a site along the 30-m isobath on the open shelf. – Make an animation for a one-week period that includes the biggest storm of the year. Animation should include: One panel that shows depth-averaged current velocities as arrows, and salinity as color. A second panel that shows near-bed suspended sediment concentration as color, and near-bed current velocity as arrows. Try to make your animation look nice.

Using THREDDS to access the data Aggregation with NCML Interoperability with DODs-enabled ncview, ncdump, nco, Matlab ncread, Matlab nctoolbox Catalog – Ask Dave to configure a public_html/testdata entry for you DODS data URL: XU_etal_2011_Paper.ncml XU_etal_2011_Paper.ncml Remote access to slices of data through DODs/OpenDAP –aware tools

DODs-aware tools (ncdump, ncview, nco, matlab) From Indian: From plain Matlab: 1005 ~]$ /export/ home/drf/bin/ncks -v ocean_time er.ncml |head -30 ocean_time: type NC_DOUBLE, 1 dimension, 4 attributes, chunked? no, compressed? no, packed? no ocean_time size (RAM) = 731*sizeof(NC_DOUBLE) = 731*8 = 5848 bytes ocean_time dimension 0: ocean_time, size = 731 NC_DOUBLE (Coordinate is ocean_time) ocean_time attribute 0: long_name, size = 25 NC_CHAR, value = time since initialization ocean_time attribute 1: units, size = 33 NC_CHAR, value = seconds since :00:00 ocean_time attribute 2: calendar, size = 9 NC_CHAR, value = gregorian ocean_time attribute 3: field, size = 20 NC_CHAR, value = time, scalar, series ocean_time[0]= seconds since :00:00 ocean_time[1]= seconds since :00:00 … 1006 ~]$ /export/home/drf/bin/ncdump -h aper.ncml netcdf XU_etal_2011_Paper { dimensions: Nbed = 4 ; Nuser = 25 ; eta_psi = 63 ; … >>> uri=' cml’; >> tvec = ncread(uri,'ocean_time'); >> length(tvec) ans = ~]$ /export/home/drf/bin/ncview _Paper.ncml Ncview David W. Pierce 24 Oct 2012

THREDDS on Plumeri: /threddshttp://plumeri.vims.edu:8080 /thredds

THREDDS on Plumeri for Julia

Julia’s ncml file

OpenDAP Data URL $ cat /export/home2/moriarty/public_html/testdata/01_aggreg.ncml

Matlab NCToolbox plumeri:/export/home/drf/2015/PROJECTS/MS698/xuModel.m