November 30, 2005HDF & HDF-EOS Workshop IX Peter Cao, NCSA November 30, 2005 HDF5 Tools.

Slides:



Advertisements
Similar presentations
The HDF Group Support for NPP/NPOESS by The HDF Group Mike Folk, Elena Pourmal The HDF Group HDF/HDF-EOS Workshop XIV September 30, 2010.
Advertisements

HDF and HDF-EOS Workshop VII, September 23-25, This work is supported in part by a Cooperative Agreement with the National Aeronautics and Space.
® Page 1 Intel Compiler Lab – Intel Array Visualizer HDF Workshop VI December 5, 2002 John Readey
X-Ways Trace Prepared By: Leen F. Arikat Supervisor: Dr. Lo’ai Tawalbeh.
The HDF Group Introduction to HDF5 Barbara Jones The HDF Group The 13 th HDF & HDF-EOS Workshop November 3-5, HDF/HDF-EOS Workshop.
Tools for Working With HDF Data (Especially MODIS) PoDAG XVIII – April 2001 Terry Haran Siri Jodha Singh Khalsa.
University of Illinois at Urbana-ChampaignHDF Mike Folk HDF-EOS Workshop IV Sept , 2000 HDF Update HDF.
Support EOS: Review and Discussions Kent Yang and Joe Lee The HDF Group October 16, 2012 Oct. 16, 2012Annual HDF Briefing to ESDIS1.
HDF 1 NCSA HDF XML Activities Robert E. McGrath Mike Folk National Center for Supercomputing Applications.
Parts of a Computer Why Use Binary Numbers? Source Code - Assembly - Machine Code.
Linux Operations and Administration
® Page 1 Intel Compiler Lab – Intel Array Visualizer HDF Workshop VIII October 27, 2004 John Readey
OCLC Online Computer Library Center CONTENTdm Migration Training Craig Yamashita Vice President, Technology and Product Development DiMeMa, Inc. July 2005.
Support for NPP/NPOESS by The HDF Group Mike Folk, Elena Pourmal, Peter Cao The HDF Group June 30, NPOESS Data Formats Working Group.
1 of 14 Substituting HDF5 tools with Python/H5py scripts Daniel Kahn Science Systems and Applications Inc. HDF HDF-EOS Workshop XIV, 28 Sep
Chapter 33 CGI Technology for Dynamic Web Documents There are two alternative forms of retrieving web documents. Instead of retrieving static HTML documents,
HDF5 Tools Update Peter Cao - The HDF Group November 6, 2007 This report is based upon work supported in part by a Cooperative Agreement.
Experiments with Remote Access to Scientific Data using HDF5 Kun Yan Robert E. McGrath NCSA May 15, 2002.
The HDF Group April 17-19, 2012HDF/HDF-EOS Workshop XV1 Introduction to HDF5 Barbara Jones The HDF Group The 15 th HDF and HDF-EOS Workshop.
1 High level view of HDF5 Data structures and library HDF Summit Boeing Seattle September 19, 2006.
HDF Project Update Mike Folk, Kent Yang, Elena Pourmal The HDF Group April 5, 2010 April 5, 2011Annual HDF Briefing to ESDIS1.
Software Engineering in Robotics Packaging and Deployment of Systems Henrik I. Christensen –
HTML presentation Embedding Graphics in Web Pages n HTML uses an empty tag called the (image tag) n n n or n n n Note: all web production tools do insert.
February 2-3, 2006SRB Workshop, San Diego P eter Cao, NCSA Mike Wan, SDSC Sponsored by NLADR, NFS PACI Project in Support of NCSA-SDSC Collaboration Object-level.
HDF Update Mike Folk, Kent Yang, Elena Pourmal The HDF Group March 31st, 2009 March 31, 2009Annual HDF Briefing to ESDIS1.
HDF Mike Folk National Center for Supercomputing Applications Science Data Processing Workshop February 26-28, 2002 HDF Update HDF.
December 1, 2005HDF & HDF-EOS Workshop IX P eter Cao, NCSA December 1, 2005 Sponsored by NLADR, NFS PACI Project in Support of NCSA-SDSC Collaboration.
1 HDF-EOS Status and Development Larry Klein, Abe Taaheri, and Cid Praderas L-3 Communications Government Services, Inc. November 30, 2005.
Why do I want to know about HDF and HDF- EOS? Hierarchical Data Format for the Earth Observing System (HDF-EOS) is NASA's primary format for standard data.
Introduction to Java Programming with Forte Y. Daniel Liang.
Introduction to MISR Data Analysis and Tools
Page 1 Status of HDF-EOS, Related Software, and Tools Abe Taaheri, Raytheon IIS HDF & HDF-EOS Workshp XIII Riverdale, MD November 4, 2009.
April 28, 2008LCI Tutorial1 Introduction to HDF5 Tools Tutorial Part II.
GrADS (Gridded Analysis Display Software) By Scott Halvorson DPG/WDTC 4DWX Forecasters Conference July 25.
The HDF Group HDF5 Tools Updates Peter Cao, The HDF Group September 28-30, 20101HDF and HDF-EOS Workshop XIV.
Support for NPP/NPOESS by The HDF Group Mike Folk The HDF Group HDF and HDF-EOS Workshop XII October 17, 2008 Oct HDF and HDF-EOS Workshop XII1.
1 HDF-EOS Development Current Status and Schedule Larry Klein, Shen Zhao, Abe Taaheri and Ray Milburn L-3 Communications Government Services, Inc. September.
Deutscher Wetterdienst
HDF and HDF-EOS Workshop VIII, October 26-28, /12 Peter Cao, National Center for Supercomputing Applications This work is supported in part by a.
Easily Serving and Accessing HDF-EOS2 Datasets Using DODS Technologies Richard Chinman, UCAR-IITA, DODS Project Manager
_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.
Page 1 TOOLKIT / HDF-EOS Status and Development Abe Taaheri, Raytheon IIS Aura DSWG meeting October 2007.
The HDF Group Support for NPP/NPOESS by The HDF Group Mike Folk, Elena Pourmal, Peter Cao The HDF Group November 5, 2009 November 3-5,
Space Research Software Pedro Vicente Space Research Software, Inc. HDF-EOS Workshop VI Dec. 4-5, 2002 San Francisco, CA HDF.
1 HDF Vendors/Software Developers Workshop HDF And HDF-EOS Tools R.Suresh NASA/GSFC/HSTX Ph: FAX:
September 9, 2008SPEEDUP Workshop - HDF5 Tutorial1 Introduction to HDF5 Command-line Tools.
HDF and HDF-EOS Workshop VIII, October 26-28, /12 Peter Cao, National Center for Supercomputing Applications Ray Milnurn, Dave Buto, L-3 Communications.
The HDF Group Introduction to netCDF-4 Elena Pourmal The HDF Group 110/17/2015.
The HDF Group HDF Group Support for NPP/JPSS Mike Folk, Elena Pourmal, Larry Knox, Albert Cheng The HDF Group DEWG Meeting June 19, 2012.
The HDF Group 10/17/151 HDF5 Tools Tutorial ICALEPCS 2015.
Introduction to MISR Data Analysis and Tools Brian E. Rheingans Jet Propulsion Laboratory, California Institute of Technology Exploring and Using MISR.
9/21/04 James Gallagher Server-Side: The Basics This part of the workshop contains an overview of the two servers which OPeNDAP has developed. One uses.
Other Projects Relevant (and Not So Relevant) to the SODA Ideal: NetCDF, HDF, OLE/COM/DCOM, OpenDoc, Zope Sheila Denn INLS April 16, 2001.
The HDF Group Introduction to HDF5 Session Three HDF5 Software Overview 1 Copyright © 2010 The HDF Group. All Rights Reserved.
9/21/04 James Gallagher Server Installation and Testing: Hands-on ● Install the CGI server with the HDF and FreeForm handlers ● Link data so the server.
HDF and HDF-EOS Workshop XII
CST 1101 Problem Solving Using Computers
Web Interface for Formatter
Kent Yang, Mike Folk The HDF Group March 31, 2009
Introduction to Programming the WWW I
FileSpot Collaborative File Manager
What NetCDF users should know about HDF5?
HDF and HDF-EOS Tools George Schwenke Raytheon STX
Access HDF5 Datasets via OPeNDAP’s Data Access Protocol (DAP)
NetCDF and Scientific Data Standard
Peter Cao The HDF Group November 28, 2006
Introduction to HDF5 Mike McGreevy The HDF Group
Hierarchical Data Format (HDF) Status Update
HDF5 Tools Updates and Discussions
Review of Previous Lesson
Presentation transcript:

November 30, 2005HDF & HDF-EOS Workshop IX Peter Cao, NCSA November 30, 2005 HDF5 Tools

November 30, 2005HDF & HDF-EOS Workshop IX2/19 Purpose Introduce HDF5 tools Help you to practice

November 30, 2005HDF & HDF-EOS Workshop IX3/19 Types of HDF5 Tools NCSA command line tools  General tools: gif2h5, h52gif, h5diff, h5dump, h5import, h5jam/ h5unjam, h5repack, h5repart, h5perf, h5ls, h4toh5, h5toh4, h5debug  Compiler tools: h5cc, h5fc, h5c++, h5pcc, h5pfc, h5redeploy NCSA visualization tools  Java: HDFView  MFC: HDF Web-browser plugin (windows only) Other HDF Tools  Freely Available Software: ChomboVis, PyTables, HDF-EOS Tools, HDF Explorer, VisAD, and more  Commercial Software: Array Visualizer, IDL-HDF5 Interface, Matlab, Mathematica, ant more

November 30, 2005HDF & HDF-EOS Workshop IX4/19 Types of Command Line Tools Viewer  h5dump, h5diff, h5ls, h5debug Editor  h5repack, h5repart, h5import, h5jam/h5unjam Converter  h4toh5, h5toh4, gif2h5, h52gif Compiler  h5cc, h5fc, h5c++, h5pcc, h5pfc, h5redeploy

November 30, 2005HDF & HDF-EOS Workshop IX5/19 Command Line Tools General tools Located at bin/ with binary release Use “-h” option for help usage: h5ls [OPTIONS] [OBJECTS...] OPTIONS -h, -?, --help Print a usage message and exit -a, --address Print addresses for raw data -d, --data Print the values of datasets -e, --errors Show all HDF5 error reporting -f, --full Print full path names instead of base names -g, --group Show information about a group, not its contents -l, --label Label members of compound datasets ….

November 30, 2005HDF & HDF-EOS Workshop IX6/19 Command Line Tools General tools h5dumph5dump - Examines the contents of an HDF5 file h5diffh5diff - Compares two HDF5 files h5repackh5repack - Copies an HDF5 file to a new file with and without chunking/compression h5lsh5ls - Lists information of file objects in specified format h5reparth5repart - Repartitions a file or family of files h5importh5import - Imports ASCII or binary data into HDF5 gif2h5gif2h5 - Converts a GIF file into HDF5 h52gifh52gif - Converts an HDF5 file into GIF h5jam/h5unjamh5jam/h5unjam - Add/Remove text to/from User Block at the beginning of an HDF5 file

November 30, 2005HDF & HDF-EOS Workshop IX7/19 Example: h5dump h5dump --header SDS.h5 HDF5 "SDS.h5" { GROUP "/" { GROUP "Floats" { DATASET "FloatArray" { DATATYPE H5T_IEEE_F32LE DATASPACE SIMPLE { ( 4, 3 ) / ( 4, 3 ) } } DATASET "IntArray" { DATATYPE H5T_STD_I32LE DATASPACE SIMPLE { ( 5, 6 ) / ( 5, 6 ) } }

November 30, 2005HDF & HDF-EOS Workshop IX8/19 Example: h5dump h5dump -d /Floats/FloatArray SDS.h5 HDF5 "SDS.h5" { DATASET "/Floats/FloatArray" { DATATYPE H5T_IEEE_F32LE DATASPACE SIMPLE { ( 4, 3 ) / ( 4, 3 ) } DATA { (0,0): 0.01, 0.02, 0.03, (1,0): 0.1, 0.2, 0.3, (2,0): 1, 2, 3, (3,0): 10, 20, 30 }

November 30, 2005HDF & HDF-EOS Workshop IX9/19 Example: h5diff h5diff SDS.h5 SDS2.h5 Dataset: and 5 differences found

November 30, 2005HDF & HDF-EOS Workshop IX10/19 Example: h5diff h5diff SDS.h5 SDS2.h5 -v /IntArray Dataset: and positionIntArrayIntArraydifference [ 0 0 ]01010 [ 1 0 ] [ 2 0 ] [ 3 0 ] [ 4 0 ] differences found

November 30, 2005HDF & HDF-EOS Workshop IX11/19 Command Line Tools Compiler tools unix shell script file h5redeployh5redeploy - Updates HDF5 compiler tools' paths after the HDF5 software has been installed in a new location. Run bin/h5deploy before using h5cc h5cc, h5fc, h5c++, h5pcc, h5pfch5cc, h5fc, h5c++, h5pcc, h5pfc - Simplifies compiling an HDF5 application

November 30, 2005HDF & HDF-EOS Workshop IX12/19 Visualization Tools HDFView HDFViewHDFView - a visual tool for browsing and editing NCSA HDF4 and HDF5 files  Built in Java (JDK 1.4 or JDK 1.5)  Runs on Windows, Solaris, Linux, AIX, Irix 6.5, MacOSX, OSF1  Supports user moddules  Access remote URL and SRB storage

November 30, 2005HDF & HDF-EOS Workshop IX13/19 Visualization Tools HDFView

November 30, 2005HDF & HDF-EOS Workshop IX14/19 Visualization Tools HDF Web-browser plugin HDF Web-browser pluginHDF Web-browser plugin - application that is launched from a web browser to display HDF4 and HDF5 files  Built on MFC (C++)  Windows only  Read only  Beta release (not fully tested)

November 30, 2005HDF & HDF-EOS Workshop IX15/19 Visualization Tools HDF Web-browser plugin

November 30, 2005HDF & HDF-EOS Workshop IX16/19 Cube Visualization (cv) Tool DIAL DDI DODS Fink FreeForm GDAL GrADS h5utils (h5fromh4) HDF-EOS Tools HDF Explorer hdfgen.pl HDFLook - MODIS hdfv HIPHOP LCAVision LinkWinds Image Tools library IRI/LDEO Climate Data Library Marine Data Handbook Freely Available Software

November 30, 2005HDF & HDF-EOS Workshop IX17/19 MERLIN MICRODEM MultiSpec NAP NCL NCO (netCDF Operators) NetCDF OpenDX OSSIM Overture pyhdf REINAS Rocketeer ScanMagic SHARP Tela tnimage VCS VISTAS WebWinds zeGraph (Standard Version) Freely Available Software

November 30, 2005HDF & HDF-EOS Workshop IX18/19 Array Visualizer EASI/PACE ENVI ER Mapper ERDAS IMAGINE GDB IDL IGOR Pro Mathematica MATLAB Noesys Plot PV-Wave ResMod and related tools Slicer Dicer T3D Tecplot Transform WIM zeGraph Commercial Tools

November 30, 2005HDF & HDF-EOS Workshop IX19/19 Question / Comments?