1 HDF-EOS Status, Related Tools and Issues. 2 Overview.

Slides:



Advertisements
Similar presentations
1 HDF-EOS Status, Related Tools and Issues. 2 TOOLKIT / HDF-EOS Support.
Advertisements

MODIS Data at NSIDC MODIS Collection 5/Long Term Data Record Workshop Molly McAllister & Terry Haran January
LP DAAC User Services Provide support to users on ASTER data related problems; Resources on ASTER: EROS Data Center Land Processes DAAC URL:
Abstract Terry HaranNational Snow and Ice Data Center, 449 UCB, University of Colorado, Boulder, CO 80309, USA Contact: A spheroid is.
1 Desktop Support for HDF and HDF EOS Ted Meyer President & CEO fortnersoftware LLC (703) ext.119.
1 Generalized Conversion of HDF-EOS Products to GIS Compatible Formats Larry Klein, Ray Milburn, Cid Praderas, and Abe Taaheri Emergent Information Technologies,
University of Illinois at Urbana-ChampaignHDF Mike Folk HDF-EOS Workshop IV Sept , 2000 HDF Update HDF.
University of Illinois at Urbana-ChampaignHDF 1McGrath/Yang 2/27/02 Transitioning from HDF4 to HDF5 Robert E. McGrath Kent Yang.
Support EOS: Review and Discussions Kent Yang and Joe Lee The HDF Group October 16, 2012 Oct. 16, 2012Annual HDF Briefing to ESDIS1.
Obtaining MISR Data and Information Jeff Walter Atmospheric Science Data Center April 17, 2009.
The HDF-EOS5 Tutorial Ray Milburn L3 Communciations, EER Systems Inc McCormick Drive, 170 Largo, MD USA
Reprojecting MODIS Images. Reasons why reprojection is desirable: 1.Removes Bowtie Artifacts 2.Allows geographic overlays (e.g. coastline, city locations)
September 23-24, 2014Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.
EARTH SCIENCE MARKUP LANGUAGE “Define Once Use Anywhere” INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.
1 HDF-EOS and Related Tools Status Update. 2 Overview.
Introduction to MISR Data Analysis and Tools Linda Hunt Science Systems & Applications Inc., NASA LaRC Brian E. Rheingans Jet Propulsion Laboratory, California.
1 HDF-EOS APIs, tools, etc. Larry Klein, Abe Taaheri, and Cid Praderas L-3 Communications Government Services, Inc. November 30, 2005.
Important ESDIS 2009 tasks review Kent Yang, Mike Folk The HDF Group April 1st, /1/20151Annual briefing to ESDIS.
Page 1 HDF-EOS Tools Abe Taaheri, Raytheon IIS ESIP Meeting Chapel Hill, NC July 9, 2013.
MODIS Land and HDF-EOS HDF-EOS Workshop Presentation September 20, 2000 Robert Wolfe NASA GSFC Code 922, Raytheon ITSS MODIS Land Science Team Support.
1 Status of HDF-EOS, Related Software and Tools. 2 TOOLKIT / HDF-EOS Support.
HDF Update Mike Folk, Kent Yang, Elena Pourmal The HDF Group March 31st, 2009 March 31, 2009Annual HDF Briefing to ESDIS1.
HDF Mike Folk National Center for Supercomputing Applications Science Data Processing Workshop February 26-28, 2002 HDF Update HDF.
1 HDF-EOS Status and Development Larry Klein, Abe Taaheri, and Cid Praderas L-3 Communications Government Services, Inc. November 30, 2005.
Why do I want to know about HDF and HDF- EOS? Hierarchical Data Format for the Earth Observing System (HDF-EOS) is NASA's primary format for standard data.
Introduction to MISR Data Analysis and Tools
Page 1 Status of HDF-EOS, Related Software, and Tools Abe Taaheri, Raytheon IIS HDF & HDF-EOS Workshp XIII Riverdale, MD November 4, 2009.
The HDF Group HDF5 Tools Updates Peter Cao, The HDF Group September 28-30, 20101HDF and HDF-EOS Workshop XIV.
U.S. Department of the Interior U.S. Geological Survey Access to MODIS Land Data Products Through the Land Processes DAAC John Dwyer and Carolyn Gacke,
1 HDF-EOS Development Current Status and Schedule Larry Klein, Shen Zhao, Abe Taaheri and Ray Milburn L-3 Communications Government Services, Inc. September.
Page 1 Current Status of HDF-EOS, Maintenance, Developments, and Tools Abe Taaheri, Raytheon IIS HDF & HDF-EOS Workshop XI November 2007.
25 June 2009 Dawn Conway, AMSR-E TLSCF Lead Software Engineer AMSR-E Team Leader Science Computing Facility.
HDF & HDF-EOS Workshop VIII 2004 October Aurora, CO Bruce Beaumont, Matt Smith, Helen Conover, Sara Graves Subsetting at UAH.
1 HDF-EOS Status, Related Tools and Issues. 2 Overview.
HDF and HDF-EOS Workshop VIII, October 26-28, /12 Peter Cao, National Center for Supercomputing Applications This work is supported in part by a.
The HDF Group HDF/HDF-EOS Workshop XV1 Tools to Improve the Usability of NASA HDF Data Kent Yang and Joe Lee The HDF Group April 17, 2012.
Page 1 TOOLKIT / HDF-EOS Status and Development Abe Taaheri, Raytheon IIS Aura DSWG meeting October 2007.
NetCDF file generated from ASDC CERES SSF Subsetter ATMOSPHERIC SCIENCE DATA CENTER Conversion of Archived HDF Satellite Level 2 Swath Data Products to.
HDF4 OPeNDAP Project Progress Report MuQun Yang and Hyo-Kyung Lee 1 HDF Developers' Meeting11/24/2015.
HDF-EOS Workshop IV September 19, 2000 MODIS Reprojection Tool presented by John M. Weiss, Ph.D. Department of Mathematics and Computer Science South Dakota.
LDOPE QA Tools Sadashiva Devadiga (SSAI) MODIS LDOPE January 18, 2007.
12/2/2015Fall 2002 AGU Meeting1 Generalized EOS Data Converter: Making Data Products Accessible to GIS Tools Larry Klein, Ray Milburn, Cid Praderas and.
Facilitating Access to EOS Data at the NSIDC DAAC Siri Jodha Singh Khalsa ECS Science Coordinator for the National Snow and Ice Data Center, Distributed.
MODIS Snow and Sea Ice Data Products George Riggs SSAI Cryospheric Sciences Branch, NASA/GSFC Greenbelt, Md. Dorothy K.
1 HDF Vendors/Software Developers Workshop HDF And HDF-EOS Tools R.Suresh NASA/GSFC/HSTX Ph: FAX:
s Donna J. Scott, Marilyn Kaminski, Jason Wolfe, Terry Haran NSIDC's MODIS Snow and Sea Ice Products NSIDC provides a suite.
Page 1 HDF-EOS Status, Related Tools and Issues Abe Taaheri, Raytheon IIS 2009 THG Briefing to ESDIS.
Introduction to MISR Data Analysis and Tools Brian E. Rheingans Jet Propulsion Laboratory, California Institute of Technology Exploring and Using MISR.
1 Status of HDF-EOS, Related Software and Tools. 2 TOOLKIT / HDF-EOS Support.
Comments from User Services C. Boquist/Code 423 The HDF Group Meeting 1 April 2009.
1 The Polar HDF-EOS Data Imaging and Subsetting (PHDIS) Tool Siri Jodha Singh Khalsa Emergent Information Technologies, Inc. National Snow and Ice Data.
HDF-EOS Workshop IV September 19-21, 2000 Richard E. Ullman ESDIS Information Architect NASA/ GSFC, Code 423.
U.S. Department of the Interior U.S. Geological Survey Discover MODIS Land at your Desk January 17, 2007 Calli B. Jenkerson* MODIS Science Data Specialist.
September 23-25, 2003HDF-EOS Workshop VII ECS-HSA the HEW Subsetting Appliance HDF-EOS Workshop VII Silver Spring, MD – September 23-25, 2003 Dr. Sara.
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.
MODIS Cryosphere Science Data Product Metrics Prepared by the ESDIS SOO Metrics Team for the Cryosphere Science Data Review January 11-12, 2006.
Introduction to MISR Data Analysis and Tools Brian E. Rheingans Jet Propulsion Laboratory, California Institute of Technology Exploring and Using MISR.
MODIS Data at NSIDC MODIS Science Team Meeting - Nov. 2, 2006.
NASA HDF-EOS File Format Overview Joseph M Glassy, Director, MODIS Software Development at NTSG School of Forestry, Numerical Terradynamics Simulation.
Introduction to MISR Data Analysis and Tools Brian E. Rheingans Jet Propulsion Laboratory, California Institute of Technology Exploring and Using MISR.
GeoServer Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
HDF and HDF-EOS Workshop XII
Emergent Information Technologies, Inc.
bitcurator-access-webtools Quick Start Guide
Hierarchical Data Formats (HDF) Update
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
Kent Yang, Mike Folk The HDF Group March 31, 2009
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
Hierarchical Data Format (HDF) Status Update
bitcurator-access-webtools Quick Start Guide
Presentation transcript:

1 HDF-EOS Status, Related Tools and Issues

2 Overview

3 TOOLKIT / HDF-EOS Support

4 ECS Support of HDF-EOS

5 Downloadable Software SDP Toolkit ( Science Data Processing Tools ) MTD Toolkit (Metadata, Time/ Date Tools ) HDF-EOS2 (HDF4 based) HDF-EOS5 (HDF5 based) heconvert – Converts hybrid HDF4/HDF-EOS2 files to HDF-EOS 5 DumpMetadata (Dump HDF-EOS metadata)

6 Downloadable Applications HEG - GeoTIFF conversion - Spatial subsetting, Field Subsetting - reprojection - stitching, sub-sampling and more …. HDFView Plug-in, Java-based browser (HDF4, HDF5, HDF-EOS 2 and 5 access) HE5View* (HDF5 - based browser) EOSView* (HDF4 - based browser) * Dropped support for OS updates on July 2006

7

8 Software Releases SDP Toolkit/HDF-EOS : Last release – January 2012 – TOOLKIT – HDF-EOS 2.18, HDF- EOS with HDF4.2.6, HDF , Szip2.1, zlib1.2.5 Next release – (January 2013) – TOOLKIT – HDF-EOS 2.19, HDF-EOS with new releases of HDF4 (2.8), 5 (1.8.9 or later)

9 Software Releases MTD Toolkit: Last release – Dec 2006 – Version in-sync with SDP TOOLKIT with HDF4.2r0, HDF , Szip1.2 Next release – Dec 2012 – Version in-sync with SDP TOOLKIT with HDF releases of HDF4 (2.6), 5 (1.8.8)

10 Software Releases HDF-EOS Plug-in for HDFView: Last release – August 2011 – For HDFView Version 2.7 Next release – Dec 2012 – For HDFView Version 2.9

11 Software Releases HECONVERT ( HECONVERT (HDF-EOS2 to HDF-EOS5 Converter): Last releases – Aug Version 3.0 Next release – Dec Version 4.0  Fix for some missing global attributes in the converted file  Fix for missing some swath attributes in hybrid files DumpMetadata DumpMetadata (ASCII Dump of HDF-EOS metadata) Last release – Dec Version 1.0

12 HEG (HDF-EOS2 to GeoTIFF Converter): Last Stand-alone release – Mar – Version 2.11 Last DAAC release – April 2012 – Release 8.1 Next release – Stand-alone Version 2.12 (Nov. 2012) – DAAC release 8.2 (Aug. 2013) Software Releases

13 Major Development & Fixes Since Last HDF Group Visit Meeting

14 TOOLKIT (5.2.18): – 15-arc second (500 m) DEM elevation and Standard deviation of Elevation data support in Toolkit – 15-arc second (500 m) land/water mask data support in Toolkit – 15-arc second DEM elevation and Land/water data (from USGS/UMD) conversion from GeoTIFF to hdfeos format for use with DEM tools in TOOLKIT Major Development, Bug Fixes

15 – Support for 32 & 64-bit Mac OSX Intel with X86_64 and i386 structures – Added capability to install Toolkit/HDF-EOS5 in threadsafe mode for Linux and MacIntel (32 and 64-bit) – Capability for adding non-standard C and FORTRAN flags to TOOLKIT on installation command line – Use of gfortran (instead of PGF90) for f90 DAAC TOOLKIT compilation Major Developments, Bug Fixes

16 HDF-EOS2 (2.18): HDF-EOS5 (1.14): – Support for HDF4 version and HDF5 version – A few fixes for correct handling of unlimited dimensions in hdfeos5 – New Toolkit style INSTALL scripts for HDF-EOS2 and HDF-EOS5 – support of GDij2ll for State Plane Projection – Support for new AMSE-E Browse file by adding general raster image conversion in hdf2jpeg Major Developments, Bug Fixes

17 HDF-EOS Plug-in for HDFView2.7: Support of Linux and MAC OSX Intel 64-bit Platforms. Support for Zonal Average (ZA) objects of HDF-EOS5. Draw Map of Coastlines, international borders, and US state lines onto GRID images for all HDF-EOS supported projections. heconvert 3.0 usage. Major Developments, Bug Fixes

18 heconvert (3.0, 4.0): Handle hybrid hdf files. Write HDF objects (created by HDF4 calls) in addition to the HDF-EOS objects (created by HDF-EOS2 calls) to the output. Convert Dimension Scales when present. Copy ECS's Inventory and Archive metadata into the output Write HDF written field/group attributes to the output fields/groups. Major Developments, Bug Fixes

19 Add global attributes to the converted file Add swath attributes in hybrid input files Major Developments, Bug Fixes

20 HEG: Enhancement : – Performance improvement for conversion to Conical or Azimuthal projection – Performance improvement for all supported products (EED On-Demand-Data-Access Web Services) – Preserving input datum for output projection – Better default values when user fails to enter some key projection parameters specifically when input grid is global and output projection LCC or LA – Chunking/Compressing data fields for HDF-EOS outputs Major Development, Bug Fixes

21 – Better handling of UTM outputs when user fails to enter appropriate UTM zone and/or subset area for Global input grids – Windows VISTA and 7 testing/support – Resolving problem with some output State Plane projection conversions when user fails to enter appropriate SP zone (leading 0 in some 3-digit SP zone codes in statezones.h) – Modifying input default lat of +/- 90 for AE Ocean products when output projection is Mercator Major Development, Bug Fixes

22 – Support for fields with dimensions 5 or larger (MISR) – Allowing HEG to open Parameter file with Stand- alone GUI – Support HEG in MAC Intel – Added field image for subsetting ( conversion GUI/Grid only ) – Allowing to stitch all 180 MISR blocks when memory is available – Better conversion and interpolation schemes for swath conversion and stitching Major Development, Bug Fixes

23 Major Development, Bug Fixes

24 Major Development, Bug Fixes

25 – Bug Fixes Same input/output pixel numbers for EASE grid when No-Reprojection is used ( AMSR_E Daily Snow) MOD11_L2 version 5 support Opening of MODIS grid files containing edge tiles (Sinusoidal projected grids) Add ellipsoid code SP projected output Stand-alone HEG GUI fixes for subset area selection for some products such as AMSR_E Sea-Ice products Correcting a problem offending input negative Earth Flattening value in AMSR_E SeaIce products Major Development, Bug Fixes

26 Future Plans

27 Future Plans TOOLKIT/HDF-EOS: Support for new versions of HDF4 - HDF5 XML Metadata reading in TOOLKIT Add APIs for local and group attributes in HDF-EOS2 Fix for getting correct compression info for a field in HDF-EOS5, when Gdcompinfo / SWcompinfo fails to get the info from Structure metadata New 500-M DEM Data for areas with fillvalue (Antarctica & Greenland) using 1-KM data

28 Future Plans Store info in structural metadata somewhere else Auto Configuration for TOOLKIT RPMs for HDF-EOS and Toolkit Validation tool for HDF-EOS5 files Fix for user/DAAC reported bugs Break SDP TOOLKIT into small pieces separating general tools from PGE used tools New dimension scale routines for ease in setting dimscale for multi-field objects

29 Future Plans HDF-EOS Plug-in for HDFView: More functionalities : – Cut/paste objects, modify/delete attributes. – Create new grid/swath – Adding some HEG capabilities (such as Geotif output, swath to grid conversion, projection conversion, subsetting, resampling, etc) – Default data directory selection – Draw Map of Coastlines, international borders, and US state lines onto swath images

30 Future Plans HEG: – Selected Field spatial subseting box (lat/lon) calculation using swath fielde image – Processing of many similar files (for the same product) in a given directory using HEG stand- alone GUI (instead of batch scripts) – Support of STP projection for swath conversion – Better handling of MISR grids for online orders and with stand-alone HEG Resolve problems associated with too many fields in some MISR products (such as AEROSOL products)

31 User Support

32 Availability Access to libraries, applications, Documentation :TOOLKIT: HDFView: – –

33