1 HDF-EOS Status and Development Larry Klein, Abe Taaheri, and Cid Praderas L-3 Communications Government Services, Inc. November 30, 2005.

Slides:



Advertisements
Similar presentations
1 HDF-EOS Status, Related Tools and Issues. 2 TOOLKIT / HDF-EOS Support.
Advertisements

MODIS Data at NSIDC MODIS Collection 5/Long Term Data Record Workshop Molly McAllister & Terry Haran January
1 An Overview of HDF-EOS (Part I) Doug Ilg Raytheon STX (301)
Chap 2 System Structures.
Operating-System Structures
1 Desktop Support for HDF and HDF EOS Ted Meyer President & CEO fortnersoftware LLC (703) ext.119.
1 Generalized Conversion of HDF-EOS Products to GIS Compatible Formats Larry Klein, Ray Milburn, Cid Praderas, and Abe Taaheri Emergent Information Technologies,
Support EOS: Review and Discussions Kent Yang and Joe Lee The HDF Group October 16, 2012 Oct. 16, 2012Annual HDF Briefing to ESDIS1.
The Operating System The operation system (OS) is a set of programs that coordinates: Hardware functions Interaction between application software and computer.
Computer System System Software. Learning Objective Students should understand the different types of systems software and their functions. Students should.
Status of netCDF-3, netCDF-4, and CF Conventions Russ Rew Community Standards for Unstructured Grids Workshop, Boulder
The HDF-EOS5 Tutorial Ray Milburn L3 Communciations, EER Systems Inc McCormick Drive, 170 Largo, MD USA
R A D I A T I O N B U D G E T C L O U D S A E R O S O L S T R O P O S P H E R I C C H E M I S T R Y L a n g l e y A t m o s p h e r i c S c i e n c e s.
September 23-24, 2014Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.
1 HDF-EOS and Related Tools Status Update. 2 Overview.
Introduction to MISR Data Analysis and Tools Linda Hunt Science Systems & Applications Inc., NASA LaRC Brian E. Rheingans Jet Propulsion Laboratory, California.
1 HDF-EOS Status, Related Tools and Issues. 2 Overview.
1 HDF-EOS APIs, tools, etc. Larry Klein, Abe Taaheri, and Cid Praderas L-3 Communications Government Services, Inc. November 30, 2005.
HDF Project Update Mike Folk, Kent Yang, Elena Pourmal The HDF Group April 5, 2010 April 5, 2011Annual HDF Briefing to ESDIS1.
Important ESDIS 2009 tasks review Kent Yang, Mike Folk The HDF Group April 1st, /1/20151Annual briefing to ESDIS.
Page 1 HDF-EOS Tools Abe Taaheri, Raytheon IIS ESIP Meeting Chapel Hill, NC July 9, 2013.
April 6, 2010GMQS Meeting1 Optional Feature Support in HDF5 Tools Albert Cheng The HDF Group.
Chapter 2: Operating-System Structures. 2.2 Silberschatz, Galvin and Gagne ©2005 Operating System Concepts Chapter 2: Operating-System Structures Operating.
1 Status of HDF-EOS, Related Software and Tools. 2 TOOLKIT / HDF-EOS Support.
HDF Update Mike Folk, Kent Yang, Elena Pourmal The HDF Group March 31st, 2009 March 31, 2009Annual HDF Briefing to ESDIS1.
December 1, 2005HDF & HDF-EOS Workshop IX P eter Cao, NCSA December 1, 2005 Sponsored by NLADR, NFS PACI Project in Support of NCSA-SDSC Collaboration.
Why do I want to know about HDF and HDF- EOS? Hierarchical Data Format for the Earth Observing System (HDF-EOS) is NASA's primary format for standard data.
Introduction to MISR Data Analysis and Tools
1 The Roadmap to New Releases Todd Tannenbaum Department of Computer Sciences University of Wisconsin-Madison
Page 1 Status of HDF-EOS, Related Software, and Tools Abe Taaheri, Raytheon IIS HDF & HDF-EOS Workshp XIII Riverdale, MD November 4, 2009.
The HDF Group HDF5 Tools Updates Peter Cao, The HDF Group September 28-30, 20101HDF and HDF-EOS Workshop XIV.
1 HDF-EOS Development Current Status and Schedule Larry Klein, Shen Zhao, Abe Taaheri and Ray Milburn L-3 Communications Government Services, Inc. September.
Page 1 Current Status of HDF-EOS, Maintenance, Developments, and Tools Abe Taaheri, Raytheon IIS HDF & HDF-EOS Workshop XI November 2007.
October 15, 2008HDF and HDF-EOS Workshop XII1 What will be new in HDF5?
HDF & HDF-EOS Workshop VIII 2004 October Aurora, CO Bruce Beaumont, Matt Smith, Helen Conover, Sara Graves Subsetting at UAH.
1 HDF-EOS Status, Related Tools and Issues. 2 Overview.
Operating-System Structures. Operating System Services Operating systems provide an environment for execution of programs and services to programs and.
HDF and HDF-EOS Workshop VIII, October 26-28, /12 Peter Cao, National Center for Supercomputing Applications This work is supported in part by a.
NDE XML Tailoring Service HDF and HDF-EOS Workshop XIII November 4, 2009 Tom Feroli, Peter MacHarrie.
The Roadmap to New Releases Derek Wright Computer Sciences Department University of Wisconsin-Madison
Page 1 TOOLKIT / HDF-EOS Status and Development Abe Taaheri, Raytheon IIS Aura DSWG meeting October 2007.
GES DISC DAAC February 28, 2002HDF-EOS Workshop V1 The Goddard DAAC The Goddard DAAC Presented by:
The HDF Group Support for NPP/NPOESS by The HDF Group Mike Folk, Elena Pourmal, Peter Cao The HDF Group November 5, 2009 November 3-5,
10/8: Software What is software? –Types of software System software: Operating systems Applications Creating software –Evolution of software development.
NetCDF file generated from ASDC CERES SSF Subsetter ATMOSPHERIC SCIENCE DATA CENTER Conversion of Archived HDF Satellite Level 2 Swath Data Products to.
HDF-EOS Workshop IV September 19, 2000 MODIS Reprojection Tool presented by John M. Weiss, Ph.D. Department of Mathematics and Computer Science South Dakota.
12/2/2015Fall 2002 AGU Meeting1 Generalized EOS Data Converter: Making Data Products Accessible to GIS Tools Larry Klein, Ray Milburn, Cid Praderas and.
s Donna J. Scott, Marilyn Kaminski, Jason Wolfe, Terry Haran NSIDC's MODIS Snow and Sea Ice Products NSIDC provides a suite.
Page 1 HDF-EOS Status, Related Tools and Issues Abe Taaheri, Raytheon IIS 2009 THG Briefing to ESDIS.
HDF and HDF-EOS Workshop VIII, October 26-28, /12 Peter Cao, National Center for Supercomputing Applications Ray Milnurn, Dave Buto, L-3 Communications.
Introduction to MISR Data Analysis and Tools Brian E. Rheingans Jet Propulsion Laboratory, California Institute of Technology Exploring and Using MISR.
1 Status of HDF-EOS, Related Software and Tools. 2 TOOLKIT / HDF-EOS Support.
Robert Wolfe NASA Goddard Space Flight Center Code 614.5, Greenbelt, MD Robert Wolfe NASA Goddard Space Flight Center Code 614.5,
Comments from User Services C. Boquist/Code 423 The HDF Group Meeting 1 April 2009.
Silberschatz, Galvin and Gagne ©2009 Operating System Concepts – 8 th Edition, Chapter 2: Operating-System Structures.
September 23-25, 2003HDF-EOS Workshop VII ECS-HSA the HEW Subsetting Appliance HDF-EOS Workshop VII Silver Spring, MD – September 23-25, 2003 Dr. Sara.
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.
Introduction to MISR Data Analysis and Tools Brian E. Rheingans Jet Propulsion Laboratory, California Institute of Technology Exploring and Using MISR.
MODIS Data at NSIDC MODIS Science Team Meeting - Nov. 2, 2006.
MODIS Enhanced-V 1.MODIS IR covering Enhanced-V event 0430z May 25, 2004 Located MODIS L1B Granule at LAADs (MODIS archive and distribution web site) that.
Introduction to MISR Data Analysis and Tools Brian E. Rheingans Jet Propulsion Laboratory, California Institute of Technology Exploring and Using MISR.
Emergent Information Technologies, Inc.
NASA HDF and HDF-EOS Status Use in EOSDIS
Hierarchical Data Formats (HDF) Update
PoDAG XXII: MODIS Status
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
Kent Yang, Mike Folk The HDF Group March 31, 2009
HDF and HDF-EOS Tools George Schwenke Raytheon STX
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
Chapter 2: Operating-System Structures
Presentation transcript:

1 HDF-EOS Status and Development Larry Klein, Abe Taaheri, and Cid Praderas L-3 Communications Government Services, Inc. November 30, 2005

2 HDF-EOS Support Maintenance support is funded on EMD through July 2006 and will be extended until July 2008 Current staff - one full time for TOOLKIT/HDF-EOS, HDF-EOS plug-in for HDFView, and other related software maintenance and development -one full time for HEG development and maintenance

3 ECS Support of HDF-EOS Both HDF4 and HDF5 based flavors of HDF- EOS are part of ECS baseline. OS’s: Solaris (8, 9, 10), Irix6.5, HP 11, AIX, DEC, Windows NT/98/2000/XP, Linux (including 64-bit Opteron and Itanium), Mac OS X, adding Cygwin support Compilers: FORTRAN 77/90 & g77/pgf90, C, C++, gcc, g++ Size limit per granule is 2 GB for HDF-EOS2

4 Software Releases Last release May 05: TOOLKIT , HDF-EOS 2.13, HDF-EOS5.1.9 with HDF , Szip1.2 Oct. 05: HDF-EOS Plug-in for HDFView2.2 Nov. 05: HEG 2.6 with new web site Home (news on new versions, new features, etc.) Image Gallery Download (Linux, Sun, Sgi, Windows, Mac) Supported Product List FAQ Next release – Dec TOOLKIT , HDF-EOS 2.14, HDF-EOS with HDF , Szip2.0, Zlib HDF-EOS Plug-in for HDFView2.3

5 Since October, 2004 Dynamic ( 32KB chuncks ) buffer allocation for Structure Metadata was made backward compatible Numerous bug fixes and improvements such as: - Swath subsetting for single scan line - increased MAXNREGIONS for swath subsetting from 32 to Added routines to inquire alias list for fields in swath, grid, and Zonal Average objects. Performance improvement by holding Structure Metadata in memory, avoiding multiple readings & string manipulations. Major HDF-EOS5 Development

6 Added “ Cylindrical Equal Area ” Projection for EASE Grid Added numerous FORTRAN wrappers & inquiry routines Support for HDF-EOS2/HDF-EOS5 in Windows Support for Linux RedHat Enterprise Round off problem fixes for projection parameters in the structure metadata during writing to an output file, eliminating loss of significant digits after decimal point (important when the parameters are very small, such as the eccentricity squared).

7 SDP Toolkit Last Release: May 05, version Modified several files for proper comparison of float and double variables, instead of using “==”, resolving problems when comparing what is stored in a 64-bit memory with what is stored in 80-bit internal register in an Intel-chip-based machines (Problem was reported by OMI team) Modified PGS_EPH_getAttitRecords.c to detect any erroneous/corrupt attitude and/or ephemeris data files Support for Linux RedHat Enterprise Support for HDF4.2r0 and HDF and SZIP2.0

8 SDP Toolkit ( Cont.) Next Release: Dec. 05, version Support for Solaris 9 & 10 Fixes to chkeph tool to handle both Big-Endian and Little-Endian binary ephemeris files. Support for SGI compiler Support for HDF4.2r1 and HDF Memory leak fixes in DEM testdrivers

9 HDF-EOS/Toolkit/HEG Future Plans : Support for Cygwin Support for HDF4.2r2 and HDF5-1.8 Performance improvement, if possible, for reading HDF format ephemeris/attitude files in Toolkit Performance improvement in HDF-EOS5 by redesigning some functions More functionalities in HDF-EOS Plug-in for HDFView: -Format conversion: HDF-EOS2 -> HDF-EOS5 - Improved Help Window -Ability to modify input HDF-EOS2 granules. - Ability to cut/paste objects, modify/delete attributes. - Ability to create new grids/swaths

10 A utility that converts EOSDIS data from HDF-EOS format to common Geographical Information System (GIS)-compatible formats. Two versions available: –A downloadable desktop version –Access through NASA archive online storage (Data Pools) HDF-EOS to GeoTIFF Converter (HEG)

11 HEG Functionality Subsetting ( spatial, field, band ) Performs conversion to a single-band or multi-band GeoTIFF’s HDF-EOS output with multi-bands in single object HDF-EOS Swath to HDF-EOS Grid or Swath HDF-EOS Swath or Grid to GeoTIFF ( with metadata file ) HDF-EOS Swath or Grid to generic Binary ( with metadata file ) Stitching ( mosaicing ) + subsetting + Reprojecting Running from Command Line (batch jobs) or with Java- based GUI Reprojection ( to UTM, PS, TM, STP, LCC, LAMAZ, GEO, SIN ) Subsampling ( Subsample stacks )

12 HEG Functionality Metadata preservation/creation. Currently supports MODIS, MISR, ASTER, AIRS and AMSR-E products on TERRA and AQUA (>110 products), AURA/HDF-EOS5 support in progress Allows file selection from users local storage Operable on Sun, SGI, Win, Linux (64-bit soon), MAC Integrated into ECS Data Pool –Reduces the transfer time of HDF-EOS data sets (if subset is requested) –Provides the end-user with the exact file required by their application User Interface –Portable, written in Java. –Not dependent on COTS (eg. IDL).

13 Availability Access to libraries and applications: