September 23-25, 2003HDF-EOS Workshop VII ECS-HSA the HEW Subsetting Appliance HDF-EOS Workshop VII Silver Spring, MD – September 23-25, 2003 Dr. Sara Graves, Bruce Beaumont, Matt Smith Presented by Matt Smith University of Alabama in Huntsville Information Technology and Systems Center

September 23-25, 2003HDF-EOS Workshop VII Outline  HEW’s History  HSA: Integration with ECS  HSE: A new Subsetting Engine  Configuration options

September 23-25, 2003HDF-EOS Workshop VII HEW’s history  HDF-EOS Web-based Subsetter  Prototype software designed to be dataset- independent (HDF-EOS)  Optional Front-end/GUI Uses HTML forms and JavaScript  Back-end Needs subset criteria and HDF-EOS data Performs subsetting as a “batch” job

September 23-25, 2003HDF-EOS Workshop VII HEW Back-end  Uses HDF-EOS (and HDF) library  Instructed via a subset criteria file (ODL)  Handles multiple similar files  Handles Swath and/or Grid objects  Unix (SGI & Sun) executables available  Subsetted output files contain: StructMetadata (HDF-EOS) ArchiveMetadata* ProductMetadata (added by HEW  ODL file) CoreMetadata* (w/ modified bounding box & time info) optionally placed in.met file * if present in parent file

September 23-25, 2003HDF-EOS Workshop VII GROUP = SUBSET PARENT_FILE =(“/AQUA/AMSR/AE_L2A.hdfeos”) LATITUDE_RANGE = ( , ) LONGITUDE_RANGE = ( , ) = MET_FILE = YES GROUP = SPOG NAME = “swath_1” TYPE = “SWATH” PARAMETERS = (“89.0V_Res.1_TB”, “89.0V_Res.2_TB”) SUBSAMPLING = (“GeoTrack”, 1, “GeoXtrack”, 1) END_GROUP = SPOG END_GROUP = SUBSET END Example Subset Criteria File

September 23-25, 2003HDF-EOS Workshop VII EOS DATASETS  Terra  MODIS  MOPITT  ASTER  Aqua  AMSR-E  AIRS  Aura  HIRDLS HEW Subsettable datasets OTHERS  TRMM  TMI  NOAA-15, 16, 17  AMSU-A  Any other HDF-EOS datasets written with HDF-EOS calls in mind

September 23-25, 2003HDF-EOS Workshop VII HSA: HEW Subsetting Appliance UAH/ITSC, working with ESDIS, ECS (EOS-DIS Core System), and DAACs, have incorporated the HSA into the ECS, via the EOS-DIS Data Gateway (EDG). Infrastructure written by ITSC/UAH to allow other appliances (subsetting, reprojecting, reformatting, etc.) to be added by other data centers.

September 23-25, 2003HDF-EOS Workshop VII HEW integration with ECS

September 23-25, 2003HDF-EOS Workshop VII ECS integration status  EDG v3.5.1 has basic subsetting options  Operational at NSIDC  Testing at LPDAAC (EDC)  Testing to begin at GDAAC soon  Further enhancements for DAACs

September 23-25, 2003HDF-EOS Workshop VII HSE: HEW Subsetting Engine A new packaging option for the HDF-EOS Subsetter designed for sites that want subsetting, but do not want to host the full HEW installation or even the standalone HEW back-end.

September 23-25, 2003HDF-EOS Workshop VII Existing HEW Back-End Architecture  Front end supplies subsetting criteria file  Subsetter writes messages to status file  Subsetter writes messages to log file  Subsetter sends to end-user Many sites do not want to create ODL files or the hassle of dealing with message or log files or .

September 23-25, 2003HDF-EOS Workshop VII New HSE Architecture  User application code builds subsetting criteria structure  Subsetting engine function calls user’s functions for status and log messages  No is sent All subsetting functionality is contained within a callable function

September 23-25, 2003HDF-EOS Workshop VII HSE Availability  Version 1.0 available mid October 2003  SOM grids cannot be subsetted yet  Binary object module supplied  Subsetting engine  Utilities to create and manage structures  “Discovery” routines

September 23-25, 2003HDF-EOS Workshop VII Software packaging available Binary distributions available for SGI & Sun  HSE  Object modules (HSE and add’l functions)  HEW  Full front-and back-end  Back-end only

September 23-25, 2003HDF-EOS Workshop VII