AMSR-E and AMSR-E Validation Status at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Portland, OR September 2012
Outline Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June Accomplishments Data Support Activities at NSIDC Metrics AMSR-E AMSR-E Validation Product Review Sea ice derived from the AMSR-E 89 GHz Tbs. Image courtesy of NASA/GSFC Visualization Studio
Accomplishments Reprocessed L1A V003 ingest from JAXA and made available on 20 Aug 2012 Developed new Antarctic sea ice landmask Walt Meier and Terry Haran at NSIDC created new 6, 12, & 25 km Antarctic sea ice landmasks from a National Ice Center landmask shapefile The NIC shapefile is the newest ice shelf definition, completed by NIC Science Dept in June The shoreline was developed from ENVISAT and RADARSAT imagery from OCT 2009 until APR Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June AMSR-E Data Versions:
Accomplishments Worked with TLSCF/SIPS on the development and implementation of: Their new browse processing and images Their SIPS ISO lineage metadata; including ISO standards consultation by Siri Jodha Singh Khalsa Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June AMSR-E Data Versions:
Data Support: Data Access Data Pool On-line access to entire archivensidc.org/data/data_pool/nsidc.org/data/data_pool/ Subsetting, reformatting, reprojection Interface being retired. Replaced with subsetting services through Reverb REVERB WIST retiredreverb.echo.nasa.gov/reverb/reverb.echo.nasa.gov/reverb/ Improved user interface and search/order workflow Subscriptions Automatic delivery of new datansidc.org/daac/subscriptionsnsidc.org/daac/subscriptions through FTP push or pull Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June
Data Support: Data Access OpenDAP Provides simple access to remotensidc.org/opendap/nsidc.org/opendap/ data Currently limited use and not publicized Data Casting (RSS Feed) Automatic delivery of new data nsidc.org/feeds/data/AE_Ocean.xml nsidc.org/feeds/data/AE_Ocean.xml through an RSS feed Currently available for L2 Ocean only Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June
Data Support Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June User Services Provide support of data products, in-house developed tools, and proprietary software Documentation nsidc.org/data/amsre/data_summaries/ nsidc.org/data/amsre/data_summaries/ Comprehensive product documentation Algorithm version information nsidc.org/data/amsre/versions.html nsidc.org/data/amsre/versions.html Tools nsidc.org/data/amsre/data_summaries/ nsidc.org/data/amsre/data_summaries/ General HDF and specific data set tools Published Research nsidc.org/data/amsre/research.html nsidc.org/data/amsre/research.html
NSIDC Activities Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Digital Object Identifiers (DOIs) & Citations Develop DOI metadata for AMSR-E Version 3 DOIs Product Title Product Shortname Creator Distributor Publication Year URL (location of data) Implementing ESIP-standard citation format Doe, J. and R. Roe. 2001, updated daily. The FOO Gridded Time Series Data Set. Version 3.2. Oct Sep The FOO Data Center. doi:10.xxxx/notfoo Would like to evaluate product authors when performing Version 3 updates to ensure citations are accurate
NSIDC Activities Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Metadata Project Improve the efficiency and accuracy of our metadata creation Leads to better search results and data documentation for users Capture additional metadata for data preservation and data services NSIDC Search Redesign Driven by user feedback that it can be challenging to both find and determine which data best meets a user’s needs Goal is to redesign the search interface to enable users to easily find and compare data sets Will provide hierarchical, faceted metadata in a manner that allows users to both refine and expand the current search Feedback, both now and as updates are release, is welcome.
Archive Metrics: Volume ProductVolume (GB) Version 1 AE_SID3.56 Version 2 AE_5DSNO1.34 AE_DYOCN45.77 AE_DYSNO6.75 AE_L2A AE_LAND68.07 AE_LAND AE_MOOCN1.53 AE_MOSNO0.22 AE_OCEAN AE_RAIN AE_RNGD0.02 AE_SI AE_SI AE_SI AE_WKOCN6.58 Version 3 AMSREL1A Total Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June June 2002 – 1 August 2012 Stats from EMS Archive Volume Total Current Version Archive: 11.5 TB Total Archive (V001, V002, V003): 24 TB Archive retention plan Current Version: Version 3 for all products except sea ice drift which is Version 2 Last Version: Version 2 for all products except sea ice drift which is Version 1 All L2A versions: Will also keep Version 1 for L2A on the basis of it is the input to all higher level products
Distribution Metrics: Total Data TypeFilesVolume (TB) AE_5DSNO63, AE_DYOCN92, AE_DYSNO433, AE_L2A8,159, AE_LAND1,426, AE_LAND31,132, AE_MOOCN3, AE_MOSNO13, AE_OCEAN1,500, AE_RAIN2,600, AE_RNGD4, AE_SI12518, AE_SI25205, AE_SI6191, AE_SID AE_WKOCN8, AMSREL1A465, Total16,818, Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June June 2002 – 1 August 2012 Stats from EMS Total Distribution: 556 TBs 16.8 million files
Distribution Metrics: Files Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June File Distribution Stats from EMS 2.5 Million Files
Distribution Metrics: Volume Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June – 2012 Volume Distribution Stats from EMS 100 TB
Distribution Metrics: Users Product Distinct Users AE_LAND3828 AE_L2A765 AE_SI12373 AE_DYSNO352 AE_LAND321 AE_RAIN199 AE_5DSNO192 AE_OCEAN177 AE_SI25176 AE_MOSNO137 AE_SI6124 AE_DYOCN107 AMSREL1A104 AE_RNGD78 AE_MOOCN54 AE_WKOCN29 AE_SID2 Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June June 2002 – 1 August 2012 Stats from EMS & USO TRAK Database 2,448 Total Distinct Users U.S. Users - 45% Foreign Uses - 55% User TypeDistinct Users FOREIGN OTHER733 FOREIGN UNIVERSITY551 US UNIVERSITY531 ECS OTHER156 NASA151 FOREIGN GOVERNMENT122 US OTHER106 FOREIGN COMMERCIAL38 US COMMERCIAL37 NOAA29 US FED GOVERNMENT28 US GOVERNMENT20 US STATE/LOCAL GVNT11 US GENERAL PUBLIC9 WDC2
Distribution Metrics: Users Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Stats from USO TRAK Database 2003 – 2012 Total Active Distinct Users per Year 11% Increase
Data Support Metrics Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC2-3 June User Contacts were received by NSIDC User Services over a 3 month period (May – July) 262 of those were asking specific questions about data or documentation Of those, 19 were related to AMSR-E and 7 to AMSR-E Validation Total Number of Requests ICESat/GLAS 124 Passive Micro. 48 MODIS 25 AMSR-E 19 IceBridge 14 ECS Team 12 GLIMS 6 AMSR-E Val 5 MEaSUREs 4 DEMs 3 CLPX 2
Data Support Metrics Most Common User Questions 1.Provide guidance on which data set to use or which data within a data set 2.Provide guidance on information in the documentation 3.How do I open/read [data set] in [format] with [tool]? 4.How do I convert from [x data format or x projection] to [y data format or y projection]? 5.Is there a way to extract data for only the region I need in [data set]? Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June
NASA Products at NSIDC Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June
NASA Products at NSIDC Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June
Top 10 Products at NSIDC Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June Sea Ice Trends and Climatologies from SMMR and SSM/I-SSMIS (nsidc0192) Images of Antarctic Ice Shelves (nsidc0102) Near-Real-Time DMSP SSM/I-SSMIS Daily Polar Gridded Sea Ice Concentrations (nsidc0081) Sea Ice Concentrations from Nimbus-7 SMMR and DMSP SSM/I-SSMIS Passive Microwave Data (nsidc0051) Northern Hemisphere EASE-Grid Weekly Snow Cover and Sea Ice Extent Version 3 (nsidc0046) GLAS/ICEsat L2 Global Land Surface Altimetry Data (GLA14) AMSR-E/Aqua Daily L3 Surface Soil Moisture, Interpretive Params, & QC EASE-Grids DMSP SSM/I-SSMIS Pathfinder Daily EASE-Grid Brightness Temperatures (nsidc0032) AMSR-E/Aqua L2A Global Swath Spatially-Resampled Brightness Temperatures GLAS/ICESat L1A Global Altimetry Data (GLA01)
AMSR-E Validation No new AMSR-E Validation data sets delivered to NSIDC Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June
Distribution Metrics: Users Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June Total Distinct Users through 1 June 2011 & 1 August 2012 Total Distinct Users = 7,130 Statistics from our University FTP logs
Distribution Metrics: Files Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June Total Files distributed through 1 June 2011 & 1 August 2012 Total Files Distributed = 1,208,361 Statistics from our University FTP logs
Distribution Metrics: Volume Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June Total Volume (GB) distributed through 1 June 2011 & 1 August 2012 Total Volume Distributed = 2.8 TB Statistics from FTP logs
Terra and Aqua Product Review Motivation (as we understand them) The review materials will be used by NASA HQ to assess the current state of the EOS standard products in preparation for the next Terra/Aqua Senior Review. At the last review in 2010, the panel's wishes were to establish a process by which new products could be added to (or replace) standard products. It is our understanding that this product review is the first of several steps being taken by NASA to implement that process. More Information Needed Timeline of the funding sources for the product or product suites. In particular, NASA's support for algorithm development and maintenance of product scientific software (ROSES grants, Cooperative Agreements, EOS Contracts, DA funding etc.). Dollar amounts are not necessary; just a list of funding sources. Product Developers – please send an to Amanda ideally by this Friday Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC2-3 June
AMSR-E Team at NSIDC Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June Thanks to the AMSR-E Teams at NSIDC! AMSR-E Chris Bond – Operations Karla LeFevre – Technical Writer Lisa Booker – User Services Siri Jodha Khalsa – ECS Science Coordinator Walt Meier – Scientist Cathy Fowler – Database Administrator AMSR-E Validation Chris Bond – Operations Karla LaFevre – Technical Writer Karla LeFevre – Technical Writer Lisa Booker – User Services