AMSR-E and AMSR-E Validation Status at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Asheville, NC June 2011

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June Outline Accomplishments Data Support Activities at NSIDC Metrics  AMSR-E  AMSR-E Validation Sea ice derived from the AMSR-E 89 GHz Tbs. Image courtesy of NASA/GSFC Visualization Studio

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Accomplishments Release of Sea Ice Drift Version 1 product (24 June 2011)  Documentation & metadata creation  End-to-end ingest testing with the SIPS  Comprehensive distribution testing o Enabled spatial and parameter subsetting via WIST/Reverb Improved product latency  Level-2 product latency reduced from 5 days to 20 hours!!!  Level-3 daily product latency reduced from 5 days to 4 days AMSR-E Data Versions:

Accomplishments LANCE: SIPS-NSIDC collaboration  Close coordination to ensure  Preliminary data from the SIPS phased out in lieu of LANCE  Joint poster presented at A-Train meeting and AGU Google Earth Animations using LANCE data  12 km Sea Ice & Daily Soil Moisture  nsidc.org/data/virtual_globes/index.html nsidc.org/data/virtual_globes/index.html Upgrade to EOSDIS Core System (ECS) Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Data Support: Data Access Data Pool On-line access to entire archivensidc.org/data/data_pool/nsidc.org/data/data_pool/ Subsetting, reformatting, reprojection Warehouse Inventory Search Tool (WIST) Search/order from ECHO wist.echo.nasa.govwist.echo.nasa.gov Subsetting Subscriptions Automatic delivery of new datansidc.org/opendap/nsidc.org/opendap/ through FTP push or pull

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June New Data Support: New Data Access REVERB WIST replacementreverb.echo.nasa.gov/reverb/reverb.echo.nasa.gov/reverb/ Improved user interface and search/order workflow OpenDAP Provides simple access to remotensidc.org/opendap/nsidc.org/opendap/ data Currently limited use and not publicized Data Casting (RSS Feed) Automatic delivery of new data nsidc.org/feeds/data/AE_Ocean.xml nsidc.org/feeds/data/AE_Ocean.xml through an RSS feed Currently available for L2 Ocean only

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June Data Support User Services Provide support of data products, in-house developed tools, and proprietary software Documentation nsidc.org/data/amsre/data_summaries/ nsidc.org/data/amsre/data_summaries/ Comprehensive product documentation Algorithm version information nsidc.org/data/amsre/versions.html nsidc.org/data/amsre/versions.html Tools nsidc.org/data/amsre/data_summaries/ nsidc.org/data/amsre/data_summaries/ General HDF and specific data set tools NewNew Data Viewer - interactive tool for viewing satellite passive microwave data sets Published Research nsidc.org/data/amsre/research.html nsidc.org/data/amsre/research.html

NSIDC Activities Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Digital Object Identifiers (DOIs) & Versioning Develop process for implementation of DOIs Recommendations for NSIDC Major.Minor version schema (AMSR-E Version 2, V10 = 2.10) Each major version of a data set gets a separate DOI Recommendation for AMSR-E data management  Increment the ESDT (major) version number when a change to an algorithm warrants reprocessing the entire time series  Currently archiving both Version 1 & 2. Will need to discuss version retention policy moving forward. HDF4 content maps Collaborative study between NASA Earth Science Data Centers & The HDF Group focused on ensuring long term readability of HDF4 data XML file containing a “map” to the contents of the HDF4 file  Enables reading of the data without HDF4 libraries ECS 8.1 will generate, archive, and distribute the HDF4 content maps

NSIDC Activities Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Metadata Project Provide overall improvements to NSIDC’s metadata acquisition, creation, management, and dissemination Replace or enhance existing metadata infrastructure NOAA Sea Ice Concentration CDR – W. Meier Funded by the NOAA Climate Data Record grant Integrates current SSM/I-SSMIS algorithms (NASA Team and Bootstrap) distributed by NSIDC into one combined product NetCDF4 file will include data quality fields, metadata, & provenance Green Data Center $525,000 NSF research instrumentation grant Data center will transition power consumption from 100kw (42kw load for data center equipment, 58kw for cooling) to ~45-50kw (cooling reduced by 95%)

NSIDC Activities Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Four Phase project: 1.Machine room consolidation 2.Server Virtualization (60% reduction in servers) 3.High efficiency cooling system 4.Solar photo-voltaic power supplementation system with battery array Coolerado Units National Geographic Online Article

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Archive Metrics: Volume 1 June 2002 – 1 June 2011 Stats from EMS Version 2 Archive Volume Total Archive: 20 TBs Total Version 2 Archive: 11 TB Product Volume (GB) AE_5DSNO1.28 AE_DYOCN44.04 AE_DYSNO6.49 AE_L2A AE_LAND65.48 AE_LAND AE_MOOCN1.46 AE_MOSNO0.22 AE_OCEAN AE_RAIN AE_RNGD0.02 AE_SI AE_SI AE_SI AE_WKOCN6.32 AMSREL1A

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Distribution Metrics: Total 1 June 2002 – 1 June 2011 Stats from EMS Total Distribution: 454 TBs 13.8 million files Data TypeFilesVolume (TB) AE_5DSNO AE_DYOCN AE_DYSNO AE_L2A AE_LAND AE_LAND AE_MOOCN AE_MOSNO AE_OCEAN AE_RAIN AE_RNGD AE_SI AE_SI AE_SI AE_WKOCN AMSREL1A Total

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Distribution Metrics: Files File Distribution Stats from EMS

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Distribution Metrics: Volume 2003 – 2011 Volume Distribution Stats from EMS 100 TB 50 TB

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Distribution Metrics: Data Access Method Stats from EMS 2003 – 2011 Data access method based on data volume Overall Average:Past 3 Year Average: ECHO/EDG orders = 52 %ECHO = 28% DataPool = 43%DataPool= 70% Subscriptions = 5% Subscriptions = 2%

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Distribution Metrics: Users 1 June 2002 – 1 June 2011 Stats from EMS & USO TRAK Database 2192 Distinct Users ProductDistinct Users AE_5DSNO167 AE_DYOCN102 AE_DYSNO305 AE_L2A712 AE_LAND305 AE_LAND3719 AE_MOOCN47 AE_MOSNO124 AE_OCEAN166 AE_RAIN189 AE_RNGD71 AE_SI12339 AE_SI25165 AE_SI6120 AE_WKOCN25 AMSREL1A97 User TypeDistinct Users FOREIGN COMMERCIAL28 FOREIGN GOVERNMENT117 FOREIGN OTHER647 FOREIGN UNIVERSITY461 ECS OTHER128 NASA140 NOAA29 US COMMERCIAL35 US FEDERAL GOVERNMENT27 US GENERAL PUBLIC8 US GOVERNMENT14 US OTHER89 US STATE/LOCAL GOVERNMENT11 US UNIVERSITY455 WDC2 U.S. Users - 43% Foreign Uses - 57%

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC June Distribution Metrics: Users Stats from USO TRAK Database 2003 – 2011 Total Active Distinct Users per Year

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June AMSR-E Validation: Distribution Metrics No new AMSR-E Validation data sets delivered to NSIDC Published last data set in March 2010

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June Distribution Metrics: Archive volume Archive volume (GB) through 1 June 2011 Total Archive Volume = 575 GB

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June Distribution Metrics: Users Distinct users through 1 June Total Distinct Users = 4,952 33% increase from last year Statistics from our University FTP logs

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June AMSR-E Validation: Metrics Files distributed through 1 June 2011 Total Files Distributed = 772,364 23% increase from last year Statistics from our University FTP logs

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June Metrics: Volume Volume (GB) distributed through 1 June 2011 Total Volume Distributed = 2 TB 25% increase from last year Statistics from FTP logs

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC28-29 June AMSR-E Team at NSIDC Thanks to the AMSR-E Teams at NSIDC! AMSR-E Molly Thomas – Operations Karla LeFevre – Technical Writer Lisa Booker – User Services Sean Mallory – Programmer Siri Jodha Khalsa – ECS Science Coordinator Walt Meier – Scientist Doug Fowler – Test Engineer Cathy Fowler – Database Administrator AMSR-E Validation Molly Thomas – Operations Karla LaFevre – Technical Writer Dan Webster – Technical Writer Lisa Booker – User Services Sean Mallory – Programmer

Joint AMSR-E Science Team Meeting Amanda Leon - NSIDC DAAC2-3 June