16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.

Slides:



Advertisements
Similar presentations
1 MODAPS - Land Processing Status Robert Wolfe and Ed Masuoka Code 619, NASA GSFC Sadashiva Devadiga Sigma Space MODIS Science Team Meeting April 15-17,
Advertisements

Presented at AMSR Science Team Meeting September 23-24, 2014 AMSR SIPS STATUS Helen Conover Information Technology & Systems Center The University of Alabama.
AMSR-E SIPS Processing Status Presented by Helen Conover Information Technology and Systems Center at the University of Alabama in Huntsville AMSR-E Joint.
Beta Testing: The Contractor’s Perspective Trns·port User Group Meeting October 2005.
LP DAAC Status MODIS Science Team Meeting April , 2014 Chris Doescher, PMP LP DAAC Project Manager Dr. David Meyer.
AMSR-E SIPS Processing Status Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville AMSR-E Joint.
APPLICATION DEVELOPMENT BY SYED ADNAN ALI.
AMSR-E SIPS Processing Status Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville JAXA / AMSR-E.
September 23-24, 2014Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.
1 HDF-EOS and Related Tools Status Update. 2 Overview.
1 HDF-EOS Status, Related Tools and Issues. 2 Overview.
MODIS Land and HDF-EOS HDF-EOS Workshop Presentation September 20, 2000 Robert Wolfe NASA GSFC Code 922, Raytheon ITSS MODIS Land Science Team Support.
Presented at the LANCE User Working Group Meeting April 29, 2015 LANCE AMSR2 UPDATE Sherry Harrison
1 MODIS Land C6 Schedule and Status Sadashiva Devadiga 1,2, Ye Gang 1,2 and Edward Masuoka 1 1 NASA GSFC 2 Science Systems and Applications Inc. MODIS/VIIRS.
Configuration Management (CM)
PoDAG XXI: MODIS Status Marilyn Kaminski MODIS Product Team Lead October 16, 2003.
September 4 -5, 2013Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Leader Science Computing Facility Current Science Software.
AMSR at NSIDC PoDAG XV Briefing NSIDC 28 September 1999.
1 HDF-EOS Status and Development Larry Klein, Abe Taaheri, and Cid Praderas L-3 Communications Government Services, Inc. November 30, 2005.
BOE/Work Break Down The following slides provide a high level view of the BOE/WBS structure of the proposed NSIDC DAAC Contract.
Page 1 Status of HDF-EOS, Related Software, and Tools Abe Taaheri, Raytheon IIS HDF & HDF-EOS Workshp XIII Riverdale, MD November 4, 2009.
Archival Information Packages for NASA HDF-EOS Data R. Duerr, Kent Yang, Azhar Sikander.
25 June 2009 Dawn Conway, AMSR-E TLSCF Lead Software Engineer AMSR-E Team Leader Science Computing Facility.
AMSR-E SIPS Processing Status Presented by Helen Conover Information Technology and Systems Center at the University of Alabama in Huntsville AMSR-E Joint.
HDF & HDF-EOS Workshop VIII 2004 October Aurora, CO Bruce Beaumont, Matt Smith, Helen Conover, Sara Graves Subsetting at UAH.
1 HDF-EOS Status, Related Tools and Issues. 2 Overview.
PDS Geosciences Node Page 1 Archiving Mars Mission Data Sets with the Planetary Data System Report to MEPAG Edward A. Guinness Dept. of Earth and Planetary.
AMSR-E Cryosphere Science Data Product Metrics Prepared by the ESDIS SOO Metrics Team for the Cryosphere Science Data Review January 11-12, 2006.
MOWG 2 Sept 15-16,1999 David Hancock1 KEY PERSONNEL Dr. Bob Schutz, GLAS Science Team Leader Dr. Jay Zwally, ICESat Project Scientist, GLAS Team Member.
HDF-EOS at NOAA/NESDIS NOAA / NESDIS / ORA orbit-net.nesdis.noaa.gov/arad2/MSPPS Huan Meng, Doug Moore, Limin Zhao, Ralph Ferraro NOAA / NESDIS.
Instant Karma: Accessing Provenance Information for AMSR-E Science Data Products AMSR-E Science Team Meeting 29 June 2011 UAHuntsville The University of.
Patrick Coronado - DRL. Driving Force Behind DRL Technology Development Utility and transportability of Earth science data Modularity, scalability, portability.
Page 1 TOOLKIT / HDF-EOS Status and Development Abe Taaheri, Raytheon IIS Aura DSWG meeting October 2007.
AMSR-E Ocean Rainfall Algorithm Status AMSR-E Science Team Meeting Huntsville, AL 2-3 June, 2010 C. Kummerow Colorado State University.
Presented at AMSR Science Team Meeting September 23-24, 2014 AMSR2 NRT Land, Atmosphere Near real-time Capability for EOS (LANCE) Helen Conover Information.
AMSR-E and AMSR-E Validation Archive & Distribution Status Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Hunstville, Alabama 2-3 June.
AMSR-E SIPS Processing Status Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville
Jianchun Qin, Liguang Wu, Michael Theobald, A. K. Sharma, George Serafino, Sunmi Cho, Carrie Phelps NASA Goddard Space Flight Center, Code 902 Greenbelt,
Facilitating Access to EOS Data at the NSIDC DAAC Siri Jodha Singh Khalsa ECS Science Coordinator for the National Snow and Ice Data Center, Distributed.
MODIS Snow and Sea Ice Data Products George Riggs SSAI Cryospheric Sciences Branch, NASA/GSFC Greenbelt, Md. Dorothy K.
s Donna J. Scott, Marilyn Kaminski, Jason Wolfe, Terry Haran NSIDC's MODIS Snow and Sea Ice Products NSIDC provides a suite.
1 Status of HDF-EOS, Related Software and Tools. 2 TOOLKIT / HDF-EOS Support.
PoDAG 21: Flow Diagrams 1 Data Flow Diagram(s) PoDAG asked for a data flow diagram with an indication where NSIDC was involved.  Each data stream is unique,
Comments from User Services C. Boquist/Code 423 The HDF Group Meeting 1 April 2009.
AMSR-E and AMSR-E Validation Status at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Asheville, NC June 2011.
Finalizing the AMSR-E Rainfall Algorithm GPROF2010 AMSR-E Science Team Meeting Oxnard, CA 4-5 September, 2013 Dave Randel Colorado State University.
KEY PERSONNEL Dr. Bob Schutz, GLAS Science Team Leader Dr. Jay Zwally, ICESat Project Scientist, GLAS Team Member Mr. David Hancock, Science Software Development.
Data Activities at NSIDC DAAC September April 2001 Mark Parsons 25 April 2001.
AMSR-E Ocean Rainfall Algorithm Status AMSR-E Science Team Meeting Asheville, NC June, 2011 C. Kummerow Colorado State University.
ECS Metadata Considerations for Preservation SiriJodha S. Khalsa National Snow and Ice Data Center.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
NSIDC DAAC Operations What we did and how we did it: Sep Jan 2000 Mark Parsons Operations Manager 7 February 2000.
Page 1 Land PEATE support for CERES processing Ed Masuoka Gang Ye August 26, 2008 CERES Delta Design Review.
LANCE Processing at the AMSR-E SIPS Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville Joint.
HDF-EOS Workshop IV September 19-21, 2000 Richard E. Ullman ESDIS Information Architect NASA/ GSFC, Code 423.
ADPS Science Software Development Bryan Franz NASA Ocean Biology Processing Group Aquarius Data Processing Workshop, NASA/GSFC, March 2007.
MODIS Cryosphere Science Data Product Metrics Prepared by the ESDIS SOO Metrics Team for the Cryosphere Science Data Review January 11-12, 2006.
AMSR Team Meeting September 16, 2015 AMSR2 Rainfall Algorithm Update Christian Kummerow Colorado State University.
MODIS SDST, STTG and SDDT MODIS Science Team Meeting (Land Discipline Breakout Session) July 13, 2004 Robert Wolfe Raytheon NASA GSFC Code 922.
Presented at the AMSR Science Team Meeting September 16-17, 2015 LANCE AMSR2 NRT Sherry Harrison Land, Atmosphere Near real- time.
AMSR-E and AMSR-E Validation Status at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Portland, OR September 2012.
TERRA UPDATE Launch Date NSIDC DAAC Launch Readiness MODIS Snow and Ice Products General Product Release Timeline.
1 09/2003 Processing Library Update CF Checker – Script made available as a web based form on the BADC site -
Aura Science Meeting Data Systems Working Group HIRDLS SIPS Status October 1, 2007 Vince Dean, Brendan Torpy, Greg Young Univ. of Colorado, Boulder Cheryl.
September 11-12, 2012Dawn Conway, AMSR-E TLSCF Lead Software Engineer AMSR-E Team Leader Science Computing Facility New Browse Images Current Science Software.
PoDAG XXV, 26 Oct SSM/I Update (with some AMSR-E) Walt Meier.
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
7/13/04 Edward Masuoka MODIS Science Team Meeting 1 MODAPS Reprocessing Collections 4 and 5 Ed Masuoka July 13, 2004.
NASA Earth Science Data Stewardship
AMSR-E SIPS Processing Status
Presentation transcript:

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy Spencer Dr. Danny Braswell Dr. Elena Lobl Mr. Don Moss Ms. Dawn Conway

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF TLSCF at UAH TLSCF Data Flow TLSCF Operating Environment Science Team Software Delivery Requirements Current AMSR-E Science Software Current AMSR2 Science Software AMSR-E / AMSR2 Schedule

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF AMSR-E / AMSR2 TLSCF Science Team GHCC SIPS NSIDC DAAC Algorithm, documentation, QA, and ECS metadata updates Documentation, ESDT’s, user support Browse images, anomaly resolution, Provenance metadata, LANCE product review Delivered Algorithm Package (DAP) Data Flow

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Current AMSR-E (Sunny) AMSR2 / Future AMSR-E (Gusty) Operating SystemRHEL bitRHEL bit C compilergcc Fortran compilerLahey, ifortgfortran, ifort HDF4.2r15 HDF-EOS2.145 TLSCF Operating Environment

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Science Team Software Delivery Requirements Update from the latest DAP Software o HDF version o HDF-EOS Geo fields o Use current version of input data Delivery notes Include test input / output data

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Delivery Notes Describes the science software changes, including new requirements Lists known issues associated with the release Describes the file naming convention Includes input and output file descriptions Identifies the required operating system, compilers, libraries, and third party software Lists and describes all routines and ancillary files, identifying the ones that have changed Contacts Operating instructions

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Current AMSR-E Science Software

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Current AMSR-E Science Software All operational software is updated to include o New ISO metadata, updated ECS metadata o New ESDT o New L2A Reader o Digital Object Identifier (DOI)

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Current AMSR-E Science Software L2A Brightness Temperatures o V12 reprocessing completed July 2013 (RSS v07) o Recalibrated Brightness Temperatures o Improved RFI flags; format changes L3 Sea Ice V15 o Reprocessing completed July 2014 Update Southern Hemisphere sea ice mask Update the algorithm to correct internal land / ocean flag that conflicted with the new sea ice mask o Minor updates to Bootstrap at TLSCF (received )

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Current AMSR-E Science Software L2 Ocean o Last algorithm updates were in V05, April 2007 o Updates expected; will utilize latest TB’s and record new RFI flags L3 Ocean o Last algorithm updates were in V04, May 2010 o Updates expected; will utilize the latest RFI flags o Reprocessing after L2 Ocean reprocessing

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Current AMSR-E Science Software L2 Land o At TLSCF, I&T has begun o Combined Single Channel Algorithm (SCA) and Normalized Polarization Difference (NPD) algorithm o New format o Unified ancillary files L3 Land o Updates expected after L2 Land delivery o Reprocessing after L2 Land reprocessing

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Current AMSR-E Science Software L2 Rain o GPROF 2010 currently at SIPS for reprocessing o Next update? L3 Rain o New algorithm; derived from L2 Rain (GPROF 2010) o Monthly; 0.25 degree resolution

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Current AMSR-E Science Software L3 Snow o Last algorithm update B05, November 2005 o Updates? L3 Sea Ice Drift o Last algorithm update B03, October 2013 o Replacement algorithm expected from science team o Validated?

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF AMSR2 Science Software Integration at TLSCF equivalent to AMSR-E o Update the metadata, QA, and operational code o Update Provenance metadata o Integrate and test o Compare output o Prepare DAP o Provide documentation to NSIDC o Update the ESDT o Provide support to the SIPS to resolve processing issues

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF AMSR2 Science Software JAXA L1R o Reader written and tested by Bruce Beaumont of the SIPS (LANCE) and available to science team now o Data available from SIPS Version B01 of AMSR2 Standard Products Ready for I&T at TLSCF o L3 Sea Ice o L2 Land o L2 Rain / Ocean (GPROF)

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF AMSR-E Schedule Q3Q4Q1Q2Q3Q4Q1Q2Q3Q4Q1Q2Q3Q4 All Alg to TLSCF TLSCF Integration & Testing Algorithm Updates due TLSCF I&T* Final updates to TLSCF TLSCF I&T* Dec 2016: FINAL End of Mission algorithm updates due to TLSCF AMSR-E Senior Review Feb 1, 2016 *AMSR-E extension due to Terra-Aqua ROSES ?

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Tentative AMSR2 Schedule Q3Q4Q1Q2Q3Q4Q1Q2Q3Q4Q1Q2Q3Q4 Beta versionTransitional version Validated version Unified Mask Algorithms to TLSCF TLSCF I&T

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Overview of Tasks Support Science Team Integrate and test science software Maintain metadata, QA software, and ESDT’s Prepare all software for operations environment Deliver DAP to the SIPS Support the SIPS in resolving processing anomalies Support NSIDC (user inquiries and documentation) Documentation and web pages

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Delivered Algorithm Package A package containing software and documentation sufficient to allow a user to recreate the associated standard product 1 DAP per science software delivery DAP version = file version Delivered and installed at SIPS for processing Available to users from NSIDC

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Science Software Integration & Test Procedures Update the metadata, QA, and operational code o Document changes o Integrate the science software o Compile and run the completed software package o Compare output Update Provenance metadata Provide documentation to NSIDC Update the ESDT

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Science Software Integration & Test Procedures Review each science team delivery o Begin with current DAP? o Document changes in software and ancillary files? o Output file meets ECS requirements? o Known issues, bug fixes Compile and run the science software o Document changes necessary to compile at TLSCF o Compare output with that provided by the scientist

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 TLSCF Science Software Integration & Test Procedures Deliver DAP to the SIPS o Science, metadata, & QA software o Makefile and wrapper scripts o Delivery notes o Static ancillary files o Checksums Support SIPS in resolving processing anomalies