VIPER Quality Assessment Overview Presenter: Sathyadev Ramachandran, SPS Inc.

Slides:



Advertisements
Similar presentations
Model Evaluation Tools MET. What is MET Model Evaluation Tools ( MET )- a powerful and highly configurable verification package developed by DTC offering:
Advertisements

SNPP VIIRS green vegetation fraction products and application in numerical weather prediction Zhangyan Jiang 1,2, Weizhong Zheng 3,4, Junchang Ju 1,2,
DETAILED DESIGN, IMPLEMENTATIONA AND TESTING Instructor: Dr. Hany H. Ammar Dept. of Computer Science and Electrical Engineering, WVU.
Page 1GlobColour CDR Meeting – July 10-11, 2006, ESRIN All rights reserved © 2006, ACRI-ST Resulting Technical Specification.
Sentinel-3 Validation Team (S3VT) Meeting ESA/ESRIN, Frascati, Italy, th November 2013 BOUSSOLE David ANTOINE CNRS-LOV, France now at: Curtin University,
VIIRS NPP Ocean Color Products at NOAA CoastWatch – A First Look K. Hughes 1 (PRINCIPAL GOVERNMENT INVESTIGATOR), H. Gu 3, P. Keegstra 2, Y.S. Kim 3, S.
Characterization of radiance uncertainties for SeaWiFS and Modis-Aqua Introduction The spectral remote sensing reflectance is arguably the most important.
ITT Visual Information Solutions November 08, 2007
A Tutorial on MODIS and VIIRS Aerosol Products from Direct Broadcast Data on IDEA Hai Zhang 1, Shobha Kondragunta 2, Hongqing Liu 1 1.IMSG at NOAA 2.NOAA.
The GSM merging model. Previous achievements and application to GlobCOLOUR Globcolour / Medspiration user consultation, Dec 4-6, 2006, Villefranche/mer.
Green Vegetation Fraction (GVF) derived from the Visible Infrared Imaging Radiometer Suite (VIIRS) sensor onboard the SNPP satellite Zhangyan Jiang 1,2,
Characterizing and comparison of uncertainty in the AVHRR Pathfinder SST field, Versions 5 & 6 Robert Evans Guilllermo Podesta’ RSMAS Nov 8, 2010 with.
November 2011 At A Glance GREAT is a flexible & highly portable set of mission operations analysis tools that increases the operational value of ground.
Coordinated Energy and water-cycle Observations Peroject A Well Organized Data Archive System Data Integrating/Archiving Center at University of Tokyo.
Page 1GlobColour CDR Meeting – July 10-11, 2006, ESRIN Overview of the operational solutions with feedback on what was proposed during the SRR meeting.
RDFS Rapid Deployment Forecast System Visit at: Registration required.
Assessment of Regional Vegetation Productivity: Using NDVI Temporal Profile Metrics Background NOAA satellite AVHRR data archive NDVI temporal profile.
Retrieving Coastal Optical Properties from MERIS S. Ladner 1, P. Lyon 2, R. Arnone 2, R. Gould 2, T. Lawson 1, P. Martinolich 1 1) QinetiQ North America,
UWG 2013 Meeting PO.DAAC Web Services Demo. What are PO.DAAC Web Services?
GOES Applications: Research and Management of Living Marine Resources in the Central and Western Pacific David G. Foley Joint Institute for Marine and.
GCE Data Toolbox -- metadata-based tools for automated data processing and analysis Wade Sheldon University of Georgia GCE-LTER.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES PhEDEx Monitoring Nicolò Magini CERN IT-ES-VOS For the PhEDEx.
Harmful Algal Blooms A marine ecosystem manager is interested in using satellite and ocean model products to find precursors for the determination of harmful.
AUTOMATING THE TERASCAN IMAGE PROCESS Mentor: Keisha Wilkins Brandi R. Brehon Jameson D. Gibbs.
8th IOCCG Meeting in Florence, Italy (24-26 Feb 03) Current Status of MODIS (Terra and Aqua) by Chuck Trees for the MODIS Team Members.
ABSTRACT In recent years, the NOAA CoastWatch Okeanos Ocean Color Operational Production System (OPS) has been providing a series of high quality ocean.
1 GOES-R AWG Product Validation Tool Development Aviation Application Team – Volcanic Ash Mike Pavolonis (STAR)
1 GOES-R AWG Product Validation Tool Development Aviation Application Team – Volcanic Ash Mike Pavolonis (STAR)
Slide 12.1 Chapter 12 Implementation. Slide 12.2 Learning outcomes Produce a plan to minimize the risks involved with the launch phase of an e-business.
September 4, 2003MODIS Ocean Data Products Workshop, Oregon State University1 Goddard Earth Sciences (GES) Distributed Active Archive Center (DAAC) MODIS.
ESIP Federation 2004 : L.B.Pham S. Berrick, L. Pham, G. Leptoukh, Z. Liu, H. Rui, S. Shen, W. Teng, T. Zhu NASA Goddard Earth Sciences (GES) Data & Information.
MODIS OCEAN QA Browse Imagery (MQABI Browse Tool) NASA Goddard Space Flight Center Sept 4, 2003
Environmental Monitoring of The Great Lakes Using CoastWatch Data and Java GIS RDX06 – Remote Sensing Across The Great Lakes: Observations, Monitoring,
Jonas Eberle 25th March Automatization of information extraction to build up a crowd-sourced reference database for vegetation changes Jonas Eberle,
ORNL DAAC MODIS Subsetting and Visualization tools Tools and services to access subsets of MODIS data Suresh K. Santhana Vannan National Aeronautics and.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 In Situ SST for Satellite Cal/Val and Quality Control Alexander Ignatov.
CMS pixel data quality monitoring Petra Merkel, Purdue University For the CMS Pixel DQM Group Vertex 2008, Sweden.
NASA Ocean Color Research Team Meeting, Silver Spring, Maryland 5-7 May 2014 II. Objectives Establish a high-quality long-term observational time series.
Menghua Wang, NOAA/NESDIS/ORA Refinement of MODIS Atmospheric Correction Algorithm Menghua Wang (PI, NASA NNG05HL35I) NOAA/NESDIS/ORA Camp Springs, MD.
L3MTO Transfer to CPC Preliminary Meeting February 7, 2008.
ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.
Robert Wolfe NASA Goddard Space Flight Center Code 614.5, Greenbelt, MD Robert Wolfe NASA Goddard Space Flight Center Code 614.5,
A system for satellite LST product monitoring and retrieval algorithm evaluation Peng Yu 12, Yunyue Yu 2, Zhuo Wang 12, and Yuling Liu 12 1 ESSIC/CICS,
Ambiguity of Quality in Remote Sensing Data Christopher Lynnes, NASA/GSFC Greg Leptoukh, NASA/GSFC Funded by : NASA’s Advancing Collaborative Connections.
VIIRS Product Evaluation at the Ocean PEATE Frederick S. Patt Gene C. Feldman IGARSS 2010 July 27, 2010.
SNPP Ocean SIPS status SNPP Applications Workshop 18 November 2014 Bryan Franz and the Ocean Biology Processing Group.
Validation of Coastwatch Ocean Color products S. Ramachandran, R. Sinha ( SP Systems NOAA/NESDIS) Kent Hughes and C. W. Brown ( NOAA/NESDIS/ORA,
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
ISAC Contribution to Ocean Color activity Mediterranean high resolution surface chlorophyll mapping Use available bio-optical data sets to estimate the.
EOVSA Pipeline Processing System J. McTiernan EOVSA Prototype Review 24-Sep-2012.
 Establishing state-of-the-art coding, documentation, configuration management standards for the AWG.  Software development process comparable with CMMI.
ADPS Science Software Development Bryan Franz NASA Ocean Biology Processing Group Aquarius Data Processing Workshop, NASA/GSFC, March 2007.
Cal/Val for physics MED-MFC internal meeting CMCC-INGV-SOCIB Lecce E. Clementi, INGV.
IOP algorithm OOXX Jeremy Werdell & Bryan Franz NASA Ocean Biology Processing Group 25 Sep 2010, Anchorage, AK
Kamel Didan 12*, Armando Barreto 12, Javier Rivera 12, Muluneh Yitayew 2 VIP DATA EXPLORER: 30 Years of Vegetation Index and Phenology Observations 1 VIP.
Coastal Optical Characterization Experiment (COCE) Activities at STAR NOAA 2013 Satellite Conference, April 7-12, 2013 M. Ondrusek,
Optical Properties in coastal waters change rapidly on very fine spatial scales. The existence of multiple ocean color systems provides a unique capability.
CIOSS Ocean Optics Aug 2005 Ocean Optics, Cal/Val Plans, CDR Records for Ocean Color Ricardo M Letelier Oregon State University Outline - Defining Ocean.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 NOAA CoastWatch/OceanWatch Ocean Color Activities: Contributions to Ocean.
From Missions to Measurements: an Ocean Discipline Experience.
MODIS Atmosphere Level-3 Product & Web Site Review Paul A. Hubanks Science Systems and Applications, Inc.
EOVSA Data and Database System J. McTiernan EOVSA Technical DesignMeeting 7-Nov-2011.
“Regional” adjustments of SAA parameterization Mark Dowell & Timothy Moore EC-JRCNURC & UNH.
SeaWiFS Highlights July 2002 SeaWiFS Celebrates 5th Anniversary with the Fourth Global Reprocessing The SeaWiFS Project has just completed the reprocessing.
OceanWatch Central Pacific Satellite Oceanography Products & Applications PIFSC Melanie Abecassis, PhD Ecosystems and Oceanography Program Ecosystems Sciences.
High Resolution MODIS Ocean Color Bryan Franz NASA Ocean Biology Processing Group MODIS Science Team Meeting, 4-6 January 2006, Baltimore, MD.
VIIRS-derived Chlorophyll-a using the Ocean Color Index method SeungHyun Son 1,2 and Menghua Wang 1 1 NOAA/NESDIS/STAR, E/RA3, College Park, MD, USA 2.
NOAA Report on Ocean Parameters - SST Presented to CGMS-43 Working Group 2 session, agenda item 9 Author: Sasha Ignatov.
MODIS SST Processing and Support for GHRSST at OBPG
SDLC Phases Systems Design.
Presentation transcript:

VIPER Quality Assessment Overview Presenter: Sathyadev Ramachandran, SPS Inc

Input Products o Expect swath and geo-located CWhdf format datasets (NUPs)  IDPS-NDE, l2gen products, ESA, ISRO, JAXA native products in CWhdf format  Different spatial resolutions and bands Timeliness o Expect data ingest within 24 hours of acquisition for NRT QA processes o Automated scripts run daily and output products available for web publishing. Software platform & distribution o IDL, Perl, Web display of QA products Hardware o Tethys cluster ; ~ 10 TB of disk space for 1 year data (multiple sensors) for limited CW regions o Heritage sensors + VIIRS + OCM-2 o Currently the QA process runs on only one node (orbit102l) 2 VIPER VIPER Subsystem Requirements: Quality Assessment

NOAA Unique Product (NUP) Criteria to satisfy being called a NOAA Unique Product –Product used NOAA unique algorithms L2 products) (OC2_RS, SWIR) ; e.g. (nLw, Rrs, Chlor_a) –NOAA user requested “region list” L3 products) All L3 products whether based on NOAA unique algorithms or input data or not but binned into standard CoastWatch boxes and custom projections are deemed NUPs. –Spatial Binned or Temporally binned L4 products) Temporal : Daily Composites 61-day Composites (e.g. Harmful Algal Bloom) 7-day composites Spatial: Coarser resolution - Climate products (TBA) –NUPs can also include non-NOAA (MERIS, OCM, GCOM) L2 native products converted to NOAA CWhdf using any of the above criteria 3

Phase I –Comparison of new sensor with heritage sensors (MODIS and SeaWiFS) Ocean Color products Chlor_a, nLw or Rrs –Comparison of the standard products from IDPS/NDE (in case of VIIRS) or other new sensors (OCM-2) with alternate sources L2gen (from OBPG) generated NOAA Unique products. Phase II –Validation of NUPs with in-situ data where available MOBY over Hawaii and other coastal water regions. 4 VIPER QA Processes

VIPER QA Products generated Time series of NRT products. –Mean, median, std-dev for specific CoastWatch regions. Histograms –Chlor_a and nLw with relevant statistics for the distribution Inter-sensor comparison products –Scatter plots and Residuals with relevant statistics For specific CoastWatch regions. Further stratified by near coastal waters and open ocean pixels within each region. –Mean residuals (measure of bias) –Mean std-dev (measure of noise) –Relative error estimates with a standard of reference. ASCII file archives of the statistics computed to be used later for any dynamic plots Validation web page linked to the CoastWatch page to host limited Validation products or plots. 5

Masked Data Inter-sensor comparison Due to spatial resolution differences – CoastWatch regions Initial inter-sensor on full CW box using bulk statistics easiest to implement (like in NRT-QA) –To do pixel to pixel comparison Need (pixel clusters) of equivalent foot-print across sensors –MERIS-hires (3x3) pixel maps to (1x1) of VIIRS –AQUA, SeaWiFS, MERIS (3x3) maps to (5x5) for VIIRS –MERIS-hires (5x5) maps to (1x1) MERIS Or use Daily Composites already masked for appropriate flags and remapped (binned) to comparable spatial grid 6

QA timelines Phase I –6 weeks from data access to provide a preliminary assessment of the product quality. Need test (synthetic data) 3 months before launch to meet the above requirement. –90 days for the next assessment. Assuming > 30% matchup efficiency and > 30% for clear sky pixels we expect to see >> 10 days of good matchups for CONUS region CW boxes. –4 seasons (one year) of data collection to provide a more detailed assessment and create an adequate time-series for the new sensor. Phase II –More than 2 years of data analysis to get to peer reviewed publication quality QA. (STAR Ocean toolkit for data extraction) 7

Distribution of QA Products Web-page layout Current – we have the CW regions bulk statistics Statistics plotted as time-series (static(IDL) and dynamic(Java)) to monitor product quality Future –Pixel to Pixel and Pixel cluster comparisons across new and heritage sensors

9 Phase I Phase II Tethys QA Disk/SAN SeaWiFS MODIS MERIS VIIRS OCM-2 Okeanos ftpserver (OSDPD) NUPs Validation Process flow Rigorous QA : In-situ comparisons  2 year from launch  publications Single sensor stats: mean, median, std-dev, histograms for CW regions gives trends Inter-sensor stats: scatter plots, residual, relative error and stats for pixel clusters QA Webpage linked from CoastWatch Limited results will be posted to web following internal review Tethys cluster Tethys-okeanos (STAR) Tethys STAR Internal QA page

10 QA Web pages

Prototype QA html pages - internal 11

Tools available to OSDPD for Quality checks CDAT tools provide line command executables as well as through interactive graphics for individual data file Quality checks. –Detailed probe will require scripting line commands using Perl or IDL invoking CDAT function calls. Java tool (Ocean Toolkit) for time series display will be maintained on the Cal/Val webpage with OSDPD access. All STAR produced QA products will be displayed on this webpage. Visual inspection via link to CWpage for daily collection of images – 12