McIDAS achievements Compiled & Installed McIDAS-X v2008 Tested BOWTIE correction Enhanced MOD4 and MOD6 server code to reflect changes in v005 algorithms.

Slides:



Advertisements
Similar presentations
RP Designs Semi-Custom e-Commerce Package. Overview RP Designs semi- custom e-commerce package is a complete website solution. Visitors can browse a catalog.
Advertisements

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
Relational Database Systems Higher Information Systems Advanced Implementation in Filemaker Pro.
Linear Programming Problem
Tutorial 6 Creating a Web Form
Chapter 3: Editing and Debugging SAS Programs. Some useful tips of using Program Editor Add line number: In the Command Box, type num, enter. Save SAS.
McIDAS-Lite Dave Santek Program Manager Space Science & Engineering Center University of Wisconsin-Madison 5 December 2002.
A Tutorial on MODIS and VIIRS Aerosol Products from Direct Broadcast Data on IDEA Hai Zhang 1, Shobha Kondragunta 2, Hongqing Liu 1 1.IMSG at NOAA 2.NOAA.
Cs333/cutler Greedy1 Introduction to Greedy Algorithms The greedy technique Problems explored –The coin changing problem –Activity selection.
Click on File - > Open. Click on Database Click on “Open”
Geoscience Australia Simon Oliver Remote Sensing Science and Strategy MODIS Development Activities at ACRES Australian Government Geoscience Australia.
ADVANCED FIRE INFORMATION SYSTEM AFIS I AFIS is the 1 st satellite based, near real time fire information system developed to fulfill the needs of both.
1 Chapter 12 Working With Access 2000 on the Internet.
CS 290C: Formal Models for Web Software Lecture 10: Language Based Modeling and Analysis of Navigation Errors Instructor: Tevfik Bultan.
MATLAB Extras Week 16 – 5/12/09 Kate Musgrave
Week 2: Greedy Algorithms
Активное распределенное хранилище для многомерных массивов Дмитрий Медведев ИКИ РАН.
The Fundamentals: Algorithms, the Integers & Matrices.
Numerical Grid Computations with the OPeNDAP Back End Server (BES)
Math – Getting Information from the Graph of a Function 1.
Reprojecting MODIS Images. Reasons why reprojection is desirable: 1.Removes Bowtie Artifacts 2.Allows geographic overlays (e.g. coastline, city locations)
CEOS/WGISS 20, Kyev, September 12-16, WTF-CEOP Implementation Plan #1 Status (WTF-CEOP first prototype, by JAXA) September 12, 2005 Osamu Ochiai.
FireRMS SQL Audit, Archiving & Purging Presented by Laura Small FireRMS Quality Assurance.
McIDAS-X Software Development and Demonstration Dave Santek and Jay Heinzelman 16 October 2007.
® IBM Software Group © 2009 IBM Corporation Rational Publishing Engine RQM Multi Level Report Tutorial David Rennie, IBM Rational Services A/NZ
1 HDF-EOS and Related Tools Status Update. 2 Overview.
1 HDF-EOS Status, Related Tools and Issues. 2 Overview.
OOI CyberInfrastructure: Technology Overview - Hyrax January 2009 Claudiu Farcas OOI CI Architecture & Design Team UCSD/Calit2.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
Types of IP Models All-integer linear programs Mixed integer linear programs (MILP) Binary integer linear programs, mixed or all integer: some or all of.
Z. P. Szewczyk GIST 25, Oct Recent Field Campaigns with CERES Instruments Z. Peter Szewczyk Kory J. Priestley Lou Smith Remote Sensing of Clouds.
System Development Lifecycle Verification and Validation.
DATABASE TRANSACTION. Transaction It is a logical unit of work that must succeed or fail in its entirety. A transaction is an atomic operation which may.
Starting with our inputs, we will add some constraints to enable client-side validation Kuali University: Apply Now Lab 2: Validation and Constraints Lab.
Write-through Cache System Policies discussion and A introduction to the system.
DAP4 James Gallagher & Ethan Davis OPeNDAP and Unidata.
McIDAS-X Software Development and Demonstration Dave Santek and Jay Heinzelman 8 June 2015.
_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.
HDF OPeNDAP Project Update MuQun Yang and Hyo-Kyung Lee The HDF Group March 31, Annual briefing to ESDIS10/31/2015.
Creating Graphical User Interfaces (GUI’s) with MATLAB By Jeffrey A. Webb OSU Gateway Coalition Member.
VIPER Quality Assessment Overview Presenter: Sathyadev Ramachandran, SPS Inc.
ORNL DAAC MODIS Subsetting and Visualization tools Tools and services to access subsets of MODIS data Suresh K. Santhana Vannan National Aeronautics and.
McIDAS Advisory Committee (MAC) Sponsored: Group Discussion Joleen Feltz McIDAS Advisory Committee Co-Chair from Kristopher Bedka + McIDAS Advisory.
HDF4 OPeNDAP Project Progress Report MuQun Yang and Hyo-Kyung Lee 1 HDF Developers' Meeting11/24/2015.
Remote Data Access with OPeNDAP Dr. Dennis Heimbigner Unidata netCDF Workshop October 25, 2012.
MODIS Direct Broadcast Products at UW-Madison Recent Highlights Terra MODIS passes acquired IMAPP Level 2 Atmosphere Products released in May 2002.
LDOPE QA Tools Sadashiva Devadiga (SSAI) MODIS LDOPE January 18, 2007.
MODIS/AIRS/AMSU/HSB Direct Broadcast & Processing Package at the Cooperative Institute for Meteorological Satellite Study Space Science and Engineering.
Comments from User Services C. Boquist/Code 423 The HDF Group Meeting 1 April 2009.
MODIS Direct Acquisition, Processing and CRISP KWOH, Leong Keong Director, CRISP APEIS Capacity Building Workshop.
Data Processing Flow Chart Start NDVI, EVI2 are calculated and Rank SDS are incorporated Integrity Data Check: Is the data correct? Data: Download a) AVHRR.
MODIS Enhanced-V 1.MODIS IR covering Enhanced-V event 0430z May 25, 2004 Located MODIS L1B Granule at LAADs (MODIS archive and distribution web site) that.
Data acquisition From satellites with the MODIS instrument.
McIDAS-X Software Development and Demonstration Rick Kohrs and Jay Heinzelman 7 May 2012.
McIDAS-X Software Development and Demonstration Dave Santek and Jay Heinzelman 2 June 2009 PDA Animated Weather (PAW) Status by Russ Dengel.
AIRS Land Surface Temperature and Emissivity Validation Bob Knuteson Hank Revercomb, Dave Tobin, Ken Vinson, Chia Lee University of Wisconsin-Madison Space.
Computer Science Up Down Controls, Decisions and Random Numbers.
Software Engineering Algorithms, Compilers, & Lifecycle.
SSE SAS Project: Snow Cover Map Service SSE Workshop 2009 María José Guerrero, Gorka J Lendrino, Rosana Romero ESRIN-Italy / 10 November 2009.
McIDAS-X Software Development and Demonstration Dave Santek and Jay Heinzelman 25 October 2010.
Bijay Shrestha NASA RPC Ag-Efficiency, July 10, 2007 DATA FUSION TO PRODUCE CLOUD-FREE TEMPORAL NDVI CROSS PLATFORM COMPOSITES USING TEMPORAL MAP ALGEBRA.
CALIPSO-MODEL Visualization & Analysis Tool VisuCALIOP_Labonne
Moving from HDF4 to HDF5/netCDF-4
Microsoft Office Access 2010 Lab 2
Kanban Task Manager for Outlook ‒ Introduction
Evaluating Remote Sensing Data
McIDAS-V Powerful data analysis and 3-D visualization tool from SSEC
McIDAS-X Software Development and Demonstration
Greedy Algorithms.
OPeNDAP/Hyrax Interfaces
Presentation transcript:

McIDAS achievements Compiled & Installed McIDAS-X v2008 Tested BOWTIE correction Enhanced MOD4 and MOD6 server code to reflect changes in v005 algorithms. Added ADDE server for MODIS AEROSOL Properties (MOD4), and MODIS CLOUD Properties (MOD6). Implemented and tested export to netCDF for Hyrax & THREDDS catalog server

ADDE server enhancements mcidas2008/src imgbowtie.c - new XRD command gennavblk.for - needed for IMGBOWTIE makefile - MODIS ADDE server modifications modx.h - SSEC 2008 version with mods modradir.cp - SSEC 2008 version modraget.cp - SSEC 2008 version mod3aget.cp - SSEC 2008 XRD version modiadir.cp - SSEC 2008 XRD version with mods modiaget.cp - SSEC 2008 XRD version with mods modladir.cp - SSEC 2008 XRD version modlaget.cp - SSEC 2008 XRD version modxadir.cp - SSEC 2007 version with mods modxaget.cp - SSEC 2007 version with mods kbxmodx.dlm - SSEC 2007 version with mods mcidas2008/data SATBAND - modifications for MODIS ADDE servers

Example ADDE server enhancements

Vxeos required enhancements Bow-tie correction fails on MODIS Swaths with missing scan lines -> centre location cannot be resolved (lat: -999 lon:-999) Task: check with Dominic if this can be fixed. Tertiary (L3B) MODIS products (NDVI,LST,CRL) are currently produced in non-IMAPP compatible HDF structure (see /eOsphere/bin for relevant scripts) Task: check with Dominic if this can be fixed.

Bow-tie correction (before and after)

What is the Bow-tie problem? Hyrax OPeNDAP URL, subsets HDF MOD02 using keyword constraints: ngic.mn:8080/opendap/data/hdf4/all_modis/MXD02/MOD02HKM.A hdf.ascii?Latitude[0:4:25][0:4:25] ngic.mn:8080/opendap/data/hdf4/all_modis/MXD02/MOD02HKM.A hdf.ascii?Latitude[0:4:25][0:4:25 Server returns the following dataset in ascii: MODIS_SWATH_Type_L1B.Geolocation Fields.Latitude[0], , , MODIS_SWATH_Type_L1B.Geolocation Fields.Latitude[1], , , MODIS_SWATH_Type_L1B.Geolocation Fields.Latitude[2], , , MODIS_SWATH_Type_L1B.Geolocation Fields.Latitude[3], , , MODIS_SWATH_Type_L1B.Geolocation Fields.Latitude[4], , , MODIS_SWATH_Type_L1B.Geolocation Fields.Latitude[5], , , MODIS_SWATH_Type_L1B.Geolocation Fields.Latitude[6], , , We expect a sort of records with decreasing latitudes, but we get unexpected results (in red).

Bow-tie correction (cont) (left: uncorrected, right: corrected)

Bow-tie limitations Daily image bow-tie correction on “raw” MOD02/MYD02 1km has no limitation. However, the HKM and QKM swaths are much larger than the required geo-location fields. The geo-location field (MXD03) dimensions restrict the image output dimensions as follows: OUTPUT RES = INPUT RES (lines -1 /elems -2) (MXD03)

How to automate in McIDAS? McIDAS Scheduler Scheduler calls so-called McBASIC scripts. McBASIC is the BASIC dialect used by McIDAS (Man Computer Interactive Data Access System), a sem- automatic environment for handling large amounts of visual and statistical data, particularly satellite imagery.BASIC Or use ‘cron’ but no visual displays.

McIDAS ICC-NGIC customizations Complete TMACOMC1.MCB – In creating daily composite of ‘raw’ aka full-swath TERRA/AQUA MODIS Create McBASIC script for weekly/monthly composite based on daily composite. Using FORM=CMIN conditional minimum to avoid cloudy pixel contamination.

Mcidas customizations Creating weekly composite of bowtie-corrected TERRA/MODIS and AQUA. We want to automate (because we are lazy) this process. Using IMGOPER command with keyword FORM=CMIN conditional minimum expression. Create Monthly composite of bowtie-corrected TERRA/MODIS and AQUA, which we again want to automate. Again using FORM=CMIN conditional minimum to avoid cloud contaminated pixels.

CMIN in TOA Reflectance CMIN min new conditional minimum; uses only the term in the equation with the lowest value greater than the specified minimum; if all terms are less than min, the new value is used (default=0 0) CMIN(0)=(0,-0.1, 0.3,0.1,5….)=0.1

Mcidas customizations Creating McBASIC script for routinely generating weekly composite of bowtie- corrected NDVI TERRA/MODIS and AQUA. We want to automate this process (because we are lazy). Using IMGOPER command with keyword FORM=CMAX conditional minimum expression. Same as above but also for Monthly composite from Weekly composite

CMAX in NDVI CMAX max new conditional maximum; uses only the term in the equation with the highest value less than the specified maximum; if all terms are greater than max, the new value is used (default= ). Theoretical range: -1 to +1 Biological range: -1 to +0.7 Observed range: -1 to >+1 CMAX(0.7)=(0,1, 0.3,0.8,0.5….)=0.5

Action list 1.Learn McIDAS: IMGBOWTIE, IMGOPER (with CMAX and CMIN), McBASIC, McIDAS Scheduler, Backup and File management 2.Solve vxeos incompatibilities (produce IMAPP compatible L3B products) by either: a)Adjust vxeos file HDF formatting of tertiary products (VI’s, Fire detection, etc.), or; b)Run IMAPP in parallel to vxeos 3.Sun glint issues with the NDVI are not observed to happen with other Direct Readout MODIS station(s) in Mongolia. Suggested solution: follow 2b to have redundancy in processing chains and products quality. 4.Complete McBASIC script for routinely generating weekly composite of bowtie-corrected NDVI TERRA/MODIS and AQUA