Noise-Robust Spatial Preprocessing Prior to Endmember Extraction from Hyperspectral Data Gabriel Martín, Maciel Zortea and Antonio Plaza Hyperspectral.

Slides:



Advertisements
Similar presentations
Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Advertisements

Patch-based Image Deconvolution via Joint Modeling of Sparse Priors Chao Jia and Brian L. Evans The University of Texas at Austin 12 Sep
URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR P.Gamba, A. Villa, A. Plaza, J. Chanussot, J. A. Benediktsson.
M.S. Student, Hee-Jong Hong
Learning Convolutional Feature Hierarchies for Visual Recognition
Multiple Criteria for Evaluating Land Cover Classification Algorithms Summary of a paper by R.S. DeFries and Jonathan Cheung-Wai Chan April, 2000 Remote.
Modeling Pixel Process with Scale Invariant Local Patterns for Background Subtraction in Complex Scenes (CVPR’10) Shengcai Liao, Guoying Zhao, Vili Kellokumpu,
1 Robust Video Stabilization Based on Particle Filter Tracking of Projected Camera Motion (IEEE 2009) Junlan Yang University of Illinois,Chicago.
RETRIEVAL OF MULTIMEDIA OBJECTS USING COLOR SEGMENTATION AND DIMENSION REDUCTION OF FEATURES Mingming Lu, Qiyu Zhang, Wei-Hung Cheng, Cheng-Chang Lu Department.
Detecting Image Region Duplication Using SIFT Features March 16, ICASSP 2010 Dallas, TX Xunyu Pan and Siwei Lyu Computer Science Department University.
Multiple Human Objects Tracking in Crowded Scenes Yao-Te Tsai, Huang-Chia Shih, and Chung-Lin Huang Dept. of EE, NTHU International Conference on Pattern.
Classification of Remotely Sensed Data General Classification Concepts Unsupervised Classifications.
Face Processing System Presented by: Harvest Jang Group meeting Fall 2002.
Digital Imaging and Remote Sensing Laboratory Real-World Stepwise Spectral Unmixing Daniel Newland Dr. John Schott Digital Imaging and Remote Sensing Laboratory.
Introduction to machine learning
INTRODUCTION Problem: Damage condition of residential areas are more concerned than that of natural areas in post-hurricane damage assessment. Recognition.
Chapter 12 Spatial Sharpening of Spectral Image Data.
Graph-based consensus clustering for class discovery from gene expression data Zhiwen Yum, Hau-San Wong and Hongqiang Wang Bioinformatics, 2007.
Joint Histogram Based Cost Aggregation For Stereo Matching Dongbo Min, Member, IEEE, Jiangbo Lu, Member, IEEE, Minh N. Do, Senior Member, IEEE IEEE TRANSACTION.
MULTITEMP 2005 – Biloxi, Mississippi, USA, May 16-18, 2005 Remote Sensing Laboratory Dept. of Information and Communication Technology University of Trento.
TAILING MODELLED AND MEASURED SPECTRUM FOR MINE TAILING MAPPING IN TUNISIAN SEMI-ARID CONTEXT N. Mezned 1,2, S. Abdeljaouad 1, M. R. Boussema
Chenghai Yang 1 John Goolsby 1 James Everitt 1 Qian Du 2 1 USDA-ARS, Weslaco, Texas 2 Mississippi State University Applying Spectral Unmixing and Support.
A New Subspace Approach for Supervised Hyperspectral Image Classification Jun Li 1,2, José M. Bioucas-Dias 2 and Antonio Plaza 1 1 Hyperspectral Computing.
1 Remote Sensing Laboratory Dept. of Information Engineering and Computer Science University of Trento Via Sommarive, 14, I Povo, Trento, Italy 2.
1 Towards streaming hyperspectral endmember extraction Dževdet Burazerović, Rob Heylen, Paul Scheunders IBBT-Visionlab, University of Antwerp, Belgium.
COMMON EVALUATION FINAL PROJECT Vira Oleksyuk ECE 8110: Introduction to machine Learning and Pattern Recognition.
Dimensionality Reduction in Hyperspectral Image Analysis Using Independent Component Analysis Hongtao Du Feb 18, 2003.
COMPARISON OF IMAGE ANALYSIS FOR THAI HANDWRITTEN CHARACTER RECOGNITION Olarik Surinta, chatklaw Jareanpon Department of Management Information System.
Estimating Water Optical Properties, Water Depth and Bottom Albedo Using High Resolution Satellite Imagery for Coastal Habitat Mapping S. C. Liew #, P.
Jonatan Gefen 28/11/2012. Outline Introduction to classification Whole Pixel Subpixel Classification Linear Unmixing Matched Filtering (partial unmixing)
Using Support Vector Machines to Enhance the Performance of Bayesian Face Recognition IEEE Transaction on Information Forensics and Security Zhifeng Li,
Outline Kinds of Coding Need for Compression Basic Types Taxonomy Performance Metrics.
A Study on the Effect of Spectral Signature Enhancement in Hyperspectral Image Unmixing UNDERGRADUATE RESEARCH Student: Ms. Enid Marie Alvira-Concepción.
Feature Vector Selection and Use With Hidden Markov Models to Identify Frequency-Modulated Bioacoustic Signals Amidst Noise T. Scott Brandes IEEE Transactions.
1 Document Image Matching Based on Component Blocks Fuhui Long, Hanchuan Peng, Zheru Chi, and Wanchi Siu Center for Multimedia Signal Processing, Department.
IGARSS 2011, Vancouver, Canada HYPERSPECTRAL UNMIXING USING A NOVEL CONVERSION MODEL Fereidoun A. Mianji, Member, IEEE, Shuang Zhou, Member, IEEE, Ye Zhang,
14 ARM Science Team Meeting, Albuquerque, NM, March 21-26, 2004 Canada Centre for Remote Sensing - Centre canadien de télédétection Geomatics Canada Natural.
Validation of MODIS Snow Mapping Algorithm Jiancheng Shi Institute for Computational Earth System Science University of California, Santa Barbara.
Page  1 LAND COVER GEOSTATISTICAL CLASSIFICATION FOR REMOTE SENSING  Kęstutis Dučinskas, Lijana Stabingiene and Giedrius Stabingis  Department of Statistics,
H. Lexie Yang1, Dr. Melba M. Crawford2
Sparse Superpixel Unmixing of CRISM Hyperspectral Images 1 NASA / Caltech / JPL / Instrument Software and Science Data Systems Images courtesy NASA / Caltech.
Endmember Extraction from Highly Mixed Data Using MVC-NMF Lidan Miao AICIP Group Meeting Apr. 6, 2006 Lidan Miao AICIP Group Meeting Apr. 6, 2006.
A NOVEL METHOD FOR COLOR FACE RECOGNITION USING KNN CLASSIFIER
Hyperspectral remote sensing
Remote Sensing Unsupervised Image Classification.
Review of Spectral Unmixing for Hyperspectral Imagery Lidan Miao Sept. 29, 2005.
Demosaicking for Multispectral Filter Array (MSFA)
Mathematical Analysis of MaxEnt for Mixed Pixel Decomposition
Irfan Ullah Department of Information and Communication Engineering Myongji university, Yongin, South Korea Copyright © solarlits.com.
Sub pixelclassification
Comparative Analysis of Spectral Unmixing Algorithms Lidan Miao Nov. 10, 2005.
Remote Sensing Laboratory Dept. of Information Engineering and Computer Science University of Trento Via Sommarive, 14, I Povo, Trento, Italy Remote.
Performance Measurement of Image Processing Algorithms By Dr. Rajeev Srivastava ITBHU, Varanasi.
Edge Preserving Spatially Varying Mixtures for Image Segmentation Giorgos Sfikas, Christophoros Nikou, Nikolaos Galatsanos (CVPR 2008) Presented by Lihan.
Unsupervised Classification
Selected Hyperspectral Mapping Method
Scatter-plot Based Blind Estimation of Mixed Noise Parameters
Bag-of-Visual-Words Based Feature Extraction
A modified hyperplane clustering algorithm allows for efficient and accurate clustering of extremely large datasets Ashok Sharma, Robert Podolsky, Jieping.
Preprocessing for Hyperspectral Analysis
Improving the Performance of Fingerprint Classification
Hyperspectral Analysis Techniques
Outlier Processing via L1-Principal Subspaces
Orthogonal Subspace Projection - Matched Filter
Amin Zehtabian, Hassan Ghassemian CONCLUSION & FUTURE WORKS
University College London (UCL), UK
Cheng-Ming Huang, Wen-Hung Liao Department of Computer Science
Hyperspectral Image preprocessing
Sparse Regression-based Hyperspectral Unmixing
Mirza Muhammad Waqar PhD Scholar Website:
Presentation transcript:

Noise-Robust Spatial Preprocessing Prior to Endmember Extraction from Hyperspectral Data Gabriel Martín, Maciel Zortea and Antonio Plaza Hyperspectral Computing Laboratory Department of Technology of Computers and Communications University of Extremadura, Cáceres, Spain Contact – URL:

Talk Outline: 1. Introduction to spectral unmixing of hyperspectral data 2. Spatial preprocessing prior to endmember extraction 2.1. Spatial preprocessing (SPP) 2.2. Region-based spatial preprocessing (RBSPP) 2.3. Noise-robust spatial preprocessing (NRSPP) 3. Experimental results 3.1. Synthetic hyperspectral data 3.2. Real hyperspectral data over the Cuprite mining district, Nevada 4. Conclusions and future research lines 1. Introduction to spectral unmixing of hyperspectral data 2. Spatial preprocessing prior to endmember extraction 2.1. Spatial preprocessing (SPP) 2.2. Region-based spatial preprocessing (RBSPP) 2.3. Noise-robust spatial preprocessing (NRSPP) 3. Experimental results 3.1. Synthetic hyperspectral data 3.2. Real hyperspectral data over the Cuprite mining district, Nevada 4. Conclusions and future research lines Noise-Robust Spatial Preprocessing for Endmember Extraction IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011

Presence of mixed pixels in hyperspectral data Some particularities of hyperspectral data not to be found in other remote sensing data: Mixed pixels (due to insufficient spatial resolution and mixing effects in surfaces) Intimate mixtures (happen at particle level; increasing spatial resolution does not address them) Introduction to Spectral Unmixing of Hyperspectral Data 1 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011

Introduction to Spectral Unmixing of Hyperspectral Data 2 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011 Linear spectral unmixing (LSU) The goal is to find extreme pixel vectors (endmembers) that can be used to unmix other mixed pixels in the data using a linear mixture model Each mixed pixel can be obtained as a combination of endmember fractional abundances; a crucial issue is how to find the endmembers Band a Band b

Using spatial information in endmember extraction Much effort has been given to extracting endmembers in spectral terms Endmember extraction does not generally include information about spatial context There is a need to incorporate the spatial correlation of features in the unmixing process We develop a new strategy to include spatial information in endmember extraction The method works as a pre-processing module (easy to combine with available methods) Pixel spatial coor- dinates randomly shuffled Endmember extraction Same output results Introduction to Spectral Unmixing of Hyperspectral Data 3 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011

Talk Outline: 1. Introduction to spectral unmixing of hyperspectral data 2. Spatial preprocessing prior to endmember extraction 2.1. Spatial preprocessing (SPP) 2.2. Region-based spatial preprocessing (RBSPP) 2.3. Noise-robust spatial preprocessing (NRSPP) 3. Experimental results 3.1. Synthetic hyperspectral data 3.2. Real hyperspectral data over the Cuprite mining district, Nevada 4. Conclusions and future research lines 1. Introduction to spectral unmixing of hyperspectral data 2. Spatial preprocessing prior to endmember extraction 2.1. Spatial preprocessing (SPP) 2.2. Region-based spatial preprocessing (RBSPP) 2.3. Noise-robust spatial preprocessing (NRSPP) 3. Experimental results 3.1. Synthetic hyperspectral data 3.2. Real hyperspectral data over the Cuprite mining district, Nevada 4. Conclusions and future research lines Noise-Robust Spatial Preprocessing for Endmember Extraction IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011

Spatial Pre-Processing (SPP) Developed by Zortea and Plaza (IEEE Trans. Geosci. Remote Sens., 2009) 1.Move a spatial kernel around each hyperspectral pixel vector and calculate a spatial correction factor for each pixel 2.Assign a weight to the spectral signature of each pixel depending on the spectral similarity between each pixel and its spatial neighbors, so that anomalous pixels are displaced to the centroid, while spatially homogeneous pixels are not displaced Spatial Preprocessing Prior to Endmember Extraction 4 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011

e1e1e1e1 e3e3e3e3 e2e2e2e2 Band X Band Y Spatial Pre-Processing (SPP) Developed by Zortea and Plaza (IEEE Trans. Geosci. Remote Sens., 2009) 1.Move a spatial kernel around each hyperspectral pixel vector and calculate a spatial correction factor for each pixel 2.Assign a weight to the spectral signature of each pixel depending on the spectral similarity between each pixel and its spatial neighbors, so that anomalous pixels are displaced from the centroid, while spatially homogeneous pixels are not displaced 3.Apply spectral-based endmember extraction (using, e.g., OSP, VCA or N-FINDR) after the preprocessing, obtaining a final set of endmembers from the original image Spatial Preprocessing Prior to Endmember Extraction 4 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011

Estimation of the number of endmembers p Hyperspectral image with n spectral bands Several possibilities: Chang’s VD; Bioucas’ HySime; Luo and Chanussot’s eigenvalue approach Spatial Preprocessing Prior to Endmember Extraction 5 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011 Region-Based Spatial Pre-Processing (RBSPP) Developed by Martín and Plaza (IEEE Geosci. Remote Sens. Lett., 2011)

Hyperspectral image with n spectral bands Estimation of the number of endmembers p Unsupervised clustering ISODATA is used to partition the original image into c clusters, where c min = p and c max =2 p Spatial Preprocessing Prior to Endmember Extraction 5 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011 Region-Based Spatial Pre-Processing (RBSPP) Developed by Martín and Plaza (IEEE Geosci. Remote Sens. Lett., 2011)

Morphological erosion and redundant region thinning Hyperspectral image with n spectral bands Estimation of the number of endmembers p Unsupervised clustering Intended to remove mixed pixels at the region borders; multidimensional morphological operators are used to accomplish this task Spatial Preprocessing Prior to Endmember Extraction 5 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011 Region-Based Spatial Pre-Processing (RBSPP) Developed by Martín and Plaza (IEEE Geosci. Remote Sens. Lett., 2011)

Region selection using orthogonal projections Hyperspectral image with n spectral bands Estimation of the number of endmembers p Unsupervised clustering Morphological erosion and redundant region thinning An orthogonal subspace projection approach is then applied to the mean spectra of the regions to retain a final set of p regions Spatial Preprocessing Prior to Endmember Extraction 5 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011 Region-Based Spatial Pre-Processing (RBSPP) Developed by Martín and Plaza (IEEE Geosci. Remote Sens. Lett., 2011)

Preprocessing module Hyperspectral image with n spectral bands Estimation of the number of endmembers p Unsupervised clustering Morphological erosion and redundant region thinning Region selection using orthogonal projections Automatic endmember extraction and unmixing p fully cons- trained abun- dance maps (one per endmember) Spatial Preprocessing Prior to Endmember Extraction 5 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011 Region-Based Spatial Pre-Processing (RBSPP) Developed by Martín and Plaza (IEEE Geosci. Remote Sens. Lett., 2011)

Noise-robust spatial preprocessing (NRSPP) The method first derives a spatial homogeneity index which is relatively insensitive to the noise present in the original hyperspectral data; then, it fuses this index with a spectral-based classification, obtaining a set of pure regions which are used to guide the endmember searching process Step 1: Apply multidimensional Gaussian filtering using different scales, which results in different filtered versions of the original hyperspectral image Spatial Preprocessing Prior to Endmember Extraction 6 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011

Noise-robust spatial preprocessing (NRSPP) Step 2: Calculate the root mean square error (RMSE) between the original image and each of the filtered images and derive a spatial homogeneity index as the average of the obtained difference values; such spatial homogeneity calculation is robust in the presence of noise Spatial Preprocessing Prior to Endmember Extraction 7 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011

Noise-robust spatial preprocessing (NRSPP) Step 3: Perform a spectral-based unsupervised classification of the original image; here, we use the ISODATA algorithm, where the number of components retained was set to p, the number of endmembers Step 4: For each cluster in the classification map, a percentage (alpha) of spatially homogeneous pixels are selected; then, we apply the OSP algorithm over the averaged signatures in each resulting region to select the most highly pure regions (removing those which contain mixed pixels) Endmember extraction is finally applied to the pixels retained after the NRSPP, which acts as a pre-processing module (as the SPP and RBSPP) Spatial Preprocessing Prior to Endmember Extraction 8 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011

Talk Outline: 1. Introduction to spectral unmixing of hyperspectral data 2. Spatial preprocessing prior to endmember extraction 2.1. Spatial preprocessing (SPP) 2.2. Region-based spatial preprocessing (RBSPP) 2.3. Noise-robust spatial preprocessing (NRSPP) 3. Experimental results 3.1. Synthetic hyperspectral data 3.2. Real hyperspectral data over the Cuprite mining district, Nevada 4. Conclusions and future research lines 1. Introduction to spectral unmixing of hyperspectral data 2. Spatial preprocessing prior to endmember extraction 2.1. Spatial preprocessing (SPP) 2.2. Region-based spatial preprocessing (RBSPP) 2.3. Noise-robust spatial preprocessing (NRSPP) 3. Experimental results 3.1. Synthetic hyperspectral data 3.2. Real hyperspectral data over the Cuprite mining district, Nevada 4. Conclusions and future research lines Noise-Robust Spatial Preprocessing for Endmember Extraction IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011

Synthetic Image Generation The scenes have been generated using fractals to generate random spatial patterns Each fractal image is divided into a set of classes or clusters Mixed pixels are generated inside each cluster using library signatures Spectral signatures obtained from a library of mineral spectral signatures available online from U.S. Geological Survey (USGS) – Random noise in different signal-to-noise ratios (SNRs) is added to the scenes Experimental Results with Synthetic and Real Hyperspectral Data 9 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011

Synthetic Image Generation Database available online: Experimental Results with Synthetic and Real Hyperspectral Data 10 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011

Experiments with Synthetic Images Average spectral angle (degrees) between ground-truth USGS spectra and the endmembers extracted across five synthetic scenes with different SNRs (alpha=70) RMSE after reconstructing the five synthetic scenes (with different SNRs) using the endmembers extracted by OSP (alpha=70) Experimental Results with Synthetic and Real Hyperspectral Data 11 IEEE International Geoscience and Remote Sensing Symposium (IGARSS 2011), Vancouver, Canada, July 24 – 29, 2011

AVIRIS Data Over Cuprite, Nevada Experimental Results with Synthetic and Real Hyperspectral Data 12 IEEE International Geoscience and Remote Sensing Symposium (IGARSS’2011), Vancouver, Canada, July 24 – 29, 2011

Experiments with the AVIRIS Cuprite hyperspectral image OSP (81 seconds)AMEE (96 seconds)SSEE (320 seconds) SPP+OSP (49+81 seconds)RBSPP+OSP (78+14 seconds)NRSPP+OSP (71+12 seconds) Experimental Results with Synthetic and Real Hyperspectral Data 13 IEEE International Geoscience and Remote Sensing Symposium (IGARSS’2011), Vancouver, Canada, July 24 – 29, 2011 RMSE=0.165 RMSE=0.265 RMSE=0.101 RMSE=0.067 RMSE=0.085 RMSE=0.129 Times measured in Intel Core i7 920 CPU at 2.67 GHz with 4 GB OF RAM (p = 22)

Conclusions and Future Lines.- We have developed a new spatial pre-processing method which can be used prior to endmember extraction and spectral unmixing of hyperspectral images The proposed method shows some advantages over other existing approaches, in particular, when the noise level in the hyperspectral data is relatively high The results obtained with synthetic scenes anticipate that the incorporation of spatial information may be beneficial in order to allow a better modelling of spatial patterns and robustness in the presence of noise The results obtained with real scenes indicate that the incorporation of spatial information directs the endmember searching process to spatially homogeneous regions in the original hyperspectral scene Future work will be directed towards comparisons with multiple endmember spectral mixture analysis techniques (comparable in terms of abundance estimation accuracy but more complex in computational terms) Conclusions and Hints at Plausible Future Research IEEE International Geoscience and Remote Sensing Symposium (IGARSS’09), Cape Town, South Africa, July 12 – 17,

IEEE J-STARS Special Issue on Hyperspectral Image and Signal Processing IEEE International Geoscience and Remote Sensing Symposium (IGARSS’09), Cape Town, South Africa, July 12 – 17,

Noise-Robust Spatial Preprocessing Prior to Endmember Extraction from Hyperspectral Data Gabriel Martín, Maciel Zortea and Antonio Plaza Hyperspectral Computing Laboratory Department of Technology of Computers and Communications University of Extremadura, Cáceres, Spain Contact – URL: