1. Digital Imaging and Remote Sensing Laboratory Real-World Stepwise Spectral Unmixing Daniel Newland Dr. John Schott Digital Imaging and Remote Sensing Laboratory Center for Imaging Science May 7, 1999

2. Digital Imaging and Remote Sensing Laboratory OutlineOutline Objective Unmixing Background Data and Preparation Results Conclusions

3. Digital Imaging and Remote Sensing Laboratory ObjectiveObjective Use real data to verify a stepwise spectral unmixing routine tested only on synthetic data –Compare to traditional spectral unmixing –Compare to hierarchical spectral unmixing Hyperspectral DataMaterial Fraction Maps

4. Digital Imaging and Remote Sensing Laboratory OutlineOutline Objective Unmixing Background Data and Preparation Results Conclusions

5. Digital Imaging and Remote Sensing Laboratory Operating Scenario Remote sensing by airborne or spaceborne imagers Finite flux reaching sensor causes spatial-spectral resolution trade-off Hyperspectral data has hundreds of bands of spectral information Spectrum characterization allows subpixel analysis and material identification

6. Digital Imaging and Remote Sensing Laboratory Spectral Mixture Analysis Assumes reflectance from each pixel is caused by a linear mixture of subpixel materials Mixed Spectrum Example

7. Digital Imaging and Remote Sensing Laboratory Mixed Pixels and Material Maps Input Image 1.0 0.0 0.5 1.00.0 0.5 Red Fraction Map Green Fraction Map UNMIXED PURE MIXED

8. Digital Imaging and Remote Sensing Laboratory i = 1 … k Constraint Conditions Unconstrained: Partially Constrained: Fully Constrained: Traditional Linear Unmixing

9. Digital Imaging and Remote Sensing Laboratory Unmixes broad material classes first Proceeds to a group’s constituents only if the unmixed fraction is greater than a given threshold Hierarchical Linear Unmixing Example Materials Hierarchy Full Library Concrete Metal Water Deciduous Trees Coniferous Trees Grass

10. Digital Imaging and Remote Sensing Laboratory Stepwise Unmixing Employs linear unmixing to find fractions Uses iterative regressions to accept only the endmembers that improve a statistics-based model Shown to be superior to classic linear method –Has better accuracy –Can handle more endmembers Quantitatively tested only on synthetic data

11. Digital Imaging and Remote Sensing Laboratory Performance Evaluation Compare squared error from traditional, stepwise and hierarchical methods Visually assess fraction maps for accuracy Error Metric:

12. Digital Imaging and Remote Sensing Laboratory OutlineOutline Objective Unmixing Background Data and Preparation Results Conclusions

13. Digital Imaging and Remote Sensing Laboratory Data and Preparation Used HYDICE collection over the ARM site –210 bands around 10nm in width –Covers wavelengths of 0.4 - 2.5 microns –Spatial resolution of 1.75 meters per pixel Processed original scene to generate unmixing input –Spatial averaging to form mixed pixels –Spectral subset to remove noise Constructed material library and truth map

14. Digital Imaging and Remote Sensing Laboratory HYDICE Scene Original 320 x 320 Convolved 80 x 80

15. Digital Imaging and Remote Sensing Laboratory Atmospheric Attenuation

16. Digital Imaging and Remote Sensing Laboratory Atmospheric Effects Band 108 1.4 microns Road Pixel Vegetation Pixel

17. Digital Imaging and Remote Sensing Laboratory Endmember Selection Endmembers are simply material types –Broad classification: road, grass, trees… –Fine classification: dry soil, moist soil... Used image-derived endmembers to produce spectral library –Average reference spectra from “pure” sample pixels –Chose 18 distinct endmembers

18. Digital Imaging and Remote Sensing Laboratory Endmember Listing Strong Road Weak Road Panel 2k Panel 3k Panel 5k Panel 8k Panel 14k Panel 17k Panel 25k Spectral Panel Parking Lot Trees Strong Vegetation Medium Vegetation Weak Vegetation Strong Cut Vegetation Medium Cut Vegetation Weak Cut Vegetation False-Color IR

19. Digital Imaging and Remote Sensing Laboratory Materials Hierarchy Grouped similar materials into 3-level hierarchy – Level 1 – Level 2 – Level 3

20. Digital Imaging and Remote Sensing Laboratory Truth Map Creation Realistic classification required automated procedure Tested classification routines available in ENVI Chose Minimum Distance to the Mean classifier

21. Digital Imaging and Remote Sensing Laboratory Truth Map False-Color IR Classified Scene

22. Digital Imaging and Remote Sensing Laboratory Truth Detail Test Site Trees Parking Lot

23. Digital Imaging and Remote Sensing Laboratory Tools for Analysis Data processed with ENVI and IDL Three unmixing routines written in IDL IDL support programs

24. Digital Imaging and Remote Sensing Laboratory OutlineOutline Objective Unmixing Background Data and Preparation Results Conclusions

25. Digital Imaging and Remote Sensing Laboratory Truth Fraction Maps Labels Fractions

26. Digital Imaging and Remote Sensing Laboratory Linear Unmixing Linear Truth

27. Digital Imaging and Remote Sensing Laboratory Hierarchical Unmixing Hierarchical Truth

28. Digital Imaging and Remote Sensing Laboratory Stepwise Unmixing Stepwise Truth

29. Digital Imaging and Remote Sensing Laboratory Fraction Maps Material Truth Linear Hierarch. Stepwise Panel 3k Uncut Mid Vegetation Cut Weak Vegetation

30. Digital Imaging and Remote Sensing Laboratory Linear Color Maps

31. Digital Imaging and Remote Sensing Laboratory Hierarchical Color Maps

32. Digital Imaging and Remote Sensing Laboratory Stepwise Color Maps

33. Digital Imaging and Remote Sensing Laboratory Histogram Comparison Linear Hierarchical Stepwise

34. Digital Imaging and Remote Sensing Laboratory Squared Error Results

35. Digital Imaging and Remote Sensing Laboratory Hierarchical Results

36. Digital Imaging and Remote Sensing Laboratory OutlineOutline Objective Unmixing Background Data and Preparation Results Conclusions

37. Digital Imaging and Remote Sensing Laboratory ConclusionsConclusions Linear unmixing does poorly, forcing fractions for all materials Hierarchical approach performs better but requires extensive user involvement Stepwise routine succeeds using adaptive endmember selection without extra preparation

38. Digital Imaging and Remote Sensing Laboratory Special Thanks Dr. John Schott Daisei Konno Lee Sanders Francois Alain

39. Digital Imaging and Remote Sensing Laboratory Questions?Questions? False-Color IR Stepwise Unmixed Fraction Maps