URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR P.Gamba, A. Villa, A. Plaza, J. Chanussot, J. A. Benediktsson

OUTLINE 1) Introduction 2) The EnMap sensor 3) Experimental test 4) Conclusions and perspectives

INTRODUCTION Urban remote sensing is a crucial task : Monitoring cities development Infrastructure extraction Land cover mapping  Satellites provide cheap and timely data Main challenges : Urban land cover classes not well distinct Heterogeneous areas lead to mixed pixels Can hyperspectral data be helpul for such a task?

INTRODUCTION Can hyperspectral data be helpul for urban monitoring? Pro: very detailed spectral information of the scene Con: tradeoff between spectral and spatial resolution (~tens of meters) A number of hyperspectral missions already planned: PRISMA – ASI, 2014 (spatial res: 30 m) EnMap – DLR, 2014 (spatial res: 30 m) Hyper-J (JAXA) and HyspIRI (NASA) in the next future.. Need to assess the effectiveness of hyperspectral data for urban monitoring!

AIM OF THE WORK Preliminary investigation of hyperspectral sensors potentialities: - Can urban structures be monitored with hyperspectral sensors? - Is the rich spectral information of hyperspectral data useful for such a task? Two main issues addressed: 1) Creation of realistic urban scenes by considering EnMap PSF 2) Comparison with classical and advanced methods

OUTLINE 1) Introduction 2) The EnMap sensor 3) Experimental test 4) Conclusions and perspectives

EnMap mission Dedicated imaging pushbroom hyperspectral sensor mainly based on modified existing or pre-developed technology Broad spectral range from 420 nm to 1000 nm (VNIR) and from 900 nm to 2450 nm (SWIR) with high radiometric resolution and stability in both spectral ranges Swath width 30km at high spatial resolution of 30 m x 30 m and off-nadir (30°) pointing feature for fast target revisit (4 days) Sufficient on-board memory to acquire km swath length per orbit and a total of km per day. S. Kaiser, B. Sang, J. Schubert, S. Hofer and T. Stuffler: "Compact prism spectrometer of pushbroom type for hyperspectral imaging", Proc. SPIE Conf. Imaging Spectrometry XIII, vol. 7100, p , 2008.

SYNTHETIC REALISTIC IMAGES Original image Low resolution image EnMap PSF (900 nm) Spatial resolution degradation 1)Create realistic hyperspectral images by downscaling the spatial resolution according to the EnMap PSF

Low resolution image SVM SVM-SU 1 1.Villa et al., Spectral Unmixing to obtain classification maps at a finer resolution, Journal of Selected Topics in Signal Processing, 2011 Classification map Classification map at finer resolution CLASSIFICATION COMPARISON 2) Evaluate the performances of traditional methods and sub-pixel techniques in terms of land cover classification

SVM - SU SVM – Spectral Unmixing (*) : 1)Probabilistic SVM determines which pixels can be considered as pure (if prob > treshold) 2) Spectral unmixing is used to retrieve class abundances within mixed pixels 3) Final spatial regularization (*) A. Villa, J. Chanussot, J.A. Benediktsson and C. Jutten., Spectral Unmixing to obtain classification maps at a finer resolution, Journal of Selected Topics in Signal Processing, vol. 5, n. 3, May 2011

SVM - SU SVM – Spectral Unmixing: 1)Probabilistic SVM determines which pixels can be considered as pure (if prob > treshold) 2) Spectral unmixing is used to retrieve class abundances within mixed pixels and to fill “upsampled” sub-pixels 3) Final spatial regularization

SVM - SU SVM – Spectral Unmixing: 1)Probabilistic SVM determines which pixels can be considered as pure (if prob > threshold) 2) Spectral unmixing is used to retrieve class abundances within mixed pixels and to fill “upsampled” sub-pixels 3) Final spatial regularization is performed (Cost function to be minimized: total perimeter of the connected areas ) The results is a thematic map at a finer resolution  useful to assess possibilities offered by HSI at low-medium spatial resolution.

OUTLINE 1) Introduction 2) The EnMap sensor 3) Experimental test 4) Conclusions and perspectives

DATA SET ROSIS Center data set: 1096 x 712 pixels, 102 spectral bands Spatial resolution: 1.3 meters Spatial resolution decreased of a factor 3 and 5 Classification with SVM and SVM-SU, 100 samples per class.

Reference data SVMSVM-SU ROSIS Center (3x downscale) OA (%) Δ (%) ROSIS Center (5x downscale) OA (%) Δ (%) EXPERIMENTS

THEMATIC MAPS SVM on original HR data (ground truth) SVM on LR data 70.97% Finer Classification 74.32%

SVM on original HR data (ground truth) SVM on LR data 70.97% Finer Classification 74.32% THEMATIC MAPS

EXPERIMENTS Preliminary conclusions -- Even slight spatial resolution degradation leads to a significant classification accuracy decrease -- Sub-pixel information of HSI is helpful to improve classification accuracy -- Potentialities of hyperspectral data depend on the desired application

OUTLINE 1) Introduction 2) The EnMap sensor 3) Experimental test 4) Conclusions and perspectives

CONCLUSIONS Conclusions -- Low spatial resolution is a major challenge in urban environment → Hard to perform urban monitoring with hyperspectral sensors -- Additional spectral information useful if properly exploited → Need for advanced techniques to study sub-pixel information Perspectives - Consider more realistic models (more PSFs, geometric distortions..) - Investigate lower spatial resolution (comparable to HSI) - Further investigations of the possibilities offered by sub-pixel methods