1 Challenge the future Coastal Image Classification Bas Hoonhout, Max Radermacher, Fedor Baart
2 Challenge the future Coastal Image Classification
3 Challenge the future Why is it useful?
4 Challenge the future How does it work? 1.Segmentation (superpixels) Create clusters of pixels with similar intrinsic properties 2.Feature extraction Extract as much information as possible from superpixels 3.Model construction and training Train a model to discriminate between classes using features 4.Model prediction Predict classification of an unseen image
5 Challenge the future Step 1: segmentation (superpixels) Intensity:R, G, B, C, Y, M, K, … Position: N, M … and gradients and filters Intensity, position and gradients Shape, texture, … Variance, frequency, …
6 Challenge the future Step 2: feature extraction
7 Challenge the future Step 2: feature extraction 16 channels and 1727 features per superpixel
8 Challenge the future Step 3: model construction and training
9 Challenge the future Step 3: model construction and training C 00 f1f1 …fKfK … f1f1 …fKfK C 0M f1f1 …fKfK … f1f1 …fKfK … f1f1 …fKfK … f1f1 …fKfK CN0CN0 f1f1 …fKfK … f1f1 …fKfK C NM f1f1 …fKfK C 00 f1f1 …fKfK … f1f1 …fKfK C 0M f1f1 …fKfK … f1f1 …fKfK … f1f1 …fKfK … f1f1 …fKfK CN0CN0 f1f1 …fKfK … f1f1 …fKfK C NM f1f1 …fKfK Ψ 01 Ψ 0M … … Ψ N1 ΨNMΨNM Ψ10Ψ10 …Ψ1MΨ1M ΨN0ΨN0... ΨNMΨNM
10 Challenge the future Step 3: model construction and training pixel intensity seabeach
11 Challenge the future Step 3: model construction and training hue saturation
12 Challenge the future Step 3: model construction and training et cetera, until we have a 1727-dimensional feature space
13 Challenge the future Step 4: model prediction hue saturation sea beach
14 Challenge the future Performance Ongoing research! 192 manually annotated Argus images doi: /uuid: cb2-a7ec-9ed2937db119 Training set 75%, test set 25% Last benchmark test: >90% correct Target benchmark test: >95% correct
15 Challenge the future Take home messages Classify coastal images? Spend your creativity on features! Classify large datasets? Go for full automation! What would you do with 95% accurate, automated classification of coastal images? flamingo.tudelft.nl openearth.nl