1. Andrew Ng Feature learning for image classification Kai Yu and Andrew Ng

2. Andrew Ng Computer vision is hard

3. Andrew Ng Machine learning and feature representations Input Input space Motorbikes “Non”-Motorbikes Learning algorithm pixel 1 pixel 2 pixel 1 pixel 2

4. Andrew Ng Machine learning and feature representations Input Input space Feature space Motorbikes “Non”-Motorbikes Feature representation Learning algorithm pixel 1 pixel 2 “wheel” “handle” handle wheel

5. Andrew Ng How is computer perception done? Image Low-level vision features Recognition Image Grasp point Low-level features Low-level state features Action Helicopter Audio Low-level audio features Speaker identification Object detection Audio classification Helicopter control

6. Andrew Ng Learning representations Sensor Learning algorithm Feature Representation

7. Andrew Ng Computer vision features SIFT Spin image HoG RIFT Textons GLOH

8. Andrew Ng Audio features ZCR Spectrogram MFCC Rolloff Flux Problems of hand-tuned features 1. Needs expert knowledge 2. Time-consuming and expensive 3. Does not generalize to other domains

9. Andrew Ng Computer vision is more than pictures Camera array 3d range scan (laser scanner) 3d range scans (flash lidar) Audio Can we automatically learn good feature representations? Images Visible light image Thermal Infrared Key question: Can we automatically learn a good feature representation? Video

10. Andrew Ng Learning representations Sensor Learning algorithm Feature Representation

11. Andrew Ng Sensor representation in the brain [BrainPort; Martinez et al; Roe et al.] Seeing with your tongue Human echolocation (sonar) Auditory cortex learns to see. Auditory Cortex

12. Andrew Ng Unsupervised feature learning Find a better way to represent images than pixels.

13. Andrew Ng The goal of Unsupervised Feature Learning Unlabeled images Learning algorithm Feature representation

14. Andrew Ng Tutorial outline 1. Current methods. 2. Sparse coding for feature learning. — Break — 3. Advanced classification. 4. Advanced concepts & deep learning.