1. Perceptual Loss Deep Feature Interpolation for Image Content Changes
Upchurch P, Gardner J, Bala K, et al. arXiv 2016.
Perceptual Losses for Real-Time Style Transfer and Super-Resolution
Johnson J, Alahi A, Fei-Fei L. ECCV citation:43

2. Outline What’s Perceptual Loss
Image Content Changes and Style Transfer
Style Transfer
Real-Time Style Transfer
Features Interpolation for Image Content Changes

3. Outline What’s Perceptual Loss
Image Content Changes and Style Transfer
Style Transfer
Real-Time Style Transfer
Features Interpolation for Image Content Changes

4. What’s Perceptual Loss
Perceptual Loss : differences between high-level image feature presentations
extracted from pre-trained CNN

5. What’s Perceptual Loss
Perceptual Loss : differences between high-level image feature presentations
extracted from pre-trained CNN
groundtruth
MSE:
MSE:

6. Pixel-level Loss failed to capture perceptual differences!
What’s Perceptual Loss
Perceptual Loss : differences between high-level image feature presentations
extracted from pre-trained CNN
Pixel-level Loss failed to capture perceptual differences!
groundtruth
MSE:
MSE:

7. Outline What’s Perceptual Loss
Image Content Changes and Style Transfer
Style Transfer
Real-Time Style Transfer
Features Interpolation for Image Content Changes

8. Outline What’s Perceptual Loss
Image Content Changes and Style Transfer
Style Transfer
Real-Time Style Transfer
Features Interpolation for Image Content Changes

9. Style Transfer

12. Content loss:

13. Content loss:
Style loss:

14. Content loss:
Style loss:
Total loss:

19. Outline What’s Perceptual Loss
Image Content Changes and Style Transfer
Style Transfer
Real-Time Style Transfer
Features Interpolation for Image Content Changes

20. Outline What’s Perceptual Loss
Image Content Changes and Style Transfer
Style Transfer
Real-Time Style Transfer
Features Interpolation for Image Content Changes

24. Content loss:

25. Content loss:
Style loss:

26. Content loss:
Style loss:
Total variation loss: loss

27. Content loss:
Style loss:
Total variation loss: loss
Total:

32. Outline What’s Perceptual Loss
Image Content Changes and Style Transfer
Style Transfer
Real-Time Style Transfer
Features Interpolation for Image Content Changes

33. Outline What’s Perceptual Loss
Image Content Changes and Style Transfer
Style Transfer
Real-Time Style Transfer
Features Interpolation for Image Content Changes

34. Aging: Facial Attribute:
Deep Feature Interpolation for Image Content Changes
Aging:
Facial Attribute:

35. This demonstration of unsupervised generative models learning object attributes like scale, rotation, position, and semantics was one of the first.

36. Step 1: Map target and source images into deep feature space:

37. Step 1: Map target and source images into deep feature space:
Step 2: Compute attribute vector:

38. Step 1: Map target and source images into deep feature space:
Step 2: Compute attribute vector:
Step 3: Interpolate test image:

39. Step 1: Map target and source images into deep feature space:
Step 2: Compute attribute vector:
Step 3: Interpolate test image:
Step 4: Reverse mapping:

40. Reverse mapping:

45. Thank you