1. Eye Tracking for Personalized Photography Steven Scher (UCSC student) James Davis (UCSC advisor) Sriram Swaminarayan (LANL advisor)

2. Who’s Behind the Camera? Photo Creative Commons http://www.flickr.com/photos/jasonpratt

3. Who’s Behind the Camera? Photo Creative Commons http://www.flickr.com/photos/scobleizer

4. Human-Computer Hybrid Computation Photo Creative Commons http://www.flickr.com/photos/m500/ Photo Creative Commons http://www.flickr.com/photos/popculturegeek Photo Creative Commons http://www.flickr.com/photos/aloha75

5. Human-Computer Hybrid Computation Semi-automated “Photoshop” effects Rotoscoping – Keyframe-Based Tracking for Rotoscoping and Animation Tone Mapping – Interactive local adjustment of tonal values

6. Human-Computer Hybrid Computation Amazon Mechanical Turk Object Recognition as “20 questions” – Visual Recognition with Humans in the Loop Object Tracking – Efficiently Scaling Up Video Annotation with Crowdsourced Marketplaces

7. Human-Computer Hybrid Computation Eyetrack-automated “Photoshop” effects Cropping – Gaze-Based Interaction for Semi-Automatic Photo Cropping

8. Saliency: What is this a picture of?

9. Automatic Saliency Detection Harel et al

10. Saliency Itti, Koch, & Niebur A Model of Saliency-based Visual Attention for Rapid Scene Analysis Harel, Koch, & Perona Graph Based Visual Saliency Feature extraction Activation Normalization Summation

11. Saliency: Who is this a picture of?

12. Eye Tracking Half-Mirror Infrared camera Infrared Light

13. Future Expectations: EyeTracker in Camera Viewfinder Viewfinder Camera

14. Future Expectations: EyeTracker in Camera Viewfinder Canon EOS A2 “Eye Controlled Focus” 1992

15. Photo Creative Commons http://www.flickr.com/photos/1080p/

16. Eye Tracks (1kHz)

17. Eye Tracking Seconds after finishing calibration Eye Tracking Error (pixels) on 800x600 screen

18. Eye Tracks (1kHz)

19. Gaussian Weighted According to Eyetracker’s Calibration accuracy

20. Logarithmically Flattened

21. Automatic Saliency Detection Itti et al

22. Automatic Saliency Detection Harel et al

23. Actual Eyetrack

24. Automatic Saliency Detection Itti et al

25. Automatic Saliency Detection Harel et al

26. Actual Eyetrack

27. Applications Selective DefocusContent-Aware Retargeting

28. Applications Selective DefocusContent-Aware Retargeting

29. Applications Selective DefocusContent-Aware Retargeting

30. Applications Selective DefocusContent-Aware Retargeting

31. Original Image

32. Selectively Defocused

36. Applications Selective DefocusContent-Aware Retargeting

37. Content Aware Retargeting

38. New Aspect Ratio

39. Content Aware Retargeting

40. Seam Carving Remove one pixel from each row

46. New Aspect Ratio

47. Original Image

48. Simple Resizing

50. Actual Eyetracks

51. Eyetrack-based content-aware resizing

52. Simple resizing

53. Original Image

54. Automatic Saliency

55. Actual Eye Track

56. Content-Aware Resizing Based on Automatic Saliency

57. Content-Aware Resizing Based on Eye Tracks