1. Projection Defocus Analysis for Scene Capture and Image Display Li Zhang Shree Nayar Columbia University IIS-00-85864 SIGGRAPH Conference July 2006, Boston, USA

2. Modeling Complex Scenes is Hard Courtesy of Maia C @ flickr.com

3. LimitationGoal The Limits of 3D Photography Scene Depth Map Structured Light & Stereo Depth from Camera Defocus Photometric Stereo Missing Data near Occlusions Inaccurate at Discontinuities Only for Single Surface Image-CompleteAccurate for Complex Scenes

4. Projection Defocus Analysis Projector Defocus Model Robust Depth Recovery Image Refocusing Video Composition Enhanced Image Display Increasing Depth of Field Depixelation

5. Camera Defocus Cue Courtesy of Koesbong @ flickr.com

6. Limitation of Depth from Camera Defocus Focal Plane Surface Camera Camera Defocus:

7. Depth from Projector Defocus Focal Plane Lamp Projector

8. Depth from Projector Defocus Focal Plane Lamp Surface Projector

9. Depth from Projector Defocus Focal Plane Lamp Surface Projector Projector Defocus:

10. Camera Defocus vs. Projector Defocus Projector Defocus: Camera Defocus:

11. Temporal Defocus Method Focal Plane Lamp Shift Surface Projector Camera Projector Defocus Model:

12. Experimental Setup Projector Half-mirror Camera Projector Camera Half-mirror

13. Experimental Setup Projector Half-mirror Camera

14. Books and Gate: Sharp Discontinuities SceneDepth Map 3D Model

15. Books and Gate: Sharp Discontinuities SceneDepth Map Refocus on Gate +

16. Books and Gate: Sharp Discontinuities SceneDepth Map Refocus on Back +

17. Application: Refocus Synthesis

18. Wrestlers: Curved and Specular Surfaces SceneDepth Map 3D Model

19. Fence and Leaves: Complex Occlusions SceneDepth Map 3D Model

20. Application: Refocus Synthesis

21. Playing Cards: Object Insertion SceneDepth Map Green Screen Capture Depth-based Composition

22. Projection Defocus Analysis Projector Defocus Model Robust Depth Recovery Image Refocusing Video Composition Enhanced Image Display Increasing Depth of Field Depixelation

23. Focused Projection at Multiple Depths

24. A Multi-Projector Solution [Bimber & Emmerling 2006]

25. Focused Projection at Multiple Depths Our Single Projector Solution Defocus Compensation 30 inches 3 meters

26. ? ? Defocused Projection Original ImageCompensation Image Defocus Compensation Defocus Kernel

27. Compensation Image ? Defocused Projection Defocus Compensation Defocus Kernel Simple Sharpening Does NOT work. Result

28. ? Defocus Compensation Original Image Defocus Kernel Compensation Image

29. Compensated Projection Front PlaneMiddle PlaneBack Plane Original Image Compensation Results Normal Projection

30. Defocus-Based Depixelation Screen-Door Effect

31. Depixelation Results Depixelated Projection Original Image Normal Projection

32. Contributions Reducing Pixelation for Digital Projectors Increasing DoF without Changing Optics Estimating Depth from Projector Defocus

33. Limitations and Future Work Real-time Compensation Real-time Depth Recovery Translucency Acquisition Matte Estimation

34. The End