1. Lensless Imaging with A Controllable Aperture Assaf Zomet and Shree K. Nayar Columbia University IEEE CVPR Conference June 2006, New York, USA

2. Cameras Today Lens Plane in focus Image Detector Aperture

3. Attenuating Aperture Our Lensless Camera Image Detector Volumetric

4. Multilayer Aperture Layered Aperture Image Detector Attenuating apertures: Farid&Simoncelli ‘97, Nayar&Branzoi ‘03

5. Implementation Camera bodyAperture: LCD LCD Control

6. Image Detector Attenuating Layer Pinhole Controllable Pinhole Image Detector Pinhole Attenuating Layer

7. Controllable Pinhole: Video

8. Limitations of Lensless Imaging Optimal pinhole (Raleigh): Brightness: f-number Sharpness and brightness increase with FOV (image center).

9. Limitations of Lensless Imaging Optimal pinhole (Raleigh): Brightness: f-number Sharpness and brightness increase with FOV (image center). f and detector larger by factor k : Resolution/brightness by.

10. Zand, 1992 Collecting More Light: Coded Apertures

11. Conventional View Desired View

12. Split Field of View: Implementation Attenuating Layers (2nd layer physical) Image Detector Pinhole Fov 2 Fov 1 Fov 3

13. Split Field of View: Results Lens camera Our camera

14. Split Field of View: Video

15. Finding Faces Wasted pixels

16. Finding Faces

17. Pinhole Attenuating Layers (2 nd layer physical) Split Image: Computational Camera Correlation pattern Image Detector

18. Computations in the Optics Our cameraLens camera Correlation Pattern Normalized correlation: ImagePattern Noncoherent optical processing (Rogers 1977)

19. A Camera as a Mapping Camera Optics

20. Imaging Formulation: One Layer f

21. Imaging Formulation: Multilayer fjfj

22. Varying Zoom Conventional view Desired view H H LL L L

23. Varying Zoom Mapping Desired view Scene M X and M X are impossible to implement with 3 layers

24. Attenuating Layers Image Detector Fov 1Fov 3 Pinhole Fov 2 Varying Zoom: Imaging (simulation) Captured Desired

25. Varying Zoom: Reconstruction I computed I capturted

26. Summary Controllable Pinhole Computational CameraSpatially Varying Zoom Split Field of View Programmable cameras, Nayar, Branzoi & Boult 2004