Lensless Imaging with A Controllable Aperture Assaf Zomet and Shree K. Nayar Columbia University IEEE CVPR Conference June 2006, New York, USA
Cameras Today Lens Plane in focus Image Detector Aperture
Attenuating Aperture Our Lensless Camera Image Detector Volumetric
Multilayer Aperture Layered Aperture Image Detector Attenuating apertures: Farid&Simoncelli ‘97, Nayar&Branzoi ‘03
Implementation Camera bodyAperture: LCD LCD Control
Image Detector Attenuating Layer Pinhole Controllable Pinhole Image Detector Pinhole Attenuating Layer
Controllable Pinhole: Video
Limitations of Lensless Imaging Optimal pinhole (Raleigh): Brightness: f-number Sharpness and brightness increase with FOV (image center).
Limitations of Lensless Imaging Optimal pinhole (Raleigh): Brightness: f-number Sharpness and brightness increase with FOV (image center). f and detector larger by factor k : Resolution/brightness by.
Zand, 1992 Collecting More Light: Coded Apertures
Conventional View Desired View
Split Field of View: Implementation Attenuating Layers (2nd layer physical) Image Detector Pinhole Fov 2 Fov 1 Fov 3
Split Field of View: Results Lens camera Our camera
Split Field of View: Video
Finding Faces Wasted pixels
Finding Faces
Pinhole Attenuating Layers (2 nd layer physical) Split Image: Computational Camera Correlation pattern Image Detector
Computations in the Optics Our cameraLens camera Correlation Pattern Normalized correlation: ImagePattern Noncoherent optical processing (Rogers 1977)
A Camera as a Mapping Camera Optics
Imaging Formulation: One Layer f
Imaging Formulation: Multilayer fjfj
Varying Zoom Conventional view Desired view H H LL L L
Varying Zoom Mapping Desired view Scene M X and M X are impossible to implement with 3 layers
Attenuating Layers Image Detector Fov 1Fov 3 Pinhole Fov 2 Varying Zoom: Imaging (simulation) Captured Desired
Varying Zoom: Reconstruction I computed I capturted
Summary Controllable Pinhole Computational CameraSpatially Varying Zoom Split Field of View Programmable cameras, Nayar, Branzoi & Boult 2004