Jason Holloway Aswin Sankaranarayanan Ashok Veeraraghavan Salil Tambe April 28, 2012.

Slides:



Advertisements
Similar presentations
PHOTOGRAPHY DSLR – The Basics!. CONTROL OF LIGHT, MOTION AND BACKGROUND  1. Shutter Speed (Dial TV) SHUTTER SPEED Shutter Speed is controlled by the.
Advertisements

Borough of Verona 2014 Using axis technology. Two Types of Day and Night Vision Technologies Wide dynamic range (WDR) describes an attribute of an imaging.
ISO, Aperture and Shutter Speed For Beginners. The photographer can control how much natural light reaches the sensor by adjusting the camera's ISO shutter.
CS-MUVI Video compressive sensing for spatial multiplexing cameras Aswin Sankaranarayanan, Christoph Studer, Richard G. Baraniuk Rice University.
Sequence-to-Sequence Alignment and Applications. Video > Collection of image frames.
High-Resolution Three- Dimensional Sensing of Fast Deforming Objects Philip Fong Florian Buron Stanford University This work supported by:
High-Speed Microscopic Imaging of the Initial Stage of Diesel Spray Formation and Primary Breakup C. Crua, T. Shoba, M. Heikal, University of Brighton.
Francisco Barranco Cornelia Fermüller Yiannis Aloimonos Event-based contour motion estimation.
International Conference on Image Analysis and Recognition (ICIAR’09). Halifax, Canada, 6-8 July Video Compression and Retrieval of Moving Object.
Adam Rachmielowski 615 Project: Real-time monocular vision-based SLAM.
SIGGRAPH Course 30: Performance-Driven Facial Animation Section: Markerless Face Capture and Automatic Model Construction Part 2: Li Zhang, Columbia University.
Power Distribution FPGADDR2 OEM Board Flash MEMSSDINSD3 Cameras Connector Board 1.2V1.8V5V3.3V 3.3V, 5V, 12V 15V3.3V9-36V.
i Sight1 April 1998 i Sight2 Objective u Present i Sight Company. u Present i Sight Technologies. u Description of technologies. u Status of each technology.
High Dynamic Range Imaging: Spatially Varying Pixel Exposures Shree K. Nayar, Tomoo Mitsunaga CPSC 643 Presentation # 2 Brien Flewelling March 4 th, 2009.
CCU VISION LABORATORY Object Speed Measurements Using Motion Blurred Images 林惠勇 中正大學電機系
CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.
Bernd Girod: Image Compression and Graphics 1 Image Compression and Graphics: More Than a Sum of Parts? Bernd Girod Collaborators: Peter Eisert, Marcus.
Frequency Analysis and Sheared Reconstruction for Rendering Motion Blur Kevin Egan Yu-Ting Tseng Nicolas Holzschuch Frédo Durand Ravi Ramamoorthi Columbia.
CSCE 641: Computer Graphics Image-based Rendering Jinxiang Chai.
Xinqiao LiuRate constrained conditional replenishment1 Rate-Constrained Conditional Replenishment with Adaptive Change Detection Xinqiao Liu December 8,
Synchronized Strobe for Video Camera Jeff Baskett & Jason Zubo Project Advisor: Dr. Irwin.
Achieving True Color Fidelity
Digital Camera Settings
+ Video Compression Rudina Alhamzi, Danielle Guir, Scott Hansen, Joe Jiang, Jason Ostroski.
Complementary Metal-Oxide Semiconductor Image Sensor Photobit, Pasadena, CA Innovation The firm has developed high-performance CMOS image sensors using.
© 2010, TSI Incorporated Time Resolved PIV Systems.
MERL, MIT Media Lab Reinterpretable Imager Agrawal, Veeraraghavan & Raskar Amit Agrawal, Ashok Veeraraghavan and Ramesh Raskar Mitsubishi Electric Research.
Raskar, Camera Culture, MIT Media Lab Camera Culture Ramesh Raskar MIT Media Lab Ramesh Raskar Associate Professor.
Lensless Imaging Richard Baraniuk Rice University Ashok Veeraraghavan
Camera Basics. ● DSLR – Digital Single Lens Reflex ● The camera has a viewfinder that sees through the lens by way of a 45°-angled mirror that flips.
[1] Reference: QCam API reference manual document version Charge Coupled Device (CCD)
Measurements in Fluid Mechanics 058:180 (ME:5180) Time & Location: 2:30P - 3:20P MWF 3315 SC Office Hours: 4:00P – 5:00P MWF 223B-5 HL Instructor: Lichuan.
Digital Photography A tool for Graphic Design Graphic Design: Digital Photography.
Introduction to Computational Photography. Computational Photography Digital Camera What is Computational Photography? Second breakthrough by IT First.
1 Imaging Techniques for Flow and Motion Measurement Lecture 5 Lichuan Gui University of Mississippi 2011 Imaging & Recording Techniques.
Computational photography CS4670: Computer Vision Noah Snavely.
Planning Ahead Developing Your Strategy for the Next Five Years Mar , 2011 Fort Myers, FL.
Recovering low rank and sparse matrices from compressive measurements Aswin C Sankaranarayanan Rice University Richard G. Baraniuk Andrew E. Waters.
In Photography, there is an Exposure Triangle (Reciprocity Theory) Aperture – size of the iris opening, how much light come into the “window” Shutter Speed.
Yu-Wing Tai, Hao Du, Michael S. Brown, Stephen Lin CVPR’08 (Longer Version in Revision at IEEE Trans PAMI) Google Search: Video Deblurring Spatially Varying.
Misty Hubbard. Digital Photography;  It’s easy displayed, stored, printed and shared.  Uses digital technology to take pictures.  Is only one of several.
Intelligent Vision Systems Image Geometry and Acquisition ENT 496 Ms. HEMA C.R. Lecture 2.
Mitsubishi Electric Research Labs (MERL) Super-Res from Single Motion Blur PhotoAgrawal & Raskar Amit Agrawal and Ramesh Raskar Mitsubishi Electric Research.
The SLR Experience: TTL u New and improved viewfinder Viewfinder appears larger Magnification increased to 0.87x (XTi 0.80x) Easier to see 24.5° viewing.
EG 2011 | Computational Plenoptic Imaging STAR | VI. High Speed Imaging1 Computational Plenoptic Imaging Gordon Wetzstein 1 Ivo Ihrke 2 Douglas Lanman.
TDI-CIS扫描MTF模型 李林
2D/3D MOTION ANALYSIS Martin Sebera
1 Imaging Techniques for Flow and Motion Measurement Lecture 20 Lichuan Gui University of Mississippi 2011 Stereo High-speed Motion Tracking.
High Resolution Surface Reconstruction from Overlapping Multiple-Views
Intelligent Vision Systems Image Geometry and Acquisition ENT 496 Ms. HEMA C.R. Lecture 2.
Hmm, HID HMMs Gerald Dalley MIT AI Lab Activity Perception Group Group Meeting 17 April 2003.
In Photography, there is an Exposure Triangle (Reciprocity Theory) Aperture – size of the iris opening, how much light come into the “window” Shutter Speed.
In Video, the shutter remains set Shutter Speed – amount of time the camera shutter is open during the exposure of one frame. (Standard – 1/50 sec.
 Many people like the flexibility of digital images. For example:  They can be shared by attaching to /uploading to Internet  Sent via mobiles.
Strictly confidential High Speed Cameras 07/28/2015: 2014 Applied Core Technology Inc., All Rights High Speed Imaging.
MRFs (X1,X2) X3 X1 X2 4 (X2,X3,X3) X4. MRFs (X1,X2) X3 X1 X2 4 (X2,X3,X3) X4.
Radon Transform Imaging
In Video, the shutter remains set Shutter Speed – amount of time the camera shutter is open during the exposure of one frame. (Standard – 1/50.
DSLR vs. point and shoot.
L-infinity minimization in geometric vision problems.
Optical Flow Estimation and Segmentation of Moving Dynamic Textures
Sampling and Reconstruction of Visual Appearance
Super-Resolution Image Reconstruction
Week 8 Nicholas Baker.
Modeling Motion Blur in Computer – Generated Images
Femto-Photography Camera Culture MIT Media Lab Ramesh Raskar
Introduction to Compressive Sensing Aswin Sankaranarayanan
Shutter Speed & DSLR PHOTOGRAPHY.
Deblurring Shaken and Partially Saturated Images
PYTHON25K: CMOS Image Sensor, 26.2 MP, Global Shutter
Presentation transcript:

Jason Holloway Aswin Sankaranarayanan Ashok Veeraraghavan Salil Tambe April 28, 2012

Low-speed images work for static scenes

open shut 33 ms

Blurring in dynamic areas High spatial resolution in static areas

 30 million voxel budget  Increasing fps decreases light throughput 1 Megapixel x 30 fps175 x 175 x 1000 fps

Optical coding

-LCOS -Per pixel coded exposure P2C2 [Reddy et al. 2011] Per pixel shutter control Flexible Voxels Gupta et al. 2011] CPEV [Hitomi et al. 2010, -Implement on CMOS -Single bump per pixel per frame Per pixel sensor control FSVC – Global shutter control Global shutter control y t x Exposure Single Pixel Camera [Wakin et al. 2006] Spatial-muliplexing y t x y t x

Video Removed General motion Linear with known velocity PeriodicityLinear dynamical systems Coded Strobing [Veeraraghavan et al. 2011] CD-LDS [Sankaranarayanan et al. 2010] Flutter Shutter [Raskar et al. 2006] P2C2 [Reddy et al. 2011] Flexible Voxels [Gupta et al. 2010] CPEV [Hitomi et al. 2011] FSVC 80x20x-50x 6x-16x

 Locally linear motion model  Union of subspaces (UoS)  General motion  TV minimization

High-speed PCA subspace approx. A 18x18x24 patch can be expressed using 324 dimensional subspace y t x 521 velocities, 40 angles and 13 speeds y t

High-speed subspace Low-speed subspace Patch based reconstruction

 Speed = 1.38 pixels/high-speed frame  Direction = 61° Speed (pixels/frame)

Video Removed PSNR: 35.5 dB

Video Removed  Hairnets advertisement placard moving right PSNR: 40.6 dB

Video Removed  Dancer clapping causes a chalk cloud to form PSNR: 28.7 dB

 PointGrey Machine Vision cameras were used to simulate FSVC  Flea3 grayscale camera operating at 8 fps

Video Removed Observed framesRecovered video (6x) Video Removed

Hardware complexity Reconstruction quality FSVC CPEV P2C2 Global shutter control suffices for high speed video recovery

 Questions?