Interactive Images: Cuboid Proxies for Smart Image Manipulation Youyi Zheng, Xiang Chen, Mingming Cheng, Kun Zhou, Shi-Min Hu, Niloy J. Mitra Presenter:

Slides:

Advertisements

Similar presentations

Single-view geometry Odilon Redon, Cyclops, 1914.

Advertisements

Epipolar Geometry.

A Robust Super Resolution Method for Images of 3D Scenes Pablo L. Sala Department of Computer Science University of Toronto.

Automatic Color Gamut Calibration Cristobal Alvarez-Russell Michael Novitzky Phillip Marks.

Xiaoyong Ye Franz Alexander Van Horenbeke David Abbott

The fundamental matrix F

Two-View Geometry CS Sastry and Yang

Video Inpainting Under Constrained Camera Motion Kedar A. Patwardhan, Student Member, IEEE, Guillermo Sapiro, Senior Member, IEEE, and Marcelo Bertalm.

Two-view geometry.

Lecture 8: Stereo.

Semi-automatic Range to Range Registration: A Feature-based Method Chao Chen & Ioannis Stamos Computer Science Department Graduate Center, Hunter College.

Camera calibration and epipolar geometry

Image alignment Image from

Exchanging Faces in Images SIGGRAPH ’04 Blanz V., Scherbaum K., Vetter T., Seidel HP. Speaker: Alvin Date: 21 July 2004.

Multiple View Geometry : Computational Photography Alexei Efros, CMU, Fall 2005 © Martin Quinn …with a lot of slides stolen from Steve Seitz and.

Direct Methods for Visual Scene Reconstruction Paper by Richard Szeliski & Sing Bing Kang Presented by Kristin Branson November 7, 2002.

Epipolar geometry. (i)Correspondence geometry: Given an image point x in the first view, how does this constrain the position of the corresponding point.

Uncalibrated Geometry & Stratification Sastry and Yang

Real-time Combined 2D+3D Active Appearance Models Jing Xiao, Simon Baker,Iain Matthew, and Takeo Kanade CVPR 2004 Presented by Pat Chan 23/11/2004.

3D reconstruction of cameras and structure x i = PX i x’ i = P’X i.

Uncalibrated Epipolar - Calibration

Lecture 16: Single-view modeling, Part 2 CS6670: Computer Vision Noah Snavely.

Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.

Single-view geometry Odilon Redon, Cyclops, 1914.

Linearizing (assuming small (u,v)): Brightness Constancy Equation: The Brightness Constraint Where:),(),(yxJyxII t  Each pixel provides 1 equation in.

Camera parameters Extrinisic parameters define location and orientation of camera reference frame with respect to world frame Intrinsic parameters define.

COMP322/S2000/L271 Stereo Imaging Ref.V.S.Nalwa, A Guided Tour of Computer Vision, Addison Wesley, (ISBN ) Slides are adapted from CS641.

Multiple View Geometry : Computational Photography Alexei Efros, CMU, Fall 2006 © Martin Quinn …with a lot of slides stolen from Steve Seitz and.

Multi-view geometry. Multi-view geometry problems Structure: Given projections of the same 3D point in two or more images, compute the 3D coordinates.

776 Computer Vision Jan-Michael Frahm, Enrique Dunn Spring 2013.

Automatic Camera Calibration

CSC 589 Lecture 22 Image Alignment and least square methods Bei Xiao American University April 13.

Camera Geometry and Calibration Thanks to Martial Hebert.

What we didn’t have time for CS664 Lecture 26 Thursday 12/02/04 Some slides c/o Dan Huttenlocher, Stefano Soatto, Sebastian Thrun.

Multi-view geometry.

Linearizing (assuming small (u,v)): Brightness Constancy Equation: The Brightness Constraint Where:),(),(yxJyxII t  Each pixel provides 1 equation in.

Acquiring 3D models of objects via a robotic stereo head David Virasinghe Department of Computer Science University of Adelaide Supervisors: Mike Brooks.

Computer Vision : CISC 4/689 Going Back a little Cameras.ppt.

Single-view geometry Odilon Redon, Cyclops, 1914.

Two-view geometry. Epipolar Plane – plane containing baseline (1D family) Epipoles = intersections of baseline with image planes = projections of the.

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.

Large-Scale Matrix Factorization with Missing Data under Additional Constraints Kaushik Mitra University of Maryland, College Park, MD Sameer Sheoreyy.

Linearizing (assuming small (u,v)): Brightness Constancy Equation: The Brightness Constraint Where:),(),(yxJyxII t  Each pixel provides 1 equation in.

Single-view geometry Odilon Redon, Cyclops, 1914.

Image-Based Rendering Geometry and light interaction may be difficult and expensive to model –Think of how hard radiosity is –Imagine the complexity of.

Improvements on Automated Registration CSc83020 Project Presentation Cecilia Chao Chen.

Camera Calibration Course web page: vision.cis.udel.edu/cv March 24, 2003  Lecture 17.

Lec 26: Fundamental Matrix CS4670 / 5670: Computer Vision Kavita Bala.

Acquiring, Stitching and Blending Diffuse Appearance Attributes on 3D Models C. Rocchini, P. Cignoni, C. Montani, R. Scopigno Istituto Scienza e Tecnologia.

Calibrating a single camera

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry

Graphcut Textures:Image and Video Synthesis Using Graph Cuts

Think-Pair-Share What visual or physiological cues help us to perceive 3D shape and depth?

Depth from disparity (x´,y´)=(x+D(x,y), y)

The Brightness Constraint

Two-view geometry Computer Vision Spring 2018, Lecture 10

Epipolar geometry.

A special case of calibration

Image Stitching Slides from Rick Szeliski, Steve Seitz, Derek Hoiem, Ira Kemelmacher, Ali Farhadi.

3D Photography: Epipolar geometry

The Brightness Constraint

The Brightness Constraint

Uncalibrated Geometry & Stratification

Multi-view geometry.

Single-view geometry Odilon Redon, Cyclops, 1914.

Calibration and homographies

Lecture 15: Structure from motion

Image Stitching Linda Shapiro ECE/CSE 576.

Single Image Vignetting Correction

Image Stitching Linda Shapiro ECE P 596.

Presentation transcript:

Interactive Images: Cuboid Proxies for Smart Image Manipulation Youyi Zheng, Xiang Chen, Mingming Cheng, Kun Zhou, Shi-Min Hu, Niloy J. Mitra Presenter: Jiapei ZHANG

Outline Coupled 2D-3D Analysis 2D pixels 3D proxies Image Decomposition Background + Textured Proxies Interactive Editing

Initial camera calibration Grab Cut Six corners Corner points 6 correspondence pairs Linear program Camera calibration

Initial Scene Estimation Triplet of adjacent edgesCandidate cuboid For each candidate cuboid in the set {Pi} Joint Optimization minimize the total fitting error

Stacking & Occlusion A B

Resolving Ambiguities MRF formulation

Non-convex objects Cutting plane identificationRedundancy removal Greedy Algorithm Choose the one covers the largest area of Ri

Light & Shadow User-marked shadow correspondence Estimate a single light position (in a least squares sense) such that

Decomposition Remove projected proxy and shadows Image completion For each proxy: (i) shadow effects based on light position (ii) symmetric regions to fill in missing texture for invisible faces

Basic Operation Extracted proxies + Relations Relations: Operations: placement, repetition, alignment, coplanarity, repetition, parallelism translate, rotate, scale, stack

User-Indicated Relation hinge joint slide inside mark

Repeated Edit

Virtual Shopping

User Study V.S. Users recognized: 63.2% real images 44.5% fake images