Automatic Photo Pop-up Derek Hoiem Alexei A. Efros Martial Hebert.

Slides:



Advertisements
Similar presentations
Automatic Photo Pop-up Derek Hoiem Alexei A.Efros Martial Hebert Carnegie Mellon University.
Advertisements

CVPR2013 Poster Modeling Actions through State Changes.
Illumination Estimation via Thin Plate Spline Weihua Xiong ( OmniVision Technology,USA ) Lilong Shi, Brian Funt ( Simon Fraser University, Canada) ( Simon.
Spatial-Temporal Consistency in Video Disparity Estimation ICASSP 2011 Ramsin Khoshabeh, Stanley H. Chan, Truong Q. Nguyen.
Learning Techniques for Video Shot Detection Under the guidance of Prof. Sharat Chandran by M. Nithya.
Internet Vision - Lecture 3 Tamara Berg Sept 10. New Lecture Time Mondays 10:00am-12:30pm in 2311 Monday (9/15) we will have a general Computer Vision.
Video Inpainting Under Constrained Camera Motion Kedar A. Patwardhan, Student Member, IEEE, Guillermo Sapiro, Senior Member, IEEE, and Marcelo Bertalm.
Title of Presentation Author 1, Author 2, Author 3, Author 4 Abstract Introduction This is my abstract. This is my abstract. This is my abstract. This.
Tracking Features with Large Motion. Abstract Problem: When frame-to-frame motion is too large, KLT feature tracker does not work. Solution: Estimate.
Single-view metrology
Exchanging Faces in Images SIGGRAPH ’04 Blanz V., Scherbaum K., Vetter T., Seidel HP. Speaker: Alvin Date: 21 July 2004.
Hierarchical Region-Based Segmentation by Ratio-Contour Jun Wang April 28, 2004 Course Project of CSCE 790.
Image Quilting for Texture Synthesis and Transfer Alexei A. Efros1,2 William T. Freeman2.
Image Segmentation. Introduction The purpose of image segmentation is to partition an image into meaningful regions with respect to a particular application.
Example-Based Color Transformation of Image and Video Using Basic Color Categories Youngha Chang Suguru Saito Masayuki Nakajima.
3D Hand Pose Estimation by Finding Appearance-Based Matches in a Large Database of Training Views
Image Morphing : Rendering and Image Processing Alexei Efros.
Abstract Extracting a matte by previous approaches require the input image to be pre-segmented into three regions (trimap). This pre-segmentation based.
A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications Lucia Maddalena and Alfredo Petrosino, Senior Member, IEEE.
Lecture#6: segmentation Anat Levin Introduction to Computer Vision Class Fall 2009 Department of Computer Science and App math, Weizmann Institute of Science.
Automatic Photo Popup Derek Hoiem Alexei A. Efros Martial Hebert Carnegie Mellon University.
Smart Traveller with Visual Translator for OCR and Face Recognition LYU0203 FYP.
COS 429 PS3: Stitching a Panorama Due November 4 th.
Opportunities of Scale, Part 2 Computer Vision James Hays, Brown Many slides from James Hays, Alyosha Efros, and Derek Hoiem Graphic from Antonio Torralba.
Wrap Up : Computational Photography Alexei Efros, CMU, Fall 2005 © Robert Brown.
3D Scene Models Object recognition and scene understanding Krista Ehinger.
Image Morphing CSC320: Introduction to Visual Computing
Summer School on Image Processing 2009, Debrecen, Hungary Colour image processing for SHADOW REMOVAL Alina Elena Oprea, University Politehnica of Bucharest.
ICPR/WDIA-2012 High Quality Novel View Synthesis Based on Low Resolution Depth Image and High Resolution Color Image Jui-Chiu Chiang, Zheng-Feng Liu, and.
Efficient Editing of Aged Object Textures By: Olivier Clément Jocelyn Benoit Eric Paquette Multimedia Lab.
Single-view 3D Reconstruction Computational Photography Derek Hoiem, University of Illinois 10/18/12 Some slides from Alyosha Efros, Steve Seitz.
Digital Face Replacement in Photographs CSC2530F Project Presentation By: Shahzad Malik January 28, 2003.
Chapter 14: SEGMENTATION BY CLUSTERING 1. 2 Outline Introduction Human Vision & Gestalt Properties Applications – Background Subtraction – Shot Boundary.
Object Stereo- Joint Stereo Matching and Object Segmentation Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on Michael Bleyer Vienna.
Recovering Surface Layout from a Single Image D. Hoiem, A.A. Efros, M. Hebert Robotics Institute, CMU Presenter: Derek Hoiem CS 598, Spring 2009 Jan 29,
Implementing Codesign in Xilinx Virtex II Pro Betim Çiço, Hergys Rexha Department of Informatics Engineering Faculty of Information Technologies Polytechnic.
Stylization and Abstraction of Photographs Doug Decarlo and Anthony Santella.
Recognizing Action at a Distance Alexei A. Efros, Alexander C. Berg, Greg Mori, Jitendra Malik Computer Science Division, UC Berkeley Presented by Pundik.
Single-view 3D Reconstruction Computational Photography Derek Hoiem, University of Illinois 10/12/10 Some slides from Alyosha Efros, Steve Seitz.
12/7/10 Looking Back, Moving Forward Computational Photography Derek Hoiem, University of Illinois Photo Credit Lee Cullivan.
Scene Completion Using Millions of Photographs James Hays, Alexei A. Efros Carnegie Mellon University ACM SIGGRAPH 2007.
Notes for Project 6 PVA Pro Problem Definition The PVA Pro 9000 is a software application to support the estimation of acreage from aerial photographs.
Figure ground segregation in video via averaging and color distribution Introduction to Computational and Biological Vision 2013 Dror Zenati.
Associative Hierarchical CRFs for Object Class Image Segmentation
Orientable Textures for Image- Based Pen-And-Ink Illustration Michael P. Salisbury Michael T. Wong John F. Hughes David A. Salesin SIGGRAPH 1997 Andrea.
Single-view 3D Reconstruction
Video Tracking G. Medioni, Q. Yu Edwin Lei Maria Pavlovskaia.
Extracting Depth and Matte using a Color-Filtered Aperture Yosuke Bando TOSHIBA + The University of Tokyo Bing-Yu Chen National Taiwan University Tomoyuki.
Journal of Visual Communication and Image Representation
Object Recognition as Ranking Holistic Figure-Ground Hypotheses Fuxin Li and Joao Carreira and Cristian Sminchisescu 1.
Object Recognition by Integrating Multiple Image Segmentations Caroline Pantofaru, Cordelia Schmid, Martial Hebert ECCV 2008 E.
Wonjun Kim and Changick Kim, Member, IEEE
Learning Photographic Global Tonal Adjustment with a Database of Input / Output Image Pairs.
A Free Software tool for Automatic Tuning of Segmentation Parameters SPT 3.0 Pedro Achanccaray, Victor Ayma, Luis Jimenez, Sergio Garcia, Patrick Happ,
12/15/ Fall 2006 Two-Point Perspective Single View Geometry Final Project Faustinus Kevin Gozali an extended tour.
Image-Based Rendering Geometry and light interaction may be difficult and expensive to model –Think of how hard radiosity is –Imagine the complexity of.
Video Textures Arno Schödl Richard Szeliski David Salesin Irfan Essa Microsoft Research, Georgia Tech.
May 2003 SUT Color image segmentation – an innovative approach Amin Fazel May 2003 Sharif University of Technology Course Presentation base on a paper.
DIGITAL IMAGE FORGERY Name: Reshma P.D Roll No:19.
Edge Preserving Spatially Varying Mixtures for Image Segmentation Giorgos Sfikas, Christophoros Nikou, Nikolaos Galatsanos (CVPR 2008) Presented by Lihan.
1 2D TO 3D IMAGE AND VIDEO CONVERSION. INTRODUCTION The goal is to take already existing 2D content, and artificially produce the left and right views.
Heechul Han and Kwanghoon Sohn
IMAGE SEGMENTATION USING THRESHOLDING
Nonparametric Semantic Segmentation
Opportunities of Scale, Part 2
Adversarially Tuned Scene Generation
Analysis and classification of images based on focus
Poetry & Prose Instructions.
Field Photos
Copyright © 2014 Elsevier Inc. All rights reserved.
Presentation transcript:

Automatic Photo Pop-up Derek Hoiem Alexei A. Efros Martial Hebert

ABSTRACT Presents a fully automatic method for creating a 3D model from a single photograph. Algorithm labels regions of the input image into coarse categories: “ground”, “sky”, and “vertical”. Labels are then used to “cut and fold” the image into a pop-up model using a set of simple assumptions. The algorithm is not expected to work on every image.

OUTLINE INTRODUCTION RELATED WORK( 暫無 ) APPROACH EXTENDING TO VIDEOS RESULTS

INTRODUCTION Advances in the field of image-based rendering during the past decade. The method for creating virtual walkthroughs that is completely automatic and requires only a single photograph as input. The approach is similar to the creation of a pop-up illustration in a children’s book.

RELATED WORK

APPROACH

A. Handling the Illuminant Color in Images A fundamental limitation of our previous algorithm is that it required target images to be taken under the D65. We apply the color-by-correlation method to estimate the illuminant color.

APPROACH B. Color Naming Method We denote the categorization as the “color naming” of a pixel. The color naming method consists of two steps: initial color naming and fuzzy color naming. Initial color naming, for example, if the color of a pixel is categorized in the first BCC, then the vector becomes In the initial color naming process, each pixel completely belongs to one of the 11 BCCs. Fuzzy color naming is done to avoid pseudo-contours.

APPROACH B. Color Naming Method

APPROACH C. Computing Corresponding Color Values in the Chromatic Categories

APPROACH D. Computing Corresponding Color Values In the Achromatic Categories E. Transferring Colors

EXTENDING TO VIDEOS A. Color Naming Method

EXTENDING TO VIDEOS B. Computing Corresponding Color Values in the Chromatic Categories

EXTENDING TO VIDEOS C. Computing Corresponding Color Values in the Achromatic Categories D. Transferring Colors

RESULTS

Thank you for your listening!