Computer Graphics Laboratory, Hiroshima City University All images are compressed. The images in this file are not.

Slides:

Advertisements

Similar presentations

A Common Framework for Ambient Illumination in the Dichromatic Reflectance Model Color and Reflectance in Imaging and Computer Vision Workshop 2009 October.

Advertisements

Photometric Image Formation

A Graph based Geometric Approach to Contour Extraction from Noisy Binary Images Amal Dev Parakkat, Jiju Peethambaran, Philumon Joseph and Ramanathan Muthuganapathy.

3D Modeling from a photograph

Machine Vision Laboratory The University of the West of England Bristol, UK 2 nd September 2010 ICEBT Photometric Stereo in 3D Biometrics Gary A. Atkinson.

Spherical Convolution in Computer Graphics and Vision Ravi Ramamoorthi Columbia Vision and Graphics Center Columbia University SIAM Imaging Science Conference:

Polarization-based Inverse Rendering from Single View Daisuke Miyazaki Robby T. Tan Kenji Hara Katsushi Ikeuchi.

BMVC 2009 Specularity and Shadow Interpolation via Robust Polynomial Texture Maps Mark S. Drew 1, Nasim Hajari 1, Yacov Hel-Or 2 & Tom Malzbender 3 1 School.

Lecture 23: Photometric Stereo CS4670/5760: Computer Vision Kavita Bala Scott Wehrwein.

Exchanging Faces in Images SIGGRAPH ’04 Blanz V., Scherbaum K., Vetter T., Seidel HP. Speaker: Alvin Date: 21 July 2004.

Robust Object Segmentation Using Adaptive Thresholding Xiaxi Huang and Nikolaos V. Boulgouris International Conference on Image Processing 2007.

Stereoscopic Light Stripe Scanning: Interference Rejection, Error Minimization and Calibration By: Geoffrey Taylor Lindsay Kleeman Presented by: Ali Agha.

Visibility Subspaces: Uncalibrated Photometric Stereo with Shadows Kalyan Sunkavalli, Harvard University Joint work with Todd Zickler and Hanspeter Pfister.

Stepan Obdrzalek Jirı Matas

Previously Two view geometry: epipolar geometry Stereo vision: 3D reconstruction epipolar lines Baseline O O’ epipolar plane.

Object recognition under varying illumination. Lighting changes objects appearance.

Photometric Stereo Merle Norman Cosmetics, Los Angeles Readings R. Woodham, Photometric Method for Determining Surface Orientation from Multiple Images.

Face Relighting with Radiance Environment Maps Zhen Wen 1, Zicheng Liu 2, Thomas Huang 1 Beckman Institute 1 University of Illinois Urbana, IL61801, USA.

Image segmentation by clustering in the color space CIS581 Final Project Student: Qifang Xu Advisor: Dr. Longin Jan Latecki.

Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’04) /04 $20.00 c 2004 IEEE 1 Li Hong.

Digital Archive of Cultural Heritages - Three Dimensional Modeling of Cultural Heritages and its use for Educational Purposes - Atsushi Nakazawa, Takeshi.

Linked Edges as Stable Region Boundaries* Michael Donoser, Hayko Riemenschneider and Horst Bischof This work introduces an unsupervised method to detect.

1/20 Obtaining Shape from Scanning Electron Microscope Using Hopfield Neural Network Yuji Iwahori 1, Haruki Kawanaka 1, Shinji Fukui 2 and Kenji Funahashi.

Analysis of Lighting Effects Outline: The problem Lighting models Shape from shading Photometric stereo Harmonic analysis of lighting.

Analysis of Subsurface Scattering under Generic Illumination Y. Mukaigawa K. Suzuki Y. Yagi Osaka University, Japan ICPR2008.

Computer Graphics Laboratory, Hiroshima City University All images are compressed.

Understanding the effect of lighting in images Ronen Basri.

Digital Photography with Flash and No-Flash Image Pairs Gabriela Martínez Processamento de Imagem IMPA.

Scene Completion Using Millions of Photographs James Hays, Alexei A. Efros Carnegie Mellon University ACM SIGGRAPH 2007.

A survey of Light Source Detection Methods Nathan Funk University of Alberta Nov

Image-Based Segmentation of Indoor Corridor Floors for a Mobile Robot

Scientific Systems 1 Scientific Systems Company, Inc Presentation at Meeting No. 96 Aerospace Control and Guidance Systems Committee Harbour Town Resorts.

December 11, 2002MVA20021 Determining Shapes of Transparent Objects from Two Polarization Images Daisuke Miyazaki Masataka Kagesawa Katsushi Ikeuchi The.

Image-Based Segmentation of Indoor Corridor Floors for a Mobile Robot Yinxiao Li and Stanley T. Birchfield The Holcombe Department of Electrical and Computer.

1 Self-Calibration and Neural Network Implementation of Photometric Stereo Yuji IWAHORI, Yumi WATANABE, Robert J. WOODHAM and Akira IWATA.

Color and Brightness Constancy Jim Rehg CS 4495/7495 Computer Vision Lecture 25 & 26 Wed Oct 18, 2002.

Shape from Shading Course web page: vision.cis.udel.edu/cv February 26, 2003  Lecture 6.

Computer Graphics Laboratory, Hiroshima City University All images are compressed. The images in this file is not the original.

Announcements Final Exam Friday, May 16 th 8am Review Session here, Thursday 11am.

1Ellen L. Walker 3D Vision Why? The world is 3D Not all useful information is readily available in 2D Why so hard? “Inverse problem”: one image = many.

Polarization-based dehazing using two reference objects

Active Lighting for Appearance Decomposition Todd Zickler DEAS, Harvard University.

Mesostructure from Specularity Using Coded Illumination

Tal Amir Advanced Topics in Computer Vision May 29 th, 2015 COUPLED MOTION- LIGHTING ANALYSIS.

Chapter 24: Perception April 20, Introduction Emphasis on vision Feature extraction approach Model-based approach –S stimulus –W world –f,

Computer Vision Computer Vision based Hole Filling Chad Hantak COMP December 9, 2003.

Notes Over 3.1 Solving a System Graphically Graph the linear system and estimate the solution. Then check the solution algebraically.

Understanding the effect of lighting in images Ronen Basri.

COMPUTER GRAPHICS AND LINEAR ALGEBRA AN INTRODUCTION.

Announcements Project 3a due today Project 3b due next Friday.

1 Resolving the Generalized Bas-Relief Ambiguity by Entropy Minimization Neil G. Alldrin Satya P. Mallick David J. Kriegman University of California, San.

MAN-522 Computer Vision Spring

- photometric aspects of image formation gray level images

ROBUST SUBSPACE LEARNING FOR VISION AND GRAPHICS

CS4670 / 5670: Computer Vision Kavita Bala Lec 27: Stereo.

Announcements Final is Thursday, March 20, 10:30-12:20pm

Rogerio Feris 1, Ramesh Raskar 2, Matthew Turk 1

Fast Preprocessing for Robust Face Sketch Synthesis

Merle Norman Cosmetics, Los Angeles

Fast Bilateral Filtering for the Display of High-Dynamic-Range Images

Polarization-based Inverse Rendering from Single View

Filtering Things to take away from this lecture An image as a function

Announcements Today: evals Monday: project presentations (8 min talks)

Announcements Final is Thursday, March 16, 10:30-12:20

Daisuke Miyazaki Katsushi Ikeuchi The University of Tokyo

Daisuke Miyazaki Katsushi Ikeuchi The University of Tokyo

All images are compressed.

ECE 692 – Advanced Topics in Computer Vision

Saliency Optimization from Robust Background Detection

All images are compressed.

Presentation transcript:

Computer Graphics Laboratory, Hiroshima City University All images are compressed. The images in this file are not the original ones. SVD Photometric stereo (Miyazaki, Ikeuchi)

Computer Graphics Laboratory, Hiroshima City University Photometric stereo under unknown light sources using robust SVD with missing data Daisuke MiyazakiThe University of TokyoPreviously Hiroshima City UniversityCurrently Katsushi IkeuchiThe University of Tokyo SVD Photometric stereo (Miyazaki, Ikeuchi)

CG Lab, Hiroshima City University Geometric modeling SVD Photometric stereo (Miyazaki, Ikeuchi) [Laser range sensor][Uncalibrated photometric stereo] Algorithm(10)Experiment(5)Conclusion(1)Introduction(1/2)

CG Lab, Hiroshima City University Proposed method Photometric stereo SVD: Our hole-filling SVD –Related work: [Mukaigawa 07] [Tomasi 92] [Shum 95] [Brand 02] Robust to outliers: shadow, specular reflection Point light source in far distance with small size: directional light Typically around 30 to 100 number of images The direction (and the power) of light sources are unknown –Related work: [Hayakawa 94] [Woodham 91] [Yuille 99] [Belhumeur 99] SVD Photometric stereo (Miyazaki, Ikeuchi) Algorithm(10)Experiment(5)Conclusion(1)Introduction(2/2)

CG Lab, Hiroshima City University Photometric stereo SVD Photometric stereo (Miyazaki, Ikeuchi) Lambertian model for diffuse reflection Algorithm(1/10)Experiment(5)Conclusion(1)Introduction(2)

CG Lab, Hiroshima City University Linearization SVD Photometric stereo (Miyazaki, Ikeuchi) Specular reflection Shadow pos neg Linearization Linear algebra Cosine function Algorithm(2/10)Experiment(5)Conclusion(1)Introduction(2)

CG Lab, Hiroshima City University Three orthonormal basis images using SVD SVD Photometric stereo (Miyazaki, Ikeuchi) PCA/SVD 3 bases [Shashua 97] Linearized image Representable by 3 bases pos: green neg: red

CG Lab, Hiroshima City University Outlier SVD Photometric stereo (Miyazaki, Ikeuchi) Shadow Specular reflection Outlier "hole" Algorithm(4/10)Experiment(5)Conclusion(1)Introduction(2)

CG Lab, Hiroshima City University Hole filling SVD Photometric stereo (Miyazaki, Ikeuchi) Without hole Bases With hole ??? cba cba Algorithm(5/10)Experiment(5)Conclusion(1)Introduction(2)

CG Lab, Hiroshima City University Gradually filling holes SVD Photometric stereo (Miyazaki, Ikeuchi) SVD Bases Hole filling SVD Bases Hole filling Algorithm(6/10)Experiment(5)Conclusion(1)Introduction(2)

CG Lab, Hiroshima City University Matrix representation SVD Photometric stereo (Miyazaki, Ikeuchi) Pixel number Image number Matrix-vector representation Image matrix SVD... Image 1Image 2 Algorithm(7/10)Experiment(5)Conclusion(1)Introduction(2)

CG Lab, Hiroshima City University Row/column scraping SVD Photometric stereo (Miyazaki, Ikeuchi) Input image with outliers Algorithm(8/10)Experiment(5)Conclusion(1)Introduction(2)

CG Lab, Hiroshima City University Row/column sticking SVD Photometric stereo (Miyazaki, Ikeuchi) Hole filling Linearized input image Hole filling SVD Algorithm(9/10)Experiment(5)Conclusion(1)Introduction(2)

CG Lab, Hiroshima City University Algorithm flow SVD Photometric stereo (Miyazaki, Ikeuchi) Thresholding & graph cut Hole filling SVD Region segmentation Occluding boundary Outlier detection Linearization Light source direction estimation [Hayakawa 94] [Shi 10] [Belhumeur 99] [Sato 07] [Our method] Light source direction estimation Algorithm(10/10)Experiment(5)Conclusion(1)Introduction(2)

CG Lab, Hiroshima City University Linearizaiton result SVD Photometric stereo (Miyazaki, Ikeuchi) Input image Linearized image Algorithm(10)Experiment(1/5)Conclusion(1)Introduction(2)

CG Lab, Hiroshima City University Result SVD Photometric stereo (Miyazaki, Ikeuchi) Algorithm(10)Experiment(2/5)Conclusion(1)Introduction(2)

CG Lab, Hiroshima City University Result SVD Photometric stereo (Miyazaki, Ikeuchi) Algorithm(10)Experiment(3/5)Conclusion(1)Introduction(2)

CG Lab, Hiroshima City University Comparison SVD Photometric stereo (Miyazaki, Ikeuchi) With outlier detection [Our result] Without outlier detection Algorithm(10)Experiment(4/5)Conclusion(1)Introduction(2)

CG Lab, Hiroshima City University Comparison SVD Photometric stereo (Miyazaki, Ikeuchi) With outlier detection [Our result] Without outlier detection Algorithm(10)Experiment(5/5)Conclusion(1)Introduction(2)

CG Lab, Hiroshima City University Conclusion SVD Photometric stereo (Miyazaki, Ikeuchi) SVD Photometric Stereo Con: Computation time (1h~1d) Light source unknown Shadow Specular reflection Hole filling SVD Algorithm(10)Experiment(5)Conclusion(1/1)Introduction(2)

Computer Graphics Laboratory, Hiroshima City University (c) Crypton Future Media, Inc. Crypton Future Media, Inc. owns the copyright of this character, Miku Hatsune. This picture is drawn by Daisuke Miyazaki under Piapro Character License. SVD Photometric stereo (Miyazaki, Ikeuchi)

Computer Graphics Laboratory, Hiroshima City University (c) Daisuke Miyazaki 2010 All rights reserved. Daisuke Miyazaki, Katsushi Ikeuchi, "Photometric stereo under unknown light sources using robust SVD with missing data," Proceedings of International Conference on Image Processing, pp , Hong Kong, China, Sep SVD Photometric stereo (Miyazaki, Ikeuchi)