3D OBJECT MANIPULATION IN A SINGLE PHOTOGRAPH USING STOCK 3D MODELS
Overview Video: Key idea: 3D manipulation in 2D photograph - beyond Photoshop. Essentially a data-driven interactive single image modeling problem.
Pipeline
Geometric Correction – Data term
Geometric Correction - Smoothness
Geometric Correction - Symmetry
Geometric Correction - Optmization
Illumination and Appearance Estimation Lambertian Surface
Illumination and Appearance Estimation Light model
Illumination&Appearance - Objective function
Illumination&Appearance - Data term
Illumination&Appearance – Illumination Prior Sparse light sources
Illumination&Appearance – Appearance Prior Appearance similar to the stock model
Relating Hidden & Visible Parts via Symmetries Completing Appearance via MRF
Relating Hidden & Visible Parts via Symmetries
Completing Appearance via MRF
Results
Results - Comparisons