Eurographics 2012, Cagliari, Italy 3D Material Style Transfer Chuong H. Nguyen 1, Tobias Ritschel 2, Karol Myszkowski 1, Elmar Eisemann 2, Hans-Peter Seidel.

Slides:

Advertisements

Similar presentations

Image Repairing: Robust Image Synthesis by Adaptive ND Tensor Voting IEEE Computer Society Conference on Computer Vision and Pattern Recognition Jiaya.

Advertisements

Binary Shading using Geometry and Appearance Bert Buchholz Tamy Boubekeur Doug DeCarlo Marc Alexa Telecom ParisTech – CNRS Rutgers University TU Berlin.

IIIT Hyderabad Pose Invariant Palmprint Recognition Chhaya Methani and Anoop Namboodiri Centre for Visual Information Technology IIIT, Hyderabad, INDIA.

Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,

IMAGE RESTORATION AND REALISM MILLIONS OF IMAGES SEMINAR YUVAL RADO.

Summary & Homework Jinxiang Chai. Outline Motion data process paper summary Presentation tips Homework Paper assignment.

Exchanging Faces in Images SIGGRAPH ’04 Blanz V., Scherbaum K., Vetter T., Seidel HP. Speaker: Alvin Date: 21 July 2004.

(conventional Cartesian reference system)

Signal Processing Institute Swiss Federal Institute of Technology, Lausanne 1 “OBJECTIVE AND SUBJECTIVE IDENTIFICATION OF INTERESTING AREAS IN VIDEO SEQUENCES”

Approximate Soft Shadows on Arbitrary Surfaces using Penumbra Wedges Tomas Akenine-Möller Ulf Assarsson Department of Computer Engineering, Chalmers University.

Materials II Lavanya Sharan March 2nd, Computational thinking about materials Physics-basedPseudo physics-based.

Convergence of vision and graphics Jitendra Malik University of California at Berkeley Jitendra Malik University of California at Berkeley.

 For many years human being has been trying to recreate the complex mechanisms that human body forms & to copy or imitate human systems  As a result.

Computer graphics & visualization Introduction. computer graphics & visualization Image Synthesis – WS 07/08 Dr. Jens Krüger – Computer Graphics and Visualization.

Computer Vision Spring ,-685 Instructor: S. Narasimhan WH 5409 T-R 10:30am – 11:50am Lecture #15.

Input: Original intensity image. Target intensity image (i.e. a value sketch). Using Value Images to Adjust Intensity in 3D Renderings and Photographs.

Interactive Reflection Editing Tobias Ritschel Makoto Okabe Thorsten Thormählen Hans-Peter Seidel Max-Planck-Institut Informatik SIGGRAPH Asia 2009 Friday,

A Gentle Introduction to Bilateral Filtering and its Applications 08/10: Applications: Advanced uses of Bilateral Filters Jack Tumblin – EECS, Northwestern.

Distinctive Image Features from Scale-Invariant Keypoints By David G. Lowe, University of British Columbia Presented by: Tim Havinga, Joël van Neerbos.

Feature Sensitive Bas Relief Generation Jens Kerber 1, Art Tevs 1, Alexander Belyaev 2, Rhaleb Zayer 3, and Hans-Peter Seidel 1 1 Max-Planck-Instut für.

Projective Texture Atlas for 3D Photography Jonas Sossai Júnior Luiz Velho IMPA.

REVES research group REndering for Virtual Environments with Sound REVES/INRIA, Sophia-Antipolis, France Contact:

1 Intelligent Robotics Research Centre (IRRC) Department of Electrical and Computer Systems Engineering Monash University, Australia Visual Perception.

CSE 473/573 Computer Vision and Image Processing (CVIP) Ifeoma Nwogu Lecture 35 – Review for midterm.

Krzysztof Templin 1,2 Piotr Didyk 2 Tobias Ritschel 3 Elmar Eisemann 3 Karol Myszkowski 2 Hans-Peter Seidel 2 Apparent Resolution Enhancement for Animations.

Online Tracking of Outdoor Lighting Variations for Augmented Reality with Moving Cameras Yanli Liu 1,2 and Xavier Granier 2,3,4 1: College of Computer.

Efficient Editing of Aged Object Textures By: Olivier Clément Jocelyn Benoit Eric Paquette Multimedia Lab.

Image-Based Rendering from a Single Image Kim Sang Hoon Samuel Boivin – Andre Gagalowicz INRIA.

Interactive Virtual Relighting and Remodelling of Real Scenes C. Loscos 1, MC. Frasson 1,2,G. Drettakis 1, B. Walter 1, X. Granier 1, P. Poulin 2 (1) iMAGIS*

Validation of Color Managed 3D Appearance Acquisition Michael Goesele Max-Planck-Institut für Informatik (MPI Informatik) Vortrag im Rahmen des V 3 D 2.

Shading. What is Shading? Assigning of a color to a pixel in the final image. So, everything in shading is about how to select and combine colors to get.

Perception Motivated Hybrid Approach to Tone Mapping Martin Čadík Czech Technical University in Prague, Czech Republic.

Computer Vision Lecture 5. Clustering: Why and How.

Poisson Image Editing & Terrain Synthesis Howard Zhou Jie Sun

Scale-less Dense Correspondences Tal Hassner The Open University of Israel ICCV’13 Tutorial on Dense Image Correspondences for Computer Vision.

View-Dependent Precomputed Light Transport Using Nonlinear Gaussian Function Approximations Paul Green 1 Jan Kautz 1 Wojciech Matusik 2 Frédo Durand 1.

Rendering Complexity in Computer-Generated Pen- and-Ink Illustrations Brett Wilson & Kwan-Liu Ma The University of California, Davis.

1 Reconstructing head models from photograph for individualized 3D-audio processing Matteo Dellepiane, Nico Pietroni, Nicolas Tsingos, Manuel Asselot,

SIGGRAPH 2010 Interactive On-Surface Signal Deformation Tobias Ritschel 1 Thorsten Thormählen 1 Carsten Dachsbacher 2 Jan Kautz 3 Hans-Peter Seidel 1.

The Quotient Image: Class-based Recognition and Synthesis Under Varying Illumination T. Riklin-Raviv and A. Shashua Institute of Computer Science Hebrew.

Goal and Motivation To study our (in)ability to detect inconsistencies in the illumination of objects in images Invited Talk! – Hany Farid: Photo Forensincs:

Image-Based Rendering of Diffuse, Specular and Glossy Surfaces from a Single Image Samuel Boivin and André Gagalowicz MIRAGES Project.

12/7/10 Looking Back, Moving Forward Computational Photography Derek Hoiem, University of Illinois Photo Credit Lee Cullivan.

Segmental Brush Stroke Synthesis by Example Ryoichi Ando and Reiji Tsuruno Kyushu Univ, Japan. Came from Here !

3D Computer Graphics in a Nutshell Guillaume Caumon, January 2002.

Paint Effects.  Uses: paint brush strokes paint particle effects Traditional paint program ○ paint images on a canvas ○ paint repeatable textures that.

Differential Instant Radiosity for Mixed Reality Martin Knecht, Christoph Traxler, Oliver Mattausch, Werner Purgathofer, Michael Wimmer Institute of Computer.

Global Illumination. Local Illumination  the GPU pipeline is designed for local illumination  only the surface data at the visible point is needed to.

3D Face Recognition Using Range Images

Accurate Image Based Relighting through Optimization Pieter Peers Philip Dutré Department of Computer Science K.U.Leuven, Belgium.

UV Mapping After a 3D object has been modeled it must be prepared for texturing. 3D surfaces can be “unwrapped” into a 2D representation with. This process.

Enhancing Image-Based Aging Approaches Olivier Clément Eric Paquette.

Data-driven Architectural texture mapping Texture mapping Un-textured 3D sceneTextured output Textured Architectures 由于建筑物的3D model和 textures均属于structured.

Data-driven Image Processing Fubo Han Images in computer graphics IMAGE: the most engaging visual content in the internet. Image Superiority.

Real-Time Lens Blur Effects and Focus Control Sungkil Lee, Elmar Eisemann, and Hans-Peter Seidel Sunyeong Kim Nov. 23 nd

- 1/22 - Centre for Digital Video Processing C E N T R E F O R D I G I T A L V I D E O P R O C E S S I N G DIGIFACT: Digitisation of Museum Artefacts Facilitating.

Fine Tone Control in Hardware Hatching Matthew Webb Emil Praun Hugues Hoppe Adam Finkelstein Princeton University Microsoft Research Princeton University.

Color Image Segmentation Mentor : Dr. Rajeev Srivastava Students: Achit Kumar Ojha Aseem Kumar Akshay Tyagi.

Che-An Wu Background substitution. Background Substitution AlphaMa p Trimap Depth Map Extract the foreground object and put into another background Objective.

Physically Based Lens Flare

The Graphic PipeLine

Embedding Context with Photographic Steganography

Removing Highlight Spots in Visual Hull Rendering

Content-based Image Retrieval

Image Based Modeling and Rendering (PI: Malik)

Physics-based simulation for visual computing applications

All images are compressed.

Artistic Rendering Final Project Initial Proposal

20 November 2019 Output maps Normal Diffuse Roughness Specular

ICLR, 2019 Jiahe Li

Presentation transcript:

Eurographics 2012, Cagliari, Italy 3D Material Style Transfer Chuong H. Nguyen 1, Tobias Ritschel 2, Karol Myszkowski 1, Elmar Eisemann 2, Hans-Peter Seidel 1 1 Max-Planck-Institut Informatik 2 Telecom ParisTech / CNRS

Eurographics 2012, Cagliari, Italy Background – Material Perception [Ce Liu et al. 2010]

Eurographics 2012, Cagliari, Italy Background - Mood

Eurographics 2012, Cagliari, ItalyBackground

Motivation Scene without Materials Guide Image Scene with Materials

Eurographics 2012, Cagliari, Italy Previous Works - Colorization Color Transfer Reinhard et al: Color Transfer between Images, IEEE CG&A 2001 Colorization Welsh et al: Transfering Color to Greyscale Images, Siggraph 2001 Irony et al: Colorization by Examples, EGSR 2005

Eurographics 2012, Cagliari, Italy Previous Works – Detail Synthesis Improving the Realism Johnson et al: CG2Real: Improving the Realism of Computer Generated Images using a Large Collection of Photographs, IEEE TVCG 2010 Analogy Hertzmann et al: Image Analogies, Siggraph 2001 Mertens et al: Texture Transfer Using Geometry Correlation, EGSR 2007

Eurographics 2012, Cagliari, Italy Previous Work – Materials Image-Based Material Editing Khan et al: Image-Based Material Editing, Siggraph 2006 Material Perception Vangorp et al: The Influence of Shape on the Perception of Material Reflectance, Siggraph 2007

Eurographics 2012, Cagliari, Italy Problem statement Guide Source3D Scene ObjectsMaterials

Eurographics 2012, Cagliari, Italy Material Extraction Guide Source3D Scene ObjectsMaterials

Eurographics 2012, Cagliari, Italy Material Extraction Original Diffuse Specular 1 st K-Mean Merging2 nd K-Mean Extracted MaterialsTexture Diffuse and Specular Extraction Yang et al: Real-time Specular Highlight Removal Using Bilateral Filtering, ECCV, 2010

Eurographics 2012, Cagliari, Italy Material Extraction Results 12

Eurographics 2012, Cagliari, Italy Material Assignment Guide Source3D Scene ObjectsMaterials

Eurographics 2012, Cagliari, Italy Material Assignment Goal Guide Source ObjectsMaterials (Image Cost) (Geometry Cost)

Eurographics 2012, Cagliari, Italy Material Assignment Goal – Image Cost Guide Source ObjectsMaterials (Image Cost) (Geometry Cost)

Eurographics 2012, Cagliari, Italy Material Assignment - Image Cost Guide Source3D Scene ∑

Eurographics 2012, Cagliari, Italy Material Assignment Goal – Geometry Cost Guide Source ObjectsMaterials (Image Cost) (Geometry Cost)

Eurographics 2012, Cagliari, Italy 3D Scene Material Assignment - Geometry Cost Guide Source

Eurographics 2012, Cagliari, Italy Geometry Cost – Shape Descriptor 2D Angular Radial Transform (ART) Bober et al: MPEG-7 visual shape descriptors, IEEE Circuits and Sys. Vid. Tech. 11, 6 (2001) 35 coefs (B) 35 coefs (A) 35 coefs (C) 35 coefs (G) 35 coefs (H) 35 coefs(E) 35 coefs (D) 35 coefs (F) 35 coefs (O),…

Eurographics 2012, Cagliari, Italy Cost Function = Image Cost + Geometry Cost + ……

Eurographics 2012, Cagliari, Italy Material Assignment Guide Source3D Scene ObjectsMaterials

Eurographics 2012, Cagliari, Italy Optimization – Simulated Annealing + …… + …… otherwise assignment i th assignment i+1 th

Eurographics 2012, Cagliari, Italy Results: Pebbles

Eurographics 2012, Cagliari, Italy Results: Temple

Eurographics 2012, Cagliari, Italy Results: Kitchen

Eurographics 2012, Cagliari, Italy Results: Bedroom

Eurographics 2012, Cagliari, Italy Perceptual Study – Step 1

Eurographics 2012, Cagliari, Italy Perceptual Study – Step 2 60% best

Eurographics 2012, Cagliari, ItalyLimitations Plausible material extraction Image segmentation errors Fix lighting

Eurographics 2012, Cagliari, Italy Conclusion and Future Work Conclusion –Plausible material extraction from images –An automatic system for 3D material style transfer Future work –Material database for different objects –Better object recognition techniques

Eurographics 2012, Cagliari, Italy Thank you!