Precomputed Radiance Transfer

Slides:

Advertisements

Similar presentations

Normal Mapping for Precomputed Radiance Transfer

Advertisements

Clustered Principal Components for Precomputed Radiance Transfer Peter-Pike Sloan Microsoft Corporation Jesse Hall, John Hart UIUC John Snyder Microsoft.

All-Frequency PRT for Glossy Objects Xinguo Liu, Peter-Pike Sloan, Heung-Yeung Shum, John Snyder Microsoft.

Bi-Scale Radiance Transfer Peter-Pike Sloan Xinguo Liu Heung-Yeung Shum John Snyder Microsoft.

Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Lighting Environments Peter-Pike Sloan, Microsoft Research Jan Kautz,

Surface Signals for Graphics John Snyder Researcher 3D Graphics Group Microsoft Research.

Jan Kautz, MPI Informatik Peter-Pike Sloan, Microsoft Research

Local, Deformable Precomputed Radiance Transfer

Spherical Harmonic Lighting Jaroslav Křivánek. Overview Function approximation Function approximation Spherical harmonics Spherical harmonics Some other.

A Novel Hemispherical Basis for Accurate and Efficient Rendering P. Gautron J. Křivánek S. Pattanaik K. Bouatouch Eurographics Symposium on Rendering 2004.

Real-time Shading with Filtered Importance Sampling

Computer graphics & visualization Global Illumination Effects.

Environment Mapping CSE 781 – Roger Crawfis

Real-Time Rendering Self-Shadowing

Zhao Dong 1, Jan Kautz 2, Christian Theobalt 3 Hans-Peter Seidel 1 Interactive Global Illumination Using Implicit Visibility 1 MPI Informatik Germany 2.

Spherical Convolution in Computer Graphics and Vision Ravi Ramamoorthi Columbia Vision and Graphics Center Columbia University SIAM Imaging Science Conference:

Spherical Harmonic Lighting of Wavelength-dependent Phenomena Clifford Lindsay, Emmanuel Agu Worcester Polytechnic Institute (USA)

All-Frequency Rendering of Dynamic, Spatially-Varying Reflectance

Rendering with Environment Maps Jaroslav Křivánek, KSVI, MFF UK

1. What is Lighting? 2 Example 1. Find the cubic polynomial or that passes through the four points and satisfies 1.As a photon Metal Insulator.

Computer graphics & visualization Pre-Computed Radiance Transfer PRT.

PRT Summary. Motivation for Precomputed Transfer better light integration and light transport –dynamic, area lights –shadowing –interreflections in real-time.

Precomputed Local Radiance Transfer for Real-time Lighting Design Anders Wang Kristensen Tomas Akenine-Moller Henrik Wann Jensen SIGGRAPH ‘05 Presented.

Real-Time Rendering Paper Presentation Imperfect Shadow Maps for Efficient Computation of Indirect Illumination T. Ritschel T. Grosch M. H. Kim H.-P. Seidel.

Advanced Computer Graphics (Spring 2005) COMS 4162, Lectures 18, 19: Monte Carlo Integration Ravi Ramamoorthi Acknowledgements.

An Efficient Representation for Irradiance Environment Maps Ravi Ramamoorthi Pat Hanrahan Stanford University.

Photon Tracing with Arbitrary Materials Patrick Yau.

Advanced Computer Graphics (Fall 2010) CS 283, Lecture 18: Precomputation-Based Real-Time Rendering Ravi Ramamoorthi

Real-Time Rendering COMS , Lecture 9. Real-Time Rendering Demo Motivation: Interactive rendering with complex natural illumination and realistic,

Computational Fundamentals of Reflection COMS , Lecture

Computer Graphics (Spring 2008) COMS 4160, Lecture 20: Illumination and Shading 2

Advanced Computer Graphics (Fall 2009) CS , Lecture 1: Introduction and History Ravi Ramamoorthi Some.

Direct-to-Indirect Transfer for Cinematic Relighting Milos Hasan (Cornell University) Fabio Pellacini (Dartmouth College) Kavita Bala (Cornell University)

Advanced Computer Graphics (Fall 2010) CS 283, Lecture 10: Global Illumination Ravi Ramamoorthi Some images courtesy.

Exploiting Temporal Coherence for Incremental All-Frequency Relighting Ryan OverbeckRavi Ramamoorthi Aner Ben-ArtziEitan Grinspun Columbia University Ng.

Precomputed Radiance Transfer Harrison McKenzie Chapter.

Fast Global-Illumination on Dynamic Height Fields

A Theory of Locally Low Dimensional Light Transport Dhruv Mahajan (Columbia University) Ira Kemelmacher-Shlizerman (Weizmann Institute) Ravi Ramamoorthi.

Face Relighting with Radiance Environment Maps Zhen Wen 1, Zicheng Liu 2, Thomas Huang 1 Beckman Institute 1 University of Illinois Urbana, IL61801, USA.

CS 445 / 645: Introductory Computer Graphics

Pre-computed Radiance Transfer Jaroslav Křivánek, KSVI, MFF UK

Efficient Irradiance Normal Mapping Ralf Habel, Michael Wimmer Institute of Computer Graphics and Algorithms Vienna University of Technology.

Jonathan M Chye Technical Supervisor : Mr Matthew Bett 2010.

CSC418 Computer Graphics n Illumination n Lights n Lightinging models.

Real-Time Rendering Digital Image Synthesis Yung-Yu Chuang 01/03/2006 with slides by Ravi Ramamoorthi and Robin Green.

An Efficient Representation for Irradiance Environment Maps Ravi Ramamoorthi Pat Hanrahan Stanford University SIGGRAPH 2001 Stanford University SIGGRAPH.

David Luebke 1 10/26/2015 Lighting CS 445/645 Introduction to Computer Graphics David Luebke, Spring 2003.

Real-Time Relighting Digital Image Synthesis Yung-Yu Chuang 1/10/2008 with slides by Ravi Ramamoorthi, Robin Green and Milos Hasan.

View-Dependent Precomputed Light Transport Using Nonlinear Gaussian Function Approximations Paul Green 1 Jan Kautz 1 Wojciech Matusik 2 Frédo Durand 1.

All-Frequency Shadows Using Non-linear Wavelet Lighting Approximation Ren Ng Stanford Ravi Ramamoorthi Columbia SIGGRAPH 2003 Pat Hanrahan Stanford.

1 Implicit Visibility and Antiradiance for Interactive Global Illumination Carsten Dachsbacher 1, Marc Stamminger 2, George Drettakis 1, Frédo Durand 3.

Quick survey about PRT Valentin JANIAUT KAIST (Korea Advanced Institute of Science and Technology)

Fast Approximation to Spherical Harmonics Rotation Sumanta Pattanaik University of Central Florida Kadi Bouatouch IRISA / INRIA Rennes Jaroslav Křivánek.

Fast Approximation to Spherical Harmonics Rotation

Real-Time High Quality Rendering CSE 291 [Winter 2015], Lecture 2 Graphics Hardware Pipeline, Reflection and Rendering Equations, Taxonomy of Methods

Photo-realistic Rendering and Global Illumination in Computer Graphics Spring 2012 Material Representation K. H. Ko School of Mechatronics Gwangju Institute.

Mitsubishi Electric Research Labs Progressively Refined Reflectance Fields from Natural Illumination Wojciech Matusik Matt Loper Hanspeter Pfister.

Global Illumination. Local Illumination  the GPU pipeline is designed for local illumination  only the surface data at the visible point is needed to.

Spherical Harmonics in Actual Games

Photo-realistic Rendering and Global Illumination in Computer Graphics Spring 2012 Ultimate Realism and Speed K. H. Ko School of Mechatronics Gwangju Institute.

Non-Linear Kernel-Based Precomputed Light Transport Paul Green MIT Jan Kautz MIT Wojciech Matusik MIT Frédo Durand MIT Henrik Wann Jensen UCSD.

Global Illumination (3) Path Tracing. Overview Light Transport Notation Path Tracing Photon Mapping.

All-Frequency Shadows Using Non-linear Wavelet Lighting Approximation Ren Ng Stanford Ravi Ramamoorthi Columbia Pat Hanrahan Stanford.

Toward Real-Time Global Illumination. Global Illumination == Offline? Ray Tracing and Radiosity are inherently slow. Speedup possible by: –Brute-force:

Toward Real-Time Global Illumination. Project Ideas Distributed ray tracing Extension of the radiosity assignment Translucency (subsurface scattering)

A Practical Analytic Single Scattering Model for Real Time Rendering

Advanced Computer Graphics

The Rendering Equation

Real-time Global Illumination with precomputed probe

Presentation transcript:

Precomputed Radiance Transfer 3/27/2017 10:02 PM Precomputed Radiance Transfer Peter-Pike Sloan SDE Windows Graphics & Gaming Technologies Microsoft Corporation © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Challenges in Rendering Generating realistic images interactively is hard Many dimensions of complexity Geometric complexity Material complexity Meso-scale complexity Lighting complexity Transport complexity Synergy This talk focuses on techniques that enable more lighting/transport complexity

Material Complexity Models how light interacts with a surface 3/27/2017 10:02 PM Material Complexity Models how light interacts with a surface Assume the “structure” of the material is below the visible scale Simple variation Twist maps © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Meso-Scale Complexity 3/27/2017 10:02 PM Meso-Scale Complexity Variations at a visible scale - not geometry Bump/Roughness maps Parallax Mapping/BTFs extreme examples of this © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Lighting Complexity What kind of lighting environment is an object in? Directional/point lights Directional + ambient “Smooth” (low frequency) lighting Completely general

Lighting Complexity What kind of lighting environment is an object in? Directional/point lights Directional + ambient “Smooth” (low frequency) lighting Completely general

Lighting Complexity What kind of lighting environment is an object in? Directional/point lights Directional + ambient “Smooth” (low frequency) lighting Completely general

Lighting Complexity What kind of lighting environment is an object in? Directional/point lights Directional + ambient “Smooth” (low frequency) lighting Completely general

Transport Complexity How light interacts with objects/scene at a visible scale Shadows Inter-reflections Caustics Translucency (subsurface scattering)

Transport Complexity How light interacts with objects/scene at a visible scale Shadows Inter-reflections Caustics Translucency (subsurface scattering)

Transport Complexity How light interacts with objects/scene at a visible scale Shadows Inter-reflections Caustics Translucency (subsurface scattering)

Transport Complexity How light interacts with objects/scene at a visible scale Shadows Inter-reflections Caustics Translucency (subsurface scattering)

Some of All of This Real scenes have all of these forms of complexity Extreme realism in one form of complexity is not necessarily that interesting Incredible material models that are completely homogenous and lit by a single directional light Great lighting environments for diffuse surfaces with no shadows

What is Precomputed Radiance Transfer (PRT)? 3/27/2017 10:02 PM What is Precomputed Radiance Transfer (PRT)? Parameterize an object’s response to lighting, expressed in some basis Partition into two processes Offline transport simulator precomputes spatially varying linear operators that map lighting in given basis to exit radiance Run time render the object using the current viewing/lighting environment using precomputed data © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM PRT Teaser Demo © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Terminology © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Terminology © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Terminology © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Terminology © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Rendering Equation 3/27/2017 10:02 PM © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Rendering Equation Radiance leaving point p in direction d 3/27/2017 10:02 PM Rendering Equation Radiance leaving point p in direction d © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Rendering Equation Radiance emitted from point p in direction d 3/27/2017 10:02 PM Rendering Equation Radiance emitted from point p in direction d © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Rendering Equation Integral over directions s on the hemisphere around p © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Rendering Equation BRDF at point p evaluated for incident direction s in outgoing direction d © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Rendering Equation Radiance arriving at point p from direction s (also LHS) © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Rendering Equation Lamberts law – cosine between normal and -s = dot(Np, -s) © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Neumann Expansion Exit radiance expressed as infinite series 3/27/2017 10:02 PM Neumann Expansion Exit radiance expressed as infinite series © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Neumann Expansion Direct lighting arriving at point p – from distant environment © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Neumann Expansion Direct lighting arriving at point p – from distant environment © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Neumann Expansion Source Radiance – distant lighting environment 3/27/2017 10:02 PM Neumann Expansion Source Radiance – distant lighting environment © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Neumann Expansion Visibility function - binary 3/27/2017 10:02 PM © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Neumann Expansion All paths from source that take 1 bounce 3/27/2017 10:02 PM Neumann Expansion All paths from source that take 1 bounce © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Neumann Expansion All paths from source that take 1 bounce L0 3/27/2017 10:02 PM Neumann Expansion L0 All paths from source that take 1 bounce © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Neumann Expansion All paths from source that take i bounces Li-1 3/27/2017 10:02 PM Neumann Expansion Li-1 All paths from source that take i bounces © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Diffuse PRT © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Diffuse PRT © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Diffuse PRT © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Diffuse PRT © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Diffuse PRT © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Diffuse PRT © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Diffuse PRT © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM Diffuse PRT © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Diffuse Self-Transfer 3/27/2017 10:02 PM Diffuse Self-Transfer 2D example, piecewise constant basis, shadows only Preprocess Project Light light Rendering • = = • light = • © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Precomputation . Basis 16 Basis 17 Basis 18 illuminate result 3/27/2017 10:02 PM Precomputation . Basis 16 Basis 17 illuminate result Basis 18 © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Spherical Harmonics Spherical analog to Fourier transform 3/27/2017 10:02 PM Spherical Harmonics Spherical analog to Fourier transform Represents complex functions on the sphere, real form used in graphics Polynomials in R3 Full basis through O has O2 coeffs Projection/Evaluation/Rotation are fairly straightforward Small number of bands implies “low frequency” lighting © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Spherical Harmonics 3/27/2017 10:02 PM © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Spherical Harmonics n=2 n=3 n=5 n=26 original 3/27/2017 10:02 PM © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

Spherical Harmonics Rotation invariance 3/27/2017 10:02 PM Spherical Harmonics Rotation invariance No temporal “wobbling” of projection Low frequency is also strength Reduces necessary surface sampling rate Addresses lighting that is most difficult with traditional techniques Global support is a limitation © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

3/27/2017 10:02 PM PRT Demo © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.

PRT Limitations/Extensions Rigid objects “Local, Deformable Precomputed Radiance Transfer”, Siggraph 2005 Raw form unwieldy 6th order would require 108 coefficients/vertex Siggraph 2003 paper compresses both data and computation, small number (4-12) coefficiens/vertex, much simpler shaders This is what makes it work in games…

PRT Limitations/Extensions Glossy surfaces Still to heavyweight for games, EGSR 2004 papers most applicable (separable BRDF approximations) “All Frequency”, using other light basis functions Ng et al Siggraph 2003, two EGSR 2004 papers Dramatically increases storage location per point, and spatial sampling rates over surfaces

PRT in the SDK Precomputation for diffuse objects only Includes inter-reflections and subsurface scattering Glossy isn’t practical for games Compression Siggraph 2003 paper, what made it actually doable in a game Run time code for efficient evaluation of lighting models, projection and rotation

Conclusions Precomputed Radiance Transfer enables interactive rendering of complex global illumination effects Appropriate for low frequency lights, can be mixed with traditional techniques to model high frequency lighting

Acknowledgments Coauthors John Snyder, Jan Kautz, Ben Luna, John Hart, Jesse Hall Samples/Artwork/Slides Jason Sandlin, John Steed, Shanon Drone Light Probes Paul Debevec

DirectX Community Resources http://msdn.com/directx “Windows Game Development” MSDN Forums http://forums.microsoft.com/msdn/default.aspx Forums: General, Graphics, Tools, Performance, and Audio Fully Moderated Discussions Notification Alerts, Messages and RSS Feeds Integrated with Visual Studio 2005 Advanced Search FAQs Answered/Unanswered Questions directx@microsoft.com

References “Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Lighting Environments”, Sloan, Kautz and Snyder Siggraph 2002 “Clustered Principal Components for Precomputed Radiance Transfer”, Sloan, Hall, Hart and Snyder Siggraph 2003 “All-Frequency Shadows Using Non-linear Wavelet Lighting Approximation”, Ng, Ramamoorthi and Hanranan Siggraph 2003 “All-Frequency Precomputed Radiance Transfer for Glossy Objects”, Liu, Sloan, Shum and Snyder, Eurographics Symposium on Rendering 2004 “All-Frequency Relighting of Non-Diffuse Objects using Separable BRDF Approximation”, Wang, Tran and Luebke, Eurographics Symposium on Rendering 2004 “Local, Deformable Precomputed Radiance Transfer”, Sloan, Luna and Snyder Siggraph 2005 http://research.microsoft.com/~ppsloan

© 2005 Microsoft Corporation. All rights reserved. 3/27/2017 10:02 PM © 2005 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary. © 2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no warranties, express or implied, in this summary.