Image-based Lighting Design Frederik Anrys Philip Dutré Computer Graphics Group 8 Sept. 2004.

Slides:



Advertisements
Similar presentations
Multispectral Format from Perspective of Remote Sensing
Advertisements

Photoshop Lab colorspace A quick and easy 26 step process for enhancing your photos.
High Dynamic Range Imaging Samu Kemppainen VBM02S.
UNDERSTANDING RAW Joe Sukenick DigiQuest
Week 11 - Wednesday.  Image based effects  Skyboxes  Lightfields  Sprites  Billboards  Particle systems.
Computer graphics & visualization HDRI. computer graphics & visualization Image Synthesis – WS 07/08 Dr. Jens Krüger – Computer Graphics and Visualization.
Computational Photography Prof. Feng Liu Spring /15/2015.
10/14/14 Image-based Lighting Computational Photography Derek Hoiem, University of Illinois Many slides from Debevec, some from Efros T2.
Multimedia for the Web: Creating Digital Excitement Multimedia Element -- Graphics.
Computational Photography
Digital Audio, Image and Video Hao Jiang Computer Science Department Sept. 6, 2007.
Display Issues Ed Angel Professor of Computer Science, Electrical and Computer Engineering, and Media Arts University of New Mexico.
Gradient Domain High Dynamic Range Compression
8.2 PICTURE IT Graphic Types and Their Uses. What Are Graphics?  Graphics are pictures/images  They could be images taken on a digital camera or scanned.
Computer Graphics Inf4/MSc Computer Graphics Lecture Notes #16 Image-Based Lighting.
Photoshop: Designing Graphics for the Web Christine Vucinich & Vicki Weidler ITS Training Services 224 B Computer Building University Park, PA 16802
V Obtained from a summer workshop in Guildford County July, 2014
9/14/04© University of Wisconsin, CS559 Spring 2004 Last Time Intensity perception – the importance of ratios Dynamic Range – what it means and some of.
Colour Digital Multimedia, 2nd edition Nigel Chapman & Jenny Chapman
Digital Multimedia, 2nd edition Nigel Chapman & Jenny Chapman Chapter 6 This presentation © 2004, MacAvon Media Productions Colour.
Tone mapping with slides by Fredo Durand, and Alexei Efros Digital Image Synthesis Yung-Yu Chuang 11/08/2005.
Digital Images The digital representation of visual information.
Tutorial 2: Working with Image Files. Objectives Session 2.1 Learn about file formats and their uses Change file type, file size, and resolution Examine.
Product Design Sketching Chromatic Theories. Color Spectrum The range of colors seen by human eye is the “visible color spectrum”
Technology and Historical Overview. Introduction to 3d Computer Graphics  3D computer graphics is the science, study, and method of projecting a mathematical.
The Free-form Light Stage Vincent Masselus Philip Dutré Frederik Anrys Department of Computer Science.
11/15/11 Image-based Lighting Computational Photography Derek Hoiem, University of Illinois Many slides from Debevec, some from Efros T2.
1 Image Basics Hao Jiang Computer Science Department Sept. 4, 2014.
Image-Based Rendering from a Single Image Kim Sang Hoon Samuel Boivin – Andre Gagalowicz INRIA.
How A Camera Works Image Sensor Shutter Mirror Lens.
Interactive Virtual Relighting and Remodelling of Real Scenes C. Loscos 1, MC. Frasson 1,2,G. Drettakis 1, B. Walter 1, X. Granier 1, P. Poulin 2 (1) iMAGIS*
High Dynamic Range Images cs195g: Computational Photography James Hays, Brown, Spring 2010 slides from Alexei A. Efros and Paul Debevec.
Interactive Time-Dependent Tone Mapping Using Programmable Graphics Hardware Nolan GoodnightGreg HumphreysCliff WoolleyRui Wang University of Virginia.
Tone Mapping Software Photomatix Pro Application to Photography Konferenz und Workshop '05 Reality-Based Visualization.
Dynamic Range And Granularity. Dynamic range is important. It is defined as the difference between light and dark areas of an image. All digital images.
Sebastian Enrique Columbia University Relighting Framework COMS 6160 – Real-Time High Quality Rendering Nov 3 rd, 2004.
Filtering and Color To filter a color image, simply filter each of R,G and B separately Re-scaling and truncating are more difficult to implement: –Adjusting.
High-Resolution Interactive Panoramas with MPEG-4 발표자 : 김영백 임베디드시스템연구실.
Vocabulary Words. 2-stage shutter release is a shutter release, that when pressed halfway, it activates the autofocus and the light meter of the camera,
1 Introduction to Computer Graphics with WebGL Ed Angel Professor Emeritus of Computer Science Founding Director, Arts, Research, Technology and Science.
1 Chapter 2: Color Basics. 2 What is light?  EM wave, radiation  Visible light has a spectrum wavelength from 400 – 780 nm.  Light can be composed.
Advanced Computer Graphics Advanced Shaders CO2409 Computer Graphics Week 16.
Tone Mapping on GPUs Cliff Woolley University of Virginia Slides courtesy Nolan Goodnight.
Eighty-color-channel lighting Zoltán Márton Cecília Sik Lányi University of Pannonia Egyetem u. 10.
Rendering Synthetic Objects into Real Scenes: Bridging Traditional and Image-based Graphics with Global Illumination and High Dynamic Range Photography.
How digital cameras work The Exposure The big difference between traditional film cameras and digital cameras is how they capture the image. Instead of.
Relighting with 4D Incident Light Fields Vincent Masselus Pieter Peers Philip Dutré Yves D. Willems.
Differential Instant Radiosity for Mixed Reality Martin Knecht, Christoph Traxler, Oliver Mattausch, Werner Purgathofer, Michael Wimmer Institute of Computer.
Histograms and Color Balancing Computational Photography Derek Hoiem, University of Illinois 09/13/11 “Empire of Light”, Magritte.
Accurate Image Based Relighting through Optimization Pieter Peers Philip Dutré Department of Computer Science K.U.Leuven, Belgium.
Colors. Color Systems In computer graphics, we use RGB colors. But… –Can it represent all colors? –Is it linear? For example, (1.0, 1.0, 1.0) is white.
Augmented Reality and 3D modelling Done by Stafford Joemat Supervised by Mr James Connan.
Intelligent Robotics Today: Vision & Time & Space Complexity.
Composition.  Our first impulse when drawing is about the subject matter  But like a character in a story you might love, the story as well as the character.
03/03/03© 2003 University of Wisconsin Last Time Subsurface scattering models Sky models.
Romain Pacanowski INRIA Bordeaux University Xavier GranierChristophe SchlickPierre Poulin.
Image-Based Rendering Geometry and light interaction may be difficult and expensive to model –Think of how hard radiosity is –Imagine the complexity of.
All-Frequency Shadows Using Non-linear Wavelet Lighting Approximation Ren Ng Stanford Ravi Ramamoorthi Columbia Pat Hanrahan Stanford.
Multimedia and weBLOGging Grade 7-9 | Cahaya Bangsa Classical School (C) 2010 Digital Media Production Facility 03 - Still Picture 01 – Basics.
© ExplorNet’s Centers for Quality Teaching and Learning 1 Objective % Understand digital graphics production methods, software, and hardware.
Digital Light Sources First introduced in 2001.
Display Issues Ed Angel
Image-based Lighting Computational Photography
Digital Photo editing with Photoshop
Graphics: Production Methods, software, & Hardware
Introduction to Computer Graphics with WebGL
HDR Photography Hishamuddin Siri.
Lightmap compression in Halo 3
Traditionally artist have created their work with the following tools:
High Dynamic Range Images
Presentation transcript:

Image-based Lighting Design Frederik Anrys Philip Dutré Computer Graphics Group 8 Sept. 2004

Overview Paint a design on a photograph of a real life object. Light intensities are determined by using the photograph.

Previous Work Lighting Design –Sketching highlights and shadows to position lights (Poulin ‘97) –Painting with Light (Schoeneman ‘93) Image-based Relighting –A lighting reproduction approach to live-action composition (Debevec ‘02)

Overview

Acquisition: Lights Light Stage (Debevec) 40 IColor MR RGB Led Lights Simulate the visible spectrum once calibrated

Acquisition: Camera Canon EOS D30 digital Camera High Dynamic Range (HDR) Images Luminance values are represented in full floating point values instead of 8-bit RGB values used for display. No compression using a response curve. Usually constructed by taking a series of photographs

Overview

Basis images For each light source, construct a HDR image. Linearize each HDR image into a vector. Store each vector into matrix A.

Design Specification 1.Start painting desired lighting design using Adobe Photoshop. 2.Adjust color, contrast, add shadows, … 3.Linearize it into vector Y.

Overview

Optimization Find x such that is minimal A y

Optimization Ax resides in luminance space y resides in display space F converts Ax to display space –Why? The L2 norm is well defined and fast method for comparing images in display space. –F is standard Gamma correction function

Optimization Objective function is non-linear. Constrained in added for favoring regions/pixels

Optimization The problem is solved by Sequential Quadratic Programming (SQP). Gradient is computed analytically. Optimization takes 15 seconds to complete: –40 lightsources (3 channels). –P3-1.2 Ghz computer.

Results TargetResultTargetResultTargetResult

Results

TargetResultTargetResult

Future Work Determining light positions/directions. Multiple camera viewpoints. Give designer interactive feedback.

Acknowledgements Graphics group from K.U.Leuven. Artists for lending out their work. Thank you all. Questions?

Applying configuration to Light Stage: Reality check Target VirtualReal