Shape-Dependent Gloss Correction

Slides:

Advertisements

Similar presentations

Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania.

Advertisements

Effects of brightness and Dragutin Ivanec & Veseljka Rebić Department of Psychology Faculty of Humanities and Social Sciences, University of Zagreb background-stimulus.

Am I Blue? 30 January 2011 (v. 2.0) Brian C. Madden, Ph.D. Department of Dermatology University of Rochester.

Motion Illusions As Optimal Percepts. What’s Special About Perception? Arguably, visual perception is better optimized by evolution than other cognitive.

Understanding the role of phase function in translucent appearance

The perception of Shading and Reflectance E.H. Adelson, A.P. Pentland Presenter: Stefan Zickler.

SPECULAR FLOW AND THE PERCEPTION OF SURFACE REFLECTANCE Stefan Roth * Fulvio Domini † Michael J. Black * * Computer Science † Cognitive and Linguistic.

A Perceptual Heuristic for Shadow Computation in Photo-Realistic Images Wednesday, 2 August 2006 Peter VangorpOlivier DumontToon LenaertsPhilip Dutré.

Color2Gray: Salience-Preserving Color Removal

Color2Gray: Salience-Preserving Color Removal Amy Gooch Sven Olsen Jack Tumblin Bruce Gooch Northwestern University.

Audiovisual Emotional Speech of Game Playing Children: Effects of Age and Culture By Shahid, Krahmer, & Swerts Presented by Alex Park

Physics-based Illuminant Color Estimation as an Image Semantics Clue Christian Riess Elli Angelopoulou Pattern Recognition Lab (Computer Science 5) University.

LECTURE 2: LOOKING AT LANDSCAPES 1VISUAL PERCEPTION 2VISUAL ELEMENTS 3PERCEPTUAL RELATIONSHIPS.

Graphics-1 Gentle Introduction to Computer Graphics Based on: –David Brogan’s “Introduction to Computer Graphics” Course Slides, University of Virginia.

Medical Image Display Bradley Hemminger School of Information and Library Science Department of Radiology, University of North Carolina, Chapel Hill

May 2004SFS1 Shape from shading Surface brightness and Surface Orientation --> Reflectance map READING: Nalwa Chapter 5. BKP Horn, Chapter 10.

Myers’ EXPLORING PSYCHOLOGY (6th Ed)

Blackshot: An Unexpected Dimension of Human Sensitivity to Contrast Michael S. Landy New York University Charles Chubb University of California, Irvine.

WPI Center for Research in Exploratory Data and Information Analysis From Data to Knowledge: Exploring Industrial, Scientific, and Commercial Databases.

Input: Original intensity image. Target intensity image (i.e. a value sketch). Using Value Images to Adjust Intensity in 3D Renderings and Photographs.

Estimating the delay of the fMRI response C.H. Liao 1, K.J. Worsley 12, J-B. Poline 3, G.H. Duncan 4, A.C. Evans 2 1 Department of Mathematics.

Graphs Recording scientific findings. The Importance of Graphs Line Graphs O Graphs are a “picture” of your data. O They can reveal patterns or trends.

Technology and Historical Overview. Introduction to 3d Computer Graphics  3D computer graphics is the science, study, and method of projecting a mathematical.

The Free-form Light Stage Vincent Masselus Philip Dutré Frederik Anrys Department of Computer Science.

Lecture 2b Readings: Kandell Schwartz et al Ch 27 Wolfe et al Chs 3 and 4.

Radiance Workshop, October 1-2, 2007 Perceived shininess and rigidity - Measurements of shape-dependent specular flow of rotating objects Katja Doerschner.

Purdue University Page 1 Color Image Fidelity Assessor Color Image Fidelity Assessor * Wencheng Wu (Xerox Corporation) Zygmunt Pizlo (Purdue University)

“When” rather than “Whether”: Developmental Variable Selection Melissa Dominguez Robert Jacobs Department of Computer Science University of Rochester.

Image-based Lighting Design Frederik Anrys Philip Dutré Computer Graphics Group 8 Sept

Goal and Motivation To study our (in)ability to detect inconsistencies in the illumination of objects in images Invited Talk! – Hany Farid: Photo Forensincs:

Introduction to Radiosity Geometry Group Discussion Session Jiajian (John) Chen 9/10/2007.

Vector Graphics Digital Multimedia Chap 이병희

Image-Based Rendering of Diffuse, Specular and Glossy Surfaces from a Single Image Samuel Boivin and André Gagalowicz MIRAGES Project.

G52IIP, School of Computer Science, University of Nottingham 1 Summary of Topic 2 Human visual system Cones Photopic or bright-light vision Highly sensitive.

Copyright, 1999 © Valerie A. Summers Calibration for Augmented Reality Experimental Testbeds Valerie A. Summers, Kellogg S. Booth, Tom Calvert, Evan Graham,

PERCEPTUAL STRATEGIES FOR MATERIAL IDENTIFICATION Qasim Zaidi Rocco Robilotto Byung-Geun Khang SUNY College of Optometry.

Evaluating Perceptual Cue Reliabilities Robert Jacobs Department of Brain and Cognitive Sciences University of Rochester.

1 Self-Calibration and Neural Network Implementation of Photometric Stereo Yuji IWAHORI, Yumi WATANABE, Robert J. WOODHAM and Akira IWATA.

Unit VI: Perception: Perceptual constancy Perceptual constancy Stimuli changes, object perceived to stay the same In other words: Image on retina changes,

Motion Illusions As Optimal Percepts. What’s Special About Perception? Visual perception important for survival  Likely optimized by evolution  at least.

Accurate Image Based Relighting through Optimization Pieter Peers Philip Dutré Department of Computer Science K.U.Leuven, Belgium.

Geometry Synthesis Ares Lagae Olivier Dumont Philip Dutré Department of Computer Science Katholieke Universiteit Leuven 10 August, 2004.

姓名 : 許浩維學號 :M 日期 : Road Accident: Driver Behaviour, Learning and Driving Task 1.

Illumination Model How to compute color to represent a scene As in taking a photo in real life: – Camera – Lighting – Object Geometry Material Illumination.

Effect of laterality-specific training on visual learning Jenna Kelly & Nestor Matthews Department of Psychology, Denison University, Granville OH

Complex Experiments.

REGRESSION MODELS OF BEST FIT Assess the fit of a function model for bivariate (2 variables) data by plotting and analyzing residuals.

Bayesian Perception.

CHF 0.52 v’ 0.45 GT EC 0.16 u’ 0.24 BRM A D65 CHF GT EC JA D65 A EC BRM CHF GT CHF GT EC JA D65 A #1255 S URFACE C OLOR AND S PECULARITY : T ESTING THE.

Visual motion Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys.

Journal of Vision. 2003;3(5):3. doi: /3.5.3 Figure Legend:

Chapter 10: Complex Experimental Designs

From: Contextual effects on real bicolored glossy surfaces

Journal of Vision. 2017;17(2):1. doi: / Figure Legend:

Brain States: Top-Down Influences in Sensory Processing

Satoru Suzuki, Marcia Grabowecky Neuron

Coding of the Reach Vector in Parietal Area 5d

Joel S. Winston, Patrik Vuilleumier, Raymond J. Dolan Current Biology

Complex Experimental Designs

Visual Motion and the Perception of Surface Material

What is Science? Review This slide show will present a question, followed by a slide with an acceptable answer. For some questions, there is a definite.

Digital Image Fundamentals

Satoru Suzuki, Marcia Grabowecky Neuron

Brain States: Top-Down Influences in Sensory Processing

Joseph T. McGuire, Matthew R. Nassar, Joshua I. Gold, Joseph W. Kable

Jingping P. Xu, Zijiang J. He, Teng Leng Ooi Current Biology

Joel S. Winston, Patrik Vuilleumier, Raymond J. Dolan Current Biology

The Perception and Misperception of Specular Surface Reflectance

Taosheng Liu, Franco Pestilli, Marisa Carrasco Neuron

Volume 34, Issue 4, Pages (May 2002)

Presentation transcript:

Shape-Dependent Gloss Correction Peter Vangorp Philip Dutré Department of Computer Science Katholieke Universiteit Leuven

Gloss Perception Shape influences gloss perception [Vangorp et al. 2007]

Gloss Perception Shape influences gloss perception [Vangorp et al. 2007]

Same material, different gloss perception Shape influences gloss perception Same material, different gloss perception

Corrected material, same gloss perception Shape influences gloss perception Corrected material, same gloss perception

Gloss Perception Shape influences gloss perception Bumpiness influences gloss perception [Ho et al. 2008]

Overview Perceptual Experiment Statistical Analysis Application: Gloss Correction

Stimulus Images Shape Material Differential rendering [Debevec 1998] Natural illumination [Fleming et al. 2003]

Stimulus Images Shape 5 well-known 3D models Size-independent statuettes and abstract shapes S1: Blob S2: Buddha S3: Bunny S4: Dragon S5: Sphere

Stimulus Images Material Neutral light grey plastic Perceptually uniform gloss variations [Pellacini et al. 2000] Adaptive to diffuse color G1 G2 G3 G4 G5

Which object is more glossy?

Experimental Procedure Training session 75 image pairs Same shape, only gloss difference Understanding of the term “glossy” Main experiment 325 image pairs (20 minutes) Shape and gloss difference 16 participants No difference between experienced and others

Cue Combination Simultaneous sensory cues Cue combination function Physical gloss G Physical shape S Cue combination function Perceived gloss = f(G,S) Decision variable D = f(Gleft,Sleft) – f(Gright,Sright) + e D > 0 if left image looks more glossy than right

Decision Variable Ideal observer Right image Left image

Decision Variable Ideal observer Right image Left image

Decision Variable Ideal observer Right image Left image

Decision Variable Ideal observer Right image Left image

Decision Variable Ideal observer Right image Left image

Decision Variable Ideal observer Right image Left image

Decision Variable Ideal observer Right image Left image

Decision Variable Ideal observer Right image Left image

Decision Variable Experimental data Right image Left image

Decision Variable Experimental data Right image Left image

Cue Combination Simplest model for perceived gloss f(G,S) Interaction between G and S Independent of S Additive influence of G and S Full interaction Linearity of G component [Pellacini et al. 2000] Linear Non-linear

Cue Combination 6 models for f(G,S)

Cue Combination 6 models for f(G,S) Full Additive Independent

Cue Combination 6 models for f(G,S) Non-linear Linear

Cue Combination 6 models for f(G,S)

Cue Combination 6 models for f(G,S)

Cue Combination 6 models for f(G,S)

Cue Combination 6 models for f(G,S)

Cue Combination Non-linear, additive model for f(G,S) Non-linear curve Additive offset bunny dragon blob buddha sphere

Gloss Correction Change shape Vertical Horizontal Jump curves Physical gloss Horizontal Perceptual gloss

Gloss Correction Change shape Vertical Horizontal Jump curves Physical gloss Horizontal Perceptual gloss starting point

without gloss correction Change shape Jump curves Vertical Physical gloss Horizontal Perceptual gloss starting point shape change without gloss correction

without gloss correction Change shape Jump curves Vertical Physical gloss Horizontal Perceptual gloss starting point shape change without gloss correction

without gloss correction Change shape Jump curves Vertical Physical gloss Horizontal Perceptual gloss starting point shape change with gloss correction shape change without gloss correction

without gloss correction Change shape Jump curves Vertical Physical gloss Horizontal Perceptual gloss starting point shape change with gloss correction shape change without gloss correction

Examples Uncorrected

Examples Corrected

Examples Uncorrected

Examples Corrected

Examples bunny dragon blob buddha sphere

Examples bunny dragon blob buddha sphere Uncorrected:

Examples bunny dragon blob buddha sphere Corrected:

Non-linearity Perceptually uniform gloss variations [Pellacini et al. 2000] Contrast gloss c Distinctness-of-image gloss d Additional experiments

d c and d Material c

Distinctness-of-image gloss d Non-linearity Low end of contrast gloss c Main experiment c and d Contrast gloss c Distinctness-of-image gloss d

Examples: contrast gloss bunny dragon blob buddha sphere Uncorrected:

Examples: contrast gloss bunny dragon blob buddha sphere Corrected c:

Examples: DOI gloss bunny dragon blob buddha sphere Uncorrected:

Examples: DOI gloss bunny dragon blob buddha sphere Corrected d:

Conclusions and Future Work Influence of shape on gloss perception Simple model Application Gloss Correction Generalization Any shape, viewpoint, and illumination

Questions? www.cs.kuleuven.be/~graphics/SDGC