Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania.

Slides:



Advertisements
Similar presentations
Objectives Make qualitative and quantitative observations
Advertisements

13- 1 Chapter 13: Color Processing 。 Color: An important descriptor of the world 。 The world is itself colorless 。 Color is caused by the vision system.
1 Graphics CSCI 343, Fall 2013 Lecture 18 Lighting and Shading.
Fleming, Breidt & Bülthoff Supplementary Images The following slides contain a number of example photographs to show how the claims in the main submission.
Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm Lecture #12.
Physics-based Illuminant Color Estimation as an Image Semantics Clue Christian Riess Elli Angelopoulou Pattern Recognition Lab (Computer Science 5) University.
Illumination Model How to compute color to represent a scene As in taking a photo in real life: – Camera – Lighting – Object Geometry Material Illumination.
Perception of illumination and shadows Lavanya Sharan February 14th, 2011.
Advanced lighting and rendering Multipass rendering.
Basic Principles of Surface Reflectance
Perception of illumination and shadows Lavanya Sharan February 14th, 2011.
Color, lightness & brightness Lavanya Sharan February 7, 2011.
Colour Constancy T.W. Hung. Colour Constancy – Human A mechanism enables human to perceive constant colour of a surface over a wide range of lighting.
Basic Principles of Surface Reflectance Lecture #3 Thanks to Shree Nayar, Ravi Ramamoorthi, Pat Hanrahan.
6.1 Vis_04 Data Visualization Lecture 6 - A Rough Guide to Rendering.
University of British Columbia CPSC 414 Computer Graphics © Tamara Munzner 1 Shading Week 5, Wed 1 Oct 2003 recap: lighting shading.
Image Statistics and the Perception of 3D Shape Roland W. Fleming Max Planck Institute for Biological Cybernetics Yuanzhen Li Edward H. Adelson Massachusetts.
RenderToolbox A MATLAB Toolkit for Hyperspectral Rendering with Radiance and PBRT Daniel P. Lichtman, Bei Xiao, David H. Brainard.
Face Relighting with Radiance Environment Maps Zhen Wen 1, Zicheng Liu 2, Thomas Huang 1 Beckman Institute 1 University of Illinois Urbana, IL61801, USA.
Integration Of CG & Live-Action For Cinematic Visual Effects by Amarnath Director, Octopus Media School.
Computer Vision Spring ,-685 Instructor: S. Narasimhan PH A18B T-R 10:30am – 11:50am Lecture #13.
Fundamentals of Computer Graphics Part 6 Shading prof.ing.Václav Skala, CSc. University of West Bohemia Plzeň, Czech Republic ©2002 Prepared with Angel,E.:
UNIT THREE PACKAGE PRINTING AND DECORATING 单元三 包装印刷与装潢 Lesson 9 Color 颜色 Introduction Color Perception Color Terminology Viewing Color.
Shading (introduction to rendering). Rendering  We know how to specify the geometry but how is the color calculated.
COMPUTER GRAPHICS CS 482 – FALL 2014 AUGUST 27, 2014 FIXED-FUNCTION 3D GRAPHICS MESH SPECIFICATION LIGHTING SPECIFICATION REFLECTION SHADING HIERARCHICAL.
1.What is the difference between a primary and secondary color? 2.What are the different parts of the eye and how they work? 3.What is the difference.
Human Eye and Color Rays of light enter the pupil and strike the back of the eye (retina) – signals go to the optic nerve and eventually to the brain Retina.
Image-Based Rendering from a Single Image Kim Sang Hoon Samuel Boivin – Andre Gagalowicz INRIA.
Shading. What is Shading? Assigning of a color to a pixel in the final image. So, everything in shading is about how to select and combine colors to get.
Color and Light. Physical Properties of Light Physical properties is one of many different ways light can be classified/understood. Aesthetic Psychological.
Lecture 2b Readings: Kandell Schwartz et al Ch 27 Wolfe et al Chs 3 and 4.
Radiance Workshop, October 1-2, 2007 Perceived shininess and rigidity - Measurements of shape-dependent specular flow of rotating objects Katja Doerschner.
Graphical Models in Vision. Alan L. Yuille. UCLA. Dept. Statistics.
How natural scenes might shape neural machinery for computing shape from texture? Qiaochu Li (Blaine) Advisor: Tai Sing Lee.
CSE 381 – Advanced Game Programming GLSL Lighting.
Image-Based Rendering of Diffuse, Specular and Glossy Surfaces from a Single Image Samuel Boivin and André Gagalowicz MIRAGES Project.
Chapter 4: Variability. Variability Provides a quantitative measure of the degree to which scores in a distribution are spread out or clustered together.
Announcements Office hours today 2:30-3:30 Graded midterms will be returned at the end of the class.
Computer Graphics: Programming, Problem Solving, and Visual Communication Steve Cunningham California State University Stanislaus and Grinnell College.
Illumination and Shading
Photo-realistic Rendering and Global Illumination in Computer Graphics Spring 2012 Material Representation K. H. Ko School of Mechatronics Gwangju Institute.
Vision Review: Miscellaneous Course web page: October 8, 2002.
1 Surface Reflectance Estimation and Natural Illumination Statistics Ron Dror, Ted Adelson, Alan Willsky Artificial Intelligence Lab, Lab for Information.
CH. 2 Science Basics Biology: the scientific study of life. What makes something scientific? Observations, data, inferences, and generalizations are important.
Reflection of Light How do objects interact with incoming light?
Color and Brightness Constancy Jim Rehg CS 4495/7495 Computer Vision Lecture 25 & 26 Wed Oct 18, 2002.
UV Mapping After a 3D object has been modeled it must be prepared for texturing. 3D surfaces can be “unwrapped” into a 2D representation with. This process.
Visual Appearance Chapter 4 Tomas Akenine-Möller Department of Computer Engineering Chalmers University of Technology.
Illumination Model How to compute color to represent a scene As in taking a photo in real life: – Camera – Lighting – Object Geometry Material Illumination.
Shape-Dependent Gloss Correction
David Luebke3/16/2016 CS 551 / 645: Introductory Computer Graphics David Luebke
Moon Illusion Is an optical illusion in which the Moon appears larger near the horizon than it does while higher up in the sky and farther away.
1 of 32 Computer Graphics Color. 2 of 32 Basics Of Color elements of color:
Elements of Art & Principles of Design. Elements of Art – (building blocks of visual art)
Perceiving COLOR …like an Artist. What colors do you see? atch?v=9Q63z6GIPm0.
Computer Graphics: Illumination
Stimuli were presented on a 17 inch monitor (in a dimly lit room), operating at 60 Hz with a resolution of 1280 x Two objects of the same type (teapot.
CHF 0.52 v’ 0.45 GT EC 0.16 u’ 0.24 BRM A D65 CHF GT EC JA D65 A EC BRM CHF GT CHF GT EC JA D65 A #1255 S URFACE C OLOR AND S PECULARITY : T ESTING THE.
MAN-522 Computer Vision Spring
Shading CS 465 Lecture 4 © 2004 Steve Marschner • 1.
An Additive Latent Feature Model
Color and Light.
Visual Appearance Chapter 4
From: Surface color perception and equivalent illumination models
Unit-7 Lighting and Shading
Brief Review of Recognition + Context
Human Perception 9: Color.
Fundamentals of Computer Graphics Part 6 Shading
Visual Motion and the Perception of Surface Material
Optical Illusions An optical illusion is characterized by visually perceived images that are deceptive or misleading. The information gathered by the eye.
Presentation transcript:

Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania

What Color is the Mug?

Most Appearance Studies Consider Flat Uniform Patches

Highlight Inter-reflection A Complex Pattern of Light is Reflected from 3D Objects

Surface Gloss Increases the Variation of Reflected Light

How do people perceive the color of different parts of an object? Questions How do material properties of the object affect color perception?

Task: Asymmetric Color Matching TestMatch

Task: Asymmetric Color Matching Adjusting! TestMatch

Task: Asymmetric Color Matching Adjusting! TestMatch

Task: Asymmetric Color Matching Adjusting! TestMatch

Task: Asymmetric Color Matching Adjusting! TestMatch

Task: Asymmetric Color Matching Adjusting! TestMatch

Task: Asymmetric Color Matching TestMatch Done!

Rendering Methods Images are rendered wavelength by wavelength using customized Matlab software (RenderToolbox). The underlying renderer is Radiance. RenderToolbox is available at

Ward Model of Surface Reflection Specular Component (material properties) Diffuse Component (body color)

Experimental Variables: Location, Material, Color Material Color Location

Results: Pictorial Representation Mean Up Match Up Mean Bottom Match Bottom Test Up Test Bottom

Results: Pictorial Representation Match Up Match Bottom Test Up Mean Up Test Bottom Mean Bottom

Results: Pictorial Representation Test Up Mean Up Match Up Test Bottom Mean Bottom Match Bottom

Results: Pictorial Representation Test Up Mean Up Match Up Test Bottom Mean Bottom

Match Bottom Results: Pictorial Representation Test Up Mean Up Match Up Test Bottom Mean Bottom

Match Bottom Results: Pictorial Representation Test Up Mean Up Match Up Test Bottom Mean Bottom

Preliminary Conclusions Changing test patch location of an object has a small effect on color perception of the patch. This is not predicted by the average of the light reflected from the patch. Effect of surface material properties on color perception of the patch is also small.

Quantitative Data Representation test mean Xiao, B. and Brainard, D.H. (under review) Visual Neuroscience

Transformed Data Representation test mean

Transformed Data Representation test mean match

Transformed Data Representation test mean match

Transformed Data Representation test mean match

Transformed Data Representation test mean match

Transformed Data Representation test mean match

Soccer Ball Experiment, More Data

Location Effect Index (LEI) up bottom Vt Vm For each material condition: LEI = [ |Vm| / |Vt| ] test mean match

LEI Histograms Corrected mean: Purple = 0.09 Yellow-green = 0.13

Material Influence Index (MII) For each mach: MII = [ |Vm| / |Vt| ] matte glossy test mean match Vt Vm

MII Histograms Corrected mean: Purple = 0.17 Yellow-green = 0.13

Conclusions Effect of location is small in comparison with the mean prediction. This suggests color appearance is stable across different parts of an object. Matches are not predicted by the average of the light reflected across the image of the object. Were interested in the color appearance of 3D objects in rich scenes. Surface gloss has a small effect on color perception of the test patch on 3D objects when the diffuse component is constant.

Prof. David H. Brainard Ah Rim Shin Lu Yin Dan Lichtman Dr. Sarah Allred Prof. James Hillis Dr. Robyn Oliver Chris Broussard Acknowledgement

Implications For Models Image-statistics: Use image mean, skewness, percentiles to estimate diffuse reflectance (body color). Inverse-optics: estimating geometry of the light source and use the estimated geometry to infer diffuse reflectance.

Design: Test Patch Location Effect

Results: Pictorial Representation Test Up Match Up Mean Up Test Bottom Match Bottom Mean Bottom

Results: Pictorial Representation Test Up Match Up Mean Up Test Bottom Match Bottom Mean Bottom

Results: Pictorial Representation Test Up Match Up Mean Up Test Bottom Match Bottom Mean Bottom

CIELAB Representation of Test Stimuli

LEI Histograms, Compared with Residuals

Material Influence Index (LEI)

Results: Pictorial Representation Test Up Match Up Mean Up Test Bottom Match Bottom Mean Bottom

Results: Pictorial Representation Test Up Match Up Mean Up Test Bottom Match Bottom Mean Bottom

Results: Pictorial Representation Test Up Match Up Mean Up Test Bottom Match Bottom Mean Bottom

Results: Pictorial Representation Test Up Match Up Mean Up Test Bottom Match Bottom Mean Bottom

Results: Pictorial Representation Test Up Match Up Mean Up Test Bottom Match Bottom Mean Bottom

Results: Pictorial Representation Test Up Match Up Mean Up Test Bottom Match Bottom Mean Bottom

Results: Pictorial Representation Test Up Match Up Mean Up Test Bottom Match Bottom Mean Bottom

Results: Pictorial Representation Test Up Match Up Mean Up Test Bottom Match Bottom Mean Bottom