Lightness, Brightness, Contrast, and Constancy Ware Chapter 3 University of Texas – Pan American CSCI 6361, Spring 2014.

Slides:



Advertisements
Similar presentations
Lecture 16 – Lightness Perception
Advertisements

Chapter 6 Vision. Sensation and Perception: Important Vocabulary Terms Sensation is the process of receiving, transducing, and coding stimulus energy.
Physics 1230: Light and Color Ivan I. Smalyukh, Instructor Office: Gamow Tower, F Phone: Lectures: Tuesdays.
Chapter 7: Processing the Image Review structure of the eye Review structure of the retina Review receptive fields –Apply to an image on the retina –Usage.
Chapter 3: Neural Processing and Perception. Lateral Inhibition and Perception Experiments with eye of Limulus –Ommatidia allow recordings from a single.
Chapter 6 Spatial Vision. The visual system recognizes objects from patterns of light and dark. We will focus on the mechanisms the visual system uses.
Chapter 9: Color Vision. Overview of Questions How do we perceive 200 different colors with only three cones? What does someone who is “color-blind” see?
What is vision Aristotle - vision is knowing what is where by looking.
Outline Sensation, Perception, Behavior Process of sensation Perceived vs. “real” world Properties of perceptual processes - Adaptation, pattern coding.
Perception Chapter 3 Light is necessary but not sufficient for vision Ganzfeld: a visual field completely lacking in contour, or luminance changes. Prolonged.
PSYC 330: Perception Seeing in Color PSYC 330: Perception
Perception of Stimuli Stephen Taylor.
1 Computational Vision CSCI 363, Fall 2012 Lecture 33 Color.
Version 0.10 (c) 2007 CELEST VISI  N Star Light, Star Bright, Let’s Explore Light How You Perceive Light How many black dots can you count?
Chapter 6 The Visual System
Why is this hard to read. Unrelated vs. Related Color Unrelated color: color perceived to belong to an area in isolation (CIE 17.4) Related color: color.
Brightness and Lightness Brightness: Describe the intensity of the light sources such as sun, candle, Dark, dim, bright, dazzling… Sensation depends on.
The Human Visual System Vonikakis Vasilios, Antonios Gasteratos Democritus University of Thrace
Ch 31 Sensation & Perception Ch. 3: Vision © Takashi Yamauchi (Dept. of Psychology, Texas A&M University) Main topics –convergence –Inhibition, lateral.
Physics 1230: Light and Color Ivan I. Smalyukh, Instructor Office: Gamow Tower, F Phone: Lectures: Tuesdays.
Major transformations of the light signal in the retina: 1.Temporal filtering – visual response slower than input signal. 2. Spatial filtering – local.
LECTURE 17: VISION--ORGANIZATION AND FUNCTION OF RETINA REQUIRED READING: Kandel text, Chapter 26 central The retina is part of the central nervous system,
EE465: Introduction to Digital Image Processing
Polygon Shading. Assigning color to a shape to make graphical scenes look realistic, or artistic, or whatever effect we’re attempting to achieve But first.
Any questions about the current assignment? (I’ll do my best to help!)
DO NOW: What do you know about our sense of sight and vision? What parts of the eye do you know? What do you know about light?
1 Perception and VR MONT 104S, Fall 2008 Lecture 7 Seeing Color.
Human Eye and Color Rays of light enter the pupil and strike the back of the eye (retina) – signals go to the optic nerve and eventually to the brain Retina.
Sensation & Perception
Lightness && Ming Huan Lee Feb. 3, 2003 Brightness CPSC 533C Information Visualization Contrast Constancy.
Foveal cones are about 2.4 μm in diameter (0.7 min of arc) Peripheral cones are about 5.8 μm in diameter (1.7 min of arc)
Computer Vision – Fundamentals of Human Vision Hanyang University Jong-Il Park.
3.2 VISION 70% of your receptor cells are in your eyes taste and touch need direct contact where as sight and smell don’t Sight can be experienced from.
15 1 Grossberg Network Biological Motivation: Vision Eyeball and Retina.
Myers EXPLORING PSYCHOLOGY Module 14 Introduction to Sensation and Perception: Vision James A. McCubbin, PhD Clemson University Worth Publishers.
.  Sensation: process by which our sensory receptors and nervous system receive and represent stimulus energy  Perception: process of organizing and.
Chapter 9: Perceiving Color. What Are Some Functions of Color Vision? Color signals help us classify and identify objects. Color facilitates perceptual.
Vision: change, lightness, acuity
Illusions By Linda Doan. The Hermann Square Do you see gray circles in the intersection of the squares? Look again, do those circles really exist?
Ch 31 Sensation & Perception Ch. 3: Vision © Takashi Yamauchi (Dept. of Psychology, Texas A&M University) Main topics –convergence –Inhibition, lateral.
Chapter 6 Section 2: Vision. What we See Stimulus is light –Visible light comes from sun, stars, light bulbs, & is reflected off objects –Travels in the.
Chapter 3 Sensation and Perception McGraw-Hill ©2010 The McGraw-Hill Companies, Inc. All rights reserved.
CHAPTER 4 – SENSATION AND PERCEPTION SECTION 1 – SENSATION AND PERCEPTION: THE BASICS Objective: DISTINGUISH BETWEEN SENSATION AND PERCEPTION, AND EXPLAIN.
The Visual System: Retinal Mechanisms
03/05/03© 2003 University of Wisconsin Last Time Tone Reproduction If you don’t use perceptual info, some people call it contrast reduction.
Exam Results Mean: 76 Median: 79. Exam Results: Grading Policies Our grading policies as outlined on the website are as follows: Approximately half of.
Retina- your CCD.
Chapter 3: Neural Processing and Perception. Neural Processing and Perception Neural processing is the interaction of signals in many neurons.
1 Computational Vision CSCI 363, Fall 2012 Lecture 5 The Retina.
Option E: Neurobiology and Behavior. E.2.1 Outline the diversity of stimuli that can be detected by human sensory receptors, including mechanoreceptors,
1 Perception and VR MONT 104S, Fall 2008 Lecture 4 Lightness, Brightness and Edges.
Version 0.10 (c) 2007 CELEST VISI  N BRIGHTNESS CONTRAST CLASSROOM PRESENTATION PRE-EXPERIMENT How many black dots can you count?
Sensation and Perception Module 18 Vision. Energy=Light We only see a small spectrum of light rays 2 characteristics determine our sensory experiences.
COMPUTER GRAPHICS CS 482 – FALL 2015 SEPTEMBER 1, 2015 HUMAN VISUAL PERCEPTION EYE PHYSIOLOGY COLOR BLINDNESS CONSTANCY SHADOWS PARALLAX STEREOSCOPY.
Chapter 9: Perceiving Color. Figure 9-1 p200 Figure 9-2 p201.
1 Computational Vision CSCI 363, Fall 2012 Lecture 32 Biological Heading, Color.
Version 0.10 (c) 2007 CELEST VISI  N BRIGHTNESS CONTRAST CLASSROOM PRESENTATION PRE-EXPERIMENT How many black dots can you count?
Psychology 304: Brain and Behaviour Lecture 28
Illumination and Shading. Illumination (Lighting) Model the interaction of light with surface points to determine their final color and brightness OpenGL.
Lightness, Brightness and Contrast Week 3 :CCT370 – Introduction to Computer Visualization.
Vision.
Wadsworth, a division of Thomson Learning
Early Processing in Biological Vision
Introduction to Perception and Color
Mind, Brain & Behavior Wednesday February 12, 2003.
Option E: Neurobiology and Behavior
Image Perception and Color Space
Experiencing the World
(Do Now) Journal What is psychophysics? How does it connect sensation with perception? What is an absolute threshold? What are some implications of Signal.
Option E: Neurobiology and Behavior
Presentation transcript:

Lightness, Brightness, Contrast, and Constancy Ware Chapter 3 University of Texas – Pan American CSCI 6361, Spring 2014

The Big Picture (again) Ecological optics/perception –Gibson –Perception is in service of action For evolutionary (survival) advantage –See/perceive things that allow action E.g., surfaces for walking on, objects for interacting with, … Leads to (visual) system that: –Does extract “elementary” elements to use in perception Features Stage 1 Basis of sensory systems –AND interaction throughout system leads to perception Stages 2 and 3

Unfortunately … This evolutionarily derived system has pitfalls –Especially when used with various electronic media –Which is what we are concerned with! E.g., to see objects need to find edges... But, in effect “oversee” edges, e.g., Mach band –And other things …

Simultaneous Brightness Contrast Gray patch on dark background looks lighter than same patch on light background

Saw “Overdection” in GC Flat shading “looks worse than is…” –Mach banding at polygon edge for flat shading

Hermann Grid Illusion Black spots appear at intersections of bright lines –Couple of other things going on here …

So, … What perceived is NOT what is there! –Here, perceived edges, discontinuities, … –… and flashing dots (for heaven’s sake)! That way for evolutionary reasons –System to detect edges … For forming boundaries among things, to perceive objects –… and in general works well We’ve just been pushing systems boundaries –Finding places where fail Important to know where, and how, fails for designing visualizations At core of explanation is that “neurons detect differences” –… as Ware says –Will examine how neurons work –~Feature extraction

Overview Neurons detect differences … –… and inhibit, as well as excite And are connected to many others, …., as we’ve discussed Neurons, receptive fields, and brightness illusions Hermann grid, Mach bands, simultaneous brightness contrast –Contrast effects and artifacts in cg Lots of illustrations to complement theory Edge enhancement Luminance, brightness, and lightness –Physical energy, and perceived reflectance/color –Perception of surface lightness

Neurons Detect Differences Last time, saw that receptors act as transducers –Changing energy or chemicals to nerve signals In fact, receptors transmit signals about relative (vs. absolute) amount of energy, e.g., light –relative - How light differs from one receptor to another (spatial) –relative - How light has changed in past instant (temporal) –Ware: “Neurons in the early stages of the visual system do not behave like light meters; they behave like change meters.” –Implication is that visualization not good for measuring absolute numerical values, but rather for displaying patterns of differences or changes over time Again, nature of visual system leads to “errors” –Especially in computer graphics

Visualization and Neurology Main point of tonight is that as visualization designers we should: 1. At least be “sensitive” to the occurrence of these errors 2. As possible, be able to specify the conditions under which they occur Below – gravitational field –Neurologically detecting difference leads to Mach banding and contrast errors

Neurons, Receptive Fields, and Brightness Illusions In fact, considerable processing of information in eye itself –Several layers of cells culminate in retinal ganglion cells –Recall, n retinal cells into ganglion cells differs, as f(distance) fovea –Reception of retinal cells is by fields of neurons Ganglion cells send information through optic nerve to lateral geniculate nucleus Then, on to primary visual processing areas at back of brain, visual cortex

Receptive Fields Receptive field of a cell: –Visual area over which cell responds to light –Patterns of light falling on retina influence way neuron responds Even though may be many synapses removed from receptors Retinal ganglion cells organized with circular receptive fields that are either (1) on-center or (2) off- center –Cells are firing constantly –1. For on-center (from baseline firing rate): When stimulated in center of its receptive field, it emits pulses at greater rate When stimulated outside center of field, emits pulses at lower rate –Inhibitory effect of edge –2. For off-center, opposite A. Receptive field structure of on-center cell B. Response in activity of array of on-center cells to being stimulated by a bright edge - Output of system: Enhanced response on bright side of edge - Cell fires more on bright side because there is less light in inhibitory region, hence less inhibited Depressed response on dark side of edge Intermediate to uniform areas on either side of edge C. Smoothed plot of activity level

Receptive Fields – Another Graphical View Again, 1. For on-center –(from baseline firing rate) –When stimulated in center of its receptive field, it emits pulses at greater rate –When stimulated outside center of field, emits pulses at lower rate Inhibitory effect of edge –And, can be on-center-off-surround or off-center-on-surround But, let’s keep it simple

Center-surround Receptive Fields Receptive fields distributed across retina (and overlap) –Overlap not shown at rt. Work simultaneously to “enhance” and “suppress” rate of firing of collection of receptors in the field Center-surround Receptive Fields –Act as edge detectors more than level detectors – in ex at rt: A: mid-low B: Lowest C: Highest D: mid-high

Receptive Fields: DOG Model (opt.) Basic idea is that patterns are detected – will just mention … –And this model works well Firing rate of cells: –One Gaussian distribution represents center, other represent surround And firing rate is difference Difference of Gaussians (DOG) model Where, –x = distance from center of field –w 1 = width of center –w 2 = width of surround –  1,  2 amplitude parameters = amount of excitation or inhibition Can calculate effect of DOG-type receptor on patterns –Think of pattern passing over receptive field of cell, or output of whole array of DOG cells arranged in a line across the pattern –DOG receptive field can be used to explain variety of brightness contrast effects

Hermann Grid Illusion Black spots appear at intersections of bright lines –There is more inhibition at points between two squares –Hence, they seem brighter than at the points at the intersection

Hermann Grid Illusion with Receptive Fields Black spots appear at intersections of bright lines –There is more inhibition at points between two squares –Hence, they seem brighter than at the points at the intersection

Simultaneous Brightness Contrast Gray patch on a dark background looks lighter than the same patch on a light background –Or, are they really not the same? … bets?

Simultaneous Brightness Contrast Background removed! (honest, no change in foreground)

Simultaneous Brightness Contrast Same phenomenon, again

Simultaneous Brightness Contrast Gray patch on a dark background looks lighter than the same patch on a light background –Predicted by DOG model of concentric opponent receptive fields

Mach Bands Saw the phenomenon, what’s going on?

Mach Bands At point where uniform area meets a luminance ramp, bright band is perceived –Said another way, appear where abrupt change in first derivative of brightness profile –Simulated by DOG model –Particularly a problem for uniformly shaded polygons in computer graphics Hence, various methods of smoothing are applied Ernst Mach

Mach Bands and Receptor Fields Point where uniform area meets luminance ramp, bright band is perceived –Another way, appear where abrupt change in 1st derivative of brightness profile –Simulated by DOG model –Particularly a problem for uniformly shaded polygons in computer graphics Hence, various methods of smoothing are applied

Simultaneous Contrast and Error Contrast effects are clear –Overestimate differences as edges –Even see things that aren’t there! Leads to errors of judgment in extracting information from visual displays –Gray scales, or any continuous tone, in particular lead to such errors –E.g., gravitational map, error in extracting information of 20% of entire scale

Simultaneous Contrast and Error Contrast effects are clear –Overestimate differences as edges –Even see things that aren’t there! Lead to errors of judgment in extracting information from visual displays –Gray scales, or any continuous tone, in particular lead to such errors –E.g., gravitational map, error in extracting information of 20% of entire scale

Contrast Effects and Artifacts in CG As noted, for computer graphics: –Consequence of Mach bands, etc. for shading algorithms –At best loss of “realism”, at worst perception of patterns at edges Shading of facets (polygons) –Uniform 1 value for a polygon –Gouraud Value for edges Average of surface normals at boundaries where facets meet Interpolated between boundaries Still discontinuity at at facet boundaries (edges) –Phong Surface normal interpolated between edges No Mach banding Actual light Perceived/DOG

Edge Enhancement: Cornsweet Effect Lateral inhibition –Can be considered 1 st stage of an edge detection process –Signals positions and contrasts of edges in environment –Result is that “pseudo-edges” are formed Cornsweet effect –2 areas that physically have same brightness can be made to look different by having an edge that shades off gradually to the 2 sides –Brain does perceptual interpolation, so that entire central region appear lighter than surrounding regions

Edge Enhancement: Art and Visualization Also used by artists –Limited dynamic range of paint –Important to make objects distinct –Seurat –Signat notes: Observance of the laws of contrast, methodical separation of the elements (light, shadow, local color, reactions) Visualization, generally –Adjust background –Make object stand out

Edge Enhancement: Seurat Bathing at Asnieres

Edge Enhancement: Seurat La Grande Jatte

Luminance, Brightness, Lightness

Ecologically, need to be able to manipulate objects in environment Information about quantity of light, of relatively little use –Rather, what need to know about its use Human visual system evolved to extract surface properties –Loose information about quantity and quality of light –E.g., experience colored objects, not color light Color constancy –Similarly, overall reflectance of a surface Lightness constancy

Luminance, Brightness, Lightness Consider physical stimulus and perception Luminance (physical) –Amount of light (energy) coming from region of space, Measured as units energy / unit area E.g., foot-candles / square ft, candelas / square m Physical Brightness (perceptual) –Perceived amount of light coming from a source –Here, will refer to things perceived as self- luminous Lightness (perceptual) –Perceived reflectance of a surface –E.g., white surface is light, black surface is dark –Physical Luminance –Number of photons coming from a region of space –Perceptual: Brightness –Amount of light coming from a glowing source Lightness –Reflectance of a surface, paint shade

Luminance Amount of light (energy) hitting the eye To take into account human observer: –Weighted by the sensitivity of the photoreceptors to each wavelength Spectral sensitivity function: E.g., humans about 100 times less sensitive to light at 450nm than at 510nm Note, use of blue for detail, e.g., text, not seem good –Compounded by chromatic aberration in which blue focuses at different point Later, will examine difference cone sensitivities

Finer Detail Requires More Luminance Difference Recall, from last time spatial contrast sensitivity function Text: at least 3:1 –10:1 preferred Generalizes to data –Detection of detail requires more contrast More detail -> More Contrast

Brightness Perceived brightness and physical intensity Perceived amount of light coming from a glowing (self-luminous) object –E.g., instruments Perceived brightness very non-linear function of the amount of light –Shine a light of some intensity on a surface, and ask an observer, “How bright?” Intensity = How bright is the point?” (physical) (perceptual) Steven’s power law Intensity -> Perceived ^ Brightness |

Brightness – Power Law Stevens power law –Perceived sensation, S, is proportional to stimulus intensity, I, raised to a power, n –S = I n –Here, Brightness = Luminance n –With n = for patches of light, 0.5 for points –Applies only to lights in relative isolation in dark, so application more complicated Applies to many other perceptual channels –Loudness (dB), smell, taste, heaviness, force, friction, touch, etc. Enables high sensitivity at low levels without saturation at high levels Intensity -> Perceived ^ Brightness |

Monitor Gamma Monitors in fact emit light in amounts that are not linearly related to the voltage driving them –Historically, effort of early television engineers to most efficiently use available bandwidth –Exploits non-linearity of human perception Attempt to make linear change in voltage map for more closely to linear perceptual difference Luminance = Voltage  –  is monitor gamma –L ranges from 1.4 through 3 –L=3 cancels n=0.33 Stevens’ function: Brightness ~ (Voltage 3 ) 0.33 ~ Voltage Precise control of luminance requires careful monitor measurement and calibration –Can adjust on many monitors, as well as other corrections

Adaptation: Overall Light Level Amazing and high survival value Factor of 10,000 difference: sunlight to moonlight –Still can identify different-brightness materials –Absolute amount of light from surface irrelevant Adaptation to change in overall light level –Overall level of illumination “factored out” Allows relative changes in an environment to be perceived –Factor of 2 hardly noticeable –Iris opens and closes (small effect) –Receptors photobleach at high light levels (large effect) –Can take time to regenerate when entering dark areas –Eventually switch to rods 50 lux interior to 50,000 lux bright sunlight

End.

Contrast and Constancy Various constancies One is lightness constancy –Easy to tell which piece of paper is gray and which white –White paper is lighter relative to its background –Desk color is constant (factored in by system Contrast of object with background provides cue for accurate perception

Perception of Surface Lightness Perception of surface lightness, and lightness constancy depends on: –Adaptation and contrast, as noted Direction of illumination and surface orientation –E.g., white surface turned away from light source reflects less light than if turned toward light Lightest object in scene serves as “reference white to determine gray values of other objects –Cf., lightness scaling formulas Ratio of specular to nonspecular reflection –E.g., everything black vs. white, specular cues