Twelve visual perception. Processing in the human visual system (maybe, sort of) eye early vision (striate cortex) contour detection salienceattention.

Slides:



Advertisements
Similar presentations
Perception Chapter 4.
Advertisements

Sources of Illusions Illusions occur because our perceptual system is structured to function as though our assumptions and hypotheses about the world around.
PERCEPTION Chapter 4.5. Gestalt Principles  Gestalt principles are based on the idea that the whole is greater than the sum of the parts.  These principles.
Sensation and Perception
PSYC 1000 Lecture 21. Selective Attention: Stroop.
The eye – curved cornea – lens – retina – fovea – optic disk Using Light.
Outline Sensation, Perception, Behavior Process of sensation Perceived vs. “real” world Properties of perceptual processes - Adaptation, pattern coding.
Cognitive Processes PSY 334 Chapter 2 – Perception June 30, 2003.
Part 1. Part 1: Sensory Processing Vision Part 2: Other Sensory Systems.
Human Visual System Lecture 3 Human Visual System – Recap
The Human Visual System Vonikakis Vasilios, Antonios Gasteratos Democritus University of Thrace
Depth of Field depth of fieldConversely, for a given film position, there is a range of distance at which all objects have acceptable images on the film.
Myers’ EXPLORING PSYCHOLOGY (6th Ed)
Cognitive Processes PSY 334 Chapter 2 – Perception.
Ten light and image. Oscillation Occurs when two forces are in opposition Causes energy to alternate between two forms Guitar string Motion stretches.
Visual Perception. Sensation Stimuli from the outside world is detected by sensory receptors found in out our sensory organs. Sensation is the stimulation.
1B50 – Percepts and Concepts Daniel J Hulme. Outline Cognitive Vision –Why do we want computers to see? –Why can’t computers see? –Introducing percepts.
Sensation and Perception Part 1: Intro and Vision.
Perception Illusion A false representation of the environment
Sensation and Perception. Sensation: What is it? The process by which a stimulus in the environment produces a neural impulse that the brain interprets.
With respect to STM, grouping several items together to form a single larger item is called: A.BlockingB.Lumping C.ChunkingD.Grouping Electrochemical.
By Andrea Rees. Gestalt Principles 1) Closure 2) Proximity 3) Similarity 4) Figure VISUAL PERCEPTION PRINCIPLES OVERVIEW Depth Principles Binocular 1)
Vision Hearing Other Senses Perception 1 Perception 2.
Perception: The process of organizing and interpreting sensory information PERCEPTION.
PowerPoint  Presentation C h a p t e r 4 S E N S A T I O N & P E R C E P T I O N P S Y C H O L O G Y T h i r d E d i t i o n by Drew Westen John Wiley.
1 Perception, Illusion and VR HNRS , Spring 2008 Lecture 3 The Eye.
BY JESSIE PARKER VISUAL PERCEPTION PRINCIPLES. VISUAL PERCEPTION Visual perception is the ability to interpret the surrounding environment by processing.
Perception The process of organizing and interpreting information, enabling us to recognize meaningful objects and events.
VIEWING THE WORLD IN COLOR. COLOR A psychological interpretation Based on wavelength, amplitude, and purity Humans can discriminate among c. 10 million.
Sensation and Perception
1 Perception, Illusion and VR HNRS 299, Spring 2008 Lecture 8 Seeing Depth.
Chapter 6 Section 2: Vision. What we See Stimulus is light –Visible light comes from sun, stars, light bulbs, & is reflected off objects –Travels in the.
Chapter 3 Sensation and Perception McGraw-Hill ©2010 The McGraw-Hill Companies, Inc. All rights reserved.
Vision Part 2 Theories on processing colors. Objectives: The Student Will Compare and contrast color theories (VENN) Explain the Gestalt Theory List your.
Primary Questions in the Study of Perception The physiological question: How are the properties of objects in the environment represented by the activity.
Perception Chapter 5.
CHAPTER 4 – SENSATION AND PERCEPTION SECTION 1 – SENSATION AND PERCEPTION: THE BASICS Objective: DISTINGUISH BETWEEN SENSATION AND PERCEPTION, AND EXPLAIN.
Two Views of Perception: Bottom-up processing: -Low-level -Feature driven Top-down processing -Knowledge driven -Unconscious inference (Helmholtz)
Perception Is… The process of recognizing, organizing, and interpreting sensory information.
Perception Chapter 8, Section 3. Perception Allows us to confront changes in the environment; this allows us to adapt to change. The brain receives information.
1 Computational Vision CSCI 363, Fall 2012 Lecture 5 The Retina.
Color, Form and Depth Perception
1 Perception and VR MONT 104S, Fall 2008 Lecture 4 Lightness, Brightness and Edges.
Mind, Brain & Behavior Wednesday February 19, 2003.
1 Perception and VR MONT 104S, Fall 2008 Lecture 2 The Eye.
Sensation and Perception By Sarah Fredericks Period 1.
Perception 1. Inattentional Blindness Challenge: Count the number of passes the white shirts pass! VideoVideo (2mins) Video Type of selective attention.
Perception The process of organizing and interpreting information, enabling us to recognize meaningful objects and events.
Perception How do we define it?
Perception and VR MONT 104S, Fall 2008 Lecture 8 Seeing Depth
Visual Perception There are two categories of cognitive processes that we use when we assign meaning to incoming information. What are they?
Perception l The process by which sensory input is organized and formulated into “meaningful experiences” l Nativism vs Empiricism.
Visual Perception. What is Visual Perception? Visual perception are rules we apply to visual information to assist our organisation and interpretation.
Eight light and image. Oscillation Occurs when two forces are in opposition Causes energy to alternate between two forms Guitar string Motion stretches.
Perception  How do we define it? How we recognize and interpret stimuli How we recognize and interpret stimuli Top down processing… Top down processing…
Perception. The means by which information acquired from the environment via the sense organs is transformed into experiences of objects, events, sounds,
Sensation and Perception 19th October 2007
Vision.
How we organize and interpret sensory information
Visual Perception Chapter 3.
Wadsworth, a division of Thomson Learning
VIEWING THE WORLD IN COLOR
Chapter 4 Section 2 The Visual System
How you perceive your surroundings
Mind, Brain & Behavior Wednesday February 12, 2003.
Cognitive Processes PSY 334
Terms Sensation Perception Absolute Threshold Difference Threshold
Cognitive Processes PSY 334
Experiencing the World
PERCEPTION Def: the mental process of organizing sensory input into meaningful patterns.
Presentation transcript:

twelve visual perception

Processing in the human visual system (maybe, sort of) eye early vision (striate cortex) contour detection salienceattention object recognition (IT cortex) spatial memory (PP cortex) “what” pathway “where” pathway grouping

The eye Lens Depth of field Chromatic aberration Photoreceptors Rods Cones Fovea, macula, and periphery Retinal processing Gain control Edge enhancement? Simple motion detection lens/iris rods cones retinal ganglion

Photoreceptors Rods Found mostly in the macula and periphery Very sensitive to light But don’t detect color Cones Found in the fovea Less sensitive Color sensitive  Colors seem to fade in low light

Trichromacy Having different cones for every possible wavelength would be bad We just have three kinds of cones “Blue” cones: short wavelengths “Green” cones: intermediate wavelengths “Red” cones: long wavelengths However, their responses overlap The eye reduces all the wavelengths at a given pixel to just the total “amount” of “red”, “green”, and “blue”

Components of a color image

Evolution of the color system S to cortex

Evolution of the color system S to cortex L + intensity − chroma (B-Y) cool/warm

Intensity and chromaticity Color image Intensity (R+G+B)Chromaticity (B-Y) white = cool black = warm grey = neurtral

Evolution of the color system S to cortex I + intensity − chroma (B-Y) L − chroma (R-G) cool/warm

Intensity and chromaticity Color image Intensity Chromaticity (B-Y) white = cool black = warn grey = neutral Chromaticity (R-G) white = red black = green grey = balanced

Code [define gray [i → [color i i i]]] [define signed-gray [i → [gray [+ 128 [∕ i 2]]]]] [define b-y [c → [− [blue c] [∕ [+ [red c] [green c]] 2]]]] [map-bitmap [c → [signed-gray [b-y c]]] cones]

Code [define r-g [c → [− [red c] [green c]]]] [map-bitmap [c → [signed-gray [r-g c]]] cones]

Image-level processing Pixel-level processing Massively parallel Preattentive Very fast

Contrast versus absolute intensity The visual system responds less to the amount of light or color Than to variations in the amount This is also known as contrast

Contrast detection Many of the neurons in the visual system are designed to respond to contrast Center/surround receptive fields Stimulated by the presence of light in a specific area Inhibited by its presence in the area immediately around it − + inhibitory region (light prevents firing) excitatory region (light stimulates firing)

Edge detection When applied to image intensity (R+G+B), Center/surround processing responds to lightness contrast Which often occurs at object edges

Scale space Contrast detection is performed at many different scales

Oriented edge detection Other neurons Are stimulated by light in an elongated region And inhibited by it in the region next to it These can detect the orientation of edges −+ −+ −+

Oriented edges

Constancy Illumination varies over a surface in intensity in chroma But you (usually don’t perceive the color of the surface as changing This is called perceptual constancy Color constancy Lightness constancy Georges de la tour, The Repentant Magdalene, C. 1640

Failures of lightness constancy

Failures of color constancy

Depth cues The world is 3D But the image is 2D Your vision system uses depth cues to recover lost information Stereopsis Motion Linear perspective Aerial perspective Relative size

Occlusion The interruption of edges of one object by the edges of another object Shows the interrupting object is in front C. Coles Phillips, Brittish Tank on Fifth Avenue, 1917

Stereo vision Your eyes are in slightly different positions So they receive slightly different images The disparity between images decreases with distance (simple case) So by matching features between the two eyes Your brain computes disparity And hence, depth

Motion parallax Objects farther away seem to move slower So the background seems to remain stable And the foreground moves Or, the opposite, if the camera tracks the foreground This is frequently used in cell animation

Linear perspective Parallel lines converge at a vanishing point One-point perspective One set of lines converging Gives a sense of immersion in the scene Background seems to pop out Two-point perspective Two sets of converging lines The object seems to pop out Three-point perspective Rarely used Very dramatic

Aerial perspective Surfaces get hazier as they recede into the distance

Relative size Apparent size decreases with distance So

Texture gradients Textures get finer as objects recede

Gestalt theory Theory of how we organize components of a percept into wholes Max Wertheimer, Kurt Koffka, Wolfgang Köhler Law of prägnanz (simplicity) We choose the simplest possible interpretation of a scene Formulated laws of grouping Disks or pacman?

Grouping by proximity

Grouping by similarity

Grouping by continuity

Grouping by closure

Grouping by common fate

Figure and ground We tend to separate the scene into One or more objects (“figure”), in front of or on top of A ground plane or background (“ground”) We use a number of tricks to do it Depth, grouping But it can be hard in degenerate cases

Attention Remember our fovea is only about 2° So we have to view scenes by scanning the fovea over the image Attention is driven both top-down by cognition Task Knowledge, expectations And bottom-up by Size Intensity Local contrast Motion Odd-man-out As well as recency (don’t look if we’ve just looked there)

Attention and scale space Attention starts at coarse (large) scales And narrows to finer scales

Attention and intensity All things being equal, our attention is driven to intense stimuli Bright lights Saturated colors Rapid motion

Attention and color Warm, bright colors draw attention Cooler, darker colors tend to recede into the background Claude Monet, Sunrise, 1872

Attention and contrast But one of the biggest drivers of attention is contrast We focus on unusual elements of the scene Elements that are different from their neighbors

Attention follows curves

Attention follows perspective and depth

Top-down attention Attention is also driven by expectations If I see something face-like I look for the facial features Or vice-versa And by task

Change blindness We only really see what the fovea is fixating If anything changes, we don’t notice unless we see motion Oh, and we don’t see motion while our eye is moving … Continuity in films Pretty woman Neisser et al’s demo Neisser et al’s demo Simons and Chabris’ demo SupplyPattern Work area Adapted from Ballard et al.

Shape recognition We don’t really know how this works It’s really hard … And there are a lot of high level semantic effects