Perception & Attention Computational Cognitive Neuroscience Randall O’Reilly.

Slides:

Advertisements

Similar presentations

Distinctive Image Features from Scale-Invariant Keypoints

Advertisements

Biologically Motivated Computer Vision

Perception Chapter 4 Visual Process beyond the Retina

Chapter 4: The Visual Cortex and Beyond

What do we know about Primary Visual Cortex (V1)

Visual Sensation & Perception How do we see?. Structure of the eye.

Object recognition and scene “understanding”

Object Recognition with Features Inspired by Visual Cortex T. Serre, L. Wolf, T. Poggio Presented by Andrew C. Gallagher Jan. 25, 2007.

Fast Readout of Object Identity from Macaque Inferior Tempora Cortex Chou P. Hung, Gabriel Kreiman, Tomaso Poggio, James J.DiCarlo McGovern Institute for.

Backprop, 25 Years Later: Biologically Plausible Backprop Randall C. O’Reilly University of Colorado Boulder eCortex, Inc.

Visual Attention: Outline Levels of analysis 1.Subjective: perception of unattended things 2.Functional: tasks to study components of attention 3.Neurological:

HMAX Models Architecture Jim Mutch March 31, 2010.

Visual Fields KW Fovea on Cortex KW 8-22 Occipital Lobes are Independent KW 8-24.

Attention Orienting System and Associated Disorders Neglect, Extinction and Balint’s Syndrome.

Attention Orienting System and Associated Disorders Neglect, Extinction and Balint’s Syndrome.

“Mimicking cortical responses in the visual cortex” Presentation 27 May 2004 Florie Daniels Lotte Verbunt.

Computational Vision: Object Recognition Object Recognition Jeremy Wyatt.

Visual Cognition II Object Perception. Theories of Object Recognition Template matching models Feature matching Models Recognition-by-components Configural.

Psychophysics of the structure of object memory Cristina Savin.

Computing motion between images

Edge Detection Lecture 2: Edge Detection Jeremy Wyatt.

December 1, 2009Introduction to Cognitive Science Lecture 22: Neural Models of Mental Processes 1 Some YouTube movies: The Neocognitron Part I:

ניורוביולוגיה ומדעי המח חלק 2 – מערכת הראייה Introduction to Neurobiology Part 2 – The Visual System Shaul Hochstein.

Blob detection.

The Human Visual System Vonikakis Vasilios, Antonios Gasteratos Democritus University of Thrace

Overview 1.The Structure of the Visual Cortex 2.Using Selective Tuning to Model Visual Attention 3.The Motion Hierarchy Model 4.Simulation Results 5.Conclusions.

PY202 Overview. Meta issue How do we internalise the world to enable recognition judgements to be made, visual thinking, and actions to be executed.

Michael Arbib & Laurent Itti: CS664 – USC, spring Lecture 6: Object Recognition 1 CS664, USC, Spring 2002 Lecture 6. Object Recognition Reading Assignments:

Cognitive Neuroscience How do we connect cognitive processes in the mind with physical processes in the brain?

Laurent Itti: CS599 – Computational Architectures in Biological Vision, USC Lecture 5: Introduction to Vision 2 1 Computational Architectures in.

Towards Helicopter Tracking CS223b Project #20 Ritchie Lee Yu-Tai Ray Chen.

Dorsal and Ventral Pathways and What They Do. Dorsal and Ventral Pathways visual information arrives at V1 via the retinostriate pathway it is already.

Motion detection with movement detectors. It is a non-linear device: response to velocity a and velocity b is not equal to velocity a+b movement detection.

Face Recognition Using Neural Networks Presented By: Hadis Mohseni Leila Taghavi Atefeh Mirsafian.

Multiclass object recognition

Physiology of Vision: a swift overview Pixels to Percepts A. Efros, CMU, Spring 2011 Some figures from Steve Palmer.

Active Vision Key points: Acting to obtain information Eye movements Depth from motion parallax Extracting motion information from a spatio-temporal pattern.

2 2  Background  Vision in Human Brain  Efficient Coding Theory  Motivation  Natural Pictures  Methodology  Statistical Characteristics  Models.

The Leabra Object Recognition Model

Computational Cognitive Neuroscience PSYC 4175/5175 Randall O’Reilly.

The primate visual systemHelmuth Radrich, The primate visual system 1.Structure of the eye 2.Neural responses to light 3.Brightness perception.

Movimento complesso: flusso ottica. Lettura Morrone, M.C., Burr, D.C., and Vaina, L. (1995). Two stages of visual processing for radial and circular motion.

Human vision Jitendra Malik U.C. Berkeley. Visual Areas.

EE141 1 Perception - Vision Janusz A. Starzyk

Object Recognition in ROS Using Feature Extractors and Feature Matchers By Dolev Shapira.

Vision Photoreceptor cells Rod & Cone cells Bipolar Cells Connect in between Ganglion Cells Go to the brain.

Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.

From cortical anisotropy to failures of 3-D shape constancy Qasim Zaidi Elias H. Cohen State University of New York College of Optometry.

Brodmann’s Functional Map

Creating the street of the future. In this project you get to create your own futuristic house using a tool called Google Sketchup. Afterwards you will.

Psychology 3680 Illusion Lecture. What is Vision?

CORNELL UNIVERSITY CS 764 Seminar in Computer Vision Attention in visual tasks.

Activity Recognition Journal Club “Neural Mechanisms for the Recognition of Biological Movements” Martin Giese, Tomaso Poggio (Nature Neuroscience Review,

9.012 Presentation by Alex Rakhlin March 16, 2001

Convolutional Neural Network

Cognitive Architectures

Outline Announcement Local operations (continued) Linear filters

Lecture 08: Coordinate Transformation II

Early Processing in Biological Vision

Ibn Sahl 984 Laws of refraction Ibn al-Haytham (Alhazen) Book of optics Ray theories of light Human Visual System.

Optic Nerve Projections

Institute of Neural Information Processing (Prof. Heiko Neumann •

Large Scale Image Deduplication

Ibn Sahl 984 Laws of refraction Ibn al-Haytham (Alhazen) Book of optics Ray theories of light Human Visual System.

Pattern Recognition Binding Edge Detection

KFC: Keypoints, Features and Correspondences

SIFT keypoint detection

Ibn Sahl 984 Laws of refraction Ibn al-Haytham (Alhazen) Book of optics Ray theories of light Human Visual System.

Human vision: function

Object Recognition in Biological Vision Systems

Presentation transcript:

Perception & Attention Computational Cognitive Neuroscience Randall O’Reilly

Perception Overview

Optic Pathway

Retinal Contrast Filtering

V1

Visual Hierarchy: What vs Where 6

7

Hierarchy of Detectors.. 8

Self-Organization of V1 Orientation Selective Neurons

Topography! Map of orientations “Pinwheel” singularities Hypercolumn organization

What is Common?

Self-Organized Topography

Invariant Object Recognition 13

It’s Hard

Invariant Object Recognition Hierarchy of increasing:  Feature complexity  Spatial invariance Strong match to RF’s in corresponding brain areas (Neocognitron, HMAX, SLF, Pinto/DiCarlo, etc.) 15

Biological Data 16

Simple Textbook Test

3D models from Google SketchUp 100 categories 9-10 objects per category 2 objects left out for testing +/- 20° horiz depth rotation + 180° flip 0-30° vertical depth rotation 14° 2D planar rotations 25% scaling 30% planar translations 18 3D Object Recognition Test

Generalization to Novel Category Exemplars – Better than 90% 19

Spatial Attention and Neglect

Hemispatial Neglect

Posner Task

Boxology vs. Biology

What’s Missing? Lacking Depth..