MSU/CSE Fall 20141 Computer Vision: Imaging Devices Summary of several common imaging devices covered ( Chapter 2 of Shapiro and Stockman)

Slides:



Advertisements
Similar presentations
Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University
Advertisements

Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University
Foundations of Physics
Chapter 15 Pretest Light and Refraction
Unit 33 - Optics Optics is the study of the behavior and properties of light. This includes it’s interactions with objects including mirrors, lenses, and.
Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University
Optics. Spherical Mirrors Spherical mirror – a section of a sphere of radius R and with a center of curvature C R C Mirror.
Light and Optics 4.1 Mirrors form images by reflecting light. 4.2
Chapter 18: Light and Optics
Computer Vision: CSE 803 A brief intro MSU/CSE Fall 2014.
Optics: Lenses & Mirrors. Thin Lenses Thin Lenses: Any device which concentrates or disperses light. Types of Lenses:  Converging Lens: Parallel rays.
Stereo.
Announcements. Projection Today’s Readings Nalwa 2.1.
1 Imaging and Image Representation  Sensing Process  Typical Sensing Devices  Problems with Digital Images  Image Formats  Relationship of 3D Scenes.
MSU CSE 803 Stockman Perspective algebra: quick- and-dirty first look Geometry of similar triangles yields algebra for computing world-image transformation.
Stockman MSU/CSE Fall Computer Vision: Imaging Devices Summary of several common imaging devices covered in Chapter 2 of Shapiro and Stockman.
Stockman MSU/CSE Fall 2009 Computer Vision: CSE 803 A brief intro.
Computer Vision Lecture 3: Digital Images
This Set of Slides This set of slides deals with telescopes. Units covered: 26, 27, 28, 29, and 30.
CS 376b Introduction to Computer Vision 02 / 05 / 2008 Instructor: Michael Eckmann.
Stockman MSU/CSE Math models 3D to 2D Affine transformations in 3D; Projections 3D to 2D; Derivation of camera matrix form.
Ch 25 1 Chapter 25 Optical Instruments © 2006, B.J. Lieb Some figures electronically reproduced by permission of Pearson Education, Inc., Upper Saddle.
Digital Images The nature and acquisition of a digital image.
Chapter 17 Optics 17.1 Reflection and Refraction
1 Chapter 5: The Human Eye and Vision - I: Producing the Image Using what we have learned about lenses and cameras to understand how the eye works The.
By Joe Jodoin The Human Eye. Parts of the eye There are lots of parts of the eye so EYE will only talk about the main parts. Those parts are the cornea,
Image Formation CS418 Computer Graphics John C. Hart.
< BackNext >PreviewMain Section 1 Mirrors and Lenses Rays and the Path of Light Waves Because light waves travel in straight lines, you can use an arrow.
Chapter 18 PowerPoint Chapter Review Questions Mrs. Miller 6A light.
Refraction & Lenses Chapter 18. Refraction of Light n Look at the surface of a swimming pool n Objects look distorted n Light bends as it goes from one.
Human Eye  A human eyeball is like a simple camera! Sclera: White part of the eye, outer walls, hard, like a light-tight box. Cornea and crystalline lens.
Image Formation. Input - Digital Images Intensity Images – encoding of light intensity Range Images – encoding of shape and distance They are both a 2-D.
Light and Optics.
Electromagnetic Spectrum ColorOptic Tools The Human Eye Grab Bag
Chapter 6 Human Vision can be corrected and extended using optical systems.
Chapter 23 Preview Section 1 Mirrors and Lenses
Chapter 23 Properties of Light. Section 1: Objectives Use ray diagrams to show how light is reflected or refracted. Compare plane mirrors, concave mirrors,
PHYS 1442 – Section 004 Lecture #22-23 MW April 14-16, 2014 Dr. Andrew Brandt 1 Cameras, Film, and Digital The Human Eye; Corrective Lenses Magnifying.
Integral University EC-024 Digital Image Processing.
Chapter 20 Mirrors and Lenses. Objectives 20.1 Explain how an image is formed in three types of mirrors 20.1 Identify examples and uses of plane, concave,
1 Computer Vision 一目 了然 一目 了然 一看 便知 一看 便知 眼睛 頭腦 眼睛 頭腦 Computer = Image + Artificial Vision Processing Intelligence Vision Processing Intelligence.
The Eye and Sight Describe the relationship between the structure of the eye and sight Contrast ways in which light rays are bent by concave and convex.
Image Formation Dr. Chang Shu COMP 4900C Winter 2008.
Digital Image Fundamentals. What Makes a good image? Cameras (resolution, focus, aperture), Distance from object (field of view), Illumination (intensity.
Image Formation CS418 Computer Graphics John C. Hart.
CS 376b Introduction to Computer Vision 02 / 08 / 2008 Instructor: Michael Eckmann.
Introduction to Computer Vision Sebastian van Delden USC Upstate
Intelligent Vision Systems Image Geometry and Acquisition ENT 496 Ms. HEMA C.R. Lecture 2.
Lenses. Diverging and Converging Lenses Double Convex lenses focus light rays to a point on the opposite side of the lens. Double Concave lenses diverge.
1 CSE 455: Computer Vision Winter 2007 Instructor: Professor Linda Shapiro Additional Instructor: Dr. Matthew Brown
: Chapter 11: Three Dimensional Image Processing 1 Montri Karnjanadecha ac.th/~montri Image.
1 Artificial Intelligence: Vision Stages of analysis Low level vision Surfaces and distance Object Matching.
Tutorial Visual Perception Towards Computer Vision
1 Perception and VR MONT 104S, Fall 2008 Lecture 2 The Eye.
1 Introduction What IS computer vision? Where do images come from? the analysis of digital images by a computer.
Light. Photon is a bundle of light related to the amount of energy Light travels in straight line paths called light rays
Table of Contents Light and Color Reflection and Mirrors
Chapter 21: Stars, Galaxies, Universe Section 1: telescopes
Image Perception ‘Let there be light! ‘. “Let there be light”
Reflection and Refraction
Intelligent Vision Systems Image Geometry and Acquisition ENT 496 Ms. HEMA C.R. Lecture 2.
Lens Applications.
6.2 Extending Human Vision.  Distance between the lens and the screen must be correct to have a clear image = focussing   Compound light microscope.
The Human Retina. Retina Function To detect movement To detect color To detect detail.
Light and Optics Part Three: Optics and Reflection.
Image Perception ‘Let there be light! ‘. “Let there be light”
6.2 Extending Human Vision
Color of Light
Unit 7 Light and Vision.
Mirrors and Lenses.
Presentation transcript:

MSU/CSE Fall Computer Vision: Imaging Devices Summary of several common imaging devices covered ( Chapter 2 of Shapiro and Stockman)

MSU/CSE Fall Major issues What radiation is sensed? Is motion used to scan the scene or are all sensing elements static? How fast can sensing occur? What are the sensing elements? How is resolution determined? -- in intensity -- in space

MSU/CSE Fall CCD type camera Array of small fixed elements Can read faster than TV rates Can add refracting elts to get color in 2x2 neighborhoods 8-bit intensity common

MSU/CSE Fall Blooming Problem with Arrays Difficult to insulate adjacent sensing elements. Charge often leaks from hot cells to neighbors, making bright regions larger.

MSU/CSE Fall bit intensity can be clipped Dark grid intersections at left were actually brightest of scene. In A/D conversion the bright values were clipped to lower values.

MSU/CSE Fall Lens distortion distorts image “ Barrel distortion ” of rectangular grid is common for cheap lenses ($50). “ Pin cushion ” opposite. Precision lenses can cost $1000 or more. Zoom lenses often show severe distortion.

MSU/CSE Fall Other important effects/problems Discrete pixel effect: signal is integrated Mixed pixel effect: materials mix Thin features can be missed Measurements in pixels have error Region or material A Region or material B

MSU/CSE Fall Orbiting satellite scanner View earth 1 pixel at a time (through a straw) Prism produces multispectral pixel Image row by scanning boresight All rows by motion of satellite in orbit Scanned area of earth is a parallelogram, not a rectangle

MSU/CSE Fall Human eye as a spherical camera 100M sensing elts in retina Rods sense intensity Cones sense color Fovea has tightly packed elts, more cones Periphery has more rods Focal length is about 20mm Pupil/iris controls light entry Eye scans, or saccades to image details on fovea 100M sensing cells funnel to 1M optic nerve connections to the brain

MSU/CSE Fall Surface data (2.5D) sensed by structured light sensor Projector projects plane of light on object Camera sees bright points along an imaging ray Compute 3D surface point via line-plane intersection REF: new Minolta Vivid 910 camera

Structured light MSU/CSE Fall

MSU/CSE Fall D face image from Minolta Vivid 910 scanner in the CSE PRIP Lab A rotating mirror scans a laser stripe across the object. 320x240 rangels obtained in about 2 seconds. [x,y,z,R,G,B] image.

MSU/CSE Fall LIDAR also senses surfaces Single sensing element scans scene Laser light reflected off surface and returned Phase shift codes distance Brightness change codes albedo

MSU/CSE Fall SICK sensor range image Note human hands at the left and right and roll of tape at the center. Used by NASA navigator and Axion Racing Team in DARPA autonomous navigation grand challenge. New IBEO device yields 4 line video

MSU/CSE Fall What about human vision? Do we compute the surfaces in our environment? Do we represent them in our memory as we move around or search? Do we save representations of familiar objects? (See David Marr, Vision, 1982; Aloimonus and Rosenfeld 1991.)

MSU/CSE Fall D scanning technology 3D image of voxels obtained Usually computationally expensive reconstruction of 3D from many 2D scans (CAT computer-aided- tomography) More info later in the course.

MSU/CSE Fall Magnetic Resonance Imaging Sense density of certain chemistry S slices x R rows x C columns Volume element (voxel) about 2mm per side At left is shaded 2D image created by “ volume rendering ” a 3D volume: darkness codes depth

MSU/CSE Fall Single slice through human head MRIs are computed structures, computed from many views. At left is MRA (angiograph), which shows blood flow. CAT scans are computed in much the same manner from X- ray transmission data.

MSU/CSE Fall Other variations Microscopes, telescopes, endoscopes, … X-rays: radiation passes through objects to sensor elements on the other side Fibers can carry image around curves; in bodies, in machine tools Pressure arrays create images (fingerprints, butts) Sonar, stereo, focus, etc can be used for range sensing (see Chapters 12 and 13)

MSU/CSE Fall Summary of some digital imaging problems. Mixed pixel problem: mixed material in the world/scene map to a single pixel Loss of thin/small features due to resolution Variations in area or perimeter due to variation in object location and thresholding Path problems: refraction, dispersion, etc. takes radiation off straight path (blue light bends more or less than red light going through lens?)