EE 638: Principles of Digital Color Imaging Systems Lecture 17: Digital Camera Characterization and Calibration.

Slides:



Advertisements
Similar presentations
Charge Couple Devices Charge Couple Devices, or CCDs operate in the charge domain, rather than the current domain, which speeds up their response time.
Advertisements

Sensor Technology Kevin Dickey. Traditional CCD and CMOS sensors CCD – Charge Coupled Device CMOS – Complimentary Metal Oxide Semiconductor CMOS sensors.
CMOS Complementary Metal Oxide Semiconductor Scott Moody.
Digital Image Processing
HOW A SILICON CHIP CAPTURES AN IMAGE
DIGITAL IMAGE PROCESSING CMSC 150: Lecture 14. Conventional Cameras  Entirely chemical and mechanical processes  Film: records a chemical record of.
Temperature Dependence of FPN in Logarithmic CMOS Image Sensors Dileepan Joseph¹ and Steve Collins² ¹University of Alberta, Canada ²University of Oxford,
Modelling, calibration and rendition of colour logarithmic CMOS image sensors Dileepan Joseph and Steve Collins Department of Engineering Science University.
Color Mixing There are two ways to control how much red, green, and blue light reaches the eye: “Additive Mixing” Starting with black, the right amount.
Digital Cameras CCD (Monochrome) RGB Color Filter Array.
Imaging Science Fundamentals
Modeling the imaging system Why? If a customer gives you specification of what they wish to see, in what environment the system should perform, you as.
Imaging Techniques in Digital Cameras Presented by Jinyun Ren Jan
Color Fidelity in Multimedia H. J. Trussell Dept. of Electrical and Computer Engineering North Carolina State University Raleigh, NC
CSc 461/561 CSc 461/561 Multimedia Systems Part A: 2. Image.
CCD and CMOS Sensors Craig Robinson.
Achieving True Color Fidelity
1D or 2D array of photosensors can record optical images projected onto it by lens system. Individual photosensor in an imaging array is called pixel.
CPSC 643 Robot Vision Introduction to Computer Vision Dezhen Song,
Charge-Coupled Device (CCD)
Digital Images The nature and acquisition of a digital image.
Signal vs Noise: Image Calibration First… some terminology:  Light Frame: The individual pictures you take of your target.  Dark Frame: An image taken.
1 Basics of Digital Imaging Digital Image Capture and Display Kevin L. Lorick, Ph.D. FDA, CDRH, OIVD, DIHD.
1 University of Palestine Faculty of Applied Engineering and Urban Planning Software Engineering Department Introduction to computer vision Chapter 2:
Image formation & Geometrical Transforms Francisco Gómez J MMS U. Central y UJTL.
Photography Is the capture of reflective light on light sensitive material. Film-Base Photography used “silver” as the light sensitive material. Digital.
Camera products and the future. DAC & actuators memory and processor communication ADC video, audio, temperature, chemical, tactile electronic system.
1 CCTV SYSTEMS CCD VERSUS CMOS COMPARISON CCD (charge coupled device) and CMOS (complementary metal oxide semiconductor) image sensors are two different.
FASEP Presents What is the difference between PSD and CCD sensor technology?
Digital Photography Multimedia Communication Department.
Digital Imaging Systems –I/O. Workflow of digital imaging Two Competing imaging format for motion pictures Film vs Digital Video( TV) Presentation of.
How A Camera Works Image Sensor Shutter Mirror Lens.
Comparing Regular Film to Digital Photography
DIGITAL RADIOGRAPHY DA 105.
Module 2 : Linearity AGENDA TVI Vision, Kari Siren Linearity in general Theory, what does non-linearity mean when measuring “true” colour How to measure,
Imaging Science FundamentalsChester F. Carlson Center for Imaging Science.
776 Computer Vision Jan-Michael Frahm Fall Last class.
LCC, MIERSI SM 14/15 – T4 Special Effects Miguel Tavares Coimbra.
Elements of DR Imaging Systems
Miguel Tavares Coimbra
The Physics of Photography
How digital cameras work The Exposure The big difference between traditional film cameras and digital cameras is how they capture the image. Instead of.
Sounds of Old Technology IB Assessment Statements Topic 14.2., Data Capture and Digital Imaging Using Charge-Coupled Devices (CCDs) Define capacitance.
Digital Camera TAVITA SU’A. Overview ◦Digital Camera ◦Image Sensor ◦CMOS ◦CCD ◦Color ◦Aperture ◦Shutter Speed ◦ISO.
Copyright © 2012, 2006, 2000, 1996 by Saunders, an imprint of Elsevier Inc. Chapter 25 Digital Imaging.
EE 638: Principles of Digital Color Imaging Systems Lecture 14: Monitor Characterization and Calibration – Basic Concepts.
Lecture 16 Scanner Characterization and Calibration - Sanjyot Gindi M.S.E.C.E, Purdue University July 18th 2008.
DIGITAL CAMERAS THE IMAGE SENSORS. CCD: Charged Coupled Device CMOS: Complementary Metal Oxide Semiconductor The differences between these two sensors.
Inside the Digital Camera. Digital Camera Cross Section The digital camera is a complex device The only part that is the same as film cameras is the lens.
ECE 638: Principles of Digital Color Imaging Systems Jan P. Allebach School of Electrical and Computer Engineering
ECE 638: Principles of Digital Color Imaging Systems Lecture 5: Primaries.
ECE 638: Principles of Digital Color Imaging Systems Lecture 12: Characterization of Illuminants and Nonlinear Response of Human Visual System.
DIGITAL RADIOGRAPHY.
Copyright © 2012, 2006, 2000, 1996 by Saunders, an imprint of Elsevier Inc. 1 Digital Imaging Instead of Radiography.
ITEC2110, Digital Media Chapter 3 Digital Image Processing 1 GGC -- ITEC Digital Media.
Click to edit Master title style Click to edit Master text styles Second level Third level Fourth level Fifth level 1 Integrated Color Solutions A presentation.
CSE 185 Introduction to Computer Vision
Digital Image -M.V.Ramachandranwww.youtube.com/postmanchandru
16722 We: image sensors image sensors: real device implementations.
Electronics Lecture 5 By Dr. Mona Elneklawi.
ECE 638: Principles of Digital Color Imaging Systems
Aerial Images.
EE 638: Principles of Digital Color Imaging Systems
© 2016 Pearson Education, Inc., Hoboken, NJ. All rights reserved.
"Digital Media Primer" Yue-Ling Wong, Copyright (c)2013 by Pearson Education, Inc. All rights reserved.
ECE 638: Principles of Digital Color Imaging Systems
Charge Coupled Device Advantages
"Digital Media Primer" Yue-Ling Wong, Copyright (c)2013 by Pearson Education, Inc. All rights reserved.
Photographic Image Formation I
Presentation transcript:

EE 638: Principles of Digital Color Imaging Systems Lecture 17: Digital Camera Characterization and Calibration

Image Capture Devices l Image Capture Devices: –Scanners –Camera l Camera: l Sensor array technologies –CCD (Charge Coupled Device) –CID (Charge Injection Device) –CMOS (Complementary Metal Oxide Semiconductor) Sensor Array CCD from a HP digital camera

l CCD –Phase I Exposure l CMOS & CID Line Registers y address x address 1 pixel Detector All detectors have a certain identical sensitivity

Camera (single chip) l Single chip –CCD –CMOS –CID l Sensor response –Coat cells with three different filter materials RGBRGB GBRGBR Corresponds to trichromatic sensor How do we get a full resolution array of RGB samples at each pixel?

Camera (single chip) l Single chip –CCD –CMOS –CID l Sensor response –Coat cells with three different filter materials RGBRGB GBRGBR Demosaic to get full resolution R, G, B Inverse problem Corresponds to trichromatic sensor

Camera (cont.) l Three chips l Foveon sensor R sensor G sensor B sensor Bean-splitter More expensive, but do get full resolution  no demosaicing, do have to worry about registration R G B incident light Layered Chip More expensive, but get full resolution  No registration issues but have cross-talk & efficiency issues

l Sensor Output l “Linear”  proportional to photon count similar to CRT monitor model. l Camera models exist that provide “raw” output. NL R NL G NL B Gamma correction A/D

l To determine nonlinearities, have to perform device characterization. l Set-up: illumination Target Target camera Colorimeter This is very similar to process used to determine nonlinearities for a scanner, except that scanner and X-Rite DTP 70 provide their own illumination, which can be more carefully controlled.

l To determine nonlinearities NL R, NL G, NL B, need a special facility of stimuli. (Target illuminant) l Let be the spectral stimulus of the i-th patch. l Want l then k— doesn’t depend on i l— doesn’t depend on i

l Caveat paper white Fraction of patch covered by colorant Fraction of patch not covered by colorant Sensor pixels Full colorant Rc Halftoned Target Kodak Q60 and Macbeth Color Checker targets are not printed, and therefore do not suffer from halftoning issues.

l Remainder of camera characterization requires finding T: –1) 2) NL R NL G NL B

l Normal approach for finding T is to measure large set of patches & perform linear regression. illumination Target Target camera Colorimeter NL Regression

Summary l 1) Typically can get < accuracy for displays (monitors) because we only need visual independence of primaries. l 2) For capture, have to have sensor response span HVS, i.e. there must exist a 3x3 matrix B such that l No.2 is much more restrictive than No.1 l  Above procedure will typically yield ~ (average error = ?)

l To do better, could use double exposure where illuminant is charged between exposures, or we place a filter over the lens for the second exposure. l This delves into an area sometimes known as Hi-Fi (High Fidelity) Color or Spectral Color. We will talk about this later in the course. l Another interesting and recently very popular topic related to camera characterization and calibration is high dynamic range (HDR) imaging. We may talk about this later in the semester.