Lecture 1: Images and image filtering CS4670/5670: Intro to Computer Vision Noah Snavely Hybrid Images, Oliva et al.,

Slides:



Advertisements
Similar presentations
Lecture 2: Convolution and edge detection CS4670: Computer Vision Noah Snavely From Sandlot ScienceSandlot Science.
Advertisements

Spatial Filtering (Chapter 3)
Motion illusion, rotating snakes. Slide credit Fei Fei Li.
Computational Photography CSE 590 Tamara Berg Filtering & Pyramids.
Computational Photography Prof. Feng Liu Spring /06/2015.
Lecture 2: Filtering CS4670/5670: Computer Vision Kavita Bala.
Image Filtering CS485/685 Computer Vision Prof. George Bebis.
1 Image filtering Hybrid Images, Oliva et al.,
Lecture 2: Edge detection and resampling
Computer Vision Introduction to Image formats, reading and writing images, and image environments Image filtering.
Lecture 1: Images and image filtering
1 Image Filtering Readings: Ch 5: 5.4, 5.5, 5.6,5.7.3, 5.8 (This lecture does not follow the book.) Images by Pawan SinhaPawan Sinha formal terminology.
Linear filtering. Overview: Linear filtering Linear filters Definition and properties Examples Gaussian smoothing Separability Applications Denoising.
CS443: Digital Imaging and Multimedia Filters Spring 2008 Ahmed Elgammal Dept. of Computer Science Rutgers University Spring 2008 Ahmed Elgammal Dept.
Announcements Kevin Matzen office hours – Tuesday 4-5pm, Thursday 2-3pm, Upson 317 TA: Yin Lou Course lab: Upson 317 – Card access will be setup soon Course.
1 Image filtering Images by Pawan SinhaPawan Sinha.
1 Image filtering
Lecture 2: Image filtering
1 Images and Transformations Images by Pawan SinhaPawan Sinha.
Matlab Tutorial Continued Files, functions and images.
Linear filtering.
1 Image filtering Hybrid Images, Oliva et al.,
Most slides from Steve Seitz
Lecture 1: Images and image filtering CS4670/5670: Intro to Computer Vision Kavita Bala Hybrid Images, Oliva et al.,
Applications of Image Filters Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 02/04/10.
CS559: Computer Graphics Lecture 3: Digital Image Representation Li Zhang Spring 2008.
CSC 589 Introduction to Computer Vision Lecture 2 linear filtering Instructor: Bei Xiao Thursday, January 15th Salvador Dali “Gala Contemplating the Mediterranean.
Lecture 03 Area Based Image Processing Lecture 03 Area Based Image Processing Mata kuliah: T Computer Vision Tahun: 2010.
Linear Filters Monday, Jan 24 Prof. Kristen Grauman UT-Austin …
Linear Filters August 27 th 2015 Devi Parikh Virginia Tech 1 Slide credit: Devi Parikh Disclaimer: Many slides have been borrowed from Kristen Grauman,
Image Filtering Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 02/02/10.
Why is computer vision difficult?
Linear filtering. Motivation: Noise reduction Given a camera and a still scene, how can you reduce noise? Take lots of images and average them! What’s.
CSE 473/573 Computer Vision and Image Processing (CVIP) Ifeoma Nwogu Lecture 7 – Linear Filters 1.
Visual Computing Computer Vision 2 INFO410 & INFO350 S2 2015
CS 691B Computational Photography
CSE 6367 Computer Vision Image Operations and Filtering “You cannot teach a man anything, you can only help him find it within himself.” ― Galileo GalileiGalileo.
Pixels and Image Filtering Computational Photography Derek Hoiem 08/26/10 Graphic:
Lecture 3: Filtering and Edge detection
Lecture 5: Fourier and Pyramids
Reconnaissance d’objets et vision artificielle
Linear filtering. Motivation: Image denoising How can we reduce noise in a photograph?
Lecture 8: Edges and Feature Detection
CSE 185 Introduction to Computer Vision Image Filtering: Spatial Domain.
Grauman Today: Image Filters Smooth/Sharpen Images... Find edges... Find waldo…
Images and Filters CSEP 576 Ali Farhadi Many slides from Steve Seitz and Larry Zitnick.
Linear Filters T-11 Computer Vision University of Houston
Linear Filters April 6th, 2017
ECE 692 – Advanced Topics in Computer Vision
Filtering – Part I Gokberk Cinbis Department of Computer Engineering
Lecture 1: Images and image filtering
Image filtering Hybrid Images, Oliva et al.,
Recap from Wednesday Spectra and Color Light capture in cameras and humans.
Image gradients and edges April 11th, 2017
Image filtering Images by Pawan Sinha.
Image filtering Images by Pawan Sinha.
Image filtering Images by Pawan Sinha.
Motion illusion, rotating snakes
Linear filtering.
Lecture 5: Resampling, Compositing, and Filtering Li Zhang Spring 2008
Digital Image Processing Week IV
Most slides from Steve Seitz
Image filtering Images by Pawan Sinha.
Linear Filtering CS 678 Spring 2018.
Image filtering
Image filtering
Lecture 2: Image filtering
Lecture 1: Images and image filtering
Image Filtering Readings: Ch 5: 5. 4, 5. 5, 5. 6, , 5
Most slides from Steve Seitz
Presentation transcript:

Lecture 1: Images and image filtering CS4670/5670: Intro to Computer Vision Noah Snavely Hybrid Images, Oliva et al.,

Lecture 1: Images and image filtering CS4670: Computer Vision Noah Snavely Hybrid Images, Oliva et al.,

Lecture 1: Images and image filtering CS4670: Computer Vision Noah Snavely Hybrid Images, Oliva et al.,

CS4670: Computer Vision Noah Snavely Hybrid Images, Oliva et al., Lecture 1: Images and image filtering

Reading Szeliski, Chapter

What is an image?

Digital Camera The Eye Source: A. Efros We’ll focus on these in this class (More on this process later)

What is an image? A grid (matrix) of intensity values (common to use one byte per value: 0 = black, 255 = white) = =

We can think of a (grayscale) image as a function, f, from R 2 to R: – f (x,y) gives the intensity at position (x,y) – A digital image is a discrete (sampled, quantized) version of this function What is an image? x y f (x, y) snoop 3D view

Image transformations As with any function, we can apply operators to an image We’ll talk about a special kind of operator, convolution (linear filtering) g (x,y) = f (x,y) + 20 g (x,y) = f (-x,y)

Question: Noise reduction Given a camera and a still scene, how can you reduce noise? Take lots of images and average them! What’s the next best thing? Source: S. Seitz

Image filtering Modify the pixels in an image based on some function of a local neighborhood of each pixel Local image data 7 Modified image data Some function Source: L. Zhang

Linear filtering One simple version: linear filtering (cross-correlation, convolution) – Replace each pixel by a linear combination (a weighted sum) of its neighbors The prescription for the linear combination is called the “kernel” (or “mask”, “filter”) kernel 8 Modified image data Source: L. Zhang Local image data

Cross-correlation This is called a cross-correlation operation: Let be the image, be the kernel (of size 2k+1 x 2k+1), and be the output image Can think of as a “dot product” between local neighborhood and kernel for each pixel

Convolution Same as cross-correlation, except that the kernel is “flipped” (horizontally and vertically) Convolution is commutative and associative This is called a convolution operation:

1D Demo

Convolution Adapted from F. Durand

Mean filtering * =

Example filters Original Blur (with a box filter) Source: D. Lowe

Linear filters: examples Original Identical image Source: D. Lowe * =

Linear filters: examples Original Shifted left By 1 pixel Source: D. Lowe * =

Linear filters: examples Original Blur (with a mean filter) Source: D. Lowe * =

Linear filters: examples Original Sharpening filter (accentuates edges) Source: D. Lowe = *

Sharpening Source: D. Lowe

Smoothing with box filter revisited Source: D. Forsyth

Gaussian Kernel Source: C. Rasmussen

Gaussian filters = 30 pixels= 1 pixel = 5 pixels = 10 pixels

Mean vs. Gaussian filtering

Gaussian filter Removes “high-frequency” components from the image (low-pass filter) Convolution with self is another Gaussian – Convolving twice with Gaussian kernel of width = convolving once with kernel of width Source: K. Grauman * =

Sharpening revisited What does blurring take away? original smoothed (5x5) – detail = sharpened = Let’s add it back: originaldetail + α Source: S. Lazebnik

Sharpen filter Gaussian scaled impulse Laplacian of Gaussian image blurred image unit impulse (identity)

Sharpen filter unfiltered filtered

“Optical” Convolution Source: Bokeh: Blur in out-of-focus regions of an image. Camera shake * = Source: Fergus, et al. “Removing Camera Shake from a Single Photograph”, SIGGRAPH 2006

Questions? For next time: – Read Szeliski, Chapter