A Gentle Introduction to Bilateral Filtering and its Applications Limitation? Pierre Kornprobst (INRIA) 0:20.

Slides:



Advertisements
Similar presentations
Course Evaluations 4 Random Individuals will win an ATI Radeon tm HD2900XT.
Advertisements

Interpolating curves.
Lecture Notes #11 Curves and Surfaces II
November 12, 2013Computer Vision Lecture 12: Texture 1Signature Another popular method of representing shape is called the signature. In order to compute.
Grey Level Enhancement Contrast stretching Linear mapping Non-linear mapping Efficient implementation of mapping algorithms Design of classes to support.
Linear Filtering – Part I Selim Aksoy Department of Computer Engineering Bilkent University
Spatial Filtering (Chapter 3)
Chapter 3 Image Enhancement in the Spatial Domain.
Ter Haar Romeny, Computer Vision 2014 Geometry-driven diffusion: nonlinear scale-space – adaptive scale-space.
A Fast Approximation of the Bilateral Filter using a Signal Processing Approach Sylvain Paris and Frédo Durand Computer Science and Artificial Intelligence.
Computer Vision Lecture 16: Texture
With support from: NSF DUE in partnership with: George McLeod Prepared by: Geospatial Technician Education Through Virginia’s Community Colleges.
ECCV 2002 Removing Shadows From Images G. D. Finlayson 1, S.D. Hordley 1 & M.S. Drew 2 1 School of Information Systems, University of East Anglia, UK 2.
Image Filtering CS485/685 Computer Vision Prof. George Bebis.
Image processing. Image operations Operations on an image –Linear filtering –Non-linear filtering –Transformations –Noise removal –Segmentation.
EE663 Image Processing Edge Detection 2 Dr. Samir H. Abdul-Jauwad Electrical Engineering Department King Fahd University of Petroleum & Minerals.
MSU CSE 803 Stockman Linear Operations Using Masks Masks are patterns used to define the weights used in averaging the neighbors of a pixel to compute.
CS 376b Introduction to Computer Vision 02 / 27 / 2008 Instructor: Michael Eckmann.
1 Image Filtering Readings: Ch 5: 5.4, 5.5, 5.6,5.7.3, 5.8 (This lecture does not follow the book.) Images by Pawan SinhaPawan Sinha formal terminology.
Development of Empirical Models From Process Data
An Iterative Optimization Approach for Unified Image Segmentation and Matting Hello everyone, my name is Jue Wang, I’m glad to be here to present our paper.
CS4670: Computer Vision Kavita Bala Lecture 7: Harris Corner Detection.
A. I. P 郭瓊蓮 柯瑋明 吳榮軒 Term Project.
MSU CSE 803 Linear Operations Using Masks Masks are patterns used to define the weights used in averaging the neighbors of a pixel to compute some result.
PHY 042: Electricity and Magnetism
Normalised Least Mean-Square Adaptive Filtering
Chapter 3 (cont).  In this section several basic concepts are introduced underlying the use of spatial filters for image processing.  Mainly spatial.
Fast Bilateral Filtering
A Gentle Introduction to Bilateral Filtering and its Applications 08/10: Applications: Advanced uses of Bilateral Filters Jack Tumblin – EECS, Northwestern.
High dynamic range imaging. Camera pipeline 12 bits8 bits.
CS 376b Introduction to Computer Vision 02 / 26 / 2008 Instructor: Michael Eckmann.
A Gentle Introduction to Bilateral Filtering and its Applications How does bilateral filter relates with other methods? Pierre Kornprobst (INRIA) 0:35.
EE 7700 High Dynamic Range Imaging. Bahadir K. Gunturk2 References Slides and papers by Debevec, Ward, Pattaniak, Nayar, Durand, et al…
University of Kurdistan Digital Image Processing (DIP) Lecturer: Kaveh Mollazade, Ph.D. Department of Biosystems Engineering, Faculty of Agriculture,
EDGE DETECTION IN COMPUTER VISION SYSTEMS PRESENTATION BY : ATUL CHOPRA JUNE EE-6358 COMPUTER VISION UNIVERSITY OF TEXAS AT ARLINGTON.
03/05/03© 2003 University of Wisconsin Last Time Tone Reproduction If you don’t use perceptual info, some people call it contrast reduction.
Image Enhancement [DVT final project]
A Gentle Introduction to Bilateral Filtering and its Applications Sylvain Paris – MIT CSAIL Pierre Kornprobst – INRIA Odyssée Jack Tumblin – Northwestern.
Course 2 Image Filtering. Image filtering is often required prior any other vision processes to remove image noise, overcome image corruption and change.
Digital Image Processing Lecture 16: Segmentation: Detection of Discontinuities Prof. Charlene Tsai.
A Gentle Introduction to Bilateral Filtering and its Applications 07/10: Novel Variants of the Bilateral Filter Jack Tumblin – EECS, Northwestern University.
Segmentation of Vehicles in Traffic Video Tun-Yu Chiang Wilson Lau.
October 1, 2013Computer Vision Lecture 9: From Edges to Contours 1 Canny Edge Detector However, usually there will still be noise in the array E[i, j],
A Gentle Introduction to Bilateral Filtering and its Applications 10/10: Conclusions Jack Tumblin – EECS, Northwestern University.
Digital Image Processing Lecture 16: Segmentation: Detection of Discontinuities May 2, 2005 Prof. Charlene Tsai.
Course 5 Edge Detection. Image Features: local, meaningful, detectable parts of an image. edge corner texture … Edges: Edges points, or simply edges,
Scale-Space and Edge Detection Using Anisotropic Diffusion Presented By:Deepika Madupu Reference: Pietro Perona & Jitendra Malik.
Machine Vision Edge Detection Techniques ENT 273 Lecture 6 Hema C.R.
Computer Vision Image Features Instructor: Dr. Sherif Sami Lecture 4.
Instructor: Mircea Nicolescu Lecture 5 CS 485 / 685 Computer Vision.
Non-linear filtering Example: Median filter Replaces pixel value by median value over neighborhood Generates no new gray levels.
Processing Images and Video for An Impressionist Effect Automatic production of “painterly” animations from video clips. Extending existing algorithms.
Spatial Filtering (Chapter 3) CS474/674 - Prof. Bebis.
Digital Image Processing Lecture 16: Segmentation: Detection of Discontinuities Prof. Charlene Tsai.
3D Vision Interest Points.
Image Processing and Reconstructions Tools
A Gentle Introduction to Bilateral Filtering and its Applications
Filtering – Part I Gokberk Cinbis Department of Computer Engineering
IMAGE PROCESSING INTENSITY TRANSFORMATION AND SPATIAL FILTERING
A Gentle Introduction to Bilateral Filtering and its Applications
Computer Vision Lecture 16: Texture II
Linear Operations Using Masks
Lecture 2: Image filtering
Intensity Transformation
Image Filtering Readings: Ch 5: 5. 4, 5. 5, 5. 6, , 5
Enhancing the Enlargement of Images
Review and Importance CS 111.
An Edge-preserving Filtering Framework for Visibility Restoration
Lecture 7 Patch based methods: nonlocal means, BM3D, K- SVD, data-driven (tight) frame.
Presentation transcript:

A Gentle Introduction to Bilateral Filtering and its Applications Limitation? Pierre Kornprobst (INRIA) 0:20

Examples Input Bilateral filter Soft texture is removed

Examples Input Bilateral filter [Buades, Coll, Morel, 2005] Constant regions appear

Staircase effect Bilateral filter tends to remove texture, create flat intensity regions and new contours Questions – Why does it occur? – Can this be an advantage? – Otherwise, can we solve this problem? input output

Why? Bilateral filter is a weighted average of intensities and… space range

Why? The number of points q satisfying I p -h<I q <I p is larger than the number satisfying I p <I q <I p +h. space range

Why? Thus the average value is smaller than I p, enhancing that part of the signal. Note: Of course, opposite reasoning the the concave case space range

And Gaussians don’t change anything space range

And Gaussians don’t change anything space range

And Gaussians don’t change anything space range

So… Can this be an advantage? Yes! Since we obtain cartoon-like pictures, let us do cartoons!... [Winnemöller, Olsen, Gooch, 2006] Input Output

I said cartoons? [Winnemöller, Olsen, Gooch, 2006]

Few words about the approach [Winnemoller, Olsen, Gooch, 2006]

And you can do more! Real-time video abstraction To know more [Winnemöller, Olsen, Gooch, 2006] You want to see some example?

But… We don’t always want to have this kind of rendering When bilateral filter is used some side effects car appear

HDR input

Result without correcting the BF output Tone mapping with look transfer [Bae, Paris and Durand, 2006] Not acceptable for a photographer!

Can we avoid this defect?

“Gradient manipulation” 1. In the gradient domain: – Compare gradient amplitudes of input and current – Prevent increase 2. Solve the Poisson equation Goal of the paper was to control photographic look and transfer a “look” from a model photo [Bae, Paris and Durand, 2006] See [Perez etal, 2003] on Poisson image editing See [Agarwala, 2007] on solving Poisson equation for large images

Result without correcting the BF output Tone mapping with look transfer [Bae, Paris and Durand, 2006]

Result with corrected BF output Tone mapping with look transfer [Bae, Paris and Durand, 2006] Note that problems are essentially visible near strong contours

Edge Blending With a single iteration, staircase effects is visible only at edges. Edges detected with normalization factor (see also [Smith and Brady, 1997]) Blend edges with smoothed version of input to counteract staircase effect Goal of the paper was the display of high-dynamic-range images [Durand and Dorsey, 2002] (Combination between BF and Gaussian results at strong contours locations)

Result without correction Result with correction Tone Mapping [Durand 02]

“Linear interpolation” We saw that bilateral filter behaves like Perona-Malik and thus creates flat zones They proposed to replace the simple average by a linear regression How? Goal of the paper was to establish the link between integral formulations and differential operators [Buades, Coll, Morel, 2005]

Bilateral filter can be expressed by If you derive, you obtain “Linear interpolation”

Bilateral filter can be expressed by [Buades, Coll, Morel, 2005] changed the constant model by an affine model New value at p will be “Linear interpolation”

Remember, the problem was that lower values were more taken into consideration Geometrical interpretation space range

Now, left and right-hand side parts have the same influence “Linear interpolation” Geometrical interpretation space range

Staircase effect Input Bilateral filter

With linear interpolation… Input Bilateral filter modified [Buades, Coll, Morel, 2005]

Also… This new operator is also related to differential operators, i.e., PDEs! In this paper, you will also find extensions of bilateral filter, called non local filter. [Buades, Coll, Morel, 2005] Average when similar intensities Average when similar patch around (correlation of neighborhood)

How to choose? Two methods which correct afterward defects of bilateral filter, mainly visible on boundaries. Efficient Correction of an existing problem One method which solves the problem by adapting the bilateral filter. Directly address the problem Computationally expensive

Summary Bilateral filter produces staircase effect It has been used as a tool for many applications such as texture extraction By itself, it has some interest too! Staircase effect can be controlled The link with PDEs is again appearing

Questions?