Pyramid Coder with Nonlinear Prediction

Slides:



Advertisements
Similar presentations
CSCE 643 Computer Vision: Template Matching, Image Pyramids and Denoising Jinxiang Chai.
Advertisements

Spatial Filtering (Chapter 3)
Ted Adelson’s checkerboard illusion. Motion illusion, rotating snakes.
Slides from Alexei Efros
CS 691 Computational Photography
Convolution. Spatial Filtering Operations g(x,y) = 1/M  f(n,m) (n,m) in  S Example 3 x 3 5 x 5.
1 Image filtering Hybrid Images, Oliva et al.,
Image Filtering, Part 2: Resampling Today’s readings Forsyth & Ponce, chapters Forsyth & Ponce –
Edges and Scale Today’s reading Cipolla & Gee on edge detection (available online)Cipolla & Gee on edge detection Szeliski – From Sandlot ScienceSandlot.
Multiresolution Analysis (Section 7.1) CS474/674 – Prof. Bebis.
??? Eyes Brain (Inside) Conclusion: Ideally Suited for Image Processing.
Image Sampling Moire patterns
Lecture 4: Image Resampling CS4670: Computer Vision Noah Snavely.
Convolution. Convolution Properties Commutative: f*g = g*f Associative: (f*g)*h = f*(g*h) Homogeneous : f*( g)= f*g Additive (Distributive): f*(g+h)=
Lecture 3: Image Resampling CS4670: Computer Vision Noah Snavely Nearest-neighbor interpolation Input image 3x upsample hq3x interpolation (ZSNES)
Image Features, Hough Transform Image Pyramid CSE399b, Spring 06 Computer Vision Lecture 10
Image Analysis Preprocessing Arithmetic and Logic Operations Spatial Filters Image Quantization.
CS448f: Image Processing For Photography and Vision Wavelets Continued.
Image Representation Gaussian pyramids Laplacian Pyramids
ECE 472/572 - Digital Image Processing Lecture 4 - Image Enhancement - Spatial Filter 09/06/11.
Machine Vision ENT 273 Image Filters Hema C.R. Lecture 5.
Computer Vision – Enhancement(Part II) Hanyang University Jong-Il Park.
Image Resampling CS4670: Computer Vision Noah Snavely.
Image Resampling CS4670: Computer Vision Noah Snavely.
Image Processing Xuejin Chen Ref:
Lecture 4: Image Resampling and Reconstruction CS4670: Computer Vision Kavita Bala.
Lecture 03 Area Based Image Processing Lecture 03 Area Based Image Processing Mata kuliah: T Computer Vision Tahun: 2010.
School of Computer Science Queen’s University Belfast Practical TULIP lecture next Tues 12th Feb. Wed 13th Feb 11-1 am. Thurs 14th Feb am. Practical.
Chapter 5: Neighborhood Processing
Machine Vision ENT 273 Image Filters Hema C.R. Lecture 5.
Templates, Image Pyramids, and Filter Banks
Intelligent Vision Systems ENT 496 Image Filtering and Enhancement Hema C.R. Lecture 4.
2D Image Fourier Spectrum.
Filtering the Images.  Filtering images using low-pass filters  Filtering images using a median filter  Applying directional filters to detect edges.
Computer vision. Applications and Algorithms in CV Tutorial 3: Multi scale signal representation Pyramids DFT - Discrete Fourier transform.
Projects Project 1a due this Friday Project 1b will go out on Friday to be done in pairs start looking for a partner now.
Hierarchical Coding Decompose Image into various (spatial) resolutions (levels)‏ Encode the levels suitably Each level Reconstructed Image at a particular.
Multiresolution Analysis (Section 7.1) CS474/674 – Prof. Bebis.
Convolution.
Image Resampling & Interpolation
- photometric aspects of image formation gray level images
Applications of Multirate Signal Processing
Image Sampling Moire patterns
ECE 692 – Advanced Topics in Computer Vision
Chapter 3 Sampling.
Practical TULIP lecture next Tues 12th Feb. Wed 13th Feb 11-1 am.
Convolution.
The Chinese University of Hong Kong
Recap from Wednesday Spectra and Color Light capture in cameras and humans.
Image Sampling Moire patterns
Multiscale Analysis of Images
Fundamentals of Spatial Filtering
CSCE 643 Computer Vision: Image Sampling and Filtering
9th Lecture - Image Filters
Samuel Cheng Slide credits: Noah Snavely
Image Processing Today’s readings For Monday
Pyramid coder with nonlinear prediction
Convolution.
Filtering Part 2: Image Sampling
Linear filtering.
Image Sampling Moire patterns
Convolution.
Nov. 25 – Israeli Computer Vision Day
Image Resampling & Interpolation
Resampling.
Image Processing 고려대학교 컴퓨터 그래픽스 연구실 kucg.korea.ac.kr.
Samuel Cheng Slide credits: Noah Snavely
Convolution.
Convolution.
Templates and Image Pyramids
Presentation transcript:

Pyramid Coder with Nonlinear Prediction Panu Chaichanavong Burt/Adelson pyramid coder A nonlinear prediction Aliasing effect A switching method Conclusion

Burt/Adelson Pyramid Coder Introduced by Burt and Adelson (1983) Gaussian Laplacian Quantized and transmitted Original image Reconstructed image

A Nonlinear Prediction By Florencio and Schafer (1994) Filter Just subsample! Interpolator Replication Weighted median of 6 neighbor pixels Median of 4 neighbor pixels 1 1 1 1 2 1 2 3 2 Lower resolution image Predicted image

A Nonlinear Prediction (2) Burt/Adelson coder with nonlinear prediction

Aliasing Effect Test image

Aliasing Effect (2) Gaussian filter Only subsampling

Linear low-pass with weight shown above A Switching Method Let’s look at the following 4x4 filters .032 .058 .058 .032 .058 .102 .102 .058 0 0 0 0 0 0 1 0 0 0 0 0 0 1 2 0 0 3 4 0 Filter3 Linear low-pass with weight shown above Filter2 Median of average Filter1 Pick one !

A Switching Method (2) Input1 Input2 Input1: may be an edge, use filter1 Input2: high frequency, use filter3 How can we distinguish these inputs?

A Switching Method (3) Let D = sum of difference of adjacent pixel values sd = standard deviation of 16 pixel values p = D/sd Decision criterion: p < 18, use filter1 18 < p < 22, use filter2 p > 22, use filter3

A Switching Method (4) Filtered subsampled image Filter used Filter1

A Switching Method (5) Reconstructed image Method PSNR (dB) Bit-rate (bit/pixel) B/A 32.77 0.8278 Nonlinear 34.00 0.6544 Switch 33.58 0.6501 Reconstructed image

A Switching Method (6) Images in the Gaussian pyramid Filter used

Conclusion Low-pass filter reduces aliasing effect but gives blurred image Some nonlinear prediction preserves edges and details but may introduces annoying aliasing A decision criterion is presented to switch among various filters to select an appropriate one for a particular input