Sparse Approximation by Wavelet Frames and Applications

Slides:



Advertisements
Similar presentations
A Transform-based Variational Framework Guy Gilboa Pixel Club, November, 2013.
Advertisements

IPIM, IST, José Bioucas, Shrinkage/Thresholding Iterative Methods Nonquadratic regularizers Total Variation lp- norm Wavelet orthogonal/redundant.
Various Regularization Methods in Computer Vision Min-Gyu Park Computer Vision Lab. School of Information and Communications GIST.
Edge Preserving Image Restoration using L1 norm
L1 sparse reconstruction of sharp point set surfaces
TVL1 Models for Imaging: Global Optimization & Geometric Properties Part I Tony F. Chan Math Dept, UCLA S. Esedoglu Math Dept, Univ. Michigan Other Collaborators:
Bregman Iterative Algorithms for L1 Minimization with
Level set based Image Segmentation Hang Xiao Jan12, 2013.
Pixel Recovery via Minimization in the Wavelet Domain Ivan W. Selesnick, Richard Van Slyke, and Onur G. Guleryuz *: Polytechnic University, Brooklyn, NY.
Prediction with Regression
1 Low-Dose Dual-Energy CT for PET Attenuation Correction with Statistical Sinogram Restoration Joonki Noh, Jeffrey A. Fessler EECS Department, The University.
Surface Compression with Geometric Bandelets Gabriel Peyré Stéphane Mallat.
2013 SIAM Great Lakes Section From PDEs to Information Science and Back Russel Caflisch IPAM Mathematics Department, UCLA 1.
Learning Measurement Matrices for Redundant Dictionaries Richard Baraniuk Rice University Chinmay Hegde MIT Aswin Sankaranarayanan CMU.
Submodular Dictionary Selection for Sparse Representation Volkan Cevher Laboratory for Information and Inference Systems - LIONS.
Patch-based Image Deconvolution via Joint Modeling of Sparse Priors Chao Jia and Brian L. Evans The University of Texas at Austin 12 Sep
Discriminative Approach for Transform Based Image Restoration
Wangmeng Zuo, Deyu Meng, Lei Zhang, Xiangchu Feng, David Zhang
Extensions of wavelets
More MR Fingerprinting
Robust Principle Component Analysis Based 4D Computed Tomography Hongkai Zhao Department of Mathematics, UC Irvine Joint work with H. Gao, J. Cai and Z.
Yves Meyer’s models for image decomposition and computational approaches Luminita Vese Department of Mathematics, UCLA Triet Le (Yale University), Linh.
Sparse and Overcomplete Data Representation
SRINKAGE FOR REDUNDANT REPRESENTATIONS ? Michael Elad The Computer Science Department The Technion – Israel Institute of technology Haifa 32000, Israel.
Modern Sampling Methods Summary of Subspace Priors Spring, 2009.
ITERATED SRINKAGE ALGORITHM FOR BASIS PURSUIT MINIMIZATION Michael Elad The Computer Science Department The Technion – Israel Institute of technology Haifa.
Martin Burger Institut für Numerische und Angewandte Mathematik European Institute for Molecular Imaging CeNoS Total Variation and related Methods Numerical.
New Results in Image Processing based on Sparse and Redundant Representations Michael Elad The Computer Science Department The Technion – Israel Institute.
Martin Burger Institut für Numerische und Angewandte Mathematik European Institute for Molecular Imaging CeNoS Total Variation and Related Methods.
Wavelet Transform A very brief look.
Error Estimation in TV Imaging Martin Burger Institute for Computational and Applied Mathematics European Institute for Molecular Imaging (EIMI) Center.
Recent Trends in Signal Representations and Their Role in Image Processing Michael Elad The CS Department The Technion – Israel Institute of technology.
Martin Burger Total Variation 1 Cetraro, September 2008 Numerical Schemes Wrap up approximate formulations of subgradient relation.
EE565 Advanced Image Processing Copyright Xin Li Different Frameworks for Image Processing Statistical/Stochastic Models: Wiener’s MMSE estimation.
Compressed Sensing Compressive Sampling
Mathematics and Computation in Imaging Science and Information Processing July-December, 2003 Organized by Institute of Mathematical Sciences and Center.
Unitary Extension Principle: Ten Years After Zuowei Shen Department of Mathematics National University of Singapore.
Motivation from Real-World Applications EE565 Advanced Image Processing Copyright Xin Li Noisy Photos Noisy ultrasound data.
WEIGHTED OVERCOMPLETE DENOISING Onur G. Guleryuz Epson Palo Alto Laboratory Palo Alto, CA (Please view in full screen mode to see.
Image Priors and Optimization Methods for Low-level Vision Dilip Krishnan TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.:
RECPAD - 14ª Conferência Portuguesa de Reconhecimento de Padrões, Aveiro, 23 de Outubro de 2009 The data exhibit a severe type of signal-dependent noise,
Cs: compressed sensing
Wavelets and Denoising Jun Ge and Gagan Mirchandani Electrical and Computer Engineering Department The University of Vermont October 10, 2003 Research.
Eran Treister and Irad Yavneh Computer Science, Technion (with thanks to Michael Elad)
Multiresolution analysis and wavelet bases Outline : Multiresolution analysis The scaling function and scaling equation Orthogonal wavelets Biorthogonal.
Sparsity-based Image Deblurring with Locally Adaptive and Nonlocally Robust Regularization Weisheng Dong a, Xin Li b, Lei Zhang c, Guangming Shi a a Xidian.
The Group Lasso for Logistic Regression Lukas Meier, Sara van de Geer and Peter Bühlmann Presenter: Lu Ren ECE Dept., Duke University Sept. 19, 2008.
Review Questions Jyun-Ming Chen Spring Wavelet Transform What is wavelet? How is wavelet transform different from Fourier transform? Wavelets are.
Basis Expansions and Regularization Part II. Outline Review of Splines Wavelet Smoothing Reproducing Kernel Hilbert Spaces.
1 LES of Turbulent Flows: Lecture 7 (ME EN ) Prof. Rob Stoll Department of Mechanical Engineering University of Utah Fall 2014.
Application: Multiresolution Curves Jyun-Ming Chen Spring 2001.
Using Neumann Series to Solve Inverse Problems in Imaging Christopher Kumar Anand.
Introduction to Medical Imaging Week 6: Introduction to Medical Imaging Week 6: Denoising (part II) – Variational Methods and Evolutions Guy Gilboa Course.
From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images Alfred M. Bruckstein (Technion), David L. Donoho (Stanford), Michael.
L ECTURE 3 PDE Methods for Image Restoration. O VERVIEW Generic 2 nd order nonlinear evolution PDE Classification: Forward parabolic (smoothing): heat.
L ECTURE 5 Wavelet Frames: theory, construction and fast algorithms. B. Dong and Z. Shen, MRA-based wavelet frames and applications, IAS Lecture Notes.
Bayesian fMRI analysis with Spatial Basis Function Priors
PDE Methods for Image Restoration
Modulated Unit Norm Tight Frames for Compressed Sensing
Jinbo Bi Joint work with Jiangwen Sun, Jin Lu, and Tingyang Xu
Jeremy Watt and Aggelos Katsaggelos Northwestern University
Zhu Han University of Houston Thanks for Dr. Mingyi Hong’s slides
Wenkun Zhang, Hanming Zhang, Lei Li, Jinlai Ye, Bin Yan, Linyuan Wang
Partial Differential Equations for Data Compression and Encryption
NESTA: A Fast and Accurate First-Order Method for Sparse Recovery
Optimal sparse representations in general overcomplete bases
A Direct Numerical Imaging Method for Point and Extended Targets
Outline Sparse Reconstruction RIP Condition
Lecture 7 Patch based methods: nonlocal means, BM3D, K- SVD, data-driven (tight) frame.
Presentation transcript:

Sparse Approximation by Wavelet Frames and Applications Bin Dong Department of Mathematics The University of Arizona 2012 International Workshop on Signal Processing , Optimization, and Control June 30- July 3, 2012 USTC, Hefei, Anhui, China

Outlines Wavelet Frame Based Models for Linear Inverse Problems (Image Restoration) Applications in CT Reconstruction 1-norm based models Connections to variational model 0-norm based model Comparisons: 1-norm v.s. 0-norm Quick Intro of Conventional CT Reconstruction CT Reconstruction with Radon Domain Inpainting

Tight Frames in Orthonormal basis Riesz basis Tight frame: Mercedes-Benz frame Expansions: Unique Not unique

Tight Frames General tight frame systems Tight wavelet frames Construction of tight frame: unitary extension principles [Ron and Shen, 1997] They are redundant systems satisfying Parseval’s identity Or equivalently where and

Tight Frames Example: Fast transforms Lecture notes: [Dong and Shen, MRA-Based Wavelet Frames and Applications, IAS Lecture Notes Series,2011] Decomposition Reconstruction Perfect Reconstruction Redundancy Lecture notes: self-contained theoretical review of MRA-based wavelet frames, as well as recent applications in image restorations and analysis.

Image Restoration Model Image Restoration Problems Challenges: large-scale & ill-posed Denoising, when is identity operator Deblurring, when is some blurring operator Inpainting, when is some restriction operator CT/MR Imaging, when is partial Radon/Fourier transform

Frame Based Models Image restoration model: Balanced model for image restoration [Chan, Chan, Shen and Shen, 2003], [Cai, Chan and Shen, 2008] When , we have synthesis based model [Daubechies, Defrise and De Mol, 2004; Daubechies, Teschke and Vese, 2007] When , we have analysis based model [Stark, Elad and Donoho, 2005; Cai, Osher and Shen, 2009] Synthesis: sharper edges but more artifact. Analysis: less artifact but edges are a bit blurry. Balance in between. Which one to choose depends on applications Key: It works because images are piecewise smooth functions and have sparse representation under tight frame transforms Resembles Variational Models

Connections: Wavelet Transform and Differential Operators Nonlinear diffusion and iterative wavelet and wavelet frame shrinkage 2nd-order diffusion and Haar wavelet: [Mrazek, Weickert and Steidl, 2003&2005] High-order diffusion and tight wavelet frames in 1D: [Jiang, 2011] Difference operators in wavelet frame transform: True for general wavelet frames with various vanishing moments [Weickert et al., 2006; Shen and Xu, 2011] Filters Transform Approximation

Connections: Analysis Based Model and Variational Model [Cai, Dong, Osher and Shen, Journal of the AMS, 2012]: The connections give us Leads to new applications of wavelet frames: Converges For any differential operator when proper parameter is chosen. Geometric interpretations of the wavelet frame transform (WFT) WFT provides flexible and good discretization for differential operators Different discretizations affect reconstruction results Good regularization should contain differential operators with varied orders (e.g., total generalized variation [Bredies, Kunisch, and Pock, 2010]) Synthesis: sharper edges but more artifact. Analysis: less artifact but edges are a bit blurry. Balance in between. Which one to choose depends on applications Key: It works because images are piecewise smooth functions and have sparse representation under tight frame transforms Image segmentation: [Dong, Chien and Shen, 2010] Surface reconstruction from point clouds: [Dong and Shen, 2011] Standard Discretization Piecewise Linear WFT

Frame Based Models: 0-Norm Nonconvex analysis based model [Zhang, Dong and Lu, 2011] Motivations: Related work: Restricted isometry property (RIP) is not satisfied for many applications Penalizing “norm” of frame coefficients better balances sparsity and smoothnes Synthesis: sharper edges but more artifact. Analysis: less artifact but edges are a bit blurry. Balance in between. Which one to choose depends on applications Key: It works because images are piecewise smooth functions and have sparse representation under tight frame transforms “norm” with : [Blumensath and Davies, 2008&2009] quasi-norm with : [Chartrand, 2007&2008]

Fast Algorithm: 0-Norm Penalty decomposition (PD) method [Lu and Zhang, 2010] Algorithm: Change of variables Quadratic penalty There are other algorithms also, but split Bregman was proved to be efficient for frame based models.

Fast Algorithm: 0-Norm Step 1: Subproblem 1a): quadratic Subproblem 1b): hard-thresholding Convergence Analysis [Zhang, Dong and Lu, 2011] : There are other algorithms also, but split Bregman was proved to be efficient for frame based models.

Numerical Results Comparisons (Deblurring) Most important: relationship between minimizers. PFBS/FPC: [Combettes and Wajs, 2006] /[Hale, Yin and Zhang, 2010] Balanced Split Bregman: [Goldstein and Osher, 2008] & [Cai, Osher and Shen, 2009] Analysis 0-Norm PD Method: [Zhang, Dong and Lu, 2011]

Numerical Results Comparisons Portrait Couple Balanced Analysis Most important: relationship between minimizers. Couple Balanced Analysis

Faster Algorithm: 0-Norm Start with some fast optimization method for nonsmooth and convex optimizations: doubly augmented Lagrangian (DAL) method [Rockafellar, 1976]. Given the problem: The DAL method: where There are other algorithms also, but split Bregman was proved to be efficient for frame based models. We solve the joint optimization problem of the DAL method using an inexact alternative optimization scheme

Faster Algorithm: 0-Norm Start with some fast optimization method for nonsmooth and convex optimizations: doubly augmented Lagrangian (DAL) method [Rockafellar, 1976]. The inexact DAL method: Given the problem: The DAL method: where There are other algorithms also, but split Bregman was proved to be efficient for frame based models. Hard thresholding

Faster Algorithm: 0-Norm However, the inexact DAL method does not seem to converge!! Nonetheless, the sequence oscillates and is bounded. The mean doubly augmented Lagrangian method (MDAL) [Dong and Zhang, 2011] solve the convergence issue by using arithmetic means of the solution sequence as outputs instead: MDAL: There are other algorithms also, but split Bregman was proved to be efficient for frame based models.

Comparisons: Deblurring Comparisons of best PSNR values v.s. various noise level There are other algorithms also, but split Bregman was proved to be efficient for frame based models.

Comparisons: Deblurring Comparisons of computation time v.s. various noise level There are other algorithms also, but split Bregman was proved to be efficient for frame based models.

Comparisons: Deblurring What makes “lena” so special? Decay of the magnitudes of the wavelet frame coefficients is very fast, which is what 0-norm prefers. Similar observation was made earlier by [Wang and Yin, 2010]. 1-norm 0-norm: PD 0-norm: MDAL There are other algorithms also, but split Bregman was proved to be efficient for frame based models.

Applications in CT Reconstruction With the Center for Advanced Radiotherapy and Technology (CART), UCSD Applications in CT Reconstruction

3D Cone Beam CT Cone Beam CT

3D Cone Beam CT Discrete = Animation created by Dr. Xun Jia

Cone Beam CT Image Reconstruction Goal: solve Difficulties: Related work: Unknown Image Projected Image In order to reduce dose, the system is highly underdetermined. Hence the solution is not unique. Projected image is noisy. Total Variation (TV): [Sidkey, Kao and Pan 2006], [Sidkey and Pan, 2008], [Cho et al. 2009], [Jia et al. 2010]; EM-TV: [Yan et al. 2011]; [Chen et al. 2011]; Wavelet Frames: [Jia, Dong, Lou and Jiang, 2011]; Dynamical CT/4D CT: [Chen, Tang and Leng, 2008], [Jia et al. 2010], [Tian et al., 2011]; [Gao et al. 2011];

CT Image Reconstruction with Radon Domain Inpainting Idea: start with Benefits: Instead of solving We find both and such that: is close to but with better quality Prior knowledge of them should be used Safely increase imaging dose Utilizing prior knowledge we have for both CT images and the projected images

CT Image Reconstruction with Radon Domain Inpainting Model [Dong, Li and Shen, 2011] Algorithm: alternative optimization & split Bregman. where p=1, anisotropic p=2, isotropic

CT Image Reconstruction with Radon Domain Inpainting Algorithm [Dong, Li and Shen, 2011]: block coordinate descend method [Tseng, 2001] Convergence Analysis Problem: Algorithm: Note: If each subproblem is solved exactly, then the convergence analysis was given by [Tseng, 2001], even for nonconvex problems.

CT Image Reconstruction with Radon Domain Inpainting Results: N denoting number of projections N=15 N=20

CT Image Reconstruction with Radon Domain Inpainting Results: N denoting number of projections N=15 N=20 W/O Inpainting With Inpainting

Thank You Collaborators: Mathematics Stanley Osher, UCLA Zuowei Shen, NUS Jia Li, NUS Jianfeng Cai, University of Iowa Yifei Lou, UCLA/UCSD Yong Zhang, Simon Fraser University, Canada Zhaosong Lu, Simon Fraser University, Canada Medical School Steve B. Jiang, Radiation Oncology, UCSD Xun Jia, Radiation Oncology, UCSD Aichi Chien, Radiology, UCLA