Contrast Preserving Decolorization Cewu Lu, Li Xu, Jiaya Jia, The Chinese University of Hong Kong.

Slides:



Advertisements
Similar presentations
A Support Vector Method for Optimizing Average Precision
Advertisements

Bayesian Belief Propagation
Image Registration  Mapping of Evolution. Registration Goals Assume the correspondences are known Find such f() and g() such that the images are best.
Ignas Budvytis*, Tae-Kyun Kim*, Roberto Cipolla * - indicates equal contribution Making a Shallow Network Deep: Growing a Tree from Decision Regions of.
Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?
Decolorization: Is rgb2gray() out? Yibing Song, Linchao Bao, Xiaobin Xu and Qingxiong Yang City University of Hong Kong.
Pencil Drawing Production Cewu Lu, Li Xu, Jiaya Jia Speaker: Ying-Jou Chen.
Reducing Drift in Parametric Motion Tracking
Easy Optimization Problems, Relaxation, Local Processing for a small subset of variables.
Qualifying Exam: Contour Grouping Vida Movahedi Supervisor: James Elder Supervisory Committee: Minas Spetsakis, Jeff Edmonds York University Summer 2009.
Blending and Compositing Computational Photography Derek Hoiem, University of Illinois 09/23/14.
Hierarchical Saliency Detection School of Electronic Information Engineering Tianjin University 1 Wang Bingren.
Color2Gray Imanol Gómez Rubio Computational Photography – 11/Dec/2007 TU-Berlin.
Color2Gray: Salience-Preserving Color Removal
Color2Gray: Salience-Preserving Color Removal Amy Gooch Sven Olsen Jack Tumblin Bruce Gooch Northwestern University.
Color2Gray: Salience-Preserving Color Removal Amy A. Gooch Sven C. Olsen Jack Tumblin Bruce Gooch.
Discriminative and generative methods for bags of features
Computer Vision Optical Flow
Fast Colour2Grey Ali Alsam and Mark S. Drew The Scientific Department School of Computing Science The National Gallery London Simon Fraser University
Stas Goferman Lihi Zelnik-Manor Ayellet Tal. …
Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?
The value of kernel function represents the inner product of two training points in feature space Kernel functions merge two steps 1. map input data from.
Apparent Greyscale: A Simple and Fast Conversion to Perceptually Accurate Images and Video Kaleigh SmithPierre-Edouard Landes Joelle Thollot Karol Myszkowski.
Introduction to Image Quality Assessment
Motion Detail Preserving Optical Flow Estimation Li Xu 1, Jiaya Jia 1, Yasuyuki Matsushita 2 1 The Chinese University of Hong Kong 2 Microsoft Research.
An Iterative Optimization Approach for Unified Image Segmentation and Matting Hello everyone, my name is Jue Wang, I’m glad to be here to present our paper.
Relevance Feedback Content-Based Image Retrieval Using Query Distribution Estimation Based on Maximum Entropy Principle Irwin King and Zhong Jin The Chinese.
Online Learning Algorithms
Jinhui Tang †, Shuicheng Yan †, Richang Hong †, Guo-Jun Qi ‡, Tat-Seng Chua † † National University of Singapore ‡ University of Illinois at Urbana-Champaign.
Application of CAS to geodesy: a ‘live’ approach P. Zaletnyik 1, B. Paláncz 2, J.L. Awange 3, E.W. Grafarend 4 1,2 Budapest University of Technology and.
Session: Image Processing Seung-Tak Noh 五十嵐研究室 M2.
Support Vector Machines Piyush Kumar. Perceptrons revisited Class 1 : (+1) Class 2 : (-1) Is this unique?
Graph Embedding: A General Framework for Dimensionality Reduction Dong XU School of Computer Engineering Nanyang Technological University
Math 3360: Mathematical Imaging Prof. Ronald Lok Ming Lui Department of Mathematics, The Chinese University of Hong Kong Lecture 2: Image Transformation.
Stellar variability monitoring in open clusters with mini-SONG X.B. Zhang National Astronomical Observatories, Chinese Academy of Sciences.
Linear Image Reconstruction Bart Janssen 13-11, 2007 Eindhoven.
Line detection Assume there is a binary image, we use F(ά,X)=0 as the parametric equation of a curve with a vector of parameters ά=[α 1, …, α m ] and X=[x.
Discontinuous Galerkin Methods Li, Yang FerienAkademie 2008.
1 Markov Decision Processes Infinite Horizon Problems Alan Fern * * Based in part on slides by Craig Boutilier and Daniel Weld.
TVCG 2013 Sungkil Lee, Mike Sips, and Hans-Peter Seidel.
A New Method for Automatic Clothing Tagging Utilizing Image-Click-Ads Introduction Conclusion Can We Do Better to Reduce Workload?
Automated Fingertip Detection
Motion Estimation Today’s Readings Trucco & Verri, 8.3 – 8.4 (skip 8.3.3, read only top half of p. 199) Newton's method Wikpedia page
Optimization-based Image Decolorization Why Grayscale Image? Student Name: XU Zhinan Advisor: Professor Chiew-Lan Tai a)Widely used in pattern recognition.
Large-Scale Matrix Factorization with Missing Data under Additional Constraints Kaushik Mitra University of Maryland, College Park, MD Sameer Sheoreyy.
Recent Research about LTGA Lecturer:Yu-Fan Tung, R Advisor:Tian-Li Yu Date:May 8, 2014.
Change Blindness Images Li-Qian Ma 1, Kun Xu 1, Tien-Tsin Wong 2, Bi-Ye Jiang 1, Shi-Min Hu 1 1 Tsinghua University 2 The Chinese University of Hong Kong.
Bivariate Splines for Image Denoising*° *Grant Fiddyment University of Georgia, 2008 °Ming-Jun Lai Dept. of Mathematics University of Georgia.
6.4 Random Fields on Graphs 6.5 Random Fields Models In “Adaptive Cooperative Systems” Summarized by Ho-Sik Seok.
Learning Photographic Global Tonal Adjustment with a Database of Input / Output Image Pairs.
Motion Estimation Today’s Readings Trucco & Verri, 8.3 – 8.4 (skip 8.3.3, read only top half of p. 199) Newton's method Wikpedia page
Image Warping Many slides from Alyosha Efros + Steve Seitz + Derek oeim Photo by Sean Carroll.
ICCV 2007 National Laboratory of Pattern Recognition Institute of Automation Chinese Academy of Sciences Half Quadratic Analysis for Mean Shift: with Extension.
Linear Discriminant Functions Chapter 5 (Duda et al.) CS479/679 Pattern Recognition Dr. George Bebis.
Modeling Perspective Effects in Photographic Composition Zihan Zhou, Siqiong He, Jia Li, and James Z. Wang The Pennsylvania State University.
Color transfer between high-dynamic-range images
Automatically Collect Ground Control Points from Online Aerial Maps
Support Vector Machines and Kernels
Saliency detection Donghun Yeo CV Lab..
Learning to Detect a Salient Object
Multi-modality image registration using mutual information based on gradient vector flow Yujun Guo May 1,2006.
Combining Sketch and Tone for Pencil Drawing Production
Structure from motion Input: Output: (Tomasi and Kanade)
Before: November 28, 2017 Solve each system by graphing. 1. y = 2x – 1
Objectives Identify solutions of linear equations in two variables.
Gradient Domain Salience-preserving Color-to-gray Conversion
Structure from motion Input: Output: (Tomasi and Kanade)
Image Registration  Mapping of Evolution
Presentation transcript:

Contrast Preserving Decolorization Cewu Lu, Li Xu, Jiaya Jia, The Chinese University of Hong Kong

Mono printers are still the majority Fast Economic Environmental friendly

Documents generally have color figures

The printing problem

HP printer The printing problem

Our Result The printing problem

Decolorization Mapping Single Channel

Applications Color Blindness

Applications Color Blindness

Decolorization could lose contrast Mapping( ) = = = =

Mapping Decolorization could lose contrast

Bala and Eschbach 2004 Neumann et al Smith et al Pervious Work (Local methods)

Naive Mapping Color Contrast Result

Gooch et al Rasche et al Kim et al Pervious Work (Global methods)

Color feature preserving optimization mapping function

Pervious Work (Global methods) In most global methods, color order is strictly satisfied

Color order could be ambiguous Can you tell the order?

brightness ( ) < brightness ( ) YUV space Lightness( ) > Lightness ( ) LAB space Color order could be ambiguous

People with different culture and language background have different senses of brightness with respect to color. E. Ozgen et al., Current Directions in Psychological Science, 2004 K. Zhou et al., National Academy of Sciences, 2010 The order of different colors cannot be defined uniquely by people B. Wong et al., Nature Methods, 2010 Color order could be ambiguous

If we enforce the color order constraint, contrast loss could happen Input Ours [Rasche et al. 2005] [Kim et al. 2009] Color order could be ambiguous

Our Contribution Weak Color Order Bimodal Contrast-Preserving Relax the color order constraint Unambiguous color pairs Global Mapping Polynomial Mapping

The Framework Objective Function  Bimodal Contrast-Preserving  Weak Color Order Finite Multivariate Polynomial Mapping Function Numerical Solution

Bimodal Contrast-Preserving Color pixel, grayscale contrast, color contrast ( CIELab distance ) follows a Gaussian distribution with mean

Bimodal Contrast-Preserving Color pixel, grayscale contrast, color contrast ( CIELab distance ) follows a Gaussian distribution with mean.

Bimodal Contrast-Preserving Tradition methods (order preserving): : neighborhood pixel set Our bimodal contrast-preserving for ambiguous color pairs:

Bimodal Contrast-Preserving

Our Work Objective Function  Bimodal Contrast-Preserving  Weak Color Order Finite Multivariate Polynomial Mapping Function Numerical Solution

Weak Color Order Unambiguous color pairs: or

Weak Color Order Unambiguous color pairs: or Our model thus becomes

Our Work Objective Function  Bimodal Contrast-Preserving  Weak Color Order Finite Multivariate Polynomial Mapping Function Numerical Solution

Multivariate Polynomial Mapping Function Solve for grayscale image: Variables (pixels): 400x250 = 100,000 Example Too many (easily produce unnatural structures)

Multivariate Polynomial Mapping Function Parametric global color-to-grayscale mapping Small Scale

Multivariate Polynomial Mapping Function Parametric color-to-grayscale When n = 2, a grayscale is a linear combination of elements is the monomial basis of,.

Multivariate Polynomial Mapping Function Parametric color-to-grayscale

Multivariate Polynomial Mapping Function Parametric color-to-grayscale

Multivariate Polynomial Mapping Function Parametric color-to-grayscale

Multivariate Polynomial Mapping Function Parametric color-to-grayscale

Multivariate Polynomial Mapping Function Parametric color-to-grayscale

Multivariate Polynomial Mapping Function Parametric color-to-grayscale

Multivariate Polynomial Mapping Function Parametric color-to-grayscale

Multivariate Polynomial Mapping Function Parametric color-to-grayscale

Multivariate Polynomial Mapping Function Parametric color-to-grayscale

Multivariate Polynomial Mapping Function Parametric color-to-grayscale

Multivariate Polynomial Mapping Function Parametric color-to-grayscale

Multivariate Polynomial Mapping Function Parametric color-to-grayscale

Multivariate Polynomial Mapping Function Parametric color-to-grayscale

Our Model Objective function:

Numerical Solution Define :

Numerical Solution

Initialize :

Numerical Solution obtain

Numerical Solution obtain

Numerical Solution obtain

Numerical Solution obtain

Numerical Solution obtain

Numerical Solution (Example) Iter

Numerical Solution (Example) Iter

Numerical Solution (Example) Iter

Numerical Solution (Example) Iter

Numerical Solution (Example) Iter

Numerical Solution (Example) Iter

Numerical Solution (Example) Iter

Numerical Solution (Example) Iter

Results InputOurs [Rasche et al. 2005] [Kim et al. 2009]

Results InputOurs [Rasche et al. 2005] [Kim et al. 2009]

Results InputOurs [Rasche et al. 2005] [Kim et al. 2009]

Results InputOurs [Rasche et al. 2005] [Kim et al. 2009]

Results (Quantitative Evaluation) color contrast preserving ratio (CCPR) the set containing all neighboring pixel pairs with the original color difference.

Results (Quantitative Evaluation)

Our Results (Quantitative Evaluation)

Results (Quantitative Evaluation)

Number: Number: 24853

Results (Quantitative Evaluation) Number: Number: 24853

Results (Quantitative Evaluation)

Results (contrast boosting) substituting our grayscale image for the L channel in the Lab space

Results (contrast boosting) substituting our grayscale image for the L channel in the Lab space

Conclusion A new color-to-grayscale method that can well maintain the color contrast. Weak color constraint. Polynomial Mapping Function for global mapping.

The End

Limitations Color2gray is very subjective visual experience. Contrast enhancement may not be acceptable for everyone. Compared to the naive color2grayscale mapping, our method is less efficient due to the extra operations.

An arguable result

Running Time For a 600 × 600 color input, our Matlab implementation takes 0.8s A C-language implementation can be 10 times faster at least.