Let us have some after lunch fun

Fast Image and Video Colorization (and beyond) using Chrominance Blending Yatziv and S.

Hand-Tinting of Photos 19 th century

Hand-Tinting of postcards early 20 th century

Computer Assisted Colorization Given: a single dimension of luminance Output: three dimensions –Luminance –Chrominance Colorization is ambiguous in nature and requires some amount of human interaction.

Commercial Software Adobe Photoshop Tutorial

Computer Assisted Colorization Interfaces Sample Based –One or more color images as a source –In video, use one or more colored frames sample framegray-scaleresult colored image Example source: Sykora, Burianek, Zara “Colorization of Black-and-White Cartoons”

Computer Assisted Colorization Interfaces Chrominance Scribble Based –Small chrominance markings –Scribble area << image size gray-scalescribblesresult colored image Example source: Levin, Lischinski, Weiss, “Colorization using optimization,” SIGGRAPH’ 04

Previous Work Luminance Keying –Gonzalez, Woods, ‘Digital Image Processing’. –Welsh, Ashikhmin, Mueller, “Transferring color to grayscale images”. –Reinhard, Ashikhmin, Gooch, Shirley, “Color transfer between images”. –Hertzmann, Jacobs, Oliver, Curless, Salesin, “Image analogies”. Segmentation –Chen, Wang, Schillings, Meinel, “Gray-scale matting and colorization”. –Sykora, Burianek, Zara “Colorization of Black-and-White Cartoons”. Geometry Based –Sapiro, “Inpainting the colors”. –Levin, Lischinski, Weiss, “Colorization using optimization”

Our Approach Fast Image and Video Colorization using Chrominance Blending C s,t t s Intrinsic distance: Y is the gray-scale channel c Distance from a chrominance c: d c (t) can be calculated efficiently using improved “Fast Marching” algorithm.

…Our Approach Fast Image and Video Colorization using Chrominance Blending tc1c1 c3c3 c2c2 for (typically B=4) DW Shepard interpolation

Examples

Example - Video

NEAR FAR

DE CO LO RIZI NG

Video Inpainting Patwardhan and S.

Tracking under severe occlusions Bartesaghi and S.