Image Quilting for Texture Synthesis and Transfer Alexei A. Efros1,2 William T. Freeman2

Outline Introduction Introduction Quilting Quilting Texture Transfer Texture Transfer

Introduction Image quilting Image quilting Motivation ： one pixel at a time synthesis is most Motivation ： one pixel at a time synthesis is most complex complex

Quilting Bi ： a square blocks Bi ： a square blocks SB ： all such overlapping blocks in the input texture SB ： all such overlapping blocks in the input texture First step First step simply tile it with blocks taken randomly from SB simply tile it with blocks taken randomly from SB

Second step Second step introduce some overlap in the placement of blocks onto the new image introduce some overlap in the placement of blocks onto the new image search SB for such a block that by some measure agrees with its neighbors along the region of overlap. search SB for such a block that by some measure agrees with its neighbors along the region of overlap.

Finally step Finally step blocks have ragged edges which will allow them to better approximate the features in the texture. blocks have ragged edges which will allow them to better approximate the features in the texture. find a minimum cost path through that error surface and declare that to be the boundary of the new block find a minimum cost path through that error surface and declare that to be the boundary of the new block.

Minimum Error Boundary Cut Minimum Error Boundary Cut error surface is defined as e = error surface is defined as e = compute the cumulative minimum error E for all paths compute the cumulative minimum error E for all paths trace back and find the path of the best cut trace back and find the path of the best cut both a vertical and a horizontal overlap, the minimal paths meet in the middle and the overall minimum is chosen for the cut. both a vertical and a horizontal overlap, the minimal paths meet in the middle and the overall minimum is chosen for the cut.

Algorithm Algorithm

Synthesis Results Synthesis Results

Texture Transfer correspondence map is a spatial map of corresponding quantity over both the texture source image and a controlling target image. correspondence map is a spatial map of corresponding quantity over both the texture source image and a controlling target image. quantity could include image quantity could include image intensity, blurred image intensity intensity, blurred image intensity, local image orientation angles, local image orientation angles

END THANKS EVERYONE