Texture Synthesis and Transfer

Slides:

Advertisements

Similar presentations

Filling Algorithms Pixelwise MRFsChaos Mosaics Patch segments are pasted, overlapping, across the image. Then either: Ambiguities are removed by smoothing.

Advertisements

Image Quilting and Apples

Super-Resolution Texturing for Online Virtual Globes

Texture. Limitation of pixel based processing Edge detection with different threshold.

Data-driven methods: Texture (Sz 10.5) Cs129 Computational Photography James Hays, Brown, Spring 2011 Many slides from Alexei Efros.

Ted Adelson’s checkerboard illusion. Motion illusion, rotating snakes.

Designing Facial Animation For Speaking Persian Language Hadi Rahimzadeh June 2005.

More details on presentations Aim to speak for ~50 min (after 15 min review, leaving 10 min for discussions) Try to plan discussion topics It’s fine to.

String Recognition Simple case: recognize 1101 “ ” 0 “1” 0 “11” 0 Reset 1 “110” “1101”

CPSC 533C Static and Moving Patterns Presented by Ken Deeter Slides borrowed from Colin Ware’s PPT Slides.

Layered Texture Matting 葉展岱范智勝. Outline  Introduction  Implementation Overview  Current Work  Reference.

CSE 803 Fall 2008 Stockman1 Veggie Vision by IBM Ideas about a practical system to make more efficient the selling and inventory of produce in a grocery.

Video Texture : Computational Photography Alexei Efros, CMU, Fall 2006 © A.A. Efros.

Maryia Kazakevich “Texture Synthesis by Patch-Based Sampling” Texture Synthesis by Patch-Based Sampling Real-Time Texture Synthesis By Patch-Based Sampling,

Image Quilting for Texture Synthesis & Transfer Alexei Efros (UC Berkeley) Bill Freeman (MERL) +=

Image Quilting for Texture Synthesis and Transfer Alexei A. Efros1,2 William T. Freeman2.

Automatic Image Alignment (feature-based) : Computational Photography Alexei Efros, CMU, Fall 2005 with a lot of slides stolen from Steve Seitz and.

Color a* b* Brightness L* Texture Original Image Features Feature combination E D 22 Boundary Processing Textons A B C A B C 22 Region Processing.

Texture Reading: Chapter 9 (skip 9.4) Key issue: How do we represent texture? Topics: –Texture segmentation –Texture-based matching –Texture synthesis.

Automatic Image Alignment (feature-based) : Computational Photography Alexei Efros, CMU, Fall 2006 with a lot of slides stolen from Steve Seitz and.

COS 429 PS3: Stitching a Panorama Due November 4 th.

Fast Texture Synthesis Tree-structure Vector Quantization Li-Yi WeiMarc Levoy Stanford University.

Data-driven methods: Video : Computational Photography Alexei Efros, CMU, Fall 2007 © A.A. Efros.

Post-rendering Cel Shading & Bloom Effect

Background Estimation Mehdi Ghayoumi, MD Iftakharul Islam, Muslem Al-Saidi Department of Computer Science Kent State University, Kent, OH

3D Stereo Video Coding Heejune AHN Embedded Communications Laboratory Seoul National Univ. of Technology Fall 2013 Last updated

Yuping Lin and Gérard Medioni.  Introduction  Method  Register UAV streams to a global reference image ▪ Consecutive UAV image registration ▪ UAV to.

Video Textures Arno Schödl Richard Szeliski David Salesin Irfan Essa Microsoft Research, Georgia Tech.

Graph-based Segmentation. Main Ideas Convert image into a graph Vertices for the pixels Vertices for the pixels Edges between the pixels Edges between.

Graphite 2004 Statistical Synthesis of Facial Expressions for the Portrayal of Emotion Lisa Gralewski Bristol University United Kingdom

Geometric Operations and Morphing.

Light Using Texture Synthesis for Non-Photorealistic Shading from Paint Samples. Christopher D. Kulla, James D. Tucek, Reynold J. Bailey, Cindy M. Grimm.

TEXTURE SYNTHESIS BY NON-PARAMETRIC SAMPLING VIVA-VITAL Nazia Tabassum 27 July 2015.

Advanced Computer Graphics (Fall 2010) CS 283, Lecture 26 Texture Synthesis Ravi Ramamoorthi Slides, lecture.

Digital Image Processing, 3rd ed. © 1992–2008 R. C. Gonzalez & R. E. Woods Gonzalez & Woods Chapter 3 Intensity Transformations.

Synthesizing Natural Textures Michael Ashikhmin University of Utah.

Towards Real-Time Texture Synthesis With the Jump Map Steve Zelinka Michael Garland University of Illinois at Urbana-Champaign Thirteenth Eurographics.

(c) 2000, 2001 SNU CSE Biointelligence Lab Finding Region Another method for processing image  to find “regions” Finding regions  Finding outlines.

2D Texture Synthesis Instructor: Yizhou Yu. Texture synthesis Goal: increase texture resolution yet keep local texture variation.

Graphcut Textures Image and Video Synthesis Using Graph Cuts

Geometry Synthesis Ares Lagae Olivier Dumont Philip Dutré Department of Computer Science Katholieke Universiteit Leuven 10 August, 2004.

Scale Invariant Feature Transform (SIFT)

Texture Synthesis by Image Quilting CS766 Class Project Fall 2004 Eric Robinson.

Nonparametric Modeling of Textures Outline Parametric vs. nonparametric Image patches and similarity distance Efros-Leung’s texture synthesis by nonparametric.

Video Textures Arno Schödl Richard Szeliski David Salesin Irfan Essa Microsoft Research, Georgia Tech.

Texture Analysis and Synthesis. Texture Texture: pattern that “looks the same” at all locationsTexture: pattern that “looks the same” at all locations.

Technological Uncanny K. S'hell, C Kurtz, N. Vincent et E. André et M. Beugnet 1.

The making of Landscape Animations: Camera Motion A description of the virtual camera controls used in developing two animations for a pilot test.

Graph-based Segmentation

Graphcut Textures:Image and Video Synthesis Using Graph Cuts

Announcements Project 4 out today help session at the end of class.

Basis beeldverwerking (8D040) dr. Andrea Fuster dr. Anna Vilanova Prof

CS 4501: Introduction to Computer Vision Sparse Feature Detectors: Harris Corner, Difference of Gaussian Connelly Barnes Slides from Jason Lawrence, Fei.

Detail Preserving Shape Deformation in Image Editing

Fast Preprocessing for Robust Face Sketch Synthesis

Convolutional Networks

Announcements Final Project 3 artifacts Evals

Data-driven methods: Texture 2 (Sz 10.5)

Texture Quality Extensions to Image Quilting

Aline Martin ECE738 Project – Spring 2005

Image Quilting for Texture Synthesis & Transfer

Announcements Guest lecture next Tuesday

Digital Image Processing Week III

Depth Aware Inpainting for Novel View Synthesis Jayant Thatte

Volume 99, Issue 8, Pages (October 2010)

Using Clustering to Make Prediction Intervals For Neural Networks

Sequences II Prof. Noah Snavely CS1114

Auditory Morphing Weyni Clacken

Random Neural Network Texture Model

Lecture 7 Patch based methods: nonlocal means, BM3D, K- SVD, data-driven (tight) frame.

Presentation transcript:

Texture Synthesis and Transfer William Wedler 15-463 Final Project Fall 2007

Project Description Synthetic texture from a given sample Extract blocks and fit them together Find blocks that match along their borders Piece together with jagged edges Justification: Markov property Current state is (x,y) location Output is a block from the given sample

Synthesis Results Markov Model Current State: Overlapping region already synthesized (Shaded region) Current Output: Selected block from input sample (Dashed outline) Input Output

Dependency on Sampling Parameters 20 pixel Window 30 pixel Window 40 pixel Window Input: 1/6 Overlap 1/5 Overlap 1/4 Overlap

Texture Transfer Results Modify model sates: Add target correspondence information & Input texture Input target

Extension Into Animation Idea: Transition from mostly texture to mostly target figure Vary resemblance to texture/target Change window size with Blur input target Add time dimension to state information: Consider texture from previous frame Modified code borrowed from Proff. Efros

Animation Results Only vary window sizes, no prev. frame info: Inputs: http://www.youtube.com/watch?v=lXxkgA65TO4 Vary window, blur and add prev. frame info: http://www.youtube.com/watch?v=IrA6YKrKOPw Inputs: Outputs: