Announcements For future problems sets: email matlab code by 11am, due date (same as deadline to hand in hardcopy). Today’s reading: Chapter 9, except.

Slides:

Advertisements

Similar presentations

Texture. Limitation of pixel based processing Edge detection with different threshold.

Advertisements

Data-driven methods: Texture (Sz 10.5) Cs129 Computational Photography James Hays, Brown, Spring 2011 Many slides from Alexei Efros.

CS Spring 2009 CS 414 – Multimedia Systems Design Lecture 4 – Digital Image Representation Klara Nahrstedt Spring 2009.

November 12, 2013Computer Vision Lecture 12: Texture 1Signature Another popular method of representing shape is called the signature. In order to compute.

Recognizing Surfaces using Three-Dimensional Textons Thomas Leung and Jitendra Malik Computer Science Division University of California at Berkeley.

Image Processing Lecture 4

Chapter 3 Image Enhancement in the Spatial Domain.

Pyramids and Texture. Scaled representations Big bars and little bars are both interesting Spots and hands vs. stripes and hairs Inefficient to detect.

CS 4487/9587 Algorithms for Image Analysis

Computer Vision Lecture 16: Texture

Computational Photography CSE 590 Tamara Berg Filtering & Pyramids.

Texture. Edge detectors find differences in overall intensity. Average intensity is only simplest difference. many slides from David Jacobs.

Image Processing David Kauchak cs160 Fall 2009 Empirical Evaluation of Dissimilarity Measures for Color and Texture Jan Puzicha, Joachim M. Buhmann, Yossi.

Lecture 4 Linear Filters and Convolution

Image Filtering CS485/685 Computer Vision Prof. George Bebis.

1 Texture Texture is a description of the spatial arrangement of color or intensities in an image or a selected region of an image. Structural approach:

Image Quilting for Texture Synthesis & Transfer Alexei Efros (UC Berkeley) Bill Freeman (MERL) +=

Texture This isn’t described in Trucco and Verri Parts are described in: – Computer Vision, a Modern Approach by Forsyth and Ponce –“Texture Synthesis.

Image processing. Image operations Operations on an image –Linear filtering –Non-linear filtering –Transformations –Noise removal –Segmentation.

Announcements Big mistake on hint in problem 1 (I’m very sorry).

Texture Turk, 91.

Texture Texture is a description of the spatial arrangement of color or intensities in an image or a selected region of an image. Structural approach:

Computer Vision - A Modern Approach

Computer Vision Introduction to Image formats, reading and writing images, and image environments Image filtering.

Clustering Color/Intensity

TEXTURE SYNTHESIS PEI YEAN LEE. What is texture? Images containing repeating patterns Local & stationary.

Texture Reading: Chapter 9 (skip 9.4) Key issue: How do we represent texture? Topics: –Texture segmentation –Texture-based matching –Texture synthesis.

Texture Recognition and Synthesis A Non-parametric Multi-Scale Statistical Model by De Bonet & Viola Artificial Intelligence Lab MIT Presentation by Pooja.

Image Enhancement.

2D Fourier Theory for Image Analysis Mani Thomas CISC 489/689.

Computer Vision - A Modern Approach Set: Pyramids and Texture Slides by D.A. Forsyth Scaled representations Big bars (resp. spots, hands, etc.) and little.

1 Images and Transformations Images by Pawan SinhaPawan Sinha.

Matlab Tutorial Continued Files, functions and images.

Announcements Send to the TA for the mailing list For problem set 1: turn in written answers to problems 2 and 3. Everything.

Linear Filtering About modifying pixels based on neighborhood. Local methods simplest. Linear means linear combination of neighbors. Linear methods simplest.

Image Processing David Kauchak cs458 Fall 2012 Empirical Evaluation of Dissimilarity Measures for Color and Texture Jan Puzicha, Joachim M. Buhmann, Yossi.

Overview Introduction to local features

Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean 5409 T-R 10:30am – 11:50am.

Texture Synthesis by Non-parametric Sampling Alexei Efros and Thomas Leung UC Berkeley.

Applications of Image Filters Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 02/04/10.

CAP5415: Computer Vision Lecture 4: Image Pyramids, Image Statistics, Denoising Fall 2006.

INDEPENDENT COMPONENT ANALYSIS OF TEXTURES based on the article R.Manduchi, J. Portilla, ICA of Textures, The Proc. of the 7 th IEEE Int. Conf. On Comp.

Texture. Texture is an innate property of all surfaces (clouds, trees, bricks, hair etc…). It refers to visual patterns of homogeneity and does not result.

University of Texas at Austin CS384G - Computer Graphics Fall 2010 Don Fussell Image processing.

Course 9 Texture. Definition: Texture is repeating patterns of local variations in image intensity, which is too fine to be distinguished. Texture evokes.

Texture Key issue: representing texture –Texture based matching little is known –Texture segmentation key issue: representing texture –Texture synthesis.

Digital Image Processing Lecture 10: Image Restoration March 28, 2005 Prof. Charlene Tsai.

Chapter 5: Neighborhood Processing

Digital Image Processing Lecture 10: Image Restoration

Autonomous Robots Vision © Manfred Huber 2014.

2D Texture Synthesis Instructor: Yizhou Yu. Texture synthesis Goal: increase texture resolution yet keep local texture variation.

MIT AI Lab / LIDS Laboatory for Information and Decision Systems & Artificial Intelligence Laboratory Massachusetts Institute of Technology A Unified Multiresolution.

A Statistical Approach to Texture Classification Nicholas Chan Heather Dunlop Project Dec. 14, 2005.

Texture Synthesis by Image Quilting CS766 Class Project Fall 2004 Eric Robinson.

Image features and properties. Image content representation The simplest representation of an image pattern is to list image pixels, one after the other.

Texture Analysis and Synthesis. Texture Texture: pattern that “looks the same” at all locationsTexture: pattern that “looks the same” at all locations.

Filters– Chapter 6. Filter Difference between a Filter and a Point Operation is that a Filter utilizes a neighborhood of pixels from the input image to.

Image Enhancement in the Spatial Domain.

Linear Filters and Edges Chapters 7 and 8

Linear Filters and Edges Chapters 7 and 8

Digital Image Processing Lecture 10: Image Restoration

Linear Filters and Edges Chapters 7 and 8

Outline Texture modeling - continued Filtering-based approaches.

Texture Synthesis by Non-parametric Sampling

Computer Vision Lecture 16: Texture II

Local Binary Patterns (LBP)

Image Quilting for Texture Synthesis & Transfer

Grouping/Segmentation

Some slides: courtesy of David Jacobs

Presentation transcript:

Announcements For future problems sets: matlab code by 11am, due date (same as deadline to hand in hardcopy). Today’s reading: Chapter 9, except 9.4.

Texture Edge detectors find differences in overall intensity. Average intensity is only simplest difference.

Issues: 1) Discrimination/Analysis (Freeman)

2) Synthesis

Many more issues 3. Texture boundary detection. 4. Shape from texture. We’ll focus on 1, mention 2.

What is texture? Something that repeats with variation. Must separate what repeats and what stays the same. Model as repeated trials of a random process –The probability distribution stays the same. –But each trial is different.

Simplest Texture Each pixel independent, identically distributed (iid). Examples: –Region of constant intensity. –Gaussian noise pattern. –Speckled pattern Matlab

Texture Discrimination is then Statistics Two sets of samples. Do they come from the same random process?

Simplest Texture Discrimination Compare histograms. –Divide intensities into discrete ranges. –Count how many pixels in each range

How/why to compare Simplest comparison is SSD, many others. Can view probabilistically. –Histogram is a set of samples from a probability distribution. –With many samples it approximates distribution. –Test probability samples drawn from same distribution. Ie., is difference greater than expected when two samples come from same distribution? Matlab

i j k Chi-square Chi square distance between texton histograms (Malik)

More Complex Discrimination Histogram comparison is very limiting –Every pixel is independent. –Everything happens at a tiny scale. Matlab Use output of filters of different scales.

Example (Forsyth & Ponce)

What are Right Filters? Multi-scale is good, since we don’t know right scale a priori. Easiest to compare with naïve Bayes: Filter image one: (F1, F2, …) Filter image two: (G1, G2, …) S means image one and two have same texture. Approximate: P(F1,G1,F2,G2, …| S) By P(F1,G1|S)*P(F2,G2|S)*…

What are Right Filters? The more independent the better. –In an image, output of one filter should be independent of others. –Because our comparison assumes independence. –Wavelets seem to be best.

Difference of Gaussian Filters

Spots and Oriented Bars (Malik and Perona)

Gabor Filters Gabor filters at different scales and spatial frequencies top row shows anti-symmetric (or odd) filters, bottom row the symmetric (or even) filters.

Matlab

Gabor filters are examples of Wavelets We know two bases for images: –Pixels are localized in space. –Fourier are localized in frequency. Wavelets are a little of both. Good for measuring frequency locally.

Synthesis with this Representation (Bergen and Heeger)

Markov Model Captures local dependencies. –Each pixel depends on neighborhood. Example, 1D first order model P(p1, p2, …pn) = P(p1)*P(p2|p1)*P(p3|p2,p1)*… = P(p1)*P(p2|p1)*P(p3|p2)*P(p4|p3)*…

Example 1 st Order Markov Model Each pixel is like neighbor to left + noise with some probability. Matlab These capture a much wider range of phenomena.

There are dependencies in Filter Outputs Edge –Filter responds at one scale, often does at other scales. –Filter responds at one orientation, often doesn’t at orthogonal orientation. Synthesis using wavelets and Markov model for dependencies: –DeBonet and Viola –Portilla and Simoncelli

We can do this without filters Each pixel depends on neighbors. 1.As you synthesize, look at neighbors. 2.Look for similar neighborhood in sample texture. 3.Copy pixel from that neighborhood. 4.Continue.

This is like copying, but not just repetition Photo Pattern Repeated

With Blocks

Conclusions Model texture as generated from random process. Discriminate by seeing whether statistics of two processes seem the same. Synthesize by generating image with same statistics.

To Think About 3D effects –Shape: Tiger’s appearance depends on its shape. –Lighting: Bark looks different with light angle Given pictures of many chairs, can we generate a new chair?