Stas Goferman Lihi Zelnik-Manor Ayellet Tal. …

Slides:

Advertisements

Similar presentations

Dynamic View Selection for Time-Varying Volumes Guangfeng Ji* and Han-Wei Shen The Ohio State University *Now at Vital Images.

Advertisements

The Layout Consistent Random Field for detecting and segmenting occluded objects CVPR, June 2006 John Winn Jamie Shotton.

Presented by: Avner Gidron Presented to : Prof. Hagit Hel-Or.

DONG XU, MEMBER, IEEE, AND SHIH-FU CHANG, FELLOW, IEEE Video Event Recognition Using Kernel Methods with Multilevel Temporal Alignment.

Sparsity and Saliency Xiaodi Hou K-Lab, Computation and Neural Systems California Institute of Technology for the Crash Course on Visual Saliency Modeling:

Foreground Focus: Finding Meaningful Features in Unlabeled Images Yong Jae Lee and Kristen Grauman University of Texas at Austin.

Leveraging Stereopsis for Saliency Analysis

1. Facial Expression Editing in Video Using a Temporally- Smooth Factorization 2. Face Swapping: Automatically Replacing Faces in Photographs.

Contrast Preserving Decolorization Cewu Lu, Li Xu, Jiaya Jia, The Chinese University of Hong Kong.

Detecting Categories in News Video Using Image Features Slav Petrov, Arlo Faria, Pascal Michaillat, Alex Berg, Andreas Stolcke, Dan Klein, Jitendra Malik.

Yuanlu Xu Human Re-identification: A Survey.

Global spatial layout: spatial pyramid matching Spatial weighting the features Beyond bags of features: Adding spatial information.

Hierarchical Saliency Detection School of Electronic Information Engineering Tianjin University 1 Wang Bingren.

What Makes a Patch Distinct?

Sketch Tokens: A Learned Mid-level Representation for Contour and Object Detection CVPR2013 POSTER.

Detecting Pedestrians by Learning Shapelet Features

 Introduction  Principles of context – aware saliency  Detection of context – aware saliency  Result  Application  Conclusion.

IEEE TCSVT 2011 Wonjun Kim Chanho Jung Changick Kim

Segmentation and Perceptual Grouping Kaniza (Introduction to Computer Vision, )

1 Segmentation of Salient Regions in Outdoor Scenes Using Imagery and 3-D Data Gunhee Kim Daniel Huber Martial Hebert Carnegie Mellon University Robotics.

Segmentation and Perceptual Grouping. The image of this cube contradicts the optical image.

Cliff Rhyne and Jerry Fu June 5, 2007 Parallel Image Segmenter CSE 262 Spring 2007 Project Final Presentation.

Segmentation and Boundary Detection Using Multiscale Measurements Ronen Basri Achi Brandt Meirav Galun Eitan Sharon.

Introduction of Saliency Map

Speaker: Chi-Yu Hsu Advisor: Prof. Jian-Jung Ding Leveraging Stereopsis for Saliency Analysis, CVPR 2012.

Review: Intro to recognition Recognition tasks Machine learning approach: training, testing, generalization Example classifiers Nearest neighbor Linear.

Salient Object Detection by Composition

A Model of Saliency-Based Visual Attention for Rapid Scene Analysis Laurent Itti, Christof Koch, and Ernst Niebur IEEE PAMI, 1998.

Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.

Object Bank Presenter ： Liu Changyu Advisor ： Prof. Alex Hauptmann Interest ： Multimedia Analysis April 4 th, 2013.

Combining Perception and Impressionist Techniques for Nonphotorealistic Rendering of Multidimensional Data By Christopher Healey Presented by Guangfeng.

Lecture 2b Readings: Kandell Schwartz et al Ch 27 Wolfe et al Chs 3 and 4.

Lecture 29: Face Detection Revisited CS4670 / 5670: Computer Vision Noah Snavely.

Assessment of Computational Visual Attention Models on Medical Images Varun Jampani 1, Ujjwal 1, Jayanthi Sivaswamy 1 and Vivek Vaidya 2 1 CVIT, IIIT Hyderabad,

Building high-level features using large-scale unsupervised learning Anh Nguyen, Bay-yuan Hsu CS290D – Data Mining (Spring 2014) University of California,

Segmentation and Boundary Detection Using Multiscale Intensity Measurements Eitan Sharon, Meirav Galun, Ronen Basri, Achi Brandt Dept. of Computer Science.

CS332 Visual Processing Department of Computer Science Wellesley College Binocular Stereo Vision Region-based stereo matching algorithms Properties of.

Geodesic Saliency Using Background Priors

TVCG 2013 Sungkil Lee, Mike Sips, and Hans-Peter Seidel.

The 18th Meeting on Image Recognition and Understanding 2015/7/29 Depth Image Enhancement Using Local Tangent Plane Approximations Kiyoshi MatsuoYoshimitsu.

CVPR 2006 New York City Spatial Random Partition for Common Visual Pattern Discovery Junsong Yuan and Ying Wu EECS Dept. Northwestern Univ.

Region-Based Saliency Detection and Its Application in Object Recognition IEEE TRANSACTIONS ON CIRCUITS AND SYSTEM FOR VIDEO TECHNOLOGY, VOL. 24 NO. 5,

Creating Better Thumbnails Chris Waclawik. Project Motivation Thumbnails used to quickly select a specific a specific image from a set (when lacking appropriate.

Associative Hierarchical CRFs for Object Class Image Segmentation

VIP: Finding Important People in Images Clint Solomon Mathialagan Andrew C. Gallagher Dhruv Batra CVPR

Street Smarts: Visual Attention on the Go Alexander Patrikalakis May 13, XXX.

Spatiotemporal Saliency Map of a Video Sequence in FPGA hardware David Boland Acknowledgements: Professor Peter Cheung Mr Yang Liu.

Bellwork We’ve discussed over the past few days how design is primarily different from art. What are some things that are similar (what makes design a.

Stas Goferman Lihi Zelnik-Manor Ayellet Tal Technion.

An MPEG-7 Based Semantic Album for Home Entertainment Presented by Chen-hsiu Huang 2003/08/12 Presented by Chen-hsiu Huang 2003/08/12.

 Mentor : Prof. Amitabha Mukerjee Learning to Detect Salient Objects Team Members - Avinash Koyya Diwakar Chauhan.

Minimum Barrier Salient Object Detection at 80 FPS JIANMING ZHANG, STAN SCLAROFF, ZHE LIN, XIAOHUI SHEN, BRIAN PRICE, RADOMIR MECH IEEE INTERNATIONAL CONFERENCE.

Evaluation of Gender Classification Methods with Automatically Detected and Aligned Faces Speaker: Po-Kai Shen Advisor: Tsai-Rong Chang Date: 2010/6/14.

ICCV 2009 Tilke Judd, Krista Ehinger, Fr´edo Durand, Antonio Torralba.

Spatio-temporal Segmentation of Video by Hierarchical Mean Shift Analysis Daniel DeMenthon SMVP 2002.

Article Review Todd Hricik.

Saliency detection with background model

Saliency detection Donghun Yeo CV Lab..

Implementation of a Visual Attention Model

Li Fei-Fei, UIUC Rob Fergus, MIT Antonio Torralba, MIT

Learning to Detect a Salient Object

Saliency, Scale and Image Description (by T. Kadir and M

Enhanced-alignment Measure for Binary Foreground Map Evaluation

Week 8 Nicholas Baker.

By: Kevin Yu Ph.D. in Computer Engineering

Rob Fergus Computer Vision

Saliency detection Donghun Yeo CV Lab..

CornerNet: Detecting Objects as Paired Keypoints

Learning complex visual concepts

Presentation transcript:

Stas Goferman Lihi Zelnik-Manor Ayellet Tal

…

 Man in a flower field  In the fields  Spring blossom

 Olympic weight lifter  Olympic victory  Olympic achievement

 Man in a flower field  In the fields  Spring blossom  Olympic weight lifter  Olympic victory  Olympic achievement

 Man in a flower field  In the fields  Spring blossom  Olympic weight lifter  Olympic victory  Olympic achievement

Following perceptual properties

 Local low-level factors Contrast Color

[Walther and Koch, Neural Networks 2006]

 Local low-level factors Contrast Color Walther & Koch, 2006

 Global considerations Maintain unique features

[Hou & Zhang CVPR 2007]

 Global considerations Maintain unique features Hou & Zhang, 2007

 Local & global

InputMulti-scale contrast Center surround ColorFinal [Liu et al, CVPR 2007]

 Local & global Liu et al, 2007

 Visual organization (Gestalt) Few centers of gravity [Koffka] Position is important!!

 High-level Faces Objects People … [Judd et al, ICCV 2009] Low-level With face detection

Our result

Local Walther & Koch, 2006 Global Hou & Zhang, 2007 Local + global Liu et al, 2007

The steps of our algorithm

 Principles 1-2: Unique appearance  salient salient Not salient

 Principles 1-2: Unique appearance  salient

 Principles 1-2: Unique appearance  salient Euclidean distance between colors of patches at p i & p j

 Principles 1-2: Unique appearance  salient high salient

 Principle 3: Position is important! Similar patches both near and far Not salient

 Principle 3: Position is important! Similar patches near Salient

 Principle 3: Position is important! Normalized Euclidean distance between positions of p i & p j

 Distance between a pair of patches: salient High

 Distance between a pair of patches: salient High for K most similar

K most similar patches at scale r

 Salient at: Multiple scales  foreground Few scales  background Scale 1Scale 4

 Principle 3: Few centers of gravity Context

X Final result Focus points Distance map

 Single-scale saliency  Multiple scales  Final saliency X

…

Walther & Koch, 2006Hou & Zhang, 2007 Our result

Walther & Koch, 2006Hou & Zhang, 2007 Our result

Walther & Koch, 2006Hou & Zhang, 2007 Our result

Walther & Koch, 2006Hou & Zhang, 2007 Our result

Walther & Koch, 2006Hou & Zhang, 2007 Our result

Walther & Koch, 2006Hou & Zhang, 2007 Our result

Database of Hou & Zhang

Our Our + center Judd

Our Our + center Judd

InputOur resultBoiman & Irani

InputOur resultBoiman & Irani

Image resizing

Liu et al, 2007 Our result

Seam CarvingOur result Liu et al [Avidan et al, SIGGRPH’07]

Seam CarvingOur result [Avidan et al, SIGGRPH’07]

Seam CarvingOur result [Avidan et al, SIGGRPH’07]

Combines local & global saliency Incorporates perceptual considerations State-of-the-art results Code is available

Long run-time (~30 sec for 250x250 pixels) Repetitive texture is totally eliminated Can we control how much context is included?

Can it be extended to video? Is there a faster implementation

…