Let Computer Draw Qingyuan Kong. Goal Give me a picture “Obama stands in front of a pyramid”

Slides:

Advertisements

Similar presentations

Putting Objects in Perspective Derek Hoiem Alexei A. Efros Martial Hebert Carnegie Mellon University Robotics Institute.

Advertisements

James Hays and Alexei A. Efros Carnegie Mellon University CVPR IM2GPS: estimating geographic information from a single image Wen-Tsai Huang.

Foreground Focus: Finding Meaningful Features in Unlabeled Images Yong Jae Lee and Kristen Grauman University of Texas at Austin.

These are the ways area model, Algorithm way, bow way, area way but it takes a while …….

Shape Sharing for Object Segmentation

Multi-layer Orthogonal Codebook for Image Classification Presented by Xia Li.

Patch to the Future: Unsupervised Visual Prediction

Data-driven Visual Similarity for Cross-domain Image Matching

Global spatial layout: spatial pyramid matching Spatial weighting the features Beyond bags of features: Adding spatial information.

Proceedings of the IEEE 2010 Antonio Torralba, MIT Jenny Yuen, MIT Bryan C. Russell, MIT.

Event prediction CS 590v. Applications Video search Surveillance – Detecting suspicious activities – Illegally parked cars – Abandoned bags Intelligent.

Small Codes and Large Image Databases for Recognition CVPR 2008 Antonio Torralba, MIT Rob Fergus, NYU Yair Weiss, Hebrew University.

1 Image Recognition - I. Global appearance patterns Slides by K. Grauman, B. Leibe.

Image Quilting for Texture Synthesis and Transfer Alexei A. Efros1,2 William T. Freeman2.

LARGE-SCALE NONPARAMETRIC IMAGE PARSING Joseph Tighe and Svetlana Lazebnik University of North Carolina at Chapel Hill CVPR 2011Workshop on Large-Scale.

Beyond bags of features: Adding spatial information Many slides adapted from Fei-Fei Li, Rob Fergus, and Antonio Torralba.

An opposition to Window- Scanning Approaches in Computer Vision Presented by Tomasz Malisiewicz March 6, 2006 Advanced The Robotics Institute.

Unsupervised discovery of visual object class hierarchies Josef Sivic (INRIA / ENS), Bryan Russell (MIT), Andrew Zisserman (Oxford), Alyosha Efros (CMU)

Where computer vision needs help from computer science (and machine learning) Bill Freeman Electrical Engineering and Computer Science Dept. Massachusetts.

Agenda Introduction Bag-of-words models Visual words with spatial location Part-based models Discriminative methods Segmentation and recognition Recognition-based.

Opportunities of Scale Computer Vision James Hays, Brown Many slides from James Hays, Alyosha Efros, and Derek Hoiem Graphic from Antonio Torralba.

Opportunities of Scale, Part 2 Computer Vision James Hays, Brown Many slides from James Hays, Alyosha Efros, and Derek Hoiem Graphic from Antonio Torralba.

What, Where & How Many? Combining Object Detectors and CRFs

Agenda Introduction Bag-of-words models Visual words with spatial location Part-based models Discriminative methods Segmentation and recognition Recognition-based.

Style-aware Mid-level Representation for Discovering Visual Connections in Space and Time Yong Jae Lee, Alexei A. Efros, and Martial Hebert Carnegie Mellon.

Internet-scale Imagery for Graphics and Vision James Hays cs195g Computational Photography Brown University, Spring 2010.

SBU Digital Media CSE 690 Internet Vision Organizational Meeting Tamara Berg Assistant Professor SUNY Stony Brook.

Image Morphing CSC320: Introduction to Visual Computing

Unsupervised Learning of Categories from Sets of Partially Matching Image Features Kristen Grauman and Trevor Darrel CVPR 2006 Presented By Sovan Biswas.

Last tuesday, you talked about active shape models Data set of 1,500 hand-labeled faces 20 facial features (eyes, eye brows, nose, mouth, chin) Train 40.

Internet-scale Imagery for Graphics and Vision James Hays cs195g Computational Photography Brown University, Spring 2010.

Human abilities Presented By Mahmoud Awadallah 1.

Dense correspondences across scenes and scales Tal Hassner The Open University of Israel CVPR’14 Tutorial on Dense Image Correspondences for Computer Vision.

Bag-of-features models. Origin 1: Texture recognition Texture is characterized by the repetition of basic elements or textons For stochastic textures,

Dynamic 3D Scene Analysis from a Moving Vehicle Young Ki Baik (CV Lab.) (Wed)

NLPainter “Text Analysis for picture/movie generation” David Leoni Eduardo C á rdenas 12/01/2012.

Scale-less Dense Correspondences Tal Hassner The Open University of Israel ICCV’13 Tutorial on Dense Image Correspondences for Computer Vision.

80 million tiny images: a large dataset for non-parametric object and scene recognition CS 4763 Multimedia Systems Spring 2008.

Previous lecture Texture Synthesis Texture Transfer + =

UNBIASED LOOK AT DATASET BIAS Antonio Torralba Massachusetts Institute of Technology Alexei A. Efros Carnegie Mellon University CVPR 2011.

Scene Completion Using Millions of Photographs James Hays, Alexei A. Efros Carnegie Mellon University ACM SIGGRAPH 2007.

CVPR 2006 New York City Spatial Random Partition for Common Visual Pattern Discovery Junsong Yuan and Ying Wu EECS Dept. Northwestern Univ.

Visual Data on the Internet With slides from Alexei Efros, James Hays, Antonio Torralba, and Frederic Heger : Computational Photography Jean-Francois.

CS 1699: Intro to Computer Vision Support Vector Machines Prof. Adriana Kovashka University of Pittsburgh October 29, 2015.

Discovering Objects and their Location in Images Josef Sivic 1, Bryan C. Russell 2, Alexei A. Efros 3, Andrew Zisserman 1 and William T. Freeman 2 Goal:

Context Neelima Chavali ECE /21/2013. Roadmap Introduction Paper1 – Motivation – Problem statement – Approach – Experiments & Results Paper 2 Experiments.

Object Recognition as Ranking Holistic Figure-Ground Hypotheses Fuxin Li and Joao Carreira and Cristian Sminchisescu 1.

Object Recognition by Integrating Multiple Image Segmentations Caroline Pantofaru, Cordelia Schmid, Martial Hebert ECCV 2008 E.

Active Appearance Models Dhruv Batra ECE CMU. Active Appearance Models 1.T.F.Cootes, G.J. Edwards and C.J.Taylor. "Active Appearance Models", in Proc.

SUN Database: Large-scale Scene Recognition from Abbey to Zoo Jianxiong Xiao *James Haysy Krista A. Ehinger Aude Oliva Antonio Torralba Massachusetts Institute.

Carl Vondrick, Aditya Khosla, Tomasz Malisiewicz, Antonio Torralba Massachusetts Institute of Technology

Data-driven Image Processing Fubo Han Images in computer graphics IMAGE: the most engaging visual content in the internet. Image Superiority.

2D to 3D Conversion Using 3D Database For Football Scenes Kiana Calagari Final Project of CMPT880 July 2013.

Automatic 3D modelling of Architecture Anthony Dick 1 Phil Torr 2 Roberto Cipolla 1 1 Department of Engineering 2 Microsoft Research, University of Cambridge.

Internet-scale Imagery for Graphics and Vision James Hays cs129 Computational Photography Brown University, Spring 2011.

Tentative Future Courses Fall `11 : Computer Vision – emphasis on recognition Spring `11 : Graduate seminar Fall `12 : Computational Photography.

CROP CIRCLES Photographs and Images collected from Web Sites.

The topic discovery models

Multi-Perspective Panoramas

Opportunities of Scale, Part 2

Digit Recognition using SVMS

Li Fei-Fei, UIUC Rob Fergus, MIT Antonio Torralba, MIT

Pictures and cars.

The topic discovery models

Object-Graphs for Context-Aware Category Discovery

Recognizing and Learning Object categories

Rob Fergus Computer Vision

Poster Spotlights Shape Anchors for Data-driven

The topic discovery models

Local features and image matching May 7th, 2019

Presentation transcript:

Let Computer Draw Qingyuan Kong

Goal Give me a picture “Obama stands in front of a pyramid”

Goal Here you are!

Analogy knowledge Database/internet What does obama look like? What does pyramid look like? Search obama Search pyramid

Approach

let computer learn to extract “Obama” out – Training an extractor with Labelme – Use segmentation algorithm just on the obtained data set Reference: [1] Tomasz Malisiewicz and Alexei A. Efros. Improving spatial support for ob jects via multiple segmentations. BMVC, [2] Bryan C. Russell, Alexei A. Efros, Josef Sivic, William T. Freeman, and Andrew Zis- serman. Using multiple segmentations to discover ob jects and their extent in image collections. CVPR, 2006.

Approach Find the best background to place “obama”

Approach Find the best position to place “Obama” – Compare the marginal pixels with the background – Adjust Reference: James Hays and Alexei A. Efros. Scene completion using millions of photographs. SIGGRAPH, Ce Liu, Jenny Yuen, Antonio Torralba, Josef Sivic, and William T. Freeman. Sift ﬂow: dense correspondence across diﬀerence scenes. ECCV, 2004.

Finally

Data sets Labelme google image bing image

Evaluation of Success make the computer put some classes of objects, such like people, cars, into a background, the compound of which looks real and with few artifacts.

milestone make the computer be able to draw at least one class of objects in at least one class of background.