Recognizing and Learning Object categories

Slides:



Advertisements
Similar presentations
INTRODUCTORY MICROSOFT ACCESS Lesson 1 – Access Basics
Advertisements

Google Forms King William County Schools.  Google Forms is a free tool from Google that allows you to do the following: ● Create forms, surveys, quizzes,
Pasewark & Pasewark Microsoft Office XP: Introductory Course 1 INTRODUCTORY MICROSOFT ACCESS Lesson 5 – Reports and Macros.
Global spatial layout: spatial pyramid matching Spatial weighting the features Beyond bags of features: Adding spatial information.
Image Maps and Graphics Internet Basics and Far Beyond! Mrs. Wilson.
Proceedings of the IEEE 2010 Antonio Torralba, MIT Jenny Yuen, MIT Bryan C. Russell, MIT.
Recognition: A machine learning approach
Chapter 11 Beyond Bag of Words. Question Answering n Providing answers instead of ranked lists of documents n Older QA systems generated answers n Current.
Beyond bags of features: Adding spatial information Many slides adapted from Fei-Fei Li, Rob Fergus, and Antonio Torralba.
Statistical Recognition Slides adapted from Fei-Fei Li, Rob Fergus, Antonio Torralba, and Kristen Grauman.
1 Image Recognition - I. Global appearance patterns Slides by K. Grauman, B. Leibe.
Creating Custom Forms. 2 Design and create a custom form You can create a custom form by modifying an existing form or creating a new form. Either way,
EECS 442 – Computer vision Segments of this lectures are courtesy of Prof F. Li, R. Fergus and A. Zisserman Databases for object recognition and beyond.
Chapter 12: ADO.NET and ASP.NET Programming with Microsoft Visual Basic.NET, Second Edition.
Beyond bags of features: Adding spatial information Many slides adapted from Fei-Fei Li, Rob Fergus, and Antonio Torralba.
Object Recognition: Conceptual Issues Slides adapted from Fei-Fei Li, Rob Fergus, Antonio Torralba, and K. Grauman.
Object Recognition: Conceptual Issues Slides adapted from Fei-Fei Li, Rob Fergus, Antonio Torralba, and K. Grauman.
Agenda Introduction Bag-of-words models Visual words with spatial location Part-based models Discriminative methods Segmentation and recognition Recognition-based.
Visual Object Recognition Rob Fergus Courant Institute, New York University
Microsoft Office © Copyright William Rowan Objective By the end of this you will have being given a brief introduction to: Microsoft Word Microsoft.
2. Introduction to the Visual Studio.NET IDE 2. Introduction to the Visual Studio.NET IDE Ch2 – Deitel’s Book.
Salient Object Detection by Composition
Lab 8 – C# Programming Adding two numbers CSCI 6303 – Principles of I.T. Dr. Abraham Fall 2012.
Copyright © Texas Education Agency, All rights reserved. 1 Web Technologies Website Development with Dreamweaver.
Pasewark & Pasewark Microsoft Office 2003: Introductory 1 INTRODUCTORY MICROSOFT ACCESS Lesson 1 – Access Basics.
Advanced Forms Lesson 10.
Web Technologies Website Development Trade & Industrial Education
IE 411/511: Visual Programming for Industrial Applications
Computer Vision CS 776 Spring 2014 Recognition Machine Learning Prof. Alex Berg.
Creating your own form from scratch.. To create a custom form, you can modify an existing form or design and create a form from scratch. In either case,
Perceptual and Sensory Augmented Computing Visual Object Recognition Tutorial Visual Object Recognition Bastian Leibe & Computer Vision Laboratory ETH.
Last part: datasets and object collections. CMU/MIT frontal facesvasc.ri.cmu.edu/idb/html/face/frontal_images cbcl.mit.edu/software-datasets/FaceData2.html.
Labeling Images for FUN!!! Yan Cao, Chris Hinrichs.
Press Esc to Exit ©2011 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in.
Week 11 Creating Framed Layouts Objectives Understand the benefits and drawbacks of frames Understand and use frame syntax Customize frame characteristics.
80 million tiny images: a large dataset for non-parametric object and scene recognition CS 4763 Multimedia Systems Spring 2008.
User Interface Interface: web room planner. User Interface Inspiration: Google SketchUp.
UNBIASED LOOK AT DATASET BIAS Antonio Torralba Massachusetts Institute of Technology Alexei A. Efros Carnegie Mellon University CVPR 2011.
What have we learned?. What is a database? An organized collection of related data.
There are seven main components of a database in Access 2000: Tables. Use tables to store database information. Forms Use forms to enter or edit the information.
Online Surveys Jacqui James and Malcolm Roberts School of Education.
Introduction to EBSCOhost Tutorial support.ebsco.com.
Recognition Using Visual Phrases
Li Fei-Fei, UIUC Rob Fergus, MIT Antonio Torralba, MIT Recognizing and Learning Object Categories ICCV 2005 Beijing, Short Course, Oct 15.
Inserting an Image Using the WordPress media manager, it’s extremely simple to insert, align and link your individual images and image galleries. To insert.
BUILDING A WEB PAGE BASIC HTML CODING. We first open notepad to start to build our web page. We enter the code at the beginning. And then we write below.
XP New Perspectives on Microsoft Office Access 2003, Second Edition- Tutorial 6 1 Microsoft Office Access 2003 Tutorial 6 – Creating Custom Forms.
IE 411/511: Visual Programming for Industrial Applications Lecture Notes #2 Introduction to the Visual Basic Express 2010 Integrated Development Environment.
Dreamweaver – Setting up a Site and Page Layouts Web Design Section 7-2 Part or all of this lesson was adapted from the University of Washington’s “Web.
Machine learning & object recognition Cordelia Schmid Jakob Verbeek.
June 17, 2009 Office 2007 Tips & Tricks.
Task 2f – part a Prove that you can receive an WITH an attachment, open it AND save the attachment to your user area. Open the with the attachment.
ROBUST FACE NAME GRAPH MATCHING FOR MOVIE CHARACTER IDENTIFICATION
GO! with Microsoft Office 2016
How to Use Members Area of The Ninety-Nines Website
Li Fei-Fei, UIUC Rob Fergus, MIT Antonio Torralba, MIT
Chapter 1 Editing a Photo
Tutorial Introduction to support.ebsco.com.
Microsoft Office Access 2003
Microsoft Office Access 2003
Finding Magazine and Journal Articles in
Brief Review of Recognition + Context
Introduction to Database Programs
FINDING INFORMATION ON THE INTERNET
D Guidance 26-Jun: Would like to see a refresh of this title slide
Category 1 Category 2 Category 3 Category 4 Category
Change in Level of Care Form
Introduction to Database Programs
Tutorial Introduction to help.ebsco.com.
Lesson 2: Gathering and Organizing Information Using ICT KEY QUESTION: HOW DO YOU GATHER AND ORGANIZE INFORMATION USING THE COMPUTER AND INTERNET?
Presentation transcript:

Recognizing and Learning Object categories Summary

Summary Methods reviewed here Resources online Bag of words Parts and structure Discriminative methods Combined Segmentation and recognition Resources online Slides Code Links to datasets http://people.csail.mit.edu/torralba/iccv2005/

List properties of ideal recognition system Representation 1000’s categories, Handle all invariances (occlusions, view point, …) Explain as many pixels as possible (or answer as many questions as you can about the object) fast, robust Learning Handle all degrees of supervision Incremental learning Few training images …

Online resources http://people.csail.mit.edu/torralba/iccv2005/

Links to datasets The next tables summarize some of the available datasets for training and testing object detection and recognition algorithms. These lists are far from exhaustive. Databases for object localization CMU/MIT frontal faces vasc.ri.cmu.edu/idb/html/face/frontal_images cbcl.mit.edu/software-datasets/FaceData2.html Patches Frontal faces Graz-02 Database www.emt.tugraz.at/~pinz/data/GRAZ_02/ Segmentation masks Bikes, cars, people UIUC Image Database l2r.cs.uiuc.edu/~cogcomp/Data/Car/ Bounding boxes Cars TU Darmstadt Database www.vision.ethz.ch/leibe/data/ Motorbikes, cars, cows LabelMe dataset people.csail.mit.edu/brussell/research/LabelMe/intro.html Polygonal boundary >500 Categories Databases for object recognition Caltech 101 www.vision.caltech.edu/Image_Datasets/Caltech101/Caltech101.html Segmentation masks 101 categories COIL-100 www1.cs.columbia.edu/CAVE/research/softlib/coil-100.html Patches 100 instances NORB www.cs.nyu.edu/~ylclab/data/norb-v1.0/ Bounding box 50 toys On-line annotation tools ESP game www.espgame.org Global image descriptions Web images LabelMe people.csail.mit.edu/brussell/research/LabelMe/intro.html Polygonal boundary High resolution images Collections PASCAL http://www.pascal-network.org/challenges/VOC/ Segmentation, boxes various

LabelMe Dataset There are about 19,500 labelled objects This presentation is about LabelMe: the online open annotation tool. This is a joint project with Bryan, Antonio, and Bill. You can find the page by Google searching "LabelMe MIT". http://www.csail.mit.edu/~brussell/research/LabelMe/intro.html Google search: LabelMe MIT

LabelMe Screen Shot To give you a flavor of the tool, here is a screen shot of the tool. The tool fits entirely in the browser and is designed with simplicity in mind. To annotate an object, the user simply clicks points around the object. Upon completion, a bubble appears and queries the user to enter the label of the object. The user can delete existing labels or edit them by using the mouse to select the label of interest. The right side of the tool lists the current labels and gives a brief explanation of the task. The user can label a new image by clicking on the "Show New Image" button at the top. The user can also see some statistics that have been gathered on the annotation set.

Matlab toolbox LMquery (database, 'object.name', 'car,building,road,tree')

Toolbox LMquery (database, 'object.name', 'car,building,road,tree') LMcookdatabase (database, 'objectname', 'screen', … 'objectsize', [64 64], 'objectlocation', 'original','maximagesize', [128 128])

Example Annotations Here are some example annotations of some office scenes that have been produced by the annotation tool. These figures were generated using the MATLAB tool to query various objects in the dataset.