APPLICATIONS OF LIGHT FIELDS IN COMPUTER VISION WEEK 2 REU STUDENT: AMARI LEWIS P.H.D STUDENT: AIDEAN SHARGHI.

Slides:

Advertisements

Similar presentations

The blue and green colors are actually the same.

Advertisements

Stereo Vision System Principle of Operation: Difference between two cameras gives depth information Steps: –Compute disparity image –Find obstacles in.

Application of light fields in computer vision AMARI LEWIS – REU STUDENT AIDEAN SHARGHI- PH.D STUENT.

Large-Scale, Real-World Face Recognition in Movie Trailers Week 2-3 Alan Wright (Facial Recog. pictures taken from Enrique Gortez)

Computer Vision REU Week 2 Adam Kavanaugh. Video Canny Put canny into a loop in order to process multiple frames of a video sequence Put canny into a.

CPSC 425: Computer Vision (Jan-April 2007) David Lowe Prerequisites: 4 th year ability in CPSC Math 200 (Calculus III) Math 221 (Matrix Algebra: linear.

Introduction to Computer Vision 3D Vision Topic 9 Stereo Vision (I) CMPSCI 591A/691A CMPSCI 570/670.

A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications Lucia Maddalena and Alfredo Petrosino, Senior Member, IEEE.

Building Recognition Landry Huet Sung Hee Park DW Wheeler.

5/30/2006EE 148, Spring Visual Categorization with Bags of Keypoints Gabriella Csurka Christopher R. Dance Lixin Fan Jutta Willamowski Cedric Bray.

Viola and Jones Object Detector Ruxandra Paun EE/CS/CNS Presentation

Predicting Matchability - CVPR 2014 Paper -

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.

Stereo vision A brief introduction Máté István MSc Informatics.

3D Scene Models Object recognition and scene understanding Krista Ehinger.

Identifying Computer Graphics Using HSV Model And Statistical Moments Of Characteristic Functions Xiao Cai, Yuewen Wang.

Components of a computer vision system

Person-Specific Domain Adaptation with Applications to Heterogeneous Face Recognition (HFR) Presenter: Yao-Hung Tsai Dept. of Electrical Engineering, NTU.

CSE 473/573 Computer Vision and Image Processing (CVIP) Ifeoma Nwogu Lecture 35 – Review for midterm.

Final Exam Review CS485/685 Computer Vision Prof. Bebis.

Learning Visual Similarity Measures for Comparing Never Seen Objects By: Eric Nowark, Frederic Juric Presented by: Khoa Tran.

Internet-scale Imagery for Graphics and Vision James Hays cs195g Computational Photography Brown University, Spring 2010.

WEEK 7 Amari Lewis Aidean Sharghi Amari Lewis Aidean Sharghi.

Lecture 12 Stereo Reconstruction II Lecture 12 Stereo Reconstruction II Mata kuliah: T Computer Vision Tahun: 2010.

Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.

Introduction to Computer Vision Olac Fuentes Computer Science Department University of Texas at El Paso El Paso, TX, U.S.A.

COMPUTER VISION: SOME CLASSICAL PROBLEMS ADWAY MITRA MACHINE LEARNING LABORATORY COMPUTER SCIENCE AND AUTOMATION INDIAN INSTITUTE OF SCIENCE June 24, 2013.

Perception Introduction Pattern Recognition Image Formation

Computational photography CS4670: Computer Vision Noah Snavely.

Why Categorize in Computer Vision ?. Why Use Categories? People love categories!

Computer Vision Why study Computer Vision? Images and movies are everywhere Fast-growing collection of useful applications –building representations.

CS 8690: Computer Vision Ye Duan. CS8690 Computer Vision University of Missouri at Columbia Instructor Ye Duan (209 Engr West)

Computer Science Department Pacific University Artificial Intelligence -- Computer Vision.

Building high-level features using large-scale unsupervised learning Anh Nguyen, Bay-yuan Hsu CS290D – Data Mining (Spring 2014) University of California,

Week5 Amari Lewis Aidean Sharghi. Testing the data for classification Divide the date into TEST and TRAIN data. First the regular.jpeg images Then, the.

DIEGO AGUIRRE COMPUTER VISION INTRODUCTION 1. QUESTION What is Computer Vision? 2.

Depth Edge Detection with Multi- Flash Imaging Gabriela Martínez Final Project – Processamento de Imagem IMPA.

AUTOMATIC TARGET RECOGNITION OF CIVILIAN TARGETS September 28 th, 2004 Bala Lakshminarayanan.

Spring 2015 CSc 83020: 3D Photography Prof. Ioannis Stamos Mondays 4:15 – 6:15

Puzzle Solver Sravan Bhagavatula EE 638 Project Stanford ECE.

Copyright Howie Choset, Renata Melamud, Al Costa, Vincent Lee-Shue, Sean Piper, Ryan de Jonckheere. All Rights Reserved Computer Vision.

Scene Reconstruction Seminar presented by Anton Jigalin Advanced Topics in Computer Vision ( )

Week 10 Presentation Wesna LaLanne - REU Student Mahdi M. Kalayeh - Mentor.

Lecture 8: Feature matching CS6670: Computer Vision Noah Snavely.

Extracting Depth and Matte using a Color-Filtered Aperture Yosuke Bando TOSHIBA + The University of Tokyo Bing-Yu Chen National Taiwan University Tomoyuki.

PRESENTATION REU IN COMPUTER VISION 2014 AMARI LEWIS CRCV UNIVERSITY OF CENTRAL FLORIDA.

CT333/CT433 Image Processing and Computer Vision.

Dense Color Moment: A New Discriminative Color Descriptor Kylie Gorman, Mentor: Yang Zhang University of Central Florida I.Problem:  Create Robust Discriminative.

WEEK4 RESEARCH Amari Lewis Aidean Sharghi. PREPARING THE DATASET  Cars – 83 samples  3 images for each sample when x=0  7 images for each sample when.

HOW SCANNERS WORK A scanner is a device that uses a light source to electronically convert an image into binary data (0s and 1s). This binary data can.

Edge Segmentation in Computer Images CSE350/ Sep 03.

Learning Hierarchical Features for Scene Labeling Cle’ment Farabet, Camille Couprie, Laurent Najman, and Yann LeCun by Dong Nie.

Face recognition using Histograms of Oriented Gradients

A Plane-Based Approach to Mondrian Stereo Matching

Learning Patterns of Activity

Recognizing Deformable Shapes

Rogerio Feris 1, Ramesh Raskar 2, Matthew Turk 1

Image Segmentation Classify pixels into groups having similar characteristics.

REU student -Amari Lewis P.H.D student- Aidean Sharghi June 6th 2014

Common Classification Tasks

Multiple Organ Detection in CT Volumes using CNN Week 4

CS 1674: Intro to Computer Vision Scene Recognition

RGB-D Image for Scene Recognition by Jiaqi Guo

Large Scale Image Deduplication

Computer Vision Stereo Vision.

An Infant Facial Expression Recognition System Based on Moment Feature Extraction C. Y. Fang, H. W. Lin, S. W. Chen Department of Computer Science and.

CS 332 Visual Processing in Computer and Biological Vision Systems

Amari Lewis Aidean Sharghi

THE ASSISTIVE SYSTEM SHIFALI KUMAR BISHWO GURUNG JAMES CHOU

Presentation transcript:

APPLICATIONS OF LIGHT FIELDS IN COMPUTER VISION WEEK 2 REU STUDENT: AMARI LEWIS P.H.D STUDENT: AIDEAN SHARGHI

APPLICATIONS OF LIGHT FIELDS IN COMPUTER VISION THE GOALS OF THIS PROJECT IS TO EXAMINE : a) OBJECT RECOGNITION b) OCCLUSION DETECTION c) 3D RECONSTRUCTION OF A SCENE

WHAT IS OBJECT RECOGNITION? GIVEN TEST IMAGE, WE WANT TO DETERMINE WHAT THE IMAGE IS. STEPS FOR CONVENTIONAL OBJECT RECOGNITION: COLLECT DATASET DIVIDE INTO POSITIVE/ NEGATIVE DATA EXTRACT FEATURES ( EX: SIFT..) TRAIN A CLASSIFIER FOR EXTRACTED FEATURES GIVEN A TEST IMAGE: EXTRACT THE FEATURES USE THE CLASSIFIER TO DETERMINE WHICH OBJECT IT IS

THE PROBLEM CONVENTIONAL METHODS USE 2D INFORMATION OF THE OBJECTS FOR DETECTION. EXAMPLE: A BOTTLE AND A PICTURE OF A BOTTLE ON A PIECE OF PAPER.

LYTRO LIGHT FIELD CAMERA USING THE LYTRO CAMERA WE ARE ABLE TO INCLUDE 3D INFORMATION WITH ONE SINGLE SHOT. THE CAMERA MANAGES TO CAPTURE ALL THE LIGHT FIELD DIRECTION, INTENSITY AND COLOR.

LIGHT FIELD CAMERA HOW IT WORKS…

STEREO \. The conventional way of capturing 3d information is using stereo Finding the correspondents is difficult However finding the correspondents can be avoided…

EPI EPIPOLAR PLANE IMAGES CAN BE USED TO REPRESENT 3D INFORMATION OF THE OBJECT THIS PROJECT/RESEARCH IS BASED ON USING EPI TO DESCRIBE THE OBJECTS AND INCREASE THE OBJECT RECOGNITION ACCURACY

STEPS: i. CHOOSE 5 CATEGORIES FOR CLASSIFICATION ii. COLLECT DATASET USING THE LIGHT FIELD CAMERA iii. EXTRACT THE PHOTOS, USING THE LYTRO SOFTWARE

i.5 CATEGORIES FOR DATASET USING LIGHT FIELD CAMERA 1. BICYCLES 2. BUS 3. TREES/FLOWERS 4. BUILDINGS 5. TRUCKS

II. COLLECT DATASET USING THE LIGHT FIELD CAMERA Tree

III. REFOCUS THE IMAGE TO THE SPECIFIC OBJECT bicycles

ASSIGNMENT THERE HAS BEEN A SIMILAR STUDY TO IMPROVE OBJECT RECOGNITION AND TRACKING SCALE-INVARIANT REPRESENTATION OF LIGHT FIELD IMAGES FOR OBJECT RECOGNITION AND TRACKING ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE (SWITZERLAND)

REFERENCES NG, REN (2006). DIGITAL LIGHT FIELD PHOTOGRAPHY (DOCTORAL DISSERTATION). STANFORD UNIVERSITY, STANFORD, CALIFORNIA.

THANK YOU !!