Extracting Minimalistic Corridor Geometry from Low-Resolution Images Yinxiao Li, Vidya, N. Murali, and Stanley T. Birchfield Department of Electrical and.

Slides:



Advertisements
Similar presentations
Miroslav Hlaváč Martin Kozák Fish position determination in 3D space by stereo vision.
Advertisements

Road-Sign Detection and Recognition Based on Support Vector Machines Saturnino, Sergio et al. Yunjia Man ECG 782 Dr. Brendan.
Real-time, low-resource corridor reconstruction using a single consumer grade RGB camera is a powerful tool for allowing a fast, inexpensive solution to.
Wen-Hung Liao Department of Computer Science National Chengchi University November 27, 2008 Estimation of Skin Color Range Using Achromatic Features.
Hilal Tayara ADVANCED INTELLIGENT ROBOTICS 1 Depth Camera Based Indoor Mobile Robot Localization and Navigation.
Electrical & Computer Engineering Dept. University of Patras, Patras, Greece Evangelos Skodras Nikolaos Fakotakis.
Segmentation of Floor in Corridor Images for Mobile Robot Navigation Yinxiao Li Clemson University Committee Members: Dr. Stanley Birchfield (Chair) Dr.
Stereo.
Dana Cobzas-PhD thesis Image-Based Models with Applications in Robot Navigation Dana Cobzas Supervisor: Hong Zhang.
Golnaz Abdollahian, Cuneyt M. Taskiran, Zygmunt Pizlo, and Edward J. Delp C AMERA M OTION -B ASED A NALYSIS OF U SER G ENERATED V IDEO IEEE TRANSACTIONS.
Exchanging Faces in Images SIGGRAPH ’04 Blanz V., Scherbaum K., Vetter T., Seidel HP. Speaker: Alvin Date: 21 July 2004.
EE663 Image Processing Edge Detection 2 Dr. Samir H. Abdul-Jauwad Electrical Engineering Department King Fahd University of Petroleum & Minerals.
Multiple View Geometry : Computational Photography Alexei Efros, CMU, Fall 2005 © Martin Quinn …with a lot of slides stolen from Steve Seitz and.
Contents Description of the big picture Theoretical background on this work The Algorithm Examples.
Robust Object Segmentation Using Adaptive Thresholding Xiaxi Huang and Nikolaos V. Boulgouris International Conference on Image Processing 2007.
Detecting Image Region Duplication Using SIFT Features March 16, ICASSP 2010 Dallas, TX Xunyu Pan and Siwei Lyu Computer Science Department University.
Multiple Human Objects Tracking in Crowded Scenes Yao-Te Tsai, Huang-Chia Shih, and Chung-Lin Huang Dept. of EE, NTHU International Conference on Pattern.
3D from multiple views : Rendering and Image Processing Alexei Efros …with a lot of slides stolen from Steve Seitz and Jianbo Shi.
Student: Hsu-Yung Cheng Advisor: Jenq-Neng Hwang, Professor
Lecture 3a: Feature detection and matching CS6670: Computer Vision Noah Snavely.
MULTIPLE MOVING OBJECTS TRACKING FOR VIDEO SURVEILLANCE SYSTEMS.
A Novel 2D To 3D Image Technique Based On Object- Oriented Conversion.
Robust estimation Problem: we want to determine the displacement (u,v) between pairs of images. We are given 100 points with a correlation score computed.
Sonar-Based Real-World Mapping and Navigation by ALBERTO ELFES Presenter Uday Rajanna.
Multiple View Geometry : Computational Photography Alexei Efros, CMU, Fall 2006 © Martin Quinn …with a lot of slides stolen from Steve Seitz and.
Symmetric Architecture Modeling with a Single Image
Using Incomplete Online Metric Maps for Topological Exploration with the Gap Navigation Tree Liz Murphy and Paul Newman Mobile Robotics Research Group,
Machine Vision for Robots
Mutual Information-based Stereo Matching Combined with SIFT Descriptor in Log-chromaticity Color Space Yong Seok Heo, Kyoung Mu Lee, and Sang Uk Lee.
ICPR/WDIA-2012 High Quality Novel View Synthesis Based on Low Resolution Depth Image and High Resolution Color Image Jui-Chiu Chiang, Zheng-Feng Liu, and.
Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.
Mobile Robotics Laboratory Institute of Systems and Robotics ISR – Coimbra 3D Hand Trajectory Segmentation by Curvatures and Hand Orientation for Classification.
Perception Introduction Pattern Recognition Image Formation
3D SLAM for Omni-directional Camera
IMAGE MOSAICING Summer School on Document Image Processing
November 2012 The Role of Bright Pixels in Illumination Estimation Hamid Reza Vaezi Joze Mark S. Drew Graham D. Finlayson Petra Aurora Troncoso Rey School.
Localization for Mobile Robot Using Monocular Vision Hyunsik Ahn Jan Tongmyong University.
Automatic Minirhizotron Root Image Analysis Using Two-Dimensional Matched Filtering and Local Entropy Thresholding Presented by Guang Zeng.
Qualitative Vision-Based Mobile Robot Navigation Zhichao Chen and Stanley T. Birchfield Dept. of Electrical and Computer Engineering Clemson University.
General ideas to communicate Show one particular Example of localization based on vertical lines. Camera Projections Example of Jacobian to find solution.
Classification of Clothing using Interactive Perception BRYAN WILLIMON, STAN BIRCHFIELD AND IAN WALKER CLEMSON UNIVERSITY CLEMSON, SC USA ABSTRACT ISOLATION.
The 18th Meeting on Image Recognition and Understanding 2015/7/29 Depth Image Enhancement Using Local Tangent Plane Approximations Kiyoshi MatsuoYoshimitsu.
Raquel A. Romano 1 Scientific Computing Seminar May 12, 2004 Projective Geometry for Computer Vision Projective Geometry for Computer Vision Raquel A.
Peter Henry1, Michael Krainin1, Evan Herbst1,
Chapter 5 Multi-Cue 3D Model- Based Object Tracking Geoffrey Taylor Lindsay Kleeman Intelligent Robotics Research Centre (IRRC) Department of Electrical.
Image-Based Segmentation of Indoor Corridor Floors for a Mobile Robot
AdvisorStudent Dr. Jia Li Shaojun Liu Dept. of Computer Science and Engineering, Oakland University Automatic 3D Image Segmentation of Internal Lung Structures.
Image-Based Segmentation of Indoor Corridor Floors for a Mobile Robot Yinxiao Li and Stanley T. Birchfield The Holcombe Department of Electrical and Computer.
Turning Autonomous Navigation and Mapping Using Monocular Low-Resolution Grayscale Vision VIDYA MURALI AND STAN BIRCHFIELD CLEMSON UNIVERSITY ABSTRACT.
Lecture 16: Stereo CS4670 / 5670: Computer Vision Noah Snavely Single image stereogram, by Niklas EenNiklas Een.
Face Image-Based Gender Recognition Using Complex-Valued Neural Network Instructor :Dr. Dong-Chul Kim Indrani Gorripati.
Journal of Visual Communication and Image Representation
Multi Scale CRF Based RGB-D Image Segmentation Using Inter Frames Potentials Taha Hamedani Robot Perception Lab Ferdowsi University of Mashhad The 2 nd.
Wonjun Kim and Changick Kim, Member, IEEE
DISCRIMINATIVELY TRAINED DENSE SURFACE NORMAL ESTIMATION ANDREW SHARP.
Person Following with a Mobile Robot Using Binocular Feature-Based Tracking Zhichao Chen and Stanley T. Birchfield Dept. of Electrical and Computer Engineering.
Instructor: Mircea Nicolescu Lecture 5 CS 485 / 685 Computer Vision.
Digital Image Processing CSC331
Motion Segmentation at Any Speed Shrinivas J. Pundlik Department of Electrical and Computer Engineering, Clemson University, Clemson, SC.
Design and Calibration of a Multi-View TOF Sensor Fusion System Young Min Kim, Derek Chan, Christian Theobalt, Sebastian Thrun Stanford University.
Stereo CS4670 / 5670: Computer Vision Noah Snavely Single image stereogram, by Niklas EenNiklas Een.
Student Gesture Recognition System in Classroom 2.0 Chiung-Yao Fang, Min-Han Kuo, Greg-C Lee, and Sei-Wang Chen Department of Computer Science and Information.
Vision-Guided Humanoid Footstep Planning for Dynamic Environments
Semi-Global Matching with self-adjusting penalties
Rogerio Feris 1, Ramesh Raskar 2, Matthew Turk 1
Factors that Influence the Geometric Detection Pattern of Vehicle-based Licence Plate Recognition Systems Martin Rademeyer Thinus Booysen, Arno Barnard.
Cheng-Ming Huang, Wen-Hung Liao Department of Computer Science
Dingding Liu* Yingen Xiong† Linda Shapiro* Kari Pulli†
Estimation of Skin Color Range Using Achromatic Features
Presentation transcript:

Extracting Minimalistic Corridor Geometry from Low-Resolution Images Yinxiao Li, Vidya, N. Murali, and Stanley T. Birchfield Department of Electrical and Computer Engineering Clemson University { yinxial, vmurali, stb

What can you see from this image? 16 x 12

What can you see from this image? 32 x 24

What can you see from this image? 64 x 48

What can you see from this image? 160 x 120

What can you see from this image? 320 x 240

Motivation Goal: Investigate the impact of image resolution upon the accuracy of extracting geometry for indoor robot navigation Why? reduce computation, free the CPU for other tasks limit the algorithm search space autonomous exploration and navigation 320 x x 24

Outline Previous Work Orientation Line Estimation Wall-Floor Boundary Experimental Results Conclusion

Outline Previous Work Orientation Line Estimation Wall-Floor Boundary Experimental Results Conclusion

Previous Work Related Approaches: Selective Degradation Hypothesis (Leibowitz et al. 1979) Scene Classification Using Tiny Images (Torralba 2008, Torralba et al. 2009) Minimalistic Sensing (Tovar et al. 2004, O’Kane and LaValle 2007) Autonomous Exploration Using Low-resolution Images (Murali and Birchfield 2008, 2012) Automatic Floor Segmentation of Indoor Corridors (Li and Birchfield 2010) Our contributions: Provide a simple geometric representation for the corridor structure  orientation line and wall-floor boundary Investigate the minimum resolution needed for basic robot exploration  (320 x 240  32 x 24)

Low-resolution exploration (Murali and Birchfield 2008, 2012)

Floor segmentation (Li and Birchfield 2010)

Outline Previous Work Orientation Line Estimation Wall-Floor Boundary Experimental Results Conclusion

Orientation Line Estimation Orientation Line Estimated by combining: Median of Bright Pixels Maximum Entropy Symmetry by Mutual Information

Median of Bright Pixels Ceiling lights along the main corridor axis - If lights are not in the center  k-means - Ullman’s formula for local contrast to reduce influence of specular reflections Autonomous Exploration Using Rapid Perception of Low-Resolution Image Information, V. N. Murali and S. T. Birchfield, Autonomous Robots, 32(2): , February regularUllman

Ceiling lights along the main corridor axis Median of Bright Pixels

Maximum Entropy Max entropy occurs when camera is pointing down the corridor - Variety of depths can be seen - More image information Autonomous Exploration Using Rapid Perception of Low-Resolution Image Information, V. N. Murali and S. T. Birchfield, Autonomous Robots, 32(2): , February 2012.

Symmetry by Mutual Information Mutual Information - Divide image into vertical slices by horizontal coordinate - Compute probability mass function (PMF) Joint PMF of intensities PMFs computed of two sides Autonomous Exploration Using Rapid Perception of Low-Resolution Image Information, V. N. Murali and S. T. Birchfield, Autonomous Robots, 32(2): , February 2012.

Orientation Line Estimation Maximum Entropy Symmetry by Mutual Information Median of Bright Pixels Weights Result largely unaffected by image resolution!

Outline Previous Work Orientation Line Estimation Wall-Floor Boundary Experimental Results Conclusion

Detecting Line Segments (LS) Canny classify as horiz or vert prune

Wall-Floor Boundary – Score Model Structure ScoreBottom ScoreHomogeneous Score horizontal line Image-Based Segmentation of Indoor Corridor Floors for a Mobile Robot, Y. Li and S. Birchfield, IROS 2010 (threshold, then distance to regions) (distance to bottom of vertical lines) (size of segmented region just below)

Wall-Floor Boundary Image-Based Segmentation of Indoor Corridor Floors for a Mobile Robot, Y. Li and S. Birchfield, IROS 2010 Structure Score Bottom Score Homogeneous Score Weights horizontal line connect

Wall-Floor Boundary Image-Based Segmentation of Indoor Corridor Floors for a Mobile Robot, Y. Li and S. Birchfield, IROS 2010 Structure Score Bottom Score Homogeneous Score Weights horizontal line Result largely unaffected by image resolution!

Outline Previous Work Orientation Line Estimation Wall-Floor Boundary Experimental Results Conclusion

Results How to combine results? Orientation Line

Results How to combine results? Wall-floor Boundary

Results How to combine results? Proposed Geometry

Results Results in multi-resolution images

Results

Video

Results Corridor Reconstruction –Drove robot three times (middle, left, right) –Compared with laser ground truth (in blue)

Outline Previous Work Orientation Line Estimation Wall-Floor Boundary Experimental Results Conclusion

Summary - Minimalistic geometric representation of indoor corridor in low-resolution images - Discard 99.8% of image pixels, runs at 1000 fps, which frees CPU for other tasks Future work - Investigate more complex environments - Integrate geometric representation into closed- loop system - Use geometric representation for mapping

Thanks! Questions? Partially sponsored by NSF grant IIS