Dynamic 3D Scene Analysis from a Moving Vehicle Young Ki Baik (CV Lab.) 2007. 7. 11 (Wed)

Slides:



Advertisements
Similar presentations
Simultaneous surveillance camera calibration and foot-head homology estimation from human detection 1 Author : Micusic & Pajdla Presenter : Shiu, Jia-Hau.
Advertisements

The fundamental matrix F
For Internal Use Only. © CT T IN EM. All rights reserved. 3D Reconstruction Using Aerial Images A Dense Structure from Motion pipeline Ramakrishna Vedantam.
Wrap Up. We talked about Filters Edges Corners Interest Points Descriptors Image Stitching Stereo SFM.
1 Approximated tracking of multiple non-rigid objects using adaptive quantization and resampling techniques. J. M. Sotoca 1, F.J. Ferri 1, J. Gutierrez.
Recent work in image-based rendering from unstructured image collections and remaining challenges Sudipta N. Sinha Microsoft Research, Redmond, USA.
Patch to the Future: Unsupervised Visual Prediction
Activity Recognition Aneeq Zia. Agenda What is activity recognition Typical methods used for action recognition “Evaluation of local spatio-temporal features.
Learning to estimate human pose with data driven belief propagation Gang Hua, Ming-Hsuan Yang, Ying Wu CVPR 05.
Parallel Tracking and Mapping for Small AR Workspaces Vision Seminar
Qualifying Exam: Contour Grouping Vida Movahedi Supervisor: James Elder Supervisory Committee: Minas Spetsakis, Jeff Edmonds York University Summer 2009.
Intelligent Systems Lab. Extrinsic Self Calibration of a Camera and a 3D Laser Range Finder from Natural Scenes Davide Scaramuzza, Ahad Harati, and Roland.
Pedestrian Detection in Crowded Scenes Dhruv Batra ECE CMU.
Video Processing EN292 Class Project By Anat Kaspi.
Domenico Bloisi, Luca Iocchi, Dorothy Monekosso, Paolo Remagnino
Visual Odometry for Ground Vehicle Applications David Nister, Oleg Naroditsky, James Bergen Sarnoff Corporation, CN5300 Princeton, NJ CPSC 643, Presentation.
CSE473/573 – Stereo Correspondence
Multiple Object Class Detection with a Generative Model K. Mikolajczyk, B. Leibe and B. Schiele Carolina Galleguillos.
Non-invasive Techniques for Human Fatigue Monitoring Qiang Ji Dept. of Electrical, Computer, and Systems Engineering Rensselaer Polytechnic Institute
1 Video Surveillance systems for Traffic Monitoring Simeon Indupalli.
Object Recognition and Augmented Reality
Overview Introduction to local features
Research Area B Leif Kobbelt. Communication System Interface Research Area B 2.
Kalman filter and SLAM problem
Distinctive Image Features from Scale-Invariant Keypoints By David G. Lowe, University of British Columbia Presented by: Tim Havinga, Joël van Neerbos.
Computer Vision James Hays, Brown
A Bayesian Approach For 3D Reconstruction From a Single Image
Final Exam Review CS485/685 Computer Vision Prof. Bebis.
Driver’s View and Vehicle Surround Estimation using Omnidirectional Video Stream Abstract Our research is focused on the development of novel machine vision.
Perceptual and Sensory Augmented Computing Integrating Recognitoin and Reconstruction Integrating Recognition and Reconstruction for Cognitive Scene Interpretation.
Visual Object Tracking Xu Yan Quantitative Imaging Laboratory 1 Xu Yan Advisor: Shishir K. Shah Quantitative Imaging Laboratory Computer Science Department.
1. Introduction Motion Segmentation The Affine Motion Model Contour Extraction & Shape Estimation Recursive Shape Estimation & Motion Estimation Occlusion.
A General Framework for Tracking Multiple People from a Moving Camera
3D SLAM for Omni-directional Camera
Flow Separation for Fast and Robust Stereo Odometry [ICRA 2009]
(Wed) Young Ki Baik Computer Vision Lab.
Object Stereo- Joint Stereo Matching and Object Segmentation Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on Michael Bleyer Vienna.
Visual Scene Understanding (CS 598) Derek Hoiem Course Number: Instructor: Derek Hoiem Room: Siebel Center 1109 Class Time: Tuesday and Thursday.
Correspondence-Free Determination of the Affine Fundamental Matrix (Tue) Young Ki Baik, Computer Vision Lab.
Young Ki Baik, Computer Vision Lab.
Dynamosaicing Dynamosaicing Mosaicing of Dynamic Scenes (Fri) Young Ki Baik Computer Vision Lab Seoul National University.
Visual SLAM Visual SLAM SPL Seminar (Fri) Young Ki Baik Computer Vision Lab.
12/7/10 Looking Back, Moving Forward Computational Photography Derek Hoiem, University of Illinois Photo Credit Lee Cullivan.
A minimal solution to the autocalibration of radial distortion Young Ki Baik (CV Lab.) (Wed)
Expectation-Maximization (EM) Case Studies
Real-Time Simultaneous Localization and Mapping with a Single Camera (Mono SLAM) Young Ki Baik Computer Vision Lab. Seoul National University.
1 Motion Analysis using Optical flow CIS601 Longin Jan Latecki Fall 2003 CIS Dept of Temple University.
3D reconstruction from uncalibrated images
 Present by 陳群元.  Introduction  Previous work  Predicting motion patterns  Spatio-temporal transition distribution  Discerning pedestrians  Experimental.
Course14 Dynamic Vision. Biological vision can cope with changing world Moving and changing objects Change illumination Change View-point.
Visual Odometry David Nister, CVPR 2004
Vision-based SLAM Enhanced by Particle Swarm Optimization on the Euclidean Group Vision seminar : Dec Young Ki BAIK Computer Vision Lab.
Visual Odometry for Ground Vehicle Applications David Nistér, Oleg Naroditsky, and James Bergen Sarnoff Corporation CN5300 Princeton, New Jersey
Optical flow and keypoint tracking Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys.
Multi-view Synchronization of Human Actions and Dynamic Scenes Emilie Dexter, Patrick Pérez, Ivan Laptev INRIA Rennes - Bretagne Atlantique
Automatic 3D modelling of Architecture Anthony Dick 1 Phil Torr 2 Roberto Cipolla 1 1 Department of Engineering 2 Microsoft Research, University of Cambridge.
Representation in Vision Derek Hoiem CS 598, Spring 2009 Jan 22, 2009.
Recognizing specific objects Matching with SIFT Original suggestion Lowe, 1999,2004.
Fast Human Detection in Crowded Scenes by Contour Integration and Local Shape Estimation Csaba Beleznai, Horst Bischof Computer Vision and Pattern Recognition,
A. M. R. R. Bandara & L. Ranathunga
Lecture 07 13/12/2011 Shai Avidan הבהרה: החומר המחייב הוא החומר הנלמד בכיתה ולא זה המופיע / לא מופיע במצגת.
Paper – Stephen Se, David Lowe, Jim Little
TP12 - Local features: detection and description
Computer Vision, Robotics, Machine Learning and Control Lab
Particle Filtering for Geometric Active Contours
Real-Time Object Localization and Tracking from Image Sequences
Vehicle Segmentation and Tracking from a Low-Angle Off-Axis Camera
Combining Geometric- and View-Based Approaches for Articulated Pose Estimation David Demirdjian MIT Computer Science and Artificial Intelligence Laboratory.
Course 6 Stereo.
CVPR 2019 Poster Presented by Xu Gao 2019/07/04
Presentation transcript:

Dynamic 3D Scene Analysis from a Moving Vehicle Young Ki Baik (CV Lab.) (Wed)

Dynamic Scene Analysis from a Moving Vehicle  References Dynamic 3D Scene Analysis from a Moving Vehicle Bastian Leibe, Nico Cornelis, Kurt cornelis, Luc Van Gool Awarded the best paper prize (CVPR 2007) Fast Compact City Modeling for Navigation Pre- Visualization Nico Cornelis, Kurt cornelis, Luc Van Gool (CVPR 2006) Pedestrian detection in crowded scene Bastian Leibe et. al. (CVPR 2005) Putting Objects in Perspective Derek Hoiem et. al. (CVPR 2006)

Dynamic Scene Analysis from a Moving Vehicle  Why? … were they received the best paper prize? They completed the impressive real application with only toy computer vision algorithm. They showed that the field of vision will be a key of future technique to the public.

Dynamic Scene Analysis from a Moving Vehicle  Demo (Final result)

Dynamic Scene Analysis from a Moving Vehicle  What? …is the purpose of this paper? … is the challenges of this paper? Detect object in real environment (city road) Localize them in 3D Predict their future motion We are moving Objects can be moving Ground may not be planar

Dynamic Scene Analysis from a Moving Vehicle  What methods? … are used to accomplish their purpose? Structure from motion 2D object detection 3D trajectory estimation

Dynamic Scene Analysis from a Moving Vehicle  Overall flow 3D structure info.3D structure info. Ground planeGround plane 1. SfM Stereo camera Aligned stereo image 2. Object detection 2D and 3D Object2D and 3D Object 3D trajectory3D trajectory OrientationOrientation 3. Tracking

Dynamic Scene Analysis from a Moving Vehicle  3D structure and ground plane 3D Structure from Motion Visual odometry (David Nister) Use pre-calibrated stereo camera Use rectified stereo images Parallel processing → Extrinsic camera parameters → 3D camera trajectory (in real time) Nico Cornelis et. al. (CVPR 2006)

Dynamic Scene Analysis from a Moving Vehicle  3D structure and ground plane Ground plane estimation Known ground positions of wheel base points Nico Cornelis et. al. (CVPR 2006)

Dynamic Scene Analysis from a Moving Vehicle  3D structure and ground plane Ground plane estimation Compute normal locally Average over spatial window Nico Cornelis et. al. (CVPR 2006)

Dynamic Scene Analysis from a Moving Vehicle  SfM Demo Nico Cornelis et. al. (CVPR 2006)

Dynamic Scene Analysis from a Moving Vehicle  Object detection 2D/3D Interaction method Likelihood of 3D object hypothesis H → Given image I and a set of 2D detections h:

Dynamic Scene Analysis from a Moving Vehicle  Object detection 2D object detection 2D recognition ISM detectors Leibe et. al. (CVPR 2005)

Dynamic Scene Analysis from a Moving Vehicle  Object detection ISM detectors (Leibe et al., CVPR’05, BMVC’06) Battery of 5(car)+1(human) single view detectors Each detectors based on 3 local cues Harris-Laplace, Hessian-Laplace, DoG interest regions Local Shape Context descriptors Result: detections + segmentations Leibe et. al. (CVPR 2005)

Dynamic Scene Analysis from a Moving Vehicle  Object detection 2D/3D transfer Two image-plane detections are consistent if they correspond to the same 3D object. → Cluster 3D detections → Multi-viewpoint integration

Dynamic Scene Analysis from a Moving Vehicle  Object detection 3D prior By Using 3D structure and ground plane constraint… → Distance prior (Distance from the ground plane) → Size prior (Gaussian) Hoiem et. al. (CVPR 2006) Significantly reduced search space and outlier

Dynamic Scene Analysis from a Moving Vehicle  Quantitative results of detection Detection performance on 2 test sequences Stereo and Ground plane constraints significantly improves precision

Dynamic Scene Analysis from a Moving Vehicle  Detection Demo

Dynamic Scene Analysis from a Moving Vehicle  Object tracking Localization and Trajectory estimation By using detection results Obtain orientation of objects Space-time trajectory analysis By using the concept of a bidirectional Extended Kalman Filter

Dynamic Scene Analysis from a Moving Vehicle  Object tracking 3D Localization for static objects (car) Location Mean-shift search to find set of 3D detection hypotheses Orientation Cluster shape and detector output

Dynamic Scene Analysis from a Moving Vehicle  Object tracking Dynamic model Holonomic motion (Pedestrian) Without external constraints linking its speed and turn rate Nonholonomic motion (Car) Only move along its main axis Only turn while moving

Dynamic Scene Analysis from a Moving Vehicle  Object tracking Trajectory growing Collect detection in time space

Dynamic Scene Analysis from a Moving Vehicle  Object tracking Trajectory growing Collect detection in time space Evaluate under trajectory Bi-directionally Static assumption

Dynamic Scene Analysis from a Moving Vehicle  Object tracking Trajectory growing Collect detection in time space Evaluate under trajectory Bi-directionally Static assumption Adjust trajectory Weighted mean Predicted position Supporting observations

Dynamic Scene Analysis from a Moving Vehicle  Object tracking Trajectory growing Collect detection in time space Evaluate under trajectory Bi-directionally Static assumption Adjust trajectory Weighted mean Predicted position Supporting observations Iteration

Dynamic Scene Analysis from a Moving Vehicle  Object tracking Trajectory growing Collect detection in time space Evaluate under trajectory Bi-directionally Static assumption Adjust trajectory Weighted mean Predicted position Supporting observations Iteration Location and orientation

Dynamic Scene Analysis from a Moving Vehicle  Demo (Final result)

Dynamic Scene Analysis from a Moving Vehicle  Conclusion Summary Exact value of 3D information help to propose the new concept of detection algorithm raise the performance of detection algorithm. Better detection results Give more reliable tracking results Good orientation estimation Contribution New detection algorithm using 3d information Good integration and visualization of application system