Estimation of physical properties of real world objects Rohan Chabra & Akash Bapat.

Slides:



Advertisements
Similar presentations
Computer vision: models, learning and inference
Advertisements

The fundamental matrix F
Lecture 11: Two-view geometry
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The Linear Prediction Model The Autocorrelation Method Levinson and Durbin.
Results/Conclusions: In computer graphics, AR is achieved by the alignment of the virtual camera with the actual camera and the virtual object with the.
Joshua Fabian Tyler Young James C. Peyton Jones Garrett M. Clayton Integrating the Microsoft Kinect With Simulink: Real-Time Object Tracking Example (
Joydeep Biswas, Manuela Veloso
PACE: An Autofocus Algorithm For SAR
Two-View Geometry CS Sastry and Yang
Semantic Structure from Motion Paper by: Sid Yingze Bao and Silvio Savarese Presentation by: Ian Lenz.
Lecture 8: Stereo.
Uncertainty Representation. Gaussian Distribution variance Standard deviation.
Formation et Analyse d’Images Session 8
TOWARD DYNAMIC GRASP ACQUISITION: THE G-SLAM PROBLEM Li (Emma) Zhang and Jeff Trinkle Department of Computer Science, Rensselaer Polytechnic Institute.
Lecture 23: Photometric Stereo CS4670/5760: Computer Vision Kavita Bala Scott Wehrwein.
Motion Tracking. Image Processing and Computer Vision: 82 Introduction Finding how objects have moved in an image sequence Movement in space Movement.
1cs533d-winter-2005 Notes  Assignment 2 going okay? Make sure you understand what needs to be done before the weekend  Read Guendelman et al, “Nonconvex.
Stereoscopic Light Stripe Scanning: Interference Rejection, Error Minimization and Calibration By: Geoffrey Taylor Lindsay Kleeman Presented by: Ali Agha.
Epipolar geometry. (i)Correspondence geometry: Given an image point x in the first view, how does this constrain the position of the corresponding point.
Lecture 21: Multiple-view geometry and structure from motion
Vision-based Registration for AR Presented by Diem Vu Nov 20, 2003.
High-Quality Video View Interpolation
ECEn 670 Mini-Conference29-Nov.-2011Everett Bryan, Bryce Pincock Velocity Estimation using the Kinect Sensor Everett Bryan Bryce Pincock 29-Nov
Single Point of Contact Manipulation of Unknown Objects Stuart Anderson Advisor: Reid Simmons School of Computer Science Carnegie Mellon University.
Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.
High Speed Obstacle Avoidance using Monocular Vision and Reinforcement Learning Jeff Michels Ashutosh Saxena Andrew Y. Ng Stanford University ICML 2005.
COMP 290 Computer Vision - Spring Motion II - Estimation of Motion field / 3-D construction from motion Yongjik Kim.
Plan for today Discuss your assignments detailed on the last slide of the powerpoint for last week on: –Topics/problems in which you are most interested.
Advanced Computer Vision Structure from Motion. Geometric structure-from-motion problem: using image matches to estimate: The 3D positions of the corresponding.
Camera Parameters and Calibration. Camera parameters From last time….
CSCE 641 Computer Graphics: Image-based Modeling (Cont.) Jinxiang Chai.
The University of Ontario CS 4487/9587 Algorithms for Image Analysis n Web page: Announcements, assignments, code samples/libraries,
Multi-view geometry. Multi-view geometry problems Structure: Given projections of the same 3D point in two or more images, compute the 3D coordinates.
Automatic Camera Calibration
Computer vision: models, learning and inference
Simulation of Robot Soccer Game Kuang-Chyi Lee and Yong-Jia Huang Department of Automation Engineering National Formosa University.
Activity 1: Multi-sensor based Navigation of Intelligent Wheelchairs Theo Theodoridis and Huosheng Hu University of Essex 27 January 2012 Ecole Centrale.
Real-Time High Resolution Photogrammetry John Morris, Georgy Gimel’farb and Patrice Delmas CITR, Tamaki Campus, University of Auckland.
1 Preview At least two views are required to access the depth of a scene point and in turn to reconstruct scene structure Multiple views can be obtained.
KinectFusion : Real-Time Dense Surface Mapping and Tracking IEEE International Symposium on Mixed and Augmented Reality 2011 Science and Technology Proceedings.
Course 12 Calibration. 1.Introduction In theoretic discussions, we have assumed: Camera is located at the origin of coordinate system of scene.
Simulating the Physics of Pool using RenerMan ● Shaders and Texture Mapping ● Spherical Texture Maps ● Rotating the Balls ● Lighting ● Physics Equations.
Recap from Monday Image Warping – Coordinate transforms – Linear transforms expressed in matrix form – Inverse transforms useful when synthesizing images.
Computer Vision - A Modern Approach Set: Tracking Slides by D.A. Forsyth The three main issues in tracking.
1 Computational Vision CSCI 363, Fall 2012 Lecture 31 Heading Models.
Image stitching Digital Visual Effects Yung-Yu Chuang with slides by Richard Szeliski, Steve Seitz, Matthew Brown and Vaclav Hlavac.
Metrology 1.Perspective distortion. 2.Depth is lost.
1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k.
1 Formation et Analyse d’Images Session 7 Daniela Hall 25 November 2004.
A Passive Approach to Sensor Network Localization Rahul Biswas and Sebastian Thrun International Conference on Intelligent Robots and Systems 2004 Presented.
Chapter 5 Multi-Cue 3D Model- Based Object Tracking Geoffrey Taylor Lindsay Kleeman Intelligent Robotics Research Centre (IRRC) Department of Electrical.
3d Pose Detection Used by Kinect
Realtime Robotic Radiation Oncology Brian Murphy 4 th Electronic & Computer Engineering.
Using Adaptive Tracking To Classify And Monitor Activities In A Site W.E.L. Grimson, C. Stauffer, R. Romano, L. Lee.
Visual Odometry for Ground Vehicle Applications David Nistér, Oleg Naroditsky, and James Bergen Sarnoff Corporation CN5300 Princeton, New Jersey
Camera Model Calibration
Person Following with a Mobile Robot Using Binocular Feature-Based Tracking Zhichao Chen and Stanley T. Birchfield Dept. of Electrical and Computer Engineering.
MASKS © 2004 Invitation to 3D vision. MASKS © 2004 Invitation to 3D vision Lecture 1 Overview and Introduction.
Global predictors of regression fidelity A single number to characterize the overall quality of the surrogate. Equivalence measures –Coefficient of multiple.
11/25/03 3D Model Acquisition by Tracking 2D Wireframes Presenter: Jing Han Shiau M. Brown, T. Drummond and R. Cipolla Department of Engineering University.
Global predictors of regression fidelity A single number to characterize the overall quality of the surrogate. Equivalence measures –Coefficient of multiple.
3D Perception and Environment Map Generation for Humanoid Robot Navigation A DISCUSSION OF: -BY ANGELA FILLEY.
A Plane-Based Approach to Mondrian Stereo Matching
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry
CS 4501: Introduction to Computer Vision Augmented and Virtual Reality
Florian Shkurti, Ioannis Rekleitis, Milena Scaccia and Gregory Dudek
Epipolar geometry.
Introduction to Momentum (P)
Advanced Computer Vision
Multiple View Geometry for Robotics
Presentation transcript:

Estimation of physical properties of real world objects Rohan Chabra & Akash Bapat

Motivation 3D Scene Understanding Intelligent systems that predict collisions between objects in an environment. This system can be used in robot industry to guide robots in unexpected scenarios. Construction of VFX and special effects.

Background Object tracking : Track object even though it is occluded “Binding vision to physics based simulation: The case study of a bouncing ball”. By N. Kyriazis, I. Oikonomidis, and A. Argyros. In Proc. BMVC, Computer Vision Physics based simulation Data Graphics

Background Estimation of motion properties of objects in a video. Parameters such as:- position, linear velocity angular velocity assuming the environment and physical properties are known.

Data acquisition Microsoft Kinect 1.0 is used in the present setup. FPS= 30 Difficulties in tracking in 3D Motion blur at high velocities Depth data is recorded in mm 3D world point is estimated using camera matrix transformation

Data acquisition- bouncing ball

Data acquisition – sliding friction

3D tracking Fast versions of 3D tracking algorithms assume accurate depth maps. Most tracking algorithms assume small motion. 3D data are piecewise planar, hence keypoint-based detectors tend to fail. Hence, online-MIL tracker is uses learning for tracking Normal plane estimation is done using RANSAC or regression.

Coefficient of restitution-data

Coefficient of restitution

Velocity changes in x & z We noticed that velocities in x & z directions also change at every bounce. We applied SVD to find out impulse responsible for this. N is number of bounces, Δ v is averaged over time J= Δ t F = m Δ v µmg Δ t =m Δ v Log ( µ x ) + log( Δ t ) = log( Δ v x /g) Log ( µ z ) + log( Δ t ) = log( Δ v z /g) µ x = 0.04, µ z =0.08, Δ t = 0.1 s µ = 5*10e-3 2N equations, N+2 unknowns

Sliding friction -data

Sliding friction

Numerical simulation Bullet physics is used for simulation Inaccurate for calculating sliding friction due to multiple collisions and impulses. Hence, we are using a pseudo-force We plan to use another physics platform, or write our own code. OpenGL is used for rendering.

Coefficient of restitution e= sqrt(h 2 /h 1 ) E seed = random value between 0-1 Δ H = difference in heights Error = α *signum( Δ H)*e RMS. E new =E prev – Error where α is learning factor

Coefficient of restitution

Coefficient of restitution-data

Alpha = 0.005Initial or Seed COR = 0.5 IterationErrorEstimated COR (Least Error magnitude) Final Estimated COR =

Sliding friction 0.5mv 2 = F fr. s, where F fr = µ m g V seed is random velocity & µ seed ≈ 0 Δ X = avg(Kinect position – simulated position) E = RMS error ( Δ X) Error = signum( Δ X)*E V new = V prev + Error * α µ new = µ prev + V 2 /2gs * β β is to be selected such that s simulated ≈ s Kinect

Estimated µ V 2 simulated /2gs simulated µ simulated

Sliding friction

Comparison

Demo :sliding friction

Future Work Incorporation of mesh Stereo estimation at 60/120 fps for better accuracy. Estimation of rolling friction. Validation using actual physics experiments. For ground truth, Accelerometer and gyroscope can be used to estimate ω and v Use of real-time 3D tracking algorithms Experiment with different surface pairs & objects of different sizes/shapes.

Questions?