Vision Based Motion Control CMPUT 610 2001 Martin Jagersand.

Slides:



Advertisements
Similar presentations
3-D Homogeneous Transformations.  Coordinate transformation (translation+rotation) 3-D Homogeneous Transformations.
Advertisements

Denavit-Hartenberg Convention
Kinematic Modelling in Robotics
T. Bajd, M. Mihelj, J. Lenarčič, A. Stanovnik, M. Munih, Robotics, Springer, 2010 HOMOGENOUS TRANSFORMATION MATRICES T. Bajd and M. Mihelj.
Model Independent Visual Servoing CMPUT 610 Literature Reading Presentation Zhen Deng.
Vision Based Motion Control Martin Jagersand University of Alberta CIRA 2001.
Hybrid Manipulation: Force-Vision CMPUT 610 Martin Jagersand.
Ch. 2: Rigid Body Motions and Homogeneous Transforms
Hand-Eye Coordination and Vision-based Interaction Martin Jagersand Collaborators: Zach Dodds, Greg Hager, Andreas Pichler.
3-D Geometry.
Ch. 3: Forward and Inverse Kinematics
Serial and Parallel Manipulators
Representation CS4395: Computer Graphics 1 Mohan Sridharan Based on slides created by Edward Angel.
Introduction to ROBOTICS
Estimating Visual-Motor Functions CMPUT Martin Jagersand.
Forward Kinematics and Jacobians Kris Hauser CS B659: Principles of Intelligent Robot Motion Spring 2013.
Computer Vision Group Prof. Daniel Cremers Autonomous Navigation for Flying Robots Lecture 3.1: 3D Geometry Jürgen Sturm Technische Universität München.
ME/ECE Professor N. J. Ferrier Forward Kinematics Professor Nicola Ferrier ME Room 2246,
Robot Arms, Hands: Kinematics
Definition of an Industrial Robot
Camera Geometry and Calibration Thanks to Martial Hebert.
Kinematics of Robot Manipulator
Chapter 2 Robot Kinematics: Position Analysis
Homogeneous Coordinates (Projective Space) Let be a point in Euclidean space Change to homogeneous coordinates: Defined up to scale: Can go back to non-homogeneous.
Autonomous Navigation for Flying Robots Lecture 2.2: 2D Geometry
Robot Vision Control of robot motion from video cmput 615/499 M. Jagersand.
CSE 681 Review: Transformations. CSE 681 Transformations Modeling transformations build complex models by positioning (transforming) simple components.
Transformations Jehee Lee Seoul National University.
Metrology 1.Perspective distortion. 2.Depth is lost.
1 Fundamentals of Robotics Linking perception to action 2. Motion of Rigid Bodies 南台科技大學電機工程系謝銘原.
Geometric Camera Models
T. Bajd, M. Mihelj, J. Lenarčič, A. Stanovnik, M. Munih, Robotics, Springer, 2010 GEOMETRIC DESCRIPTION OF THE ROBOT MECHANISM T. Bajd and M. Mihelj.
Kinematics Jehee Lee Seoul National University. Kinematics How to animate skeletons (articulated figures) Kinematics is the study of motion without regard.
EEE. Dept of HONG KONG University of Science and Technology Introduction to Robotics Page 1 Lecture 2. Rigid Body Motion Main Concepts: Configuration Space.
Robot Kinematics: Position Analysis 2.1 INTRODUCTION  Forward Kinematics: to determine where the robot ’ s hand is? (If all joint variables are known)
What is Kinematics. Kinematics studies the motion of bodies.
1 Chapter 2: Geometric Camera Models Objective: Formulate the geometrical relationships between image and scene measurements Scene: a 3-D function, g(x,y,z)
CSCE 452 Intro to Robotics CSCE 452: Lecture 1 Introduction, Homogeneous Transformations, and Coordinate frames.
ECE 450 Introduction to Robotics Section: Instructor: Linda A. Gee 10/07/99 Lecture 11.
Honours Graphics 2008 Session 2. Today’s focus Vectors, matrices and associated math Transformations and concatenation 3D space.
1 Representation. 2 Objectives Introduce concepts such as dimension and basis Introduce coordinate systems for representing vectors spaces and frames.
Camera Model Calibration
Digital Image Processing Additional Material : Imaging Geometry 11 September 2006 Digital Image Processing Additional Material : Imaging Geometry 11 September.
CS559: Computer Graphics Lecture 9: 3D Transformation and Projection Li Zhang Spring 2010 Most slides borrowed from Yungyu ChuangYungyu Chuang.
Arizona’s First University. Command and Control Wind Tunnel Simulated Camera Design Jacob Gulotta.
Coordinate Systems and Transformations
III- 1 III 3D Transformation Homogeneous Coordinates The three dimensional point (x, y, z) is represented by the homogeneous coordinate (x, y, z, 1) In.
Computer Graphics I, Fall 2010 Transformations.
2D Transformation Homogenous Coordinates Scale/Rotate/Reflect/Shear: X’ = XT Translate: X’ = X + T Multiple values for the same point e.g., (2, 3, 6)
COMP322/S2000/L81 Direct Kinematics- Link Coordinates Questions: How do we assign frames? At the Joints? At the Links? Denavit-Hartenberg (D-H) Representation.
An Introduction to Robot Kinematics Renata Melamud.
End effector End effector - the last coordinate system of figure Located in joint N. But usually, we want to specify it in base coordinates. 1.
Image Warping 2D Geometric Transformations
MASKS © 2004 Invitation to 3D vision Lecture 6 Introduction to Algebra & Rigid-Body Motion Allen Y. Yang September 18 th, 2006.
Robotic Arms and Matrices By Chris Wong and Chris Marino.
CSCE 452: Question Set 1 Spatial Descriptions
Lecture 10 Geometric Transformations In 3D(Three- Dimensional)
3. Transformation
Lecture 3 Jitendra Malik
3D Geometric Transformations
Lecture 3: Camera Rotations and Homographies
Homogeneous Transformation Matrices
CHAPTER 2 FORWARD KINEMATIC 1.
Geometric Camera Models
Viewing and Perspective Transformations
PROBLEM SET 6 1. What is the Jacobian for translational velocities of point “P” for the following robot? X0 Y0 Y1 X1, Y2 X2 X3 Y3 P 1 What is the velocity.
Reflections in Coordinate Plane
Geometrical Transformations
Robotics 1 Copyright Martin P. Aalund, Ph.D.
Translation in Homogeneous Coordinates
Presentation transcript:

Vision Based Motion Control CMPUT Martin Jagersand

How to go from Visual sensation to Motor action? Camera -> Robot coordRobot -> Object

Closed loop servoing We focus on the geometric transforms EE

Lots of possible coordinates Camera – Center of projection – Different models Robot – Base frame – End-effector frame – Object

Coordinate rotation Example: Around y-axis X’ Z’ X P

Euler angles Note: Successive rotations. Order matters.

Rotation and translation Translation t’ in new o’ coordinates X’ Z’ X P

Example Matlab robot Successive translation and rotation % robocop Simulates a 3 joint robot function Jpos = robocop(theta1,theta2,theta3,L1,L 2,L3,P0) Rxy1 = [cos(theta1) sin(theta1) 0 -sin(theta1) cos(theta1) ]; Rxz2 = [cos(theta2) 0 sin(theta2) sin(theta2) 0 cos(theta2)]; Rxz3 = [cos(theta3) 0 sin(theta3) sin(theta3) 0 cos(theta3)]; P1 = P0 + Rxy1*[L1 0 0]'; P2 = P1 + Rxy1*Rxz2*[L2 0 0]'; P3 = P2 + Rxy1*Rxz2*Rxz3*[L3 0 0]'; Jpos = [P0 P1 P2 P3];

Homogeneous coordinates Write as matrix multiplications only 3-vectors -> 4 vectors Affine -> homogeneous

Denavit-Hartenberg Particular choice of homogeneous parameterization, see eq. 2.8 in Alexa’s thesis

Perspective Camera In homogeneous 4-vector Remove 3 rd row for standard camera plane proj

Hand-Eye system Motor-Visual function: y=f(x)