Vision and Obstacle Avoidance In Cartesian Space

Why is Obstacle Avoidance Important Workspace can change unexpectedly No prior knowledge of workspace Multiple robots in workspace Humans in workspace!

Addressing the Issue Vision – Object Identification – Coordinate Transformation Control – Trajectory generator avoidance – Impedance controllers

Vision Introduction

Image acquisition Grayscale Bayer Binary

Common feature extraction techniques Edge Detection – Edge(image,method) Sobel Prewitt canny Corner detection – Corner(image) – SIFT – SURF Color schemed detection – Achieved through logic

Color schemed detection demo Now that we have the pixel value from our image lets find the Cartesian coordinate of this object.

Pixel Origin Transforming from 3d to 2d where the mapping is not one-to-one, i.e. unique inverse does not exist because of the depth

Camera Calibration

Obstacle avoidance Vision Vision based controller

Haptic Geometries Using basic geometries find the optimal path around the object and back to the normal trajectory.

Vision Impedance Controller

An alternative approach A Vision Model Loop Control Loop

Questions?