Introduction to Machine Vision Systems

Slides:



Advertisements
Similar presentations
Vision Based Control Motion Matt Baker Kevin VanDyke.
Advertisements

Digital Image Processing: Digital Imaging Fundamentals.
Processing Digital Images. Filtering Analysis –Recognition Transmission.
Vision Computing An Introduction. Visual Perception Sight is our most impressive sense. It gives us, without conscious effort, detailed information about.
Chapter 2 Computer Imaging Systems. Content Computer Imaging Systems.
7/24/031 Ben Blazey Industrial Vision Systems for the extruder.
Introduction to Computer Vision CS / ECE 181B Thursday, April 13, 2004  Image Formation.
Design and Implementation of Metallic Waste Collection Robot
SL Introduction to Optical Inspection1. Introduction to Optical Inspection Helge Jordfald Sales & Marketing Manager Tordivel AS – Norway.
ECE 472/572 – Digital Image Processing Lecture 2 – Elements of Visual Perception and Image Formation 08/25/11.
Spectral contrast enhancement
ISAT 303-Lab3-1  Measurement of Condition: Lab #3 (2005):  List of parameters of condition: –Linear distance, angular displacement, vibration, displacement,
SCCS 4761 Introduction What is Image Processing? Fundamental of Image Processing.
Manufacturing Engineering Department Lecture 9 – Automated Inspection
ISAT 303 Mod 1-1  M. Zarrugh Module I Sensors and Measurements in MFG  The objectives of this module are to –understand the role which sensors.
CS 376b Introduction to Computer Vision 04 / 29 / 2008 Instructor: Michael Eckmann.
AUTOMATED INSPECTION (Part 2).
Image Formation Fundamentals Basic Concepts (Continued…)
Perception Introduction Pattern Recognition Image Formation
BACKGROUND LEARNING AND LETTER DETECTION USING TEXTURE WITH PRINCIPAL COMPONENT ANALYSIS (PCA) CIS 601 PROJECT SUMIT BASU FALL 2004.
Visual Perception PhD Program in Information Technologies Description: Obtention of 3D Information. Study of the problem of triangulation, camera calibration.
LASER AND ADVANCES IN METROLOGY
IPD Technical Conference February 19 th 2008 Friction Roller Identification Jack Weatherford Hermitage Automation & Controls.
CSCE 5013 Computer Vision Fall 2011 Prof. John Gauch
Digital Image Processing & Analysis Spring Definitions Image Processing Image Analysis (Image Understanding) Computer Vision Low Level Processes:
Sensing for Robotics & Control – Remote Sensors R. R. Lindeke, Ph.D.
Digital Image Fundamentals. What Makes a good image? Cameras (resolution, focus, aperture), Distance from object (field of view), Illumination (intensity.
Digital Image Processing & Analysis Dr. Samir H. Abdul-Jauwad Electrical Engineering Department King Fahd University of Petroleum & Minerals.
Intelligent Vision Systems Image Geometry and Acquisition ENT 496 Ms. HEMA C.R. Lecture 2.
Digital Image Processing & Analysis Fall Outline Sampling and Quantization Image Transforms Discrete Cosine Transforms Image Operations Image Restoration.
Chapter Teacher: Remah W. Al-Khatib. This lecture will cover:  The human visual system  Light and the electromagnetic spectrum  Image representation.
7 elements of remote sensing process 1.Energy Source (A) 2.Radiation & Atmosphere (B) 3.Interaction with Targets (C) 4.Recording of Energy by Sensor (D)
Chapter 2: Digital Image Fundamentals Spring 2006, 劉震昌.
MACHINE VISION Machine Vision System Components ENT 273 Ms. HEMA C.R. Lecture 1.
Introduction Advantage of DSP: - Better signal quality & repeatable performance - Flexible  Easily modified (Software Base) - Handle more complex processing.
How to startpage 1. How to start How to specify the task How to get a good image.
ECE 450 Introduction to Robotics
1 Artificial Intelligence: Vision Stages of analysis Low level vision Surfaces and distance Object Matching.
Industrial Vision Industrial Vision: components.
Tutorial Visual Perception Towards Computer Vision
Engineering H192 - Computer Programming Gateway Engineering Education Coalition Lab 1P. 1Winter Quarter Data Acquisition System Fundamentals Lab 1.
University of Kurdistan Digital Image Processing (DIP) Lecturer: Kaveh Mollazade, Ph.D. Department of Biosystems Engineering, Faculty of Agriculture,
Autonomous Robots Vision © Manfred Huber 2014.
1 Machine Vision. 2 VISION the most powerful sense.
In-Sight 5100 Vision System. What is a Vision System?  Devices that capture and analyze visual information, and are used to automate tasks that require.
Introduction to Image Processing. What is Image Processing? Manipulation of digital images by computer. Image processing focuses on two major tasks: –Improvement.
Intelligent Vision Systems Image Geometry and Acquisition ENT 496 Ms. HEMA C.R. Lecture 2.
Robotics/Machine Vision Robert Love, Venkat Jayaraman July 17, 2008 SSTP Seminar – Lecture 7.
1 Teaching Innovation - Entrepreneurial - Global The Centre for Technology enabled Teaching & Learning, N Y S S, India DTEL DTEL (Department for Technology.
An Introduction to Digital Image Processing Dr.Amnach Khawne Department of Computer Engineering, KMITL.
Presented by: Kumar Magi. ( 2MM07EC016 ). Contents Introduction Definition Sensor & Its Evolution Sensor Principle Multi Sensor Fusion & Integration Application.
Portable Camera-Based Assistive Text and Product Label Reading From Hand-Held Objects for Blind Persons.
Paresh Kamble Digital Image Processing Introduction by Paresh Kamble.
1. 2 What is Digital Image Processing? The term image refers to a two-dimensional light intensity function f(x,y), where x and y denote spatial(plane)
IMAGE PROCESSING is the use of computer algorithms to perform image process on digital images   It is used for filtering the image and editing the digital.
Visual Information Processing. Human Perception V.S. Machine Perception  Human perception: pictorial information improvement for human interpretation.
PRESENTATION ON Line follower robot.
Vision Basics Lighting I. Vision Basics Lighting I.
INTRODUCTION TO GEOGRAPHICAL INFORMATION SYSTEM
EE663-Digital Image Processing & Analysis Dr. Samir H
Machine Vision Acquisition of image data, followed by the processing and interpretation of these data by computer for some useful application like inspection,
7 elements of remote sensing process
Vehicle Segmentation and Tracking in the Presence of Occlusions
Digital Image Fundamentals
CMSC 426: Image Processing (Computer Vision)
Digital Image Fundamentals
IT523 Digital Image Processing
Presentation transcript:

Introduction to Machine Vision Systems Professor Nicola Ferrier Room 3128, ECB 265-8793 ferrier@engr.wisc.edu

Machine Vision To become familiar with technologies used for machine vision as a sensor for robots. Camera and lighting technology (obtaining a digital representation of an image) Software (computational techniques to process or modify the image data) Analysis/decisions: using the results of the processing in robot control Additional material in CS766, ECE 533, ME 739

Machine Vision in Automation Use a camera to inspect parts to: Guide a robot or control automated equipment Support statistical analysis in a computer-assisted- manufacturing (CAM) system Ensure quality in manufacturing process: dimensions/alignment Determine if all components are present Other quality issues: color, placement, …

Why use Vision? Dynamic Range Can be remotely situated Passive emits no energy (cf. Laser, sonar, IR) no contact required Flexibility Affordable

Why avoid Vision? / Computation must process images data = information Calibration Sensitivity to lighting conditions / Because the lighting is different, these 3 images appear substantially different to a computer – to a human we easily adapt our perception for variations in illumination and recognize that all three images are of the same object. Images (arrays of pixel data) must be processed to provide information

Example Application: Micro-manipulation Micro Object handling with Micro gripper Postech Robotics Lab Micro gripper Microscope Table

A machine vision system often includes the following elements: Image Acquisition (generally from a camera placed above the production line), Image Pre-Processing (e.g. increasing the contrast, motion de-blur, etc), Feature Extraction (e.g. measuring a distance, checking a screw is in place etc), Decisions (i.e. is the part OK to a tolerance, is a label in the correct position), and, Control (e.g. give the result to a Programmable Logic Controller (PLC) or robot controller).

Image Acquisition Transforms the visual image of a physical objects into a set of digitized data Illumination Image formation (including focusing) Image detection or sensing Formatting camera output signal

Image Formation and Detection Vision systems have an optical-electro device that converts electromagnetic radiation from the image of the physical object into an electric signal used by the vision processing unit Image is formed by: Illumination flux from object Optics (lens) Photosensitive detectors (photodiodes on solid state cameras)

Vision – Image Formation Shape Lighting Relative Positions Sensor sensitivity Same shape – very different images!

Lighting Structured Lighting Diffuse Backlighting Directional backlighting Fiber-optic/LED ring lights

Lighting Polarized lighting Oblique lighting Direct front lighting Cross polarization

Lighting Diffuse front lighting Dark field illumination Fibre optic near in- lighting

Image Formation and Detection Light source

Digitization of Camera Signal Analog image data (voltage) is sampled and quantized (often to 8 bits greyscale or 24 bits of color)

Software: Processing the Data The software allows the image to be processed, analyzed, and stored. Different types of software packages are available, ranging from easy-to-use packages with pre-defined tools, to SDKs (software development kits) that allow programmers to build custom imaging applications. Matlab™ has an image processing tool box Image Pre-processing Feature Extraction

Image Pre-processing What to do with the image? May need to preprocess the image in order to analyze it Remove motion blur (ECE 533/738) Enhance contrast

I Can See It – Why can’t the Computer? Minimize possible problems – The human eye and brain are elaborate and versatile systems, capable of identifying objects in a wide variety of conditions. For example, we are able to identify familiar people even when they are wearing different clothes, and recognize familiar landmarks when driving on a foggy day. A PC-based imaging system is not as versatile; it can only perform what it has been programmed to perform. Knowing what the system can and cannot "see" are important points to keep in mind to obtain the results you want, and reduce errors and incorrect measurements. Common variables include: · Changes in object’s color · Changes in surrounding lighting · Changes in camera focus or position · Improperly mounted camera ·  Environmental vibration A vibration-free environment with all extraneous light removed will eliminate many common problems.

Find the man…. Visual tasks can be made difficult!

Distractors Natural systems take advantage of the fact that visual tasks can be made difficult!

I Can See It – Why can’t the Computer? Minimize possible problems – Knowing what the system can and cannot "see" are important points to keep in mind to obtain the results you want, and reduce errors and incorrect measurements. Engineer the environment! Great examples include commercial motion capture systems

Feature Extraction/Analysis 2D Geometric Analysis: Must have high contrast to separate (“segment”) part from background In practice back lighting is often used The silhouette is used to determine: part dimensions: Width, height, orientation, etc Part features (e.g. number of holes) Relationships between parts

Controlled Environment Easy to “segment” image

Measurements from Images Must have relationship between the image “pixels” and the world 2D imaging the image plane and the “world” plane are in 1-1 correspondence 3D –harder

Goals for ME 439 and ME 739 Modeling Cameras Kinematics of Vision Basic of pinhole Kinematics of Vision Coordinate transformations Processing Images Some simple features (sections 8.13 - 8.25) 2D problems Modeling Cameras Pinhole model Projective mapping Calibration Procedures Kinematics of Vision Coordinate transformations Motion field equations Processing Images Feature detection (lines, blobs) Visual Servoing (Eye-Hand Coordination) in 3D