Robot Vision slide1. Robot Vision Exercise Robot Vision slide3 The task To locate the picking point of the object = Centre of Gravity of the object To.

Slides:



Advertisements
Similar presentations
Working with Profiles in IX1D v 3 – A Tutorial © 2006 Interpex Limited All rights reserved Version 1.0.
Advertisements

MS® PowerPoint.
Step-by-Step: Adjust a Chart Axis USE the Pricing Final presentation that is still open from the previous exercise. 1.Click the chart on slide 2 to select.
Introduction to Excel Formulas, Functions and References.
Microsoft Office XP Microsoft Excel
 Use the Left and Right arrow keys or the Page Up and Page Down keys to move between the pages. You can also click on the pages to move forward.  To.
Using Surfcam to Produce a Numeric Control (NC) Program An Introduction to the CAD/CAM Process Instructions for 3 Axis Programming Using the D&M CNC Milling.
XP New Perspectives on Microsoft Office Excel 2003, Second Edition- Tutorial 3 1 Microsoft Office Excel 2003 Tutorial 3 – Developing a Professional- Looking.
Customizing Word Microsoft Office Word 2007 Illustrated Complete.
1 of 6 This document is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS DOCUMENT. © 2007 Microsoft Corporation.
Using the Unity 98 Cordless Response System Directions : Courtesy of IHC public relations.
Quark QuarkXPress 4 Intermediate Level Course. Working with Master Pages The Document Layout Palette allows you to add, delete, and move document and.
Inventory Throughout this slide show there will be hyperlinks (highlighted in blue) follow the hyperlinks to navigate to the specified Topic or Figure.
1 QED In Vivo USB Input Output Box configuration This tutorial contains a number of instructions embedded in a great deal of explanation. Procedures that.
Office 2003 Post-Advanced Concepts and Techniques M i c r o s o f t Word Project 8 Working with Macros and Visual Basic for Applications (VBA)
Advanced Tables Lesson 9. Objectives Creating a Custom Table When a table template doesn’t suit your needs, you can create a custom table in Design view.
Word Tutorial 1 Creating a document.
1 Exercise Two The Digital Camera Helpful Notes 2004.
System-level and RESA Administrators Functions. Topics Manually creating new student account Manually creating new teacher account Importing data Viewing.
European Computer Driving Licence Syllabus version 5.0 Module 4 – Spreadsheets Chapter 22 – Functions Pass ECDL5 for Office 2007 Module 4 Spreadsheets.
Excel Worksheet # 5 Class Agenda Formulas & Functions
A First Look at Excel 2000 Excel Foundation.
Microsoft Office Excel 2003 Tutorial 3 – Developing a Professional-Looking Worksheet.
FireRMS NEMSIS (Part 2) Presented by Laura Small FireRMS Quality Assurance.
6 th Annual Focus Users’ Conference 6 th Annual Focus Users’ Conference Discipline Referrals Presented by: Christine Lee Presented by: Christine Lee.
Computing Fundamentals Module Lesson 3 — Changing Settings and Customizing the Desktop Computer Literacy BASICS.
Getting Started With AutoCAD ENGR 2 Week #1 Laboratory.
Addison Wesley is an imprint of © 2010 Pearson Addison-Wesley. All rights reserved. Chapter 7 The Game Loop and Animation Starting Out with Games & Graphics.
Microsoft Visual Basic 2012 CHAPTER THREE Program Design and Coding.
Calibration & Measurements. Calibrating the System Before we can make any measurements we need to calibrate our imaging system to create real world numbers.
CREATING TEMPLATES CREATING CUSTOM CHARACTERS IMPORTING BATCH DATA SAVING DATA & TEMPLATES CREATING SERIES DATA PRINTING THE DATA.
1 Draw Mode. 2 Notable Points (RMB) End point: Snaps to the closest end point of the selected entity. Mid point: Snaps to the middle point of the selected.
T U T O R I A L  2009 Pearson Education, Inc. All rights reserved. 1 3 Welcome Application Introduction to Visual Programming.
IC 3 BASICS, Internet and Computing Core Certification Key Applications Lesson 11 Organizing the Worksheet.
ME451:Kinematics and Dynamics of Machine Systems (Spring 09)
User Guide for Kinovea CREATED BY: KEVIN THOMAS CHRISTINA BOWEN RONDA WHYTE.
Creating Graphical User Interfaces (GUI’s) with MATLAB By Jeffrey A. Webb OSU Gateway Coalition Member.
How to startpage 1. How to start How to specify the task How to get a good image.
Rev.04/2015© 2015 PLEASE NOTE: The Application Review Module (ARM) is a system that is designed as a shared service and is maintained by the Grants Centers.
This is what we want to draw Extrude Mirror Round Edges.
1 Getting Started Exercise Part 1. 2 Profiles related to the exercise When starting use archive profile: GettingStarted_Start.zip The fully completed.
Using the AccuGlobe Software with the IndianaMap Using the AccuGlobe Software.
A skills approach © 2012 The McGraw-Hill Companies, Inc. All rights reserved. powerpoint 2010 Chapter 4 Managing and Delivering Presentations.
Fall 2003Sylnovie Merchant, Ph.D. ACCESS Tutorial Note: The purpose of this tutorial is to provide an introduction to some of the functions of ACCESS in.
Machine Vision Introduction to Using Cognex DVT Intellect.
McGraw-Hill/Irwin The Interactive Computing Series © 2002 The McGraw-Hill Companies, Inc. All rights reserved. Microsoft Excel 2002 Working with Data Lists.
ADAMS Assignment 6 ME451:Kinematics and Dynamics of Machine Systems (Fall 2013) Assigned: November 13, 2013 Due: November 20, 2013.
SL a Introduction to Scorpion 4.0 June 12,2005 Page 1.
XP 1 ﴀ New Perspectives on Microsoft Office 2003, Premium Edition Excel Tutorial 2 Microsoft Office Excel 2003 Tutorial 2 – Working With Formulas and Functions.
PestPac Software. Leads The Leads Module allows you to track all of your pending sales for your company from the first contact to the close. By the end.
For the benefit of business and people Lotus Notes R6 Training 4 February 2016 IT Division.
Microsoft PowerPoint Prepared by the Academic Faculty Members of IT.
Adding, editing, and deleting items using CONTENTdm Administration.
Train Body The next series of slides will guide you through the construction of the train body. Start a new drawing and save it as Train Body.
1 Berger Jean-Baptiste
Resource Review Excel formula basics Demonstrate how to enter manual formulas Examine some of the available functions and their usage Discuss the.
1. Using word you can create the document and edit them later, as and when required,by adding more text, modifying the existing text, deleting/moving.
Autodesk Inventor Design Exercise 2: F1 Team Challenge Car Developed by Tim Varner – Synergis Technologies © Tim Varner
MS WORD INFORMATION TECHNOLOGY MANAGEMENT SERVICE Training & Research Division.
Excel Tutorial 8 Developing an Excel Application
Computer Literacy BASICS
Getting Started with Adobe Photoshop CS6
Scratch for Interactivity
Data Validation and Protecting Workbook
SL a Robot Vision 3 exercise
Variables and Arithmetic Operations
Getting Started Exercise
Layouts, Plotting, Printing
Presentation transcript:

Robot Vision slide1

Robot Vision Exercise

Robot Vision slide3 The task To locate the picking point of the object = Centre of Gravity of the object To measure the rotation of the object = the angle between Y axes and the line going from centre point of mid hole and to centre point outer hole To send the picking point co- ordinates (x,y) and rotation (angle) in the robot co-ordinate system to the Robot system using RS232 Robot co-ordinate system X Y Origo Picking point Angle

Robot Vision slide4 Configuring of Scorpion Robot vision system 1.Create a new Scorpion Profile 2.Configure the image source - camera/file 3.Calibration of images 4.Locate the object and find the pick-up x,y coordinates 5.Calibration in Robot co-ordinates 6.Establish reference system to measure rotation 7.Configure the User Interface 8.Configure communication to external systems

Robot Vision slide5 Restore Robot Vision Start profile 1. Open Scorpion and click on restore ( if the menu is not visible right click on the mouse, click on “Show Buttons” for permanent display) 2. Browse to the catalogue “unsupportedprofiles” on the Scorpion CD 3. Select RobotVision_Start.zip an open the file

Robot Vision slide6 Create MyRobotVision profile Step 1 – Create a new Profile 1.Select ”New” 2.Give it the name ”MyRobotVision”

Robot Vision slide7 Copy the content of RobotVision_Start to the new profile 1.You can copy the content of an existing profile (including images) to automatically add functionality to the new profile 2.Mark the profile called ”RobotVision_start” and select copy 3.Select copy to the new profile ”MyRobotVision” 4.Start MyRobotVision profile

Robot Vision slide8 Starting point Operation mode: (No password) –For operators –Can start and stop the inspection –Read history list, curves and statistics –No access to any configuration Settings mode: (Password: 1234) –For operators certified to adjust certain parameters, alarm limits and logic states Service mode: (Password: 911) –Full access to all functions Enter Service mode by pressing the service button and enter the password

Robot Vision slide9 Configure the image source 1.Select Service Tab 2.We will use stored images therefore activate Simulation ON 3.Click on Snapshot 4.If no image the image directory must be checked 5.Click on the image setting source 6.Browse to find the selected image directory 7.Assure that the directory for images are set to \Scorpion_200\MyRobotVision\Images

Robot Vision slide10 Vision Strategy Calibration – for correcting lens distortion to get high precision 4 point robot calibration to synchronize image and robot co-ordinate system Use blob to find centre of gravity of the object Use the big outer hole centre and mid hole centre to establish a local reference system handling rotation Robot co-ordinate system X Y Origo Picking point Angle

Robot Vision slide11 Lens calibration In robot vision application the camera often have a large Field Of View (FOW) and a relative short distance to the object This require a wide angle lens and consequently large lens distortion Without correcting the distortion, the inaccuracy in the outer part of the FOW might cause the robot to fail picking the object correctly

Robot Vision slide12 4 point robot calibration By using 4 point calibration you can establish a co-ordinate system equal to the one used by the robot By moving the robot to the centre of each point the robot co-ordinates are found In Scorpion the centre of each is found in the Scorpion reference system This enable you to communicate pick up points and rotation in the robot co- ordinate system

Robot Vision slide13 Understanding lens correction and robot calibration Correction of lens distortion is independent of distance to the object The lens correction is done in one plane and valid for all robot planes Robot calibration is only valid for a specific distance to the object (Robot plane) For each different robot picking plane a individual robot calibration must be done Scorpion can handle multiple robot planes Robot plane 1 Robot plane 2 Robot plane 3

Robot Vision slide14 Pixel co-ordinate system Default co-ordinate system with Origo in upper left corner X and Y pixels according to camera resolution –VGA 760 x 480 –XGA 1024 x 768 (used in the exercise) X Y Origo X=0, Y=0 X=768, Y=1024 X=0, Y=1024 X=768, Y=0

Robot Vision slide15 Show Info on the image With the cursor on the image right click the mouse and select ”Show info” from the menu X and Y number are pixel position, origo (X=0 and Y=0) is in the upper left corner Pixel value is the greyscale value (0 = Black, 256 = White)

Robot Vision slide16 Zoom the image Press the left button on the mouse and mark the zoom area Release the button and the image is zoomed in Click on the image to zoom out

Robot Vision slide17 Operating the Tool Box 1.Go to the Toolbox and click on New 2.Give the Tool a Name For easy understanding of the task for this specific tool – use names 3.Select a Tool category and then a Tool 4.Use help to get information about the tool

Robot Vision slide18 Using a Tool – step 1 GENERAL Show the name and type of tool. Comments can be entered in the description field SETUP For entering parameters controlling the tool

Robot Vision slide19 Using a Tool – step 2 VISUALISATION For adding graphics on the image, visualising the operation of the tool All or this tool only visualisation, can be selected RESULT Displaying all the results from the operation of the tool

Robot Vision slide20 Create a tool - Calibration 1.Click on the button “New” 2.Name the tool - Calibration 3.Select the tool category Advanced 4.Select “Calibrator” Use help if you want information about the tool 5.Click OK

Robot Vision slide21 Selecting the image for calibration Open the tool named Calibration (double click on it) and click on the Set- up tab Browse to find the calibration image in the “MyRobotVision/Referen ces” directory Select calib1.bmp image and open 1 2 3

Robot Vision slide22 Configure the Calibration tool Set number of rows and column – count from image Set row and column spacing to 8 mm, and the unit to mm (millimetre) Click on compute 12 3

Robot Vision slide23 Results from Calibration Scaling –Under the Result tab you will find the scaling factor –The scaling factor is only valid in the grid plane Lens correction –On the image the actual correction is visualised as yellow arrows –Lens correction is valid in any plan (not only in the grid plane)

Robot Vision slide24 Multi co-ordinate system Pixel co-ordinate system (red) –the default coordinate system –Scaling is in pixels Calibration co- ordinate system (blue) –Generated by the Calibration tool –Scaling is in mm X Y X Y

Robot Vision slide25 Cursor information on the image With the cursor you can now display the x and y values in both co- ordinate system 1.Position the mouse over the image and right click 2.Highlight “Referencesystem” 3.Select the co-ordinate system Centre hole co-ordinates: Pixel co-ordinates Calibration co-ordinates 1 2 3

Robot Vision slide26 Manual measurements on the image Position the mouse on the image and right click to get the menu (be sure that “Show info is activated first” 1.Select “Measure” 2.With the cursor you now can measure the distance from the default pixel co-ordinate origo and the angle of the line 1 2

Robot Vision slide27 To measure from an arbitrary point 1.To set a new origo position the mouse where you want the new origo (i.e. centre of mid hole) and right click on the mouse 2.Select “Set Origo” and the cursor display distance from the new origo 1 2

Robot Vision slide28 Saving and storing the configuration Saving configuration –Pressing Profile button –Every time you press the Start button –Every time you close the application Archiving –The archive file is a zip file containing all configuration and images –Used for storing your profile –Ideal for sending to a Scorpion support centre for remote support

Robot Vision slide29 Archiving a profile Enter to Service mode Press the Maintenance tab Check that the Archive directory is selected Press the Backup button Scorpion suggest a default name You can add comments before the zip file is generated

Robot Vision slide30 Trigger the camera Hardwire trigger –Direct on camera from sensor Soft trigger –External from PLC RS232, TCP/IP, I/O –Internal - used in this exercise Using Scheduler (pressing Start button) Manual user input (pressing Snapshot button)

Robot Vision slide31 Scheduler For setting up tasks running at scheduled intervals The task ”Trigger” is configured to grab an image every 1000 ms When ”Start” button is pressed a new image according to the Trigger period By pressing edit you can adjust the time interval

Robot Vision slide32 Start and Stop of Inspections Automatic inspection Pressing ”Start” button set Scorpion in Running mode For every new image an inspection is automatically executed The image can either be triggered from an external system or from an internal scheduler Pressing the ”Stop” button stop the process Manual inspection –Pressing ”Snapshot” button grab a new picture –Pressing ”Inspection” button execute the inspection –Pressing ”Snapshot” button again will grab another new picture.

Robot Vision slide33 Using a Blob to locate the object Add a new tool in the toolbox: –Name= FindObject –Tool = BlobTool

Robot Vision slide34 Tool references All tools can have a Reference To relate Search area to a specific point (i.e. Centre of Gravity of an area) To relate Search area to a specific co-ordinate system, Calibration in this exercise

Robot Vision slide35 ROI – Region of Interest Each tool can must be configure to search in a specific area on the image (Range of Interest – ROI) Move the mouse to the centre of the image and read the X and Y coordinates. Enter the co-ordinates and specify the delta X and delta Y values The ROI visualisation is shown on the picture

Robot Vision slide36 Understanding the Blob tool A blob search for areas in the specified ROI with greyscale values within a given range Place the mouse on the object and read the greyscale value If the maximum Threshold is set to higher value and the minimum to a lower, the Blob tool will find the object

Robot Vision slide37 Apply your configuration To apply a new parameter set by you, the button apply must be pushed You can also set minimum and/or maximum requirements to the blob area to be located

Robot Vision slide38 Blob visualisation Through the visualisation you can see how the tool works on the image Activate only CenterofGravity, MaxContour and ROI Remember to push ”Apply” to see the result!

Robot Vision slide39 Blob result In the result tab you find the different results of the blob tool –Number of blobs (1) –total blob area (2) –centre of gravity of the largest blob, blob[0] (3) –Number of ”Holes” in blob[0](4) –If there is more than 1 blob you will find values for blob[1-n] also

Robot Vision slide40 Holes in a Blob A Hole is an area inside a blob with greyscale values outside the max and min values set in the blob tool

Robot Vision slide41 Picking location In this application the pick-up position is the centre of the object This is equal to the centre of gravity co- ordinates found for the blob

Robot Vision slide42 Strategies to find a picking location Geometrical characteristic of the object is used to find the correct picking localisation. In this example the centre of gravity was the correct picking location. However other localisations might very well be used as well. Below are some examples 1.Mid point short edge 2.One corner of the long edge 3.Centre point of the small hole on the short edge

Robot Vision slide43 Co-ordinate systems The picking point is the centre of gravity of the blob. However the x,y co- ordinates we found in the blob is according to the “Calibration” co-ordinate system (Blue) used as the reference in the blob tool We now need to recalibrate according to the Robot Calibration system

Robot Vision slide44 4 point calibration steps 1.By moving the robot to the centre of each point the robot co-ordinates are found 2.In Scorpion the centre of each point is found in the Scorpion reference system 3.By using the “ExternalReference” tool Scorpion can calibrate the image in robot co-ordinates

Robot Vision slide45 4 point Robot calibration First we need to find the four points and their centre of gravity in the robot calibration grid Add a new tool in the toolbox: –Name= FindRefPoints –Tool = BlobTool

Robot Vision slide46 Find Ref Point image The image of the 4 point calibration grid is located in the directory MyRobotVision/References Follow the steps (1 – 5) and push the Snapshot button (6) until you get the right image

Robot Vision slide47 Configure FindRefPoints tool Follow the steps to set reference to “Calibration” (1), the correct search area (2) and threshold levels (3). To eliminate disturbing blobs from the text “5cm” activate Smallest area =

Robot Vision slide48 RefPoints co-ordinates In the Result tab you find the centre of gravity x,y co- ordinates Use the cursor in the image to check that you write the correct x and y values for point 1 – X Y Point 1Point 2 Point 3Point 4

Robot Vision slide49 Robot co-ordinate system By moving the robot to the four points you get the equivalent robot co-ordinates 1234 X 0050 Y 0 0 Point 1Point 2 Point 3Point 4 Origo

Robot Vision slide50 External Reference tool Next we need to co- ordinate the image and robot co-ordinate systems Add a new tool in the toolbox: –Name= ExternalRefSystem –Tool = ExternalReference

Robot Vision slide51 Configure ExternalRefSystem tool Select Calibration as a reference (1) Fill inn the local co- ordinates for all 4 points (2) Fill in the external coordinates for all 4 points (3) 1 23

Robot Vision slide52 The different Reference system In the image you now have 3 different co- ordinate systems 1.The original Pixel systems (green) 2.The Calibration co- ordinate system (blue) 3.The Robot co-ordinate system (red)

Robot Vision slide53 Deactivate/active a tool The Blob tool “FindRefPoints” is only used to find the centres of each point during robot calibration During normal operation this tool has no task and should be deactivated (1) or deleted Highlight the tool “FindRefPOints” and click the button “Deactivate”

Robot Vision slide54 Changes back to normal images To continuo we need to change back to the original images found in the directory: MyRobotVision/Images Follow the steps (1 – 5) and push the Snapshot button (6) to check that you get the right image

Robot Vision slide55 Changing reference to the FindObject Tool To be able to find the centre of gravity x and y values we need to change the reference of the “FindObject” blob tool to the new “ExternalRefSystem” Open the tool named “FindObject” select Setup tab and push the button (1) Here you find the available references, but ExternalRefSystem is not THERE 1

Robot Vision slide56 Understanding the tool sequence All tools are executed in a sequence starting from the top of the toolbox Only results from tool being executed before can be used Therefore results from ExternalRefSystem cannot be accessed by “FindObject

Robot Vision slide57 Editing the tool sequence By highlighting the tool and then using the Up and Down buttons, any tool can be moved Move the FindRefPoints to number 2 and ExternalRefSystem to number 3.

Robot Vision slide58 Changing the reference to Robot co-ordinates Now you can change the reference of the “FindObject” blob tool to the new “ExternalRefSystem” Open the tool named “FindObject” select Setup tab and push the button (1) Select the ExternalRefSystem 1

Robot Vision slide59 Adjusting the search area according to the new reference system Since the reference system is changed, the parameter values must be changed to give the correct search area

Robot Vision slide60 Scorpion logical conditions In an industrial application a number of situations may occur In Scorpion you can define a set of conditions that will help you to handle the different situations during robot picking or inspection The worst scenario is that a situation occur and neither the vision system nor the robot knows how to handle it Then the system will fail and the process stop

Robot Vision slide61 Potential logical conditions in Robot Vision OK –Object present –Can measure rotation No Object –Object NOT present Cannot measure rotation –Object present –Cannot measure rotation (missing the outer hole used to define rotation)

Robot Vision slide62 Understanding Logical Tool In a Logical tool any results in all prior tools can be tested against max and min conditions Typical applications are: –Establish OK and Fail conditions –Testing measurements against tolerances –Verify presence of object –Validate type of object –Validate functionality of a tool

Robot Vision slide63 Object Present For testing whether an object is present we could choose different parameter 1.Number of blobs (could be sensitive to dirt and small particles that may be identified as blobs) 2.Size of Blob area – a known parameter for the specified product 3.We will use Blob area

Robot Vision slide64 Object Present logical condition Add a new tool (1), name it ObjectPresent (2) and select the LogicTool (3) Open it and select the measured value from the tool FindObject (4) and the parameter blob area[0] (5) and set the minimum conditions to 500 Normal value for the blob area is around

Robot Vision slide65 Checking the ObjectPresent tool Select the result panel and go through all images and check that the result is correct Object present should give Value = 1 Object absent should give Value = 0

Robot Vision slide66 Controlling the orientation The task is to establish a new reference system that will give the rotation/angle relative to the external robot co-ordinate system (red) By finding the centre point of the outer big hole a reference line can be designed and using the centre of gravity of the blob as origo we can generate the new reference system (blue) Y X Y X

Robot Vision slide67 Find the outer big hole Add a new tool, name it “FindHole” and select the Blob2 tool Open the tool and select FindObject as the reference and “Apply” When FindObject is used as reference, the Centre of Gravity of the object represent centre X = 0 and Y = 0 wherever the object is located on the image

Robot Vision slide68 Multi Polygon and Multi ROI’s Multi polygon ROI –An ROI constructed from arbitrary points –The ROI is constructed by clicking the mouse while the “Ctrl” button is pressed on the points defining the ROI Multi ROI’s –One tool can operate in several ROI’s ROI-1 ROI-2 Mouse clicking points Point co-ordinates defining the ROI

Robot Vision slide69 Difference ROI in Blob2 Using two ROI’s where ROI-2 is a segment inside ROI-1, the difference area will be the final ROI for the tool The red circle is ROI-1 The blue circle is the ROI-2 The search are is the difference, the grey area, and we can locate the the white outer hole

Robot Vision slide70 Define ROI-1 1.Select “Add polygon” tab 2.Select “Circle” polygon 3.Enter 0 for centre X and Y 4.Enter Radius 16 (mm). You can use the cursor to find the correct radius to use 5.Set Minimum threshold to 100 and maximum to 256 since we are looking for white holes 6.Click on “Add” 7.Click on “Apply” and the ROI is active

Robot Vision slide71 Editing multiple ROI’s Select the tab “Polygon” and you have an overview of the ROI’s Number 1 is a default ROI and number 2 is the polygon you added You can highlight the individual ROI’s by selecting “Highlight selection” To delete the default ROI highlight 1 and click on the “Delete” button Finally click on “Apply” 1 2 3

Robot Vision slide72 Constraints In many tools you can set a number of constraints to eliminate unwanted results In this case you may detect small blobs that have no interest They can be eliminated by setting constraints for the blob area Setting smallest blob area to 10 will eliminate these blobs

Robot Vision slide73 Define ROI-2 Define the ROI-2 with the following parameters –Centre X and Y = 0 –Radius = 10 Add the polygon and then Apply You now have to polygons and you see the two circles visualised in the image

Robot Vision slide74 FindHole results 1.Click on “Visualisation this only” to remove visualisation from the other tools 2.Select the “Result” tab and you will find all the results 3.Number of Blobs 4.Centre of Gravity

Robot Vision slide75 The Guard function Used to activate tools only for a specific condition Typical applications: –Selecting a set of tools tailored to a specific product (used when Scorpion is set to handle multiple products) –To prevent tools from giving false results when the condition is not fulfilled

Robot Vision slide76 Configure the Guard function When the condition ObjectPresent is False (no object in the image), the FindHole tool have no meaning and should be guarded 1.Select the General tab 2.Click to the list of possible guard functions 3.Select “ObjectPresent” 1 2 3

Robot Vision slide77 In the Status column or in the Result tab you can see the status of the tool –Status = 1 - tool is OK –Status = 3 - there is an error in the tool –Tool is blocked by guard or reference –Tool is deactivated –Tool is not run –When tool is either blocked, deactivated or not run the Status in the result tab = 0 Status for tools Run through all images and see how status changes when there is no object

Robot Vision slide78 Toolbox overview In the toolbox overview you will find the following columns with info –1 = Status –2 = Processing time for the tool –3 = The name you gave the tool –4 = The type of tool –5 = Image number reference –6 = The reference used by the tool –7 = The guarding tool Hint: to see all columns you may have to adjust the column widths

Robot Vision slide79 Understanding Geometry tools The Geometry tools are used to create new points and lines based on results from previous tools Typical applications: –To construct geometrical structures without image processing techniques –Do measurements Distances between lines and points Length and angle of lines

Robot Vision slide80 Make the reference line Add a new tool named “ReferenceLine” and select the tool “LineFromPoints” Guard with “ObjectPresent” condition Use ExternalRefSystem (Robot co-ordinates) as reference and select centre of gravity of the object as point 1 and centre of gravity of the outer hole as point

Robot Vision slide81 Reference Line check Scorpion visualise a line between the two points and a direction (from point 1 to point 2) In the result tab you will find results as length and angle If one of the points are missing the tool will have an error (status = 3)

Robot Vision slide82 Configure the ReferenceLineOK logic tool We can use a logical tool to establish a condition validating the ReferenceLine The procedure is: –Name: “ReferenceLineOK” –Tool: Logical tool –Guard: “ObjectPresent” –Add new logical parameter –Select Tool: ReferenceLine –Parameter: Status –Min and Max condition = 1 Check the result

Robot Vision slide83 Create the local co-ordinate system Based on the Reference Line and Centre of Gravity of the object we can create e new co- ordinate system. –Name: RotationRefSystem –Tool: PointLine Reference –Guard: ReferenceLineOK

Robot Vision slide84 Define the co-ordinates Select “ExternalRefSystem” to link this co-ordinate system to the robot system Select Centre of Gravity as the origo point Select ReferenceLine as the Line and the co- ordinate system will follow the rotation of the object

Robot Vision slide85 Scorpion co-ordinate systems We now have 4 co-ordinate systems 1.The Pixel system (green) 2.The Calibration system (blue) 3.The Robot system (ExtrenalRefSystem) (red) 4.The Rotation system (light blue) –With the cursor you can toggle between the systems

Robot Vision slide86 OK condition - Object Present Double click on the existing OK state Now you can enter a name, description and select the colour for display in the result panel

Robot Vision slide87 Defining the OK (Present) condition Click on ”Constrains” and ”New” The box shows a list of all available logical classifications in the Toolbox Select ”ObjectPresent” The OK condition is now true when the logical classification ”ObjectPresent” is true (=1)

Robot Vision slide88 Including ReferenceLineOK The OK condition is also dependent of that correct angle can be measures Correct angle can only be measured when the logical statement “ReferenceLineOK” is true Add “ReferenceLineOK” using the same procedure as for “ObjectPresent”

Robot Vision slide89 Testing the OK condition Run through all pictures and check the result of the condition (true or false) and the display on the result panel When no object and the object missing a hole occur, the result panel display ”Undefined Condition” since no condition for No Object and No Reference line is yet defined

Robot Vision slide90 Adding a NoObject Condition Click on ”New” for adding a new condition Name it ”No Object” Select Yellow as background colour (when this condition is true the result panel will be yellow) 1 2 3

Robot Vision slide91 Configuring the No Object condition To define the No Object condition we can use ObjectPresent Logical classification Click on ”New” and select ”ObjectPresent” To make the No Object condition true when the logical classification ObjectPresent is false, we invert the statement by pushing the invert button

Robot Vision slide92 Testing No Object State Run through the pictures and check: –the result of the both conditions (true or false) –The colour and text in the result panel

Robot Vision slide93 Adding Cannot Measure Rotation logic condition Add a new state –Name it “Cannot Measure Rotation” –Select background colour “Red”

Robot Vision slide94 Configure Cannot Measure Rotation The constrains needed are: –Object present –ReferenceLineOK “ReferenceLineOK” must be inverted to give the result true (=1 in the result) when the line is failing

Robot Vision slide95 Testing the logic conditions Run through all images and check that all logical conditions are working correctly

Robot Vision slide96 Displaying measurement values Any results from any tool can be displayed in the result panel We want to display the inner and outer radius Position the mouse inside the result panel and right click, select ”General”, ”No of measumentvalues” and enter 3 for 3 values Check the result panel

Robot Vision slide97 Selecting parameters to be displayed Position the mouse over Tagvalue 1 and right click, select Measured Values, Parameter. In the new dialog box click the ”..” button. In the new dialog box you can select the tool and the parameter you want Select the tool ReferenceSystem and the parameter Origo_x

Robot Vision slide98 Add name and unit to the value Position the mouse over Tag Value 2, right click, select Measured Values and Caption. Enter the name ”X value:” Through the same procedure you can add unit (mm) and change the number of decimals Repeat the procedure for displaying the outer radius as Tag Value 2 and name it ”Y value” 1 2

Robot Vision slide99 Adding angle value Finnaly select Tagvalue 3 and name it “Angle” In the tool RotationRefSystem you will find the parameter Angle Since the reference to this tool is the robot system (ExternalRefSystem) this value is relative to the robot co-ordinate system

Robot Vision slide100 Check all conditions

Robot Vision slide101 Sending data to a Robot or PLC We want to send status data (OK, No Object and Cannot Measure Rotation) using the RS232 interface When the status is OK we want to send the data x, y and angle We will link the timing of sending the data to the event ”Inspection” Initially the event inspection activate the command ”Inspect” (running the tools) After that we want the system to send status data

Robot Vision slide102 Adding a RS232 command In command sequence for Inspection click on ”New” Select ”RS232Cmd” Name the command ”SendStatus”

Robot Vision slide103 The command protocol Syntax %dparameter –%d = format instruction for the result value (Integer number format) –Parameter = The parameter name from any of the tools in the toolbox To find the parameter description of the result push the ”Parameters” button on the top toolbar Select ObjectPresent and Value and click on the copy button

Robot Vision slide104 Writing the command protocol Open the SendStatus command In the Parameter field write the following –Status=%d Place the cursor after the d and paste (right click the mouse) Status=%dObjectPresent. Value

Robot Vision slide105 Adding Cannot Measure Rotation We can make a 2 bit code where the first bit is Object Present and second Cannot Measure Rotation Copy the parameter Value from “ReferenceLineOK” tool The parameters must be separated by a comma Add %d to format the number Paste the parameter

Robot Vision slide106 Testing the communication Mark the SendStatus command Push the Execute button – Now the command is run once In ”Communication” select RS232 - here the out messages are logged Check that the correct status value is sent

Robot Vision slide107 Testing the Scorpion Profile Activate automatic inspection (push Start) and check that the status value sent over RS232 is correct for each inspection

Robot Vision slide108 New command for sending data When the logical condition is OK x, y and angle values should be sent also over RS232 Add a new command after SendStatus –Name: SendData –Command: RS232 –Guard: ReferenceLineOK

Robot Vision slide109 Configure the parameters %f for floating point number format Tool: RotationRefSystem Parameters –Origo.x –Origo.y –Angle Remember to format each parameter and to separate them with a comma

Robot Vision slide110 Testing the communication Mark the SendData command Push the Execute button – Now the command is run once In ”Communication” select RS232 - here the out messages are logged Check that the correct data values are sent

Robot Vision slide111 End of Robot Vision exercise Congratulations! You have made your first Robot Vision system using Scorpion Vision Software