1. A BRIEF INTRO TO: COBOTS, LSM AND A.I. APIs

2. HELLO! I am Ricardo de Azambuja, Eng, MSc
Today I will show you a little bit about our work using robots and artificial intelligence
You can find me at github.com/ricardodeazambuja

3. By the end of this lecture...

4. By the end of this lecture...
… you should be able to:
Understand what is a cobot and LSM (SNN)
Identify BAXTER's main components
Understand how MS Cognitive Service APIs work
Smile, since it is supposed to be fun too
LSM: Liquid State Machine
SNN: Spiking Neural Network
BAXTER: cobot from Rethink Robotics, Inc

5. PART I:
COBOTS & LSM

6. A cobot or co-robot (from collaborative robot) is a robot intended to physically interact with humans in a shared workspace.
Before we start, I need to give you at least this definition / explanation

7. A Liquid State Machine (LSM) is a special type of Spiking Neural Network (SNN) Reservoir Computing (RC). Time series can be processed, using only a simple linear combination at the output.
Before we start, I need to give you at least this definition / explanation

8. 1
MOTIVATION (1)
Or why do we need cobots

9. Make a joke: "be prepared, strong scenes where dummies get really hurt

10. What I have been doing with cobots1
MOTIVATION (2)
What I have been doing with cobots

11. BAXTER Controlled by LSM
LSM: Liquid State Machine
BAXTER: co-bot manufactured by Rethink Robotics, Inc.
Instead of programming, you teach the LSM
Explain this is part of my PhD in Robotics / AI

13. BAXTER Using its sense of sight
OpenCV: special library for computer vision
Robot detects things according to colour
Tell them Davi was a MSc student from Brazil and we worked together to create this demonstration using BAXTER and OpenCV

14. Point to the fact the robot has NO safety fences, cages, etc and the user CAN interact.
Explain OpenCV uses HUE colour values to create a mask, etc to finally find the ball's position

15. VERY
IMPORTANT

16. NEVER ENTER THE ROBOT'S WORKSPACE
Unless you know the robot is turned OFF or it is a SAFE cobot

17. EXAMPLES OF COBOTS

18. BAXTER Rethink Robotics, Inc (USA)
Photo credits:

19. UR Series Universal Robots (Denmark), the most successful cobot
Photo credits:

20. LBR iiwa KUKA (Germany), high accuracy - high price Photo credits:

21. Justin DLR (Germany) Photo credits:

22. GummiArm Plymouth University (UK), our local development!
Photo credits:

23. BAXTER ROS based (research version)
Two arms (7 DOF each), accuracy +/- 5mm.
Three cameras (head and one each cuff).
Torque/force sensors, IR range sensors, Accelerometers, Sonar sensors (head ring).
Remember: they must learn about BAXTER's main components and to you are supposed to program it (demonstration)
Talk about SEA's (safer by design), screen (face) and buttons (programming by demonstration)
ROS: Robot Operating System
Photo credits:

24. BAXTER Control Modes Position Control mode (safest)
Raw Position Control mode
Velocity Control mode
Torque Control mode (only mechanical springs)
Best place to learn is
DOF : Degrees-of-freedom

25. BAXTER Position Control Mode
Show them this mode has several safety mechanisms:
All joints arrive together, max speed, collision avoidance (robot hits itself) and detection (impact)
Image credits:

26. BAXTER Raw Position Control Mode
Image credits:

27. BAXTER Velocity Control Mode
Image credits:

28. BAXTER Torque Control Mode
This mode only protects the motors (max torque) and keeps gravity compensation
No safety mechanisms, but the mechanical design (springy)
Image credits:

29. BAXTER simulating it
Gazebo (sdk.rethinkrobotics.com/wiki/Baxter_Simulator)
V-REP (
Best place to learn more about BAXTER is
DOF : Degrees-of-freedom

30. ARTIFICIAL INTELLIGENCE API'S
PART II:
ARTIFICIAL INTELLIGENCE API'S
… AND HOPEFULLY SOME FUN WITH A GAME!

31. EXAMPLES OF AI API'S:
IBM Watson
Google Cloud ML
MS Cognitive Services
Amazon Alexa
BigML

32. EXAMPLES OF AI API'S:
IBM Watson
Google Cloud ML
MS Cognitive Services
Amazon Alexa
BigML

33. Register and get your key first!
REST API
Register and get your key first!
Acquire data
Send
Receive results
Explain there's no need for a continuous connection. It's HTTP: get / put / post ...

34. REST API Perfect for low power systems… IoT Image credits:

35. LET'S TRY IT ONLINE https://www.microsoft.com/cognitive-services
Use facetime

36. PYTHON CODE IMPLEMENTATION
github.com/ricardodeazambuja/MSCogServ-Bing-Speech-API

37. GAME TIME! github.com/ricardodeazambuja/Simon-Says-Game---Emotions-API

38. THANKS!
Any questions?
You can find me at github.com/ricardodeazambuja &

39. CREDITS Presentation template by SlidesCarnival
BAXTER control modes diagrams: sdk.rethinkrobotics.com