1. JC Bailey Rhodes University g11b3549@campus.ru.ac.za
Integrating real-time image processing into rapid prototype robotics
Supervised by:
James Connan
JC Bailey
Rhodes University

2. A brief reminder
Effectiveness of rapid-prototyping versus the use of bespoke systems.
Modularization of project elements into a working solution.
Creating a working PlotClock that will serve as a mechanical output.
Applying a secondary computer science field of knowledge to robotics.

3. Initial Project Proposal vs Now.
3 Specific Robots
Uses Arduino, LEGO NXT & Raspberry Pi
Rapid Construction
Originally set out to replicate the PlotClock
1 Modular Robot
Uses LEGO NXT & PC/Raspberry Pi
Rapid Development
Aiming to Improve the design to adapt to given material
Integrate image processing

4. Current Approach
Phase 1 :: Assess relevant literature and documentation.
Phase 2 :: Design, build and code working model.
Phase 3 :: Analyze results and refine solutions.
Phase 4 :: Implement improvements and complete robot.
Phase 5 :: Reformat code into modular design
Phase 6 :: Design Image processing system
Phase 7 :: Implement with robot and refine (if needed)
Phase 8 :: Test, record results and evaluate. ✔
.5✔

5. How the system currently runs
Desktop / Laptop
NXT Brick
Motor A
Motor B
Java Byte Code
JVM
Motor C
ARM Byte Code
Touch B
Touch C

6. Some Working Examples
Alpha Version.

7. Some Working Examples
Beta Version.
(Still a Work In Progress)

8. Proposed Final Version
Theta Version.
Using Beta version build.
Sends received commands from
Raspberry Pi 2 via USB or Bluetooth.
Connected to webcam.
Analyzes captured video in real time.
Reacts to environment.

9. Final Version RPi Webcam Motor A NXT Brick Py Real Time Motor B JVM
Python -> Java
Interface
JVM
Motor C
ARM Byte Code
Java Byte Code
Touch B
Touch C

10. Questions?