1. Controlling of robot using voice
CAPSTONE PROJECT
Controlling of robot using voice
Authors:
Hồ Công Anh
Nguyễn Tuấn Anh
Đỗ Đắc Hải
Huỳnh Học
Phan Thành Hưng
Supervisor:
Hoàng Xuân Sơn
Summer2015

2. Content 1 2 3 4 5 6 Introduction Project Management Plan
System Requirement 3
Implement and Testing 4
Demo 5
Future 6

3. 1. INTRODUCTION
Idea

4. 1. INTRODUCTION Scope Robot can listen and recognize human voice
control remotely by a smartphone
Following features need to be implemented to build the robot.
Chassis to mount robot component
Motors and wheel to help movement robot.
Using IC HM2007 Controller board to handle communication with other devices.
Using Radio frequency communications.
Using Bluetooth communication

5. 2. MANAGEMENT PLAN Contents Project process model.
Role and Responsibilities.
Infrastructure and Tools.
Work breakdown structure (Time plan).

6. Iterative and incremental development process model
2. MANAGEMENT PLAN
Process model
Iterative and incremental development process model

7. Role and responsibility
2. MANAGEMENT PLAN
Role and responsibility

8. Infrastructure and tools
2. MANAGEMENT PLAN
Infrastructure and tools

9. Infrastructure and tools
2. MANAGEMENT PLAN
Infrastructure and tools

10. 2. MANAGEMENT PLAN
Time Plan

11. 3. SYSTEM REQUIREMENT Contents Functional Requirement
Non Functional Requirement

12. 3. SYSTEM REQUIREMENT
Function requirement

13. Non-Function requirement
3. SYSTEM REQUIREMENT
Non-Function requirement

14. 4. IMPLEMENTATION AND TESTING
Contents
System Architecture
Voice Recognition
Transceiver
Movement
Android
Testing

15. 4. IMPLEMENTATION AND TESTING
System architecture
Voice kit controller

16. 4. IMPLEMENTATION AND TESTING
System architecture
Android controller

17. 4. IMPLEMENTATION AND TESTING
Voice recognition
Speaker Dependent : Recognition only for specific users
Example: IC HM2007
Speaker Independent : Recognition for all users.
Example: Google, Siri Apple, Microsoft....

18. 4. IMPLEMENTATION AND TESTING
Voice recognition
IC hm2007

19. 4. IMPLEMENTATION AND TESTING
Voice recognition
IC HM2007 features
Algorithm: Artificial Neural Network- ANN
Single chip voice recognition CMOS LSI.
External 64k SRAM
Maximum 40 words
Maximum 1.92 sec
Power supply: 5V
Two control mode: Manual mode and CPU mode.

20. 4. IMPLEMENTATION AND TESTING
Voice recognition
IC HM2007 pins
Waiting control input.
Wait = “L” : Do not accept voice input
Wait = “H” : Accept voice input

21. 4. IMPLEMENTATION AND TESTING
Voice recognition
IC HM2007 pins
Work in manual mode
Step 1: When Wait = “H”, RDY set to “L” : HM2007 is ready to accept the voice input
Step 2 : RDY return to “H” : HM2007 begins its recognition process.

22. 4. IMPLEMENTATION AND TESTING
Voice recognition
IC HM2007 pins
Word length select
WLEN = “H” :
Word length = 1.92 sec.
20 words maximum
WLEN = “L” :
Word length = 0.92 sec.
40 words maximum

23. 4. IMPLEMENTATION AND TESTING
Voice recognition
IC HM2007 pins
Microphone connect pin.
Connected : Capacitor and Resistor.
Low pass filter

24. 4. IMPLEMENTATION AND TESTING
Voice recognition
Schematic

25. 4. IMPLEMENTATION AND TESTING
Voice recognition
IC HM2007 circuit

26. 4. IMPLEMENTATION AND TESTING
Transceiver
Arduino Uno

27. 4. IMPLEMENTATION AND TESTING
Transceiver
Arduino Uno
Circuit Board microcontroller use AVR ATmega328.
14 digital pins and 6 analog pins
Powerful applications.
Power supply: 5V.
Rich library system
Data rate: 16 MHz

28. 4. IMPLEMENTATION AND TESTING
Transceiver
nRF24L01

29. 4. IMPLEMENTATION AND TESTING
Transceiver
nRF24L01
Work in 2.4GHZ.
126 channel.
Data rate 1Mbps or 2Mbps.
Power supply: 1.9 – 3.6V.
4 pin SPI

30. 4. IMPLEMENTATION AND TESTING
Transceiver
Arduino Mega

31. 4. IMPLEMENTATION AND TESTING
Transceiver
Arduino Mega
Circuit Board microcontroller use AVR ATmega2560.
54 pins digital
Powerful applications.
Power supply: 5V.
Rich library system
Data rate: 16 MHz

32. 4. IMPLEMENTATION AND TESTING
Movement
Diagram assembly

33. 4. IMPLEMENTATION AND TESTING
Movement
Module L2596s
Input voltage: 3 to 40VDC
Output voltage: 1.5 to 35VDC
Maximum current = 3A
Efficiency: ~ 92%

34. 4. IMPLEMENTATION AND TESTING
Movement
L298
Have 14 pins
L298 driver IC can drive two DC
motors or one stepper motor 4 phases.
Heat-resistant radiator assembled to IC, which helps IC control 2A power circuit

35. 4. IMPLEMENTATION AND TESTING
Movement
Motor
Operating voltage: with 3V to 9V DC (recommended operating voltage of about 6 to 8V) 
Maximum torque: 800gf cm min (at 3V)
No-load speed: 120rpm (3V)  and  200rpm (5V)
Load current: 70mA (250mA MAX) (3V pm)

36. 4. IMPLEMENTATION AND TESTING
Android App
Connect Module Bluetooth with Arduino
Workflow diagram of Arduino
Software Design

37. 4. IMPLEMENTATION AND TESTING
Android App
Connect Module Bluetooth with Arduino

38. 4. IMPLEMENTATION AND TESTING
Android App
Workflow diagram

39. 4. IMPLEMENTATION AND TESTING
Android App
Software Design

40. 4. IMPLEMENTATION AND TESTING
Test Plan
Execute Test
Report

41. 4. IMPLEMENTATION AND TESTING
Test Plan

42. 4. IMPLEMENTATION AND TESTING
Execute test
Controlling of robot using voice.
Controlling of robot using Android application.

43. Controlling of robot using voice
4. IMPLEMENTATION AND TESTING
Testing
Execute test
Controlling of robot using voice
Unit Test:
+ Motor
+ nRF24L01
+ KIT HM2007
Integration test
+ Robot
System test
+ Control Robot

44. Controlling of robot using ANDROID Application.
4. IMPLEMENTATION AND TESTING
Testing
Execute test
Controlling of robot using ANDROID Application.
Unit Test:
+ Main screen
+ Request permission dialog screen
+ Auto pairing
+ Send change speed robot
+ Send control robot
- System test
+ Control Robot

45. 4. IMPLEMENTATION AND TESTING
Report
All function are checked successfully.
Control robot successfully.
Have some test case fail (sound wave interference, noise…).

46. 5. DEMO
Now… It’s time for demo

47. 6. DEMO Film support. Apply for smart home.
Support for disabled people.
Apply for FPT canteen.
Apply for digital solution