1. ANTI Roland Anderson - CpE Patrick Galloway - CpE Casey Miville - EE Automatic Note Taker for the Impaired Group 29

2. Motivation Replace paid student note takers – Hired students take insufficient notes – Lower costs for Student Services Record presentations – Replay at a later date for review 2

3. Specifications Portable Robotic – Facial tracking – Point microphone at presenter 3

4. Objectives Phase I – Speech to Text on laptop – Take notes in written digital form (.txt) Phase II – Static scene shot with captions 4

5. Phase II 5 Speech output to.txt file Phase I

6. Design 6 BeagleBone Black BeagleBone Black Laptop Voltage Regulator Webcam Microphone Power Adapter Pan Servo Pan Servo Tilt Servo Tilt Servo Power Adapter

7. Data 7 BeagleBone Black BeagleBone Black Laptop Voltage Regulator Webcam Microphone Power Adapter Pan Servo Pan Servo Tilt Servo Tilt Servo Power Adapter

8. Data - Microphone “Shotgun” Microphone – Sensitive – Directional pickup – Light and inexpensive Audio-Technica ATR6550: 8

9. Data - Webcam USB Webcam – Inexpensive – Easy use – USB power and communication 9 Logitech B910 HD Webcam:

10. Power 10 BeagleBone Black BeagleBone Black Laptop Voltage Regulator Webcam Microphone Power Adapter Pan Servo Pan Servo Tilt Servo Tilt Servo Power Adapter

11. Power - Adapters Power Adapters – 2x 5V 2A switching power adapter – 2.1 x 5.5mm Barrel Jack 11 BeagleBone Black BeagleBone Black Voltage Regulator Power Adapter

12. Power – Voltage Regulation 5V Step Up/Down – Supply for motors – Signal ground for PWM 12 Voltage Regulator Pan Servo Pan Servo Tilt Servo Tilt Servo

13. Motion 13 BeagleBone Black BeagleBone Black Laptop Voltage Regulator Webcam Microphone Power Adapter Pan Servo Pan Servo Tilt Servo Tilt Servo Power Adapter

14. Motion Pan Assembly – DDP155H Small footprint Houses cables and voltage regulator 14

15. Motion Tilt Assembly – DDT500H 2x Servos – Hitec HS-322HD 15

16. Control 16 BeagleBone Black BeagleBone Black Laptop Voltage Regulator Webcam Microphone Power Adapter Pan Servo Pan Servo Tilt Servo Tilt Servo Power Adapter

17. Control – BeagleBone Black BeagleBone Black – AM3359 – ARM Cortex 8 – 1 GHz clock rate – PWM to Servo Motors 17

18. Software – On-Board OpenCV – Facial recognition algorithms Haar Cascades C++ Run from SSH 18

19. Software – On-Board Facial Tracking – Identify individual – Track that individual – Output – Coordinate of face centroid to Motor Control class 19

20. Software – On-Board Motor Control – Determine if face is centered – Convert pixel coordinates to degree shift – Set servo positions 20

21. Control 21 BeagleBone Black BeagleBone Black Laptop Voltage Regulator Webcam Microphone Power Adapter Pan Servo Pan Servo Tilt Servo Tilt Servo Power Adapter

22. Software – On-System Microsoft Speech Recognition API C# Save to file – Audio/Video – Text 22

23. Software – On-System Features – Selectable inputs Video – Webcam Audio – Microphone – Output file location/name 23

24. Software – On-System Features – Large buttons Only show when available – Time stamped output file names Video Audio 24

25. Software – On-System 25

26. Administrative - Budget 26

27. Administrative - Progress 27

28. Improvements Partnerships – Dragon Speech Recognition SDK – Google Speech API – AT&T Watson API Dedicated video processor – Process each frame at 15 FPS – Fluid movement Microphone – Increase quality More expensive 28

29. Q&A 29 BeagleBone Black BeagleBone Black Laptop Voltage Regulator Webcam Microphone Power Adapter Pan Servo Pan Servo Tilt Servo Tilt Servo Power Adapter