1. Speech Recognition Robot
Lab Book
Beti Lula John

2. Speech Recognition Robot
Problem and Mission
Civilization’s Great Steps Forward:
Fire
The Wheel
The Printing Press
The Steam Engine
The Transistor
Google
???
                                                                        

3. Speech Recognition Robot
Problem and Mission
Robots Will Rule!!!
However to make this next great leap forward, we need to make the interface between humans and machines more natural.

4. Speech Recognition Robot
Project Plan
Goal:
Design, build and present a speech recognition robot that is worthy of media attention.
It must work.
It must be engaging.
Deliverables:
Power Point Lab book
Working robot
Presentation

5. Speech Recognition Robot
Project Plan
Tasks:
Research
Identify problem
Specify solution functionality
Build
Test and modify
Manage and document
Market and present

6. Speech Recognition Robot
Teamwork
Assign specific tasks to focused specialists:
Marketing Engineering Programming
Market Demand - Technologies - Technologies
Competition - Inputs / Outputs - Inputs / Outputs
Sales Pitch - Specifications - Specifications
Project Mgm’t - Build - Program
Present - Test & Refine - Test & Refine

7. Speech Recognition Robot
Performance
Attendance - Are you present?
Professionalism - Are you respectful of your lab and your teammates?
Teamwork - Did you help your teammates or participate in discussions?
Initiative - Did you do something more than was expected?
Results - Did you get a result?
Yes = No = 0

8. Speech Recognition Robot
Project Management – 4 Phases
1) Discovery
Research applications
Research technology
2) Design
Specify a talking robot
3) Development
Build a talking robot
4) Deployment
Document project
Present project

9. Speech Recognition Robot
Speech Recognition Applications
Document useful applications of speech recognition robots.
1) Aviation
2) Healthcare
3) Administration
4) Personal computers
5) Production
6) ???

10. Speech Recognition Robot
Robots … What are they good for?
Document what robots do better than humans.
Document what humans do better than robots.

11. Speech Recognition Robot
Problem and Mission
Document a problem that could be solved by a speech recognition robot.
Document the mission. (What must our speech recognition robot do to solve the problem?)

12. Speech Recognition Robot
Problem Solving Techniques
Identify the problem and focus.
Build on the ideas of others.
Break the solution into simple parts.
Work with teammates.
Document.

13. Speech Recognition Robot
Measures of Success
Does it work 9 times out of 10?
Is it unique?
Will it attract media attention?

14. Speech Recognition Robot
Program Primitives
Series vs. Parallel
Iteration
Conditional
Variables
Messaging

15. Speech Recognition Robot
Strategies for recognizing speech
What are 3 attributes of speech that can be detected and interpreted?

16. Speech Recognition Robot
Program Flow Chart to Detect Syllables
start
Start
Wait for
syllable
Wait
Display
1 syllable No
2nd syllable
detected ?
Yes
Display
2 syllables

17. Speech Recognition Robot
Program Flow Chart to Detect Syllables
Wait for
syllable
start
Start No
Volume
high ?
Yes No
Volume
low ?
Yes
End

18. Speech Recognition Robot
Tasks
Marketing:
Develop an elevator pitch for your robot.  Research what an elevator pitch is.
Design a one page advertisement for your robot.
Design signs that explain how your robot works.
Build expressive eyes, mouth, arms, and body.
Write and record the script you want your robot to lead 
(man - machine interaction) 
Engineering:
Build the structure.
Build a gear train that drives two shafts.
Build a mechanism that makes eyes, mouth and arms move. 
Programming:
Write a program to execute the script or man - machine interaction. 
Document everything in your lab books.

19. Speech Recognition Robot
Robot / Human Script
When visitor is detected, say:
Greetings! My name is ...
Welcome to Colegio Las Hayas.
While you are waiting, would you like to ...
Please answer, "Si" or "Huh, Huh" to my question.
If "Si" then say:
If "Huh, Huh" then say:

20. Speech Recognition Robot
Structure and components
Engineering:
This structure is good for mounting motion modules and sensors at different levels.
The vertical shaft could make arms move left and right.
Robot Structure:
Click on ‘Build-It-Blocks’
Select ‘Presenting Ideas’
Select ‘LEGO Tall Structure
Gear Train:
Select ‘Spin, Rotate, Twirl’
Select ‘Power Top Gear Train Mini” 

21. Speech Recognition Robot
Structure and components
Engineering:
The ‘Open ‘n Close’ module can drive many parts to move.
Robot Structure:
Click on ‘Build-It-Blocks’
Select ‘Shake, Dance, Flap’
Select ‘Open ‘n Close’

22. Speech Recognition Robot
Structure and components
Engineering:
The arms and the mouth move.

23. Speech Recognition Robot
Robots Made from Premium Quality Junk

24. Speech Recognition Robot
Program

25. Speech Recognition Robot
Program

26. Speech Recognition Robot
Program

27. Speech Recognition Robot
Program
Programming team:

28. Speech Recognition Robot
Robot Promo
Marketing team:
What can you say and show that will make
customers want to buy your robot?
1) Write and perform a song that your robot will sing.
2) Write and design an advertisement.
3) Design a Web page or a Facebook page for your robot.

29. Speech Recognition Robot
References
Example of project web site  
Introduction to talking robots at Tokyo University
Demo of MIT Kismet language vs expression
Demo of how engaging a talking robot can be.

30. Speech Recognition Robot
Project Summary
What you should know:
The problem and mission
3 deliverables
3 measures of success
4 project management phases
3 reasons for modular construction
5 problem solving techniques
5 program primitives
Effective use of Power Point, Google, Excel and collaboration tools
Reference Slides Follow

31. Speech Recognition Robot
Presentation Outline
Project Presentation
1) Introduce team members and explain the parts of the project that were most
interesting to you.
2) State the problem and mission (PPT Lab Book)
3) Describe the 4 phases of project planning and who did what. (PPT Lab Book)
- Discovery
- Design
- Development
- Deployment
4) Present your research (PPT Lab Book)
5) Present your robot.
6) Grade your work on 5 measures of performance.
Questions
1) Why is modular construction valuable?
2) Why is teamwork important?
3) What do humans do well and what to robots do well?
4) What are 5 computer programming structures?
5) Describe how your program works?

32. Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex problems.
How many people are on the World of Warcraft team?
How many people to develop an animated feature film?

33. Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex problems.
How many people are on the World of Warcraft team?
60 developers / 400 employees when launched in employees in 2009.
How many people to develop an animated feature film?
75 artists using hand made frames. 27 animators made Toy Story using computer tools.

34. Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex problems.
How many people worked for NASA when we landed on the moon?

35. Speech Recognition Robot
Teamwork
The importance of teamwork in solving complex problems.
How many people worked for NASA when we landed on the moon?
36,000 NASA employees when man landed on the moon

36. Speech Recognition Robot
Lab Book
Beti Lula John
Can’t read from a distance. Image does not relate to content

37. Average, boring, not engaging
Speech Recognition Robot
Lab Book
Beti
Lula
John
Average, boring, not engaging

38. Speech Recognition Robot
Lab Book
Beti Lula John
Direct, engaging