1. EcoCar User Interface Final Presentation Senior Design II November 27, 2012

2. Design Team Sam Knight Computer Engineer DBus Programming CAN Bus Programming Lukas Cox Electrical Engineer Dictionary Training Physical Interfacing Adam Johns Computer Engineer Alternatives Researching Recognition Programming Renz Santos Computer Engineer Recognition Programming Website Design Dr. Marshall Molen Advisor

3. Contents Problem and Solution System Overview Model Technical and Practical Constraints Refinements and Progress – Installation Package – Accuracy – Training & GUI Testing References

4. Problem and Solution

5. Problem The increasing technology in vehicles today unfortunately increases the amount of danger to drivers and passengers alike. “Driver distraction is a leading cause of crashes, although the exact figures are difficult to gauge because of the unreliability of the data” [1].

6. Solution EcoCar User Interface – Allows car’s infotainment center to be controlled by voice – Helps lower the amount of attention needed to run modules on car – Displays critical information relating to the vehicle

7. System Overview Microphone CAN Bus Computer Voice Recognition Control Overview, Radio, Media, GPS, Diagnostic Modules Projector

8. Model

9. Technical and Practical Constraints

10. Technical Constraints NameDescription AccuracyThe system must correctly identify spoken commands with 90% accuracy. Latency The EUI must acknowledge commands within 250ms. Compatibility The system must run on Freescale SABRE platform computer. Communication The EUI must communicate with CAN bus. Vocabulary The system must recognize 12 voice commands

11. Practical Constraints TypeNameDescription ManufacturabilitySize The EUI must fit below the passenger seat and not obstruct the driver. SustainabilityDurabilityThe system must be able to withstand the vibrations of normal driving conditions.

12. Manufacturability Fit below passenger seat Microphone < 4”x2”x2” Projector < 1” depth [2]

13. Sustainability No short term problems Works as long as hardware does not fail Withstand normal car vibrations

14. Refinements

15. Installation Package Available as download in DEB package Checks system for correct dependencies Automatically installs program Launch script checks Java version

20. Debian Package Control File Package: eui Version: 1.0 Section: contrib/misc Priority: optional Architecture: all Maintainer: Sam Knight Homepage:http://www.ece.msstate.edu/courses/design/2012/team_knight Depends: libunixsocket-java, libmatthew-java-doc Description: Ecocar User Interface Voice recognition infotainment system designed for Mississippi State University Ecocar

21. Accuracy Augment the audio recognition corpus Driver dependent voice library Simple training process

22. Enhancement Process Record a series of phrases from user in GUI Sync the audio to the command keywords Process into.mfc files Assimilate into existing corpus

23. GUI Trainer

24. GUI Trainer: Recording Stage

25. GUI Trainer: Process Control

26. GUI Trainer: Console Output

27. GUI Trainer: Generated File Structure

28. GUI Trainer: Relaunch EUI

29. Testing

30. Test Goals Reevaluate the improved accuracy EUI after training Reaffirm latency and memory statistics Test CAN Bus communication Seamless automatic install in any new version of EcoCar with installation package

31. Voice Recognition Test: Accuracy

32. “EcoCar” is the keyword that must be used in conjunction with each command Recognizes 14 spoken commands Tested 200 commands with and without training For this test the EUI’s average accuracy rose from 78% to 92%

33. Voice Recognition Test: Latency

34. Voice Recognition Test: Compatibility The EcoCar’s Freescale Sabre computer board has 1 GB of RAM EUI only uses a maximum of 180 MB [3]

35. Voice Recognition Test: Compatibility

36. Communication Test: DBus method call sender=:1.199 -> dest=org.EcoCar.Module.MasterModule serial=3 path=/org/EcoCar/Module/MasterModule; interface=org.EcoCar.DBus.Interfaces.EICMaster; member=ShowModule string "player" method call sender=:1.186 -> dest=org.EcoCar.Modules.Info serial=12 path=/org/EcoCar/Modules/Info; interface=org.EcoCar.DBus.Interfaces.EICClient; member=hide method call sender=:1.186 -> dest=org.EcoCar.Modules.Radio serial=13 path=/org/EcoCar/Modules/Radio; interface=org.EcoCar.DBus.Interfaces.EICClient; member=hide method call sender=:1.186 -> dest=org.EcoCar.Modules.MediaLibrary serial=14 path=/org/EcoCar/Modules/MediaLibrary; interface=org.EcoCar.DBus.Interfaces.EICClient; member=hide method call sender=:1.186 -> dest=org.EcoCar.Modules.Navigation serial=15 path=/org/EcoCar/Modules/Navigation; interface=org.EcoCar.DBus.Interfaces.EICClient; member=hide method call sender=:1.186 -> dest=org.EcoCar.Modules.Diagnostics serial=16 path=/org/EcoCar/Modules/Diagnostics; interface=org.EcoCar.DBus.Interfaces.EICClient; member=hide method return sender=:1.186 -> dest=:1.199 reply_serial=3 method call sender=:1.186 -> dest=org.EcoCar.Modules.MediaPlayer serial=18 path=/org/EcoCar/Modules/MediaPlayer; interface=org.EcoCar.DBus.Interfaces.EICClient; member=show method return sender=:1.188 -> dest=:1.186 reply_serial=15 method return sender=:1.191 -> dest=:1.186 reply_serial=12 method return sender=:1.192 -> dest=:1.186 reply_serial=13 method return sender=:1.190 -> dest=:1.186 reply_serial=16 method return sender=:1.194 -> dest=:1.186 reply_serial=14

37. Communication Test: CAN Bus EUI communicates with the car through the CAN Bus Battery temperature, battery life, battery depletion rate, instantaneous MPG, average MPG, engine-on distance, electric distance, and engine-on count

38. CAN Test: Send Msg Format: [message|"signal":"value"]

39. CAN Test: Receive Actual Msg: [MSU_GC_Efficiency|"InstMPG":"44"]

40. Installation Testing Tested in computer, virtual machine, and actual car Car required manual dependency satisfaction Tweaks to processing scripts

41. Bill of Materials PartPrice Per UnitQuantitySubtotal Sony Condensor Stereo Microphone $74.991 MicroVision Projector Donated1Free

42. References [1] (2012, February 22). “Music Related Car Crashes,” in Car Accidents [Online]. Available: http://www.car-accidents.com/music- car-accidents-causes.htmlhttp://www.car-accidents.com/music- car-accidents-causes.html [2] Picture (2012, February 21). “Pico Projector,” in MicroVision [Online]. Available: http://www.microvision.com/pico_projector_displays/index.html\ http://www.microvision.com/pico_projector_displays/index.html\

43. EcoCar User Interface Final Presentation Senior Design II November 27, 2012