EcoCar User Interface Final Presentation Senior Design II November 27, 2012

Design Team Sam Knight Computer Engineer DBus Programming CAN Bus Programming Lukas Cox Electrical Engineer Dictionary Training Physical Interfacing Adam Johns Computer Engineer Alternatives Researching Recognition Programming Renz Santos Computer Engineer Recognition Programming Website Design Dr. Marshall Molen Advisor

Contents Problem and Solution System Overview Model Technical and Practical Constraints Refinements and Progress – Installation Package – Accuracy – Training & GUI Testing References

Problem and Solution

Problem The increasing technology in vehicles today unfortunately increases the amount of danger to drivers and passengers alike. “Driver distraction is a leading cause of crashes, although the exact figures are difficult to gauge because of the unreliability of the data” [1].

Solution EcoCar User Interface – Allows car’s infotainment center to be controlled by voice – Helps lower the amount of attention needed to run modules on car – Displays critical information relating to the vehicle

System Overview Microphone CAN Bus Computer Voice Recognition Control Overview, Radio, Media, GPS, Diagnostic Modules Projector

Model

Technical and Practical Constraints

Technical Constraints NameDescription AccuracyThe system must correctly identify spoken commands with 90% accuracy. Latency The EUI must acknowledge commands within 250ms. Compatibility The system must run on Freescale SABRE platform computer. Communication The EUI must communicate with CAN bus. Vocabulary The system must recognize 12 voice commands

Practical Constraints TypeNameDescription ManufacturabilitySize The EUI must fit below the passenger seat and not obstruct the driver. SustainabilityDurabilityThe system must be able to withstand the vibrations of normal driving conditions.

Manufacturability Fit below passenger seat Microphone < 4”x2”x2” Projector < 1” depth [2]

Sustainability No short term problems Works as long as hardware does not fail Withstand normal car vibrations

Refinements

Installation Package Available as download in DEB package Checks system for correct dependencies Automatically installs program Launch script checks Java version

Debian Package Control File Package: eui Version: 1.0 Section: contrib/misc Priority: optional Architecture: all Maintainer: Sam Knight Homepage: Depends: libunixsocket-java, libmatthew-java-doc Description: Ecocar User Interface Voice recognition infotainment system designed for Mississippi State University Ecocar

Accuracy Augment the audio recognition corpus Driver dependent voice library Simple training process

Enhancement Process Record a series of phrases from user in GUI Sync the audio to the command keywords Process into.mfc files Assimilate into existing corpus

GUI Trainer

GUI Trainer: Recording Stage

GUI Trainer: Process Control

GUI Trainer: Console Output

GUI Trainer: Generated File Structure

GUI Trainer: Relaunch EUI

Testing

Test Goals Reevaluate the improved accuracy EUI after training Reaffirm latency and memory statistics Test CAN Bus communication Seamless automatic install in any new version of EcoCar with installation package

Voice Recognition Test: Accuracy

“EcoCar” is the keyword that must be used in conjunction with each command Recognizes 14 spoken commands Tested 200 commands with and without training For this test the EUI’s average accuracy rose from 78% to 92%

Voice Recognition Test: Latency

Voice Recognition Test: Compatibility The EcoCar’s Freescale Sabre computer board has 1 GB of RAM EUI only uses a maximum of 180 MB [3]

Voice Recognition Test: Compatibility

Communication Test: DBus method call sender=: > dest=org.EcoCar.Module.MasterModule serial=3 path=/org/EcoCar/Module/MasterModule; interface=org.EcoCar.DBus.Interfaces.EICMaster; member=ShowModule string "player" method call sender=: > dest=org.EcoCar.Modules.Info serial=12 path=/org/EcoCar/Modules/Info; interface=org.EcoCar.DBus.Interfaces.EICClient; member=hide method call sender=: > dest=org.EcoCar.Modules.Radio serial=13 path=/org/EcoCar/Modules/Radio; interface=org.EcoCar.DBus.Interfaces.EICClient; member=hide method call sender=: > dest=org.EcoCar.Modules.MediaLibrary serial=14 path=/org/EcoCar/Modules/MediaLibrary; interface=org.EcoCar.DBus.Interfaces.EICClient; member=hide method call sender=: > dest=org.EcoCar.Modules.Navigation serial=15 path=/org/EcoCar/Modules/Navigation; interface=org.EcoCar.DBus.Interfaces.EICClient; member=hide method call sender=: > dest=org.EcoCar.Modules.Diagnostics serial=16 path=/org/EcoCar/Modules/Diagnostics; interface=org.EcoCar.DBus.Interfaces.EICClient; member=hide method return sender=: > dest=:1.199 reply_serial=3 method call sender=: > dest=org.EcoCar.Modules.MediaPlayer serial=18 path=/org/EcoCar/Modules/MediaPlayer; interface=org.EcoCar.DBus.Interfaces.EICClient; member=show method return sender=: > dest=:1.186 reply_serial=15 method return sender=: > dest=:1.186 reply_serial=12 method return sender=: > dest=:1.186 reply_serial=13 method return sender=: > dest=:1.186 reply_serial=16 method return sender=: > dest=:1.186 reply_serial=14

Communication Test: CAN Bus EUI communicates with the car through the CAN Bus Battery temperature, battery life, battery depletion rate, instantaneous MPG, average MPG, engine-on distance, electric distance, and engine-on count

CAN Test: Send Msg Format: [message|"signal":"value"]

CAN Test: Receive Actual Msg: [MSU_GC_Efficiency|"InstMPG":"44"]

Installation Testing Tested in computer, virtual machine, and actual car Car required manual dependency satisfaction Tweaks to processing scripts

Bill of Materials PartPrice Per UnitQuantitySubtotal Sony Condensor Stereo Microphone $ MicroVision Projector Donated1Free

References [1] (2012, February 22). “Music Related Car Crashes,” in Car Accidents [Online]. Available: car-accidents-causes.htmlhttp:// car-accidents-causes.html [2] Picture (2012, February 21). “Pico Projector,” in MicroVision [Online]. Available:

EcoCar User Interface Final Presentation Senior Design II November 27, 2012