1. Java-Based In-Car Cell Phone Integration By:Chris Keller Greg Nehus Matt Odille

2. High-Level View

3. Project Summary

4. There continues to be many accidents attributed to cell phone use while driving Text messaging is perhaps the most dangerous Our project improves safety of communication while driving –Streams phone conversations –Accepts commands via voice –Dictates text messages We will implement the software and a GUI

5. Project Summary Primary Research: –Bluetooth in Java –Bluetooth Protocol –AT Commands –Java Speech API Why we chose this: –To learn how Bluetooth is implemented –To deepen our Java knowledge –To build something tangible that works

6. Specific Aims

7. Four main goals of the project 1)To learn how Bluetooth communications are implemented 2)To investigate how Bluetooth is already being used in automobiles 3)Implement and improve the preexisting uses (via text message dictation and synthesizing) 4)Improve safety of driving while using cell phones

8. Background and Motivation

9. All group members are Computer Engineering majors with focus on software Relevant Courses: –COE 401, Intermediate Programming using Java –COE 445, Data Structures –COE 1501, Algorithm Implementation –COE 1186, Software Engineering –COE 1185, Computer Systems Interfacing

10. Background & Motivation We’re motivated to do more than small Java applications Co-op experience –Greg - ANSYS –Matt - Vocollect –Chris – ANSYS We’re interested in cell phone, Bluetooth, and automobile technology

11. Preliminary Work/ Design Possibilities

12. Combine our code with preexisting technologies –BlueCove Java Bluetooth Libraries –CloudGarden TalkingJava SDK –Broadcom’s Widcomm Bluetooth Software

13. Design Approach

14. Java Setup –Java is a general-purpose, class-based, object- oriented language –Must install the following on all development computers: Java Runtime Environment Java Development Kit –This gives us the software to develop and run Java applications

15. Design Approach Integrated Development Environment (IDE) –Using the same IDE will make combining individual code easier –We will be using NetBeans 6.5 Editor Version Control integration Syntax highlighting Etc.

16. Design Approach Version Control

17. Design Approach Bluetooth Communication –Prerequisite: BlueCove Java Bluetooth Library Java does not come packaged with any libraries that allow interfacing with the computer’s Bluetooth stack. The BlueCove library will give us that capability.

18. Design Approach Bluetooth Communication –Five parts to the anatomy of a Bluetooth application 1)Stack Initialization 2)Device Discovery 3)Device Management 4)Service Discovery 5)Communication

19. Design Approach 1)Stack Initialization –Must be done prior to any attempts at Bluetooth communication –Initializes Port Baud Rate Bluetooth mode

20. Design Approach 2)Device Discovery –Allows the computer to get a list of nearby Bluetooth devices (our phone). –Example code:

21. Design Approach 3)Device Management –Allows the computer to access properties of the phone –This piece of code obtains the MAC Address a BT device –Example code:

22. Design Approach 4)Service Discovery –Determine what services and protocols are available on the phone 5)Communication –At this point, a Bluetooth connection is established and communication can begin. –To control the cell phone, we will use AT Commands

23. Design Approach Example dialogue of communication via AT commands –Phone: +CMTI:, “I have a new text message” –PC: AT+CMGR= “Give me it!” –Phone would then return the text message in a PDU encoded form. We must decode this in our application

24. Design Approach Speech-to-Text (STT) –Improved safety with hands-free control over cell phone –Interprets voice commands –Whole companies exist based on writing STT algorithms (Vocollect) –We will utilize the Java-based CloudGarden software development kit

25. Design Approach Text-to-Speech (TTS) –This will also be accomplished by utilizing the CloudGarden software

26. Milestones and Schedule

28. Management Plan

29. Week 1 –Chris: Finish preliminary research and project proposal –Matt: Finish preliminary research and project proposal –Greg: Finish preliminary research and project proposal Week 2 –Chris: Progress report on non-technical issues –Matt: Create use case diagrams –Greg: Begin rudimentary communication between computer and phone

30. Management Plan Week 3 –Chris: Testing of established communication between computer and phone –Matt: Install and learn basics of CloudGarden voice software –Greg: Finish communication between computer and phone

31. Management Plan Week 4 –Chris: Utilize CloudGarden to begin implementing voice commands, progress report technical issues –Matt: Begin GUI design and coding, progress report technical issues –Greg: Utilize CloudGarden to begin implementing voice commands, progress report technical issues

32. Management Plan Week 5 –Chris: Finish implementation of voice commands –Matt: Finish GUI –Greg: Begin incorporation of Broadcom Week 6 –Chris: Begin final report –Matt: Test design at this stage –Greg: Finish Broadcom incorporation

33. Management Plan Week 7 –Chris: Finish final report –Matt: Any remaining technical tasks –Greg: Begin final presentation Week 8 –Chris: Final Presentation –Matt: Final Presentation –Greg: Final Presentation

34. Expected Problems and Solutions

35. Expected Problems & Solutions Voice Recognition Accuracy –Problem: Speech dictations are not always 100% accurate. –Solution: Use Levenshtein Distance Algorithm for string similarity calculations. –Example code:

36. Expected Problems & Solutions Software Compatibility Issues with CloudGarden –Problem: The CloudGarden TalkingJava SDK installation requires a specific outdated version of the Java Runtime Environment (JRE). –Solution: Uninstall any existing versions of Java and temporarily install JRE 1.4.2.

37. Expected Problems & Solutions Incorporating Broadcom software –Problem: Streaming phone calls or stereo audio over Bluetooth is an extremely difficult task. Solutions exist, by companies such as Broadcom, but even their development kit fails to state how this is accomplished. –Solution: We will utilize Broadcom’s existing application to accomplish the task of passing audio from a phone call to the computer’s speakers.

38. Estimated Costs

39. Software: –TalkingJava SDK License (academic) = $14 per license Hardware: –Microphone - $10 –Bluetooth adapter - $12 –Computer for developing and testing – N/A –Bluetooth-enabled cell phone – N/A Total Estimated Cost = $64

40. Thank you for your time. - Chris Keller Greg Nehus Matt Odille