1. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering The Prime Voting System: Multimodality & Politics Juan E. Gilbert, Ph.D. TSYS Distinguished Associate Professor Auburn University Computer Science & Software Engineering Human Centered Computing Lab gilbert@auburn.edu http://www.juanegilbert.com/

2. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Background 2000 Presidential Election  Debacle  Recounts... Remember those?  Voter intimidation and trust

3. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering 2000 Election

4. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Hanging Chad Image taken from Douglas W. Jones’ Website at U. of Iowa

5. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Pregnant Chad Image taken from Douglas W. Jones’ Website at U. of Iowa

6. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Background Direct Recording Machines  Developed in the 20 th century How it works  Touch Screen  Votes stored on AccuCards Issues  Politics  Hackers  Programmers  Lack of recount and auditing  Security  Accessibility

7. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Background Professors hack into DRE in less than 1 minute  “Hacking Democracy” HBO documentary. 2006 Mid-Term Elections  Still no decision in Sarasota County, Florida  Other problems with accessibility and long lines

8. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Prime III Multimodality & Politics

9. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Voter Be accessible to a wide range of voters  Help America Vote Act (HAVA)  Use multiple means of interaction (Touch, Voice, or Both)  Large screen layout Voter can change vote  Voter can change their vote at anytime before printing the actual ballot Must confirm voter’s actions (visual or verbal)

10. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Voter - Visual Large touch screens  Large fonts  Images or No Images  Touchable Names Voter touches the screen to make selection  Confirmation is visual

11. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Voter - Verbal Headset  The system speaks to the voter through the headset  Conversation is confidential – no one can hear the machine’s speech, but the voter Embedded microphone in the headset  Candidates are randomly assigned numbers  Provisional Patent Filed  Voter speaks the number for a candidate  Confirmation is verbal

12. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Voter – Confirmation (Optional) Confirmation of vote on paper ballot  Ballot is printed on watermarked stock card paper  Each ballot is uniquely numbered

13. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Voter - Multimodal Multimodal Interactions  Voters can speak and touch interchangeably

14. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Security

15. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Security SELinux Servers  NSA security enhanced Linux system  Provide powerful tools to construct useful security policies Two Security CD/DVD  Election Administrator CD/DVD  Executable code, ballot, audio files, plus encryption keys  Print final vote counts and print ballots (if necessary)  System Administrator CD/DVD  Directory setup (will describe this later)  Certified Election System Administrator  The 2 come together on election day.

16. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Security Each system is kept under lock, key and guard  Before and after the election  During the election everything is visible No network, keyboard or mouse access Voter files are encrypted  Advanced Encryption Standard (AES)  3Des  And others …

17. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Security Can you find a needle in a haystack? How about a needle in one of many haystacks?

18. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Security Imposter Files  Each machine has encrypted imposter vote files  Imposter vote files are constantly updated  “Finding a needle in a haystack”  Administrator CD/DVD has Key to Encryption Key file on disc.  Encryption Key file contains  Encryption key  Vote file organization/layout.

19. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering

20. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Prime III Software Software  Java (100%)  User interface  CMU Sphinx-4 speech recognition engine

21. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Demo

22. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering

23. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Conclusions

24. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Conclusions AU Outreach Grant  Implementation  Union City test site  Other test sites, e.g. Auburn, Opelika  Usability studies at Auburn University  Dissemination of findings  Apply for state certification as a voting tool Work out the bugs  Through testing and usability studies iron out problems

25. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Prime III... national election tool? We will see... Conclusions

26. Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Questions Juan E. Gilbert, Ph.D. TSYS Distinguished Associate Professor Auburn University Computer Science & Software Engineering Human Centered Computing Lab gilbert@auburn.edu http://www.juanegilbert.com/ E. Vincent Cross II, M.S.W.E. PhD. Student Auburn University Computer Science & Software Engineering Human Centered Computing Lab crossev@auburn.edu http://www.auburn.edu.com/~crossev Copyright © by Juan E. Gilbert, Ph.D.