Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering The Prime Voting System: Multimodality & Politics Juan E. Gilbert, Ph.D. TSYS Distinguished Associate Professor Auburn University Computer Science & Software Engineering Human Centered Computing Lab

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Background 2000 Presidential Election  Debacle  Recounts... Remember those?  Voter intimidation and trust

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering 2000 Election

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Hanging Chad Image taken from Douglas W. Jones’ Website at U. of Iowa

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Pregnant Chad Image taken from Douglas W. Jones’ Website at U. of Iowa

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Background Direct Recording Machines  Developed in the 20 th century How it works  Touch Screen  Votes stored on AccuCards Issues  Politics  Hackers  Programmers  Lack of recount and auditing  Security  Accessibility

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Background Professors hack into DRE in less than 1 minute  “Hacking Democracy” HBO documentary Mid-Term Elections  Still no decision in Sarasota County, Florida  Other problems with accessibility and long lines

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Prime III Multimodality & Politics

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Voter Be accessible to a wide range of voters  Help America Vote Act (HAVA)  Use multiple means of interaction (Touch, Voice, or Both)  Large screen layout Voter can change vote  Voter can change their vote at anytime before printing the actual ballot Must confirm voter’s actions (visual or verbal)

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Voter - Visual Large touch screens  Large fonts  Images or No Images  Touchable Names Voter touches the screen to make selection  Confirmation is visual

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Voter - Verbal Headset  The system speaks to the voter through the headset  Conversation is confidential – no one can hear the machine’s speech, but the voter Embedded microphone in the headset  Candidates are randomly assigned numbers  Provisional Patent Filed  Voter speaks the number for a candidate  Confirmation is verbal

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Voter – Confirmation (Optional) Confirmation of vote on paper ballot  Ballot is printed on watermarked stock card paper  Each ballot is uniquely numbered

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Voter - Multimodal Multimodal Interactions  Voters can speak and touch interchangeably

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Security

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Security SELinux Servers  NSA security enhanced Linux system  Provide powerful tools to construct useful security policies Two Security CD/DVD  Election Administrator CD/DVD  Executable code, ballot, audio files, plus encryption keys  Print final vote counts and print ballots (if necessary)  System Administrator CD/DVD  Directory setup (will describe this later)  Certified Election System Administrator  The 2 come together on election day.

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Security Each system is kept under lock, key and guard  Before and after the election  During the election everything is visible No network, keyboard or mouse access Voter files are encrypted  Advanced Encryption Standard (AES)  3Des  And others …

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Security Can you find a needle in a haystack? How about a needle in one of many haystacks?

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Security Imposter Files  Each machine has encrypted imposter vote files  Imposter vote files are constantly updated  “Finding a needle in a haystack”  Administrator CD/DVD has Key to Encryption Key file on disc.  Encryption Key file contains  Encryption key  Vote file organization/layout.

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Prime III Software Software  Java (100%)  User interface  CMU Sphinx-4 speech recognition engine

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Demo

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Conclusions

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Conclusions AU Outreach Grant  Implementation  Union City test site  Other test sites, e.g. Auburn, Opelika  Usability studies at Auburn University  Dissemination of findings  Apply for state certification as a voting tool Work out the bugs  Through testing and usability studies iron out problems

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Prime III... national election tool? We will see... Conclusions

Juan E. Gilbert, Ph.D. Human Centered Computing Lab Auburn University Computer Science and Software Engineering Questions Juan E. Gilbert, Ph.D. TSYS Distinguished Associate Professor Auburn University Computer Science & Software Engineering Human Centered Computing Lab E. Vincent Cross II, M.S.W.E. PhD. Student Auburn University Computer Science & Software Engineering Human Centered Computing Lab Copyright © by Juan E. Gilbert, Ph.D.