Bayesian audits (by example)

Slides:



Advertisements
Similar presentations
The Electoral College.
Advertisements

ThreeBallot, VAV, and Twin Ronald L. Rivest – MIT CSAIL Warren D. Smith - CRV Talk at EVT’07 (Boston) August 6, 2007 Ballot Box Ballot Mixer Receipt G.
Lesson 7: The Voting Process. Opening Discussion Have you ever voted for something before? How was the winner decided? Did you think the process was fair?
Passport to Democracy Running the Election with Students.
How can you tell which is experimental and which is theoretical probability? You tossed a coin 10 times and recorded a head 3 times, a tail 7 times.
Presidential Election 2011 The Who? Where? What? & How?
Unit 7: Chance Variation. Repeating with Excel Two EV’s and two SE’s Suppose we know the box (model) of a game, and we make many draws from the box with.
Ronald L. Rivest MIT Laboratory for Computer Science
August 6, 2007Electronic Voting Technology 2007 On Estimating the Size and Confidence of a Statistical Audit Javed A. Aslam College of Computer and Information.
Inferential Statistics
Generating Random Samples
Fractions that Equal Whole Numbers
1 1 Slide Statistical Inference n We have used probability to model the uncertainty observed in real life situations. n We can also the tools of probability.
Audit Purpose of Audit Quality assurance procedure Check accuracy of machine tally of ballots Ballots for a contest are sampled, manually verified, and.
AP Statistics Section 8.1: The Binomial Distribution.
Electronic Voting Ronald L. Rivest MIT Laboratory for Computer Science.
The Electoral Process Chapter 7.
Slide 15-1 Copyright © 2004 Pearson Education, Inc.
Playing the Lottery 6/4/2016Copyright © 2010… REMTECH, inc … All Rights Reserved1 Probability Theory and the Lottery ● The Lottery picks numbers at random.
The Sampling Distribution of
Welcome to the Hart Voting System!
Section 7.4 Use of Counting Techniques in Probability.
1 Cellular Automata What could be the simplest systems capable of wide-ranging or even universal computation? Could it be simpler than a simple cell?
Leadership & Government Citizenship Quiz Draw a box at the top to keep track of your points. Write the letter of the correct answer. Have your dry-erase.
Introduction: Metropolis-Hasting Sampler Purpose--To draw samples from a probability distribution There are three steps 1Propose a move from x to y 2Accept.
The inference and accuracy We learned how to estimate the probability that the percentage of some subjects in the sample would be in a given interval by.
Community Electoral Information Session Welcome. This presentation has been developed by the AEC to help communities understand the electoral system and.
Introduction Sample surveys involve chance error. Here we will study how to find the likely size of the chance error in a percentage, for simple random.
Auditability and Verifiability of Elections Ronald L. Rivest MIT ACM-IEEE talk March 16, 2016.
Topic 5 How do I make sure my vote gets counted?.
Unit 5: Ante Up Types of Elections.
“Appendix A” Voting for Everyone
Ronald L. Rivest MIT NASEM Future of Voting Meeting June 12, 2017
EVoting 23 October 2006.
Sequences, Series, and Probability
ThreeBallot, VAV, and Twin
Bring a penny to class tomorrow
Democracy is one of our fundamental British Values.
Understand. Implement. Administer.
Audit Thoughts Ronald L. Rivest MIT CSAIL Audit Working Meeting
Election 2008: To Vote or Not to Vote
Ronald L. Rivest MIT Laboratory for Computer Science
ELECTRONIC VOTING SYSTEMS André Martins Hugo António Miguel Cordeiro
Ronald L. Rivest MIT NASEM Future of Voting December 7, 2017
Chapter 7: Sampling Distributions
CHAPTER 7 Sampling Distributions
1.3 The Borda Count Method.
Auditability and Verifiability of Elections
Warmup A (blindfolded) marksman finds that on the average he hits the target 4 times out of 5. If he fires 4 shots, what is the probability of exactly.
دانشگاه شهیدرجایی تهران
تعهدات مشتری در کنوانسیون بیع بین المللی
Preparing Your Ballots
Four-Cut: An Approximate Sampling Procedure for Election Audits
Amazing Estimators.
Unit 6 Review Probability Bingo.
The Dog and Bone – teachers guide
Chapter 7: Sampling Distributions
CHAPTER 7 Sampling Distributions
CHAPTER 7 Sampling Distributions
CHAPTER 7 Sampling Distributions
CHAPTER 7 Sampling Distributions
Chapter 7: Sampling Distributions
CHAPTER 7 Sampling Distributions
CHAPTER 7 Sampling Distributions
1/10/ Sample Proportions.
Number of Representatives
Risk Limiting Audits Nuts, Bolts, and Paperclips
Electoral Reform Act of 2016
Ronald L. Rivest MIT ShafiFest January 13, 2019
INITIATIVE RESEARCH In groups of 3:
Presentation transcript:

Bayesian audits (by example) Ronald L. Rivest MIT Making Every Vote Count January 31, 2019

Audits are about: Sampling cast paper ballots at random Figuring out what the sampled ballots tell you about the reported election results RLAs Bayesian audits (not quite the same, but simpler to understand)

Bayesian audits are not RLAs (but are a “close cousin”) RLA Question: What is current ``risk’’ (probability that if reported winner is incorrect, audit would nonetheless accept it if audit stopped now)? Bayesian Question: What is (model-based) “upset probability” that reported winner would lose if all ballots were examined?

Bayesian Method (ballot polling) Start: draw initial sample of paper ballots Extend: simulate what you might see for remaining ballots: replace each draw of a paper ballot with copy of random earlier ballot. Find winner for all (drawn and simulated) ballots. Repeat steps 2—3 many times, measuring fraction of time reported winner loses. Escalate to larger sample if fraction > limit.

Example Hershey’s Kisses (Silver) versus Reese’s Pieces (Gold) Reported 9 Kisses (H) versus 3 Reeses (R) Sample 3H / 1R  17.4 % won by Reeses Sample 4H / 1R  7.5 % won by Reeses Sample 5H / 1R  2.3 % won by Reeses Sample 6H / 1R  0.4 % won by Reeses

Remarks Bayesian methods extend to: Ballot-comparison audits Hybrid audits (CVR and no-CVR strata) IRV (RCV) or other complex voting schemes (since method uses social choice function as a “black box” at the end of each simulation trial) For more details see https://arxiv.org/abs/1801.00528

The End Thanks for your attention! (and thanks to NSF CSOI and to Verified Voting!)