IEEE Working Group P1622 Meeting February 24-25, 2013 National Institute of Standards and Technology Gaithersburg, MD.

Slides:



Advertisements
Similar presentations
25 March 2008 (updated January 2012) The IEEE-SA strongly recommends that at each WG meeting the chair or a designee: l Show slides #1 through #4 of this.
Advertisements

Doc.: IEEE /1562r0 Submission January 2015 Yongho Seok (NEWRACOM)Slide 1 IEEE ah Sub 1 GHz license-exempt operation Agenda for January 2015.
Doc.: IEEE /0698r1 Submission May 2015 Xiaoming Peng (I2R)Slide 1 Date: Authors: IEEE aj Task Group May 2015 Report.
Doc.: IEEE /0236r0 Submission March 2015 Yongho Seok (NEWRACOM)Slide 1 IEEE ah Sub 1 GHz license-exempt operation Agenda for March 2015.
Doc.: IEEE /1298r6 Submission November 2010 David Halasz, OakTree WirelessSlide 1 IEEE ah Sub 1 GHz license-exempt operation Agenda for.
Doc.: IEEE /0357r1 Submission March 2010 Clint Chaplin, Chair (Samsung)Slide 1 WNG SC Agenda Date: Authors:
Doc.: IEEE /0021r0 Submission January 2011 Stephen McCann, RIMSlide 1 TGu Agenda Date: Authors:
IEEE Working Group P1622 Meeting February 24-25, 2013 National Institute of Standards and Technology Gaithersburg, MD.
Doc.: IEEE /1001r0 Submission Sept 2012 Jon Rosdahl (CSR)Slide 1 Sept 1 st Vice Chair Report Date: Authors:
Doc.: IEEE /0481r1 Submission May 2015 Yongho Seok (NEWRACOM)Slide 1 IEEE ah Sub 1 GHz license-exempt operation Agenda for May 2015 Date:
Doc.: IEEE /0481r3 Submission May 2015 Yongho Seok (NEWRACOM)Slide 1 IEEE ah Sub 1 GHz license-exempt operation Agenda for May 2015 Date:
1 IEEE SCC TM Series Standards Development P1547.X Working Group Meeting Date–Date, 200X; City, State P1547.X Standard Title, Scope and Purpose.
Doc.: IEEE /1511r0 Submission January 2016 Yongho Seok (NEWRACOM)Slide 1 IEEE ah Sub 1 GHz license-exempt operation Agenda for January 2016.
Doc.: IEEE /0698r0 Submission May 2015 Xiaoming Peng (I2R)Slide 1 Date: Authors: IEEE aj Task Group March 2015 Report.
Doc.: IEEE / 0404r0 Submission March 2015 Slide 1 TGax PHY Ad Hoc March 2015 Meeting Agenda Date: Authors:
Doc.: IEEE /0075r0 Report Nov 2011 Jon Rosdahl, CSRSlide 1 First Vice Chair Report 2011 Date: Authors:
Doc.: IEEE /0507r0 Submission TGaj CC12 on 10 April 2014 Report Author: Date: NameCompanyAddressPhone Haiming WANGSEU/CWPAN 2.
HL7 / ISOTC215 / IEEE11073 Device Communication Work Group Agenda January 11-16, 2009, Orlando, FL.
Doc.: IEEE /0335r1 SubmissionEldad Perahia, Intel CorporationSlide 1 Date: Authors: TGaj March 2013 Report March 2013.
Doc.: Submission, Slide 1 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [TG4r Opening and Closing for.
Doc.: IEEE /0983r0 Submission September 2015 Yongho Seok (NEWRACOM)Slide 1 IEEE ah Sub 1 GHz license-exempt operation Agenda for September.
Doc.: IEEE /0342r2 Submission March 2011 David Halasz, OakTree WirelessSlide 1 IEEE ah Sub 1 GHz license-exempt operation Agenda for March.
Doc.: IEEE sru Submission doc.:IEEE sru November, 2010 Shoichi Kitazawa, ATRSlide 1 Project: IEEE P Working.
Doc.: IEEE /1537r0 Submission November 2011 Mark Hamilton, Polycom, Inc.Slide 1 ARC-agenda-minutes-november-2011 Date: Authors:
Omniran TG 1 IEEE OmniRAN TG April 16 th, 2015 Conference Call Max Riegel, Nokia Networks (TG Chair)
Omniran TG 1 IEEE OmniRAN TG May 21 st, 2015 F2F Mtg Pittsburgh, PA Max Riegel, Nokia Networks (TG Chair)
Omniran TG 1 IEEE OmniRAN TG September 29 th, 2015 Conference Call Max Riegel, Nokia Networks (TG Chair)
1 Patents / Intellectual Property Slides. 2 Membership & Affiliation SISO-ADM-002 requires PDG/PSG members to be SISO members Membership obtained through.
Doc.: IEEE /0021r0 Submission January 2013 Jon Rosdahl (CSR)Slide 1 1 st Vice Chair Report January 2013 Date: Authors:
Doc.: IEEE leci LECIM IGSlide 1 March 2010 David Howard, On Ramp Wireless Slide 1 Project: IEEE P Working Group for Wireless Personal.
revp 1 IEEE MEDIA INDEPENDENT HANDOVER DCN: Title: IEEE m TG May 2013 Report and Agenda Date Submitted: May 2013 Presented.
IEEE ah Sub 1 GHz license-exempt operation Agenda for July 2014
Month Year doc.: IEEE /0xxxr0 January 2014
Instructions for the WG Chair
March 2018 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda March 2018 Plenary] Date Submitted:
Instructions for the WG Chair
March 2018 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda March 2018 Plenary] Date Submitted:
May 2018 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda May 2018 Interim] Date Submitted:
May 2018 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4md Agenda May 2018 Interim] Date Submitted:
November 2018 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda November 2018 Plenary]
March 2018 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda March 2018 Plenary] Date Submitted:
IEEE Contribution Author’s Name Affiliation Address Phone
May 2018 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4md Agenda May 2018 Interim] Date Submitted:
Instructions for the WG Chair
Jul 12, /12/10 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: Interest Group ELR Opening Report.
March 2018 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda March 2018 Plenary] Date Submitted:
Instructions for the WG Chair
Sub 1 GHz license-exempt operation Agenda for September 2010
March 2018 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda March 2018 Plenary] Date Submitted:
July 2018 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda July 2018 Plenary] Date Submitted:
Jul 12, /12/10 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: Interest Group ELR Opening Report.
January 2019 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda January 2019 Interim] Date.
Jul 12, /12/10 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: Study Group EIR Opening Report.
March 2019 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [IG Profiles Agenda March 2019 Plenary] Date.
May 2018 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4md Agenda May 2018 Interim] Date Submitted:
March 2019 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda March 2019 Interim] Date Submitted:
March 2019 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda March 2019 Interim] Date Submitted:
March 2019 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda March 2019 Interim] Date Submitted:
<month year> <January 2019>
Jul 12, /12/10 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: Study Group EIR Opening Report.
TGac – Coexistence Ad Hoc Meeting #3
May 2018 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda May 2018 Interim] Date Submitted:
July 2019 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [IG Profiles Agenda July 2019 Plenary] Date.
July 2019 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda July 2019 Plenary] Date Submitted:
WNG SC Agenda Date: Authors: March 2009 March 2009
Submission Title: IG SEC Opening Report for July 2014 Session
May 2018 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4md Agenda May 2018 Interim] Date Submitted:
September 2019 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [IG Profiles Agenda September 2019 Interim]
September 2019 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [IG Profiles Agenda September 2019 Interim]
September 2019 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: [4y SECN Agenda September 2019 Interim]
Presentation transcript:

IEEE Working Group P1622 Meeting February 24-25, 2013 National Institute of Standards and Technology Gaithersburg, MD

Exits and Facilities -Building 222 has two long hallways, A and B, with connecting corridors in-between and at both ends -You are on the A hallway -Exits are at either ends and in the middle (we are closest to the exit where you entered) -Mens/Womens restrooms are at either ends of central corridor (Womens on A, Mens on B) 2

Introduction -Welcome: John Wack, Arthur Keller -Agenda overview: John Wack -IEEE call for patents: Arthur Keller 3

NIST support for P1622 Organizing and hosting meetings Building membership Technical editor of standard Technical support – Schema development – Data models – Standard development Website re-vamp 4

Meeting Agenda – Day 1 All times given are in Eastern Time, GMT -5. 1pm – 1:15pm - Introduction -Welcomes: John Wack, Arthur Keller -Agenda overview: John Wack -IEEE call for patents: Arthur Keller 1:15pm – 2pm - Policies and Procedures revisions -Revision to policies and procedures for membership criteria: Arthur Keller -Policies and procedures updates for sponsoring committee for P1622: Arthur Keller 2pm – 2:30pm - Election Assistance Commission -Increasing participation in P1622: Brian Hancock -Conformance testing versus interoperability testing: Brian Hancock, Mark Skall 2:30pm – 2:45pm – Break 2:45pm – 4:30pm - Election results reporting standard -Overview of standard: John Wack -EML 520 schema discussion: John Wack, Kim Brace, David Webber 4:30pm – 4:45pm – Break 4:45pm – 6pm - Election results reporting standard – continued 6pm - Wrap-up and Adjourn 5

Meeting Agenda – Day 2 All times given are in Eastern Time, GMT -5. 8:30am – 9am - P1622 membership and elections -New member announcements: Arthur Keller -P1622 officer elections: Paul Eastman 9am – 10:30am - Continuation of election results reporting standard -Review of day one discussions: John Wack -Comparison with Associated Press reporting formats: Don Rehill -Vote to incorporate changes and prepare draft for balloting: P1622 chair 10:30am – 10:45am – Break 10:45am – 12:15pm - Event logging standard -Overview of recent event logging work in SC: Duncan Buell -Discussion on forming a PAR for an event logging standard: Duncan Buell 12:15pm – 1:30pm - Lunch – NIST cafeteria suggested 1:30pm – 3pm - Open Source Digital Voting -Modifications to EML 310, 330: Anne O'Flaherty 3pm – 3:15pm – Break 3:15pm – 4pm - NIST Election data model development -Creation of comprehensive UML data model: John Wack 4pm – 5pm - Other business -Cast vote record audit discussion: Neal McBurnett 5pm - Wrap-up – Adjourn 6

The IEEE-SA strongly recommends that at each WG meeting the chair or a designee: –Show slides #1 through #4 of this presentation –Advise the WG attendees that: The IEEE’s patent policy is described in Clause 6 of the IEEE-SA Standards Board Bylaws; Early identification of patent claims which may be essential for the use of standards under development is strongly encouraged; There may be Essential Patent Claims of which the IEEE is not aware. Additionally, neither the IEEE, the WG, nor the WG chair can ensure the accuracy or completeness of any assurance or whether any such assurance is, in fact, of a Patent Claim that is essential for the use of the standard under development. –Instruct the WG Secretary to record in the minutes of the relevant WG meeting: That the foregoing information was provided and that slides 1 through 4 (and this slide 0, if applicable) were shown; That the chair or designee provided an opportunity for participants to identify patent claim(s)/patent application claim(s) and/or the holder of patent claim(s)/patent application claim(s) of which the participant is personally aware and that may be essential for the use of that standard Any responses that were given, specifically the patent claim(s)/patent application claim(s) and/or the holder of the patent claim(s)/patent application claim(s) that were identified (if any) and by whom. –The WG Chair shall ensure that a request is made to any identified holders of potential essential patent claim(s) to complete and submit a Letter of Assurance. –It is recommended that the WG chair review the guidance in IEEE-SA Standards Board Operations Manual and in FAQs 12 and 12a on inclusion of potential Essential Patent Claims by incorporation or by reference. Note: WG includes Working Groups, Task Groups, and other standards-developing committees with a PAR approved by the IEEE-SA Standards Board. Instructions for the WG Chair (Optional to be shown)

Participants, Patents, and Duty to Inform All participants in this meeting have certain obligations under the IEEE-SA Patent Policy. –Participants [Note: Quoted text excerpted from IEEE-SA Standards Board Bylaws subclause 6.2]: “Shall inform the IEEE (or cause the IEEE to be informed)” of the identity of each “holder of any potential Essential Patent Claims of which they are personally aware” if the claims are owned or controlled by the participant or the entity the participant is from, employed by, or otherwise represents –“Personal awareness” means that the participant “is personally aware that the holder may have a potential Essential Patent Claim,” even if the participant is not personally aware of the specific patents or patent claims “Should inform the IEEE (or cause the IEEE to be informed)” of the identity of “any other holders of such potential Essential Patent Claims” (that is, third parties that are not affiliated with the participant, with the participant’s employer, or with anyone else that the participant is from or otherwise represents) –The above does not apply if the patent claim is already the subject of an Accepted Letter of Assurance that applies to the proposed standard(s) under consideration by this group –Early identification of holders of potential Essential Patent Claims is strongly encouraged –No duty to perform a patent search Slide #1

Patent Related Links All participants should be familiar with their obligations under the IEEE-SA Policies & Procedures for standards development. Patent Policy is stated in these sources: IEEE-SA Standards Boards Bylaws IEEE-SA Standards Board Operations Manual Material about the patent policy is available at Slide #2 If you have questions, contact the IEEE-SA Standards Board Patent Committee Administrator at or visit This slide set is available at

Call for Potentially Essential Patents If anyone in this meeting is personally aware of the holder of any patent claims that are potentially essential to implementation of the proposed standard(s) under consideration by this group and that are not already the subject of an Accepted Letter of Assurance: –Either speak up now or –Provide the chair of this group with the identity of the holder(s) of any and all such claims as soon as possible or –Cause an LOA to be submitted Slide #3

Other Guidelines for IEEE WG Meetings l All IEEE-SA standards meetings shall be conducted in compliance with all applicable laws, including antitrust and competition laws. l Don’t discuss the interpretation, validity, or essentiality of patents/patent claims. l Don’t discuss specific license rates, terms, or conditions. l Relative costs, including licensing costs of essential patent claims, of different technical approaches may be discussed in standards development meetings. l Technical considerations remain primary focus l Don’t discuss or engage in the fixing of product prices, allocation of customers, or division of sales markets. l Don’t discuss the status or substance of ongoing or threatened litigation. l Don’t be silent if inappropriate topics are discussed … do formally object See IEEE-SA Standards Board Operations Manual, clause and “Promoting Competition and Innovation: What You Need to Know about the IEEE Standards Association's Antitrust and Competition Policy” for more details. Slide #4

Policies and Procedures revisions -Revision to policies and procedures for membership criteria: Arthur Keller -Policies and procedures updates for sponsoring committee for P1622: Arthur Keller 12

Election Assistance Commission -Increasing participation in P1622: Brian Hancock -Conformance testing versus interoperability testing: Brian Hancock, Mark Skall 13

Break -2:30pm – 2:45pm 14

Election results reporting standard -Overview: John Wack -Districting and its complications: Kim Brace -EML 520 schema discussion: David Webber -Next steps discussion: John Wack 15

Task force members Kim Brace – EDS Joseph Hagerty – SOS, CA Justin Hankins – ESS Matt Masterson – SOS, OH Neal McBurnett – Election Audits, CO John McCarthy – Verified Voting Jan van Oort Ian Piper – Dominion Paul Stenbjorn – ESS Beth Ann Surber – SOS, WV John P Wack – NIST Webber, David RR - Oracle Sarah Whitt – SOS, WI Additional: Don Rehill, David Stonehill – AP 16

PAR - Scope This standard defines common data interchange formats for information reported about election results. Election results information is based on data from vote capture devices and resultant tabulation data or other information about the election from election management systems. This standard focuses on the OASIS EML version 7 schemas 510, 520, and 530, which contain data elements and structures for contest totals and associated counts used for reconciliations and audits. 17

PAR - Purpose This standard facilitates the import and export, in a common format, of election results data that is typically reported from distributed voting places to central offices of local jurisdictions, from local jurisdictions to state election systems, and from local and state election offices to news media and the general public. It can also facilitate post-election auditing of election results. 18

Use cases supported 1.A state/county reporting outward to the public/media on election day using an EML 520 file – very simple aggregated counts, possibly broken down by reporting unit 2.A county or similar reporting unit reporting upward to a central elections office on election day using an EML 520 file –simple aggregated counts or more detailed counts as available 3.Post-election reporting in more detail or certified results or election archive using an EML 520 file - more detailed counts, broken down by reporting unit Note: Use case 3 is almost identical to use case 2 in that reporting election results in detail on election day ends up being mostly the same as a post-election election archive. 19

Optional counts and tags Counts include – ballots cast, – ballots read, – ballots counted, – contest vote totals, and – overvotes/undervotes. Capability to "tag" counts with the manner of voting, e.g., absentee, in person, etc. Capability to tag counts with voting technology, e.g., op scan, DRE, manual count paper, etc. This includes tagging overvotes/undervotes with voting technology if possible. Note: most counts and tags are the result of requirements analysis of EAC’s VVSG 20

Additional capabilities added Reduce file sizes by associating contest and candidate and reporting unit names with IDs – First send of the file contains the mapping – Subsequent files use only IDs Be able to report on virtually any level of district breakdown – First send of file identifies district breakdowns and their associated IDs 21

Districting is complicated… 22

By Kimball Brace, President Election Data Services, Inc. February, 2013 Basic Election Administration: A Summary of Findings

Basic Election Administration Facts Diversity is the underpinning of Elections. 50 States 3,140 Counties 1,620 NE Townships 5,312 Midwest Townships 10,072 Election Jurisdictions

Basic Election Administration Facts Size is important to remember – Question: What is the mean size of jurisdictions in nation in terms of registration? 1,492 registered voters – Over 1/3 rd of nations’ counties have fewer than 10,000 registered voters in them – Half of the nation’s counties have less than 16,000 registered voters – Only 343 jurisdictions have more than 100,000 registered voters – Only 14 counties have more than 1 million voters Smallest County: Loving County, Texas: 136 voters Largest County: Los Angeles, CA: 3.9 million voters – Take 930 smallest counties to reach LA’s total.

Basic Election Administration Facts

Census Geography

Hierarchy of Census Geographic Entities

30 Census Geography Overview

State is composed of Counties

Counties are composed of Precincts (VTDs)

Precincts are composed of Census Blocks

Census Block Level

Address Points within Blocks

Thank you Kimball Brace President Election Data Services, Inc Emerywood Court Manassas, VA ( or ) or

Current status Several revisions of schema, current version implements most but not all optional counts Starting to examine and compare with other schemas and formats to ensure completeness Discussions with AP have been fruitful – AP focused more on election night reporting – Would opt for as much standardization as possible, include IDs for contest/candidates/districts 37

Open questions Has schema gotten too complicated for use in all three use cases – Should a simplified schema be used for election night (does it matter if multiple schemas)? – Should the standard be divided into two standards so as to make faster progress? – Should this be a brand-new schema? 38

Next steps Complete a simple data model and ensure that schema implements the model The model should respond to requirements, thus requirements above/beyond VVSG must be documented A need to study other reporting formats being used (AP, other states, etc) to ensure completeness 39

Break -4:30pm – 4:45pm 40

Election results reporting standard – continued 41

Wrap-up and Adjourn 42

Meeting Agenda – Day 2 All times given are in Eastern Time, GMT -5. 8:30am – 9am - P1622 membership and elections -New member announcements: Arthur Keller -P1622 officer elections: Paul Eastman 9am – 10:30am - Continuation of election results reporting standard -Review of day one discussions: John Wack -Comparison with Associated Press reporting formats: Don Rehill -Vote to incorporate changes and prepare draft for balloting: P1622 chair 10:30am – 10:45am – Break 10:45am – 12:15pm - Event logging standard -Overview of recent event logging work in SC: Duncan Buell -Discussion on forming a PAR for an event logging standard: Duncan Buell 12:15pm – 1:30pm - Lunch – NIST cafeteria suggested 1:30pm – 3pm - Open Source Digital Voting -Modifications to EML 310, 330: Anne O'Flaherty 3pm – 3:15pm – Break 3:15pm – 4pm - NIST Election data model development -Creation of comprehensive UML data model: John Wack 4pm – 5pm - Other business -Cast vote record audit discussion: Neal McBurnett 5pm - Wrap-up – Adjourn 43

P1622 membership and elections -New member announcements: Arthur Keller -P1622 officer elections: Paul Eastman 44

Continuation of election results reporting standard -Review of day one discussions: John Wack -Comparison with Associated Press reporting formats: Don Rehill -Vote to incorporate changes and prepare draft for balloting: P1622 chair 45

Break -10:30am – 10:45am 46

Event logging standard -Overview of recent event logging work in SC: Duncan Buell -Discussion on forming a PAR for an event logging standard: Duncan Buell 47

Lunch – NIST cafeteria suggested -Resume at 1:30pm 48

Open Source Digital Voting -Modifications to EML 310, 330: Anne O'Flaherty 49

Bringing Transparency to Voter Registration and Absentee Voting: OSDV/VA-SBE Use of CDFs in 2012 NIST CDF Workshop 2013

Why we are here: to brief the Workshop on real-world use of both standard and proposed common data formats in 2012 Who, What, Where, When: In collaboration with Virginia State Board of Elections and others in FVAP-funded project, all year long Background: OSDV, TrustTheVote, who we are, what we do Background: VA 2012 Project The Main Event: details about the project, CDFs, lessons learned More: more details on a new data format and use case What’s Next: continuing work, related work CDFs in Real Use in 2012

OSDV Foundation: pending non-profit corporation to support the election technology reform mission OSDV Team: Managing directors, board of trustees, general counsel, outside counsel for open-source licensing and IP, outside CPA, I.T. provided by Open Source Labs at Oregon State U. TrustTheVote Project: Open-source election technology development project supported by OSDV TTV Team: CTO, Project Leaders, UI designers, spec writers, data interchange experts, software developers TTV Stakeholders: Adopters - U.S. election officials; legislators; good-government groups; election integrity advocates; grant making organizations, individual donors OSDV: Who We Are

Mission: Develop publicly owned technology blueprints and implementations of election technology components Scope: Tech for election administration, ballot casting and counting, the whole electoral process from voter registration to reporting election results Transparency: All work product is open-source, open-data, and supports public access to detailed data recording everything about election administration and results of elections Work Product: White papers, Request for Comments (RFCs), architecture, component specifications and requirements, data format definitions, reference implementations of specifications, software OSDV and TTV: What We Do

Donors: provide funding for Foundation operations, and for directed development projects Stakeholders: provide responses to white papers, RFCs, spec, etc. Collaborators: stakeholders who help us develop work product Volunteers: Do tech work (spec dev, reference software, …) on funded and unfunded projects within the TTV Project Contractors: Do tech work on funded projects Adopters: LEO or SEOs, stakeholders who adopt and adapt open source software, deploy it for internal use or to deliver services to the public OSDV and TTV: Who and How We Do What We Do

SBE: received one of the first EASE grants from FVAP, to make: Online voter services for voters to properly complete voter registration and absentee ballot application forms Digital ballot delivery and marking service for UOCAVA voters Audit and reporting to FVAP of voter usage and outcomes Forms and ballots use existing print/sign/mail model Participants: In addition to SBE and OSDV: Democracy Live: commercial vendor of online ballot product Microsoft: application hosting & system integration of DL with VA Cyber-Data: application hosting & SI of Portal and Analytics TTV and Virginia State Board of Elections: Collaboration in 2012 SBE: Virginia State Board of Elections EASE (Electronic Absentee Systems for Elections) UOCAVA ((Uniformed and Overseas Citizens Absentee Voting Act) FVAP (Federal Voting Assistance Program) MOVE (Military and Overseas Voter Empowerment ) Act

SBE IT: System integration of legacy systems with new systems OSDV: provide open-source software for project : Adapt online VR tool to become “Voter Services Portal” Integrate Portal with legacy voter record system Integrate Portal with Democracy Live product deployed by MS Develop Analytics tool Support Cyber-data deployment of OSS from public repo Democracy Live: Data integration with legacy voter record system, web services integration with Portal, data integration with Analytics, support Microsoft deployment of DL product MS and CyberData: deploy application software in the hosting environment, provide ongoing system and application support VA SBE EASE Project Team

The Big Picture: poster of the world after the project Voters: workflows for online (Portal or DL) and offline voter registration request, voter record update request, absentee ballot request, FPCA request, absentee ballot or FWAB Online: print, sign, mailOffline: scrawl, sign mail LEOs: process request forms and ballots, on- or off-line generated receive forms in mail, approve or deny, log decision receive absentee ballots in mail, count or deny, log decision receive provisional ballots from polls, count or deny, log decision receive poll books from polls, update voter records SBE: pull log data from other 3 system, push into Analytics generate and pull reports and aggregated data Project Outcome

Now that you know how it ended, how did we get there? Project Details

Voter Services Portal Workflow Print, sign & mail form. Voter Statu s Chec k Registered? No Democrac y Live System Virginia Existing Systems Eligible to get electronic ballot? Yes Assist completing voter registration Assist completing voter forms No Portal: Web Application for Voters Voter (via Web Browser) Print, (mark), sign, & mail UOCAVA Absentee Ballot. County / City Registrar County / City Registrar

Open Source: software should be open source, freely available to other election officials to adopt and adapt Open and Flexible: SBE unconstrained in future as to who/how to expand, enhance, scale-up, etc. Open Data: data interchange and data output using public common data formats, using standards where available Cloud Hosting: public facing software with out-sourced hosting, cost-effective, and flexible for scaling State Hosting: Voter records and other data repository remain hosted and managed by SBE, with web services interface to new software, with both hosting orgs implementing appropriate security measures Portal and Analytics Software Goals

EML Usage and APIs for Data Interchange Voter Statu s Chec k Registered? Democrac y Live System Virginia Existing Systems Eligible to get electronic ballot? Assist completing voter forms Portal: Web Application for Voters Voter (via Web Browser) Web services API Request: Voter ID or SSN4 and name + Locality and DOB Web services API Response: No match, or Match + EML 330 record Web services API Push: EML 310 record with Voter-supplied information that was included in the PDF document sent to user, and PDF document tracking ID for later scan/lookup by LEOs when form is received HTTP Post: Voter ID and precinct ID used by DL determine which ballot to present

What Worked: excellent starting point for representing all the contents of a Virginia VR form for domestic voter registration, UOCAVA registration (VA FPCA), domestic voter record update, domestic absentee ballot request, UOCAVA update (VA FPCA) Extensions Needed: Several voter checkboxes (e.g. military, overseas) FPCA voter type (which of 4 kinds) FPCA military info (branch, rank, ID number) VA FPCA extensions – VA residence (un)available VA eligibility – felony or incapacity history, restore dates Address confidentiality !!! including VA-specific related info What Didn’t Work: Schema validation problems; needed more examples for clarity and to explain to non-tech stakeholders EML 310 Usage

Example: Check Boxes

Example: Extensions for VA Specific Registration or Absentee Form Info

Add a Status element attribute status to Voter after the DateTimeSubmitted element at the to VoterInformation element and to VoterIdentification element status values: New, Updated, Removed, Pending, Expired, values: New, Updated, Removed, Pending, Expired All VToken elements need to be a repeatable - right now they are simply optional; we need to be able to track multiple events and information exchanges in the extended use cases What is the difference between VTokenQualified and VToken? The definition text is obtuse - we need this more clearly explained in the text. 1.VTokenQualified: VToken that is permitted to be used for the purpose and context of a particular process and event. 2.VToken: A unique identifier for a device or entity involved in the voting process. Status (Proposed 3/2012 David Webber)

What Worked: excellent starting point for representing all the contents of a Virginia voter record needed to (1)Determine eligibility to use DL ballot system (2)Enable voter record updates Extensions Needed: Several voter attributes Election list Past election list elements for voting history Future election list elements for absentee status or lack thereof UOCAVA specific information, e.g. absentee status expiration What Didn’t Work: slightly poor fit with VA voter model generally; very poor fit with VA model of absentee voting EML 330 Usage

Example: Election List <ElectionName Type="Full Ballot" Locality="BRISTOL CITY" Permitted="yes" Voted="no" seqn="0001">2012 May City General <ElectionName Type="Full Ballot" Locality="BRISTOL CITY" Permitted="no" Voted="no" seqn="0002">2012 June Democratic Primary <ElectionName Type="Full Ballot" Locality="BRISTOL CITY" Permitted="no" Voted="no" seqn="0003">2012 June Republican Primary <ElectionName Type="Full Ballot" Locality="BRISTOL CITY" Permitted="no" Voted="no" seqn="0004">2012 November General Election <ElectionName Locality="BRISTOL CITY" seqn="0001">11/2/ NOVEMBER 2, 2004 GENERAL ELECTION <ElectionName Locality="BRISTOL CITY" seqn="0002">11/8/ NOVEMBER 8, 2005 GENERAL ELECTION <ElectionName Type="Full Ballot" Locality="BRISTOL CITY" seqn="0003">11/7/ NOVEMBER 7, 2006 GENERAL ELECTION <ElectionName Type="Full Ballot" Locality="BRISTOL CITY" seqn="0004">2008 November General

Federal Post Cards Application – FPCA true Issued Example: UOCAVA Voter

Similar to Portal: open-source, open data, extensible, cloud hosted, rely on existing state-operated systems of record CDFs: no directly applicable standards for the plethora of both common and VA-specific transaction types of log records, or for the various outcomes required in FPCA reporting New Use Case: election administration record logging worked example, requirements and schema doc, XSD, running code Players, Roles, Workflow, Dataflow: see the big picture TTV Analytics Goals

Recap: who we are, what we do, VA EASE project background, and the Big Picture Recap: Portal concept, CDF out-brief, Analytics concept After the Break: Q&A on EASE Project, or Portal, but not Analytics More on Analytics, data format walkthrough Good news? New use case possible for standards process? Next steps on Portal and Analytics Related work in TrustTheVote Project Break

Similar to Portal: open-source, open data, extensible, cloud hosted, rely on existing state-operated systems of record CDFs: no directly applicable standards for the plethora of both common and VA-specific transaction types of log records, or for the various outcomes required in FPCA reporting New Use Case: election administration record logging worked example, requirements and schema doc, XSD, running code Players, Roles, Workflow, Dataflow: see the big picture TTV Analytics Goals

Basic Purpose: meet EASE grant requirements for tracking UOCAVA voter experiences and reporting to FVAP Basic Scope: both usage of services, and outcomes of requests Usage of paper forms, online forms, online balloting Outcome of voter registration requests, absentee requests, FPCA Outcome of absentee ballot and FWAB: not returned, returned late, on-time counted, on-time rejected Comparison of usage and outcome of UOCAVA vs. other voters Extended Scope: similar tracking for all voters; all ballot outcomes (absentee, provisional, in-person); comparison based on arbitrary demographic attributes (voter type or status, year of birth, ZIP, etc.) TTV Analytics System for EASE

Basic Requirement: automatically generate FVAP-mandated report in FVAP spreadsheet format Extensibility: extend to generate HTML/PDF/CSV reports for … Other government requirements, e.g. EAC, legislature requests Reports of interest to general public Integration: data integration with existing SBE systems and data for voter records, voter history, voter demographics Logging and Accountability: consume log data from existing VA systems, from DL, from Portal, with every online or offline voter request or ballot outcome, every admin decision of LEOs TTV Analytics System for VA

Web based tool for election officials: aggregate data, make reports Each election org hosts their own private instance of Analytics Independent and based on CDFs: no system integration; data integration only, with users pushing data in CDFs, obtained from other systems, e.g. VR system, online voter services, ballot distribution, etc. Simple User Model: admin user creates accounts for others in workgroup, all share ability to push data and generate reports Simple Process: create, push, analyze, pull 1. Define a new election name, dates, etc. 2. Extract log data for that specific election, from other systems 3. Upload these log files into Analytics 4. Upload demographic data file 5. Create each report needed, view, download report file, raw data files TTV Analytics Usage Model

XSD walkthrough: only highlights here Common header for log record dataset and demographic dataset Origin data, generation time, etc. Identifier hash algorithm applied to voter unique ID numbers for anonymity Demographic data: list of records each with hashed voterID as unique key, plus attribute values like ZIP, year of birth, etc. Log data: list of records with same unique key for the voter whose request or outcome is represented in the log record Voter action: submit a request form (registration, update, absentee, …) Voter action: submit a ballot (absentee, provisional, pollbook checkin) LEO action: receive, approve, deny request LEO action: receive, reject, or count ballot (absentee, provisional) Forms (requests, ballots, pollbooks, …) Form attributes (online, FPCA, FWAB, …) Notes on the recorded transaction (reason for rejection) TTV Analytics Data Model

Portal 2012 Deployed: voter record access, eligibility check for online balloting; forms generation delayed by regulatory approval Portal Q2 2013: forms generation enabled after approval Portal Q3: voter access to online sample ballot “What’s on My Ballot?” Portal Q?: online paperless completion of voter registration requests For users with valid VA state ID, and DMV provides digital image of signature Depends on real-time integration of SBE VR back-end with DMV systems Very recent development, many details unknown, likely not to include record updates, absentee requests, UOCAVA status change, in or out of state transfers Next Steps: Portal 2013

Analytics 2012 Deployed: only FVAP report, only one election’s data, very limited use of Portal and DL Analytics Q1/Q2 2013: full data run-through for Q1 election(s) Analytics Q2: more reports generated – currently TBD Analytics Q3: more reports, more formats Analytics Q?: enhanced user model and admin features public demo system sponsored by OSDV, hosted by OSL Next Steps: Analytics 2013

Analytics 2012 Deployed: only FVAP report, only one election’s data, very limited use of Portal and DL Analytics Q1/Q2 2013: full data run-through for Q1 election(s) Analytics Q2: more reports generated – currently TBD Analytics Q3: more reports, more formats Analytics Q?: enhanced user model and admin features public demo system sponsored by OSDV, hosted by OSL Analytics 201?: support for IEEE/NIST standard CDF (hint, hint!) Next Steps: Analytics 2013

Portal 2013: use of EML 410 for ballot style definition, use of any IEEE standards updates in use of EML 310 or 330 Ballot Marking Device: build on UI usability study of ITIF/EAC funded project of U. Baltimore May use EML 410 for ballot style definition Tablet based demo: right here! and at poster session Election Night Reporting System: consumes EMS tally data, presents public with Web presentation, may use EML for precinct-level election result data. Web UI demo: Digital Pollbook: may use EML 310 for pollbook records Ballot Design Studio: may use EML 410 for ballot style definitions Next Steps: TTV 2013 Related Projects and CDFs

Break -3pm – 3:15pm 80

NIST Election data model development -Creation of comprehensive UML data model: John Wack 81

Model of election subsystems 82

Election results reporting model 83

Other business -Cast vote record audit discussion: Neal McBurnett 84

Adjourn 85