IEEE PCIC Standards Working Group Officers’ Workshop IEEE-SA Public Review Overview for Sponsor Chairs, Working Group Chairs and Ballot Designees Pat Roder Lisa Perry 4 October 2015

Agenda  IEEE-SA Public Review – What’s Changed?  IEEE-SA Implementation Timeline  IEEE-SA Public Review System  Overview of the Public Review Process  Public Review Process – Public Review Commenter  Public Review Process – Public Review Comments  Overview of the myProject & Public Review Systems  Public Review Process – Sponsor/Ballot Designee  Scenarios for Working Group Chairs  The IEEE-SA Public Review System 2

IEEE-SA Public Review – What’s Changed?  The IEEE-SA has enhanced the standards development process by implementing Public Review that will allow systematic feedback on initial IEEE-SA sponsor ballot drafts by a broad, inclusive community.  Standards that are submitted for recognition as an American National Standard will still complete the ANSI public review process  A Public Review system has been developed to facilitate the process  Support material will be available on the Help tab in the Public Review system FAQs Video Tutorials User Guide Support Center 3

Public Review Implementation Timeline  Implemented on 6 July 2015  All projects that initiate an invitation to ballot on/after 6 July 2015 will automatically have a public review initiated at the start of the sponsor ballot  The clauses of the SASB Operations Manual (5.4.6) have been updated to reflect the enhanced public review process 4

IEEE-SA Public Review System  The IEEE-SA Public Review system is currently separate from the myProject system, but will be integrated with the myProject redesign –Systems have separate login Both use your existing IEEE account username/password myProject redesign completion targeted for mid-2016  IEEE Staff Program Managers can assist Working Group Chairs with the comment files between the systems until the myProject redesign is launched 5

Overview of the Public Review Process 6 Interested party goes to Public Review website to see what documents are available Public reviewer is able to purchase the draft Public reviewer is able to submit comments (no vote) until the end of the 60 th day Once a comment is submitted the public reviewer only has 24 hours to edit/delete it within the 60 day period Working Group Chair can review the comments as they come in or the completed file when PR period closes Working Group can decide which comments influence a change and select them to include in the myProject comment spreadsheet Public reviewer is able to request and download a copy of a revised draft if a change was made as a result of a comment Working Group may opt to wait until the PR period (60 days) to recirculate or continue the process. *Note, a recirc may be needed as a result of a PR comment

Public Review Process – Public Review Commenter  The Public Review will be automatically initiated at the same time as the initial Sponsor ballot  The Public Review period will be for 60 days, and will be based only on the initial ballot draft  Any materially interested person, anywhere can sign up as a Public Review commenter and submit comments against the initial ballot draft  Will require an IEEE account  Will NOT have a vote or “must be satisfied” requirements  May need to purchase the draft standard  Does not need to be an IEEE or SA member to submit comments 7

Public Review Process – Public Review Comments  All Public Review comments shall be considered and responses provided  Consensus is not based on Public Review comments  Working Group/Comment Resolution Group will identify in their response whether they have determined that they will make a change in the draft  If responses identify a change to the draft, the Public Review commenter can request a revised draft  Each public review commenter receives only their responses  As normally required, changes to the draft must be recirculated in the Sponsor ballot  All Public Review comments and responses shall be submitted to RevCom 8

Overview of the myProject & Public Review Systems 9 myProject Invitation Initial ballot begins Initial ballot closes (30 days) Comment resolution Public Review System Project listed on Public Review page as “Upcoming” –Public review commenter provided option to join ballot Public Review period begins –Period starts automatically –Entire initial draft content open to comment for entire 60 day Public Review period Public Review closes (60 days) –Similar to comments received outside of the ballot system –Responses must be provided

Public Review Process – Sponsor/Ballot Designee  Commenting in both systems will be compatible  Comments downloaded from the Public Review system can be uploaded through the “rogue” comment mechanism in the myProject system  Comments will be annotated to indicate that they are Public Review comments  Public Review Comments downloaded from the myProject system can be uploaded to the Public Review system  Public Review Comments can be downloaded for inclusion in a ballot recirculation or for submission to RevCom 10

Scenario 1 for Working Group Chairs 11 Day 1Day 30Day 60Day70 Day 80 RevCom Public Review closes. WG can now download completed Public Review comments and begin/continue comment resolution. Note – no further comments will be received via the Public Review process. Initial sponsor ballot ends. WG can begin Ballot Comment Resolution Initial sponsor ballot (30 days) is released. Public Review is automatically released for 60 days at time of Initial Sponsor ballot release. 10 Day Recirculation initiated This includes resolution to sponsor ballot comments and response to Public Review comments Recirculation ballot closes. WG begins second round of ballot resolution. For the purposes of this example, no further recirculation is necessary. WG submits the project to RevCom. The Public Review comments and their responses must be submitted to RevCom.

Scenario 2 for Working Group Chairs 12 Day 1Day 30Day 31Day41 Day 60 RevCom 10 Day Recirculation initiated This includes only the resolution to the initial sponsor ballot comments. Initial sponsor ballot ends. WG can begin Ballot Comment Resolution Initial sponsor ballot (30 days) is released. Public Review is automatically released for 60 days at time of Initial Sponsor ballot release. 10 Day Recirculation has closed. WG begins second round of ballot resolution. Based on the WG review of the ballot comments, no further recirculation is required. Public Review closes. WG conducts comment resolution on the Public Review comments. Responses to Public Review comments did not identify a change being made to the draft. WG submits the project to RevCom. The Public Review comments and their responses must be submitted to RevCom.

13 Day 1Day 30Day 31Day41 Day 60 Day 61 RevCom 10 Day Recirculation initiated This includes only the resolution to the initial sponsor ballot comments. Public Review comments received may be addressed at this time, but as the Public Review period is still open, caution should be applied here. Initial sponsor ballot ends. WG can begin Ballot Comment Resolution Initial sponsor ballot (30 days) is released. Public Review is automatically released for 60 days at time of Initial Sponsor ballot release. 10 Day Recirculation has closed. WG begins second round of ballot resolution. Based on the wg review of the ballot comments, no further recirculation is required. Public Review closes. WG conducts comment resolution on the PR comments. Responses to Public Review comments identified a change to the draft. 10 Day Recirculation initiated This includes the dispositions to any remaining comments from the recirculation and the Public Review comments that identified a change in the draft. Scenario 3 for Working Group Chairs

Scenario 4 for Working Group Chairs 14 Day 1Day 30Day 31/RevCom Day 60 RevCom Working Group submits to RevCom. Public Review period is still open. Note – responses to Public Review comments must take place before RevCom recommendation can be received Initial sponsor ballot ends. WG can begin Ballot Comment Resolution Comment Resolution has determined that no further changes are necessary. Initial sponsor ballot (30 days) is released. Public Review is automatically released for 60 days at time of Initial Sponsor ballot release.

System Demo The IEEE-SA Public Review System Sponsor/WG Chair/Ballot Designee 15

Public Review - Homepage 16 Current = Public Review is running Upcoming = Invitation period

Public Review – Sign In Use your myProject Sign In credentials

Public Review – Working Group Chair Signed In 18

Public Review – Manage Public Reviews 19

Public Review – Review Comments 20 Download Comment file