1. SMART GRID INTEROPERABILITY PANEL WINTER 2012 FACE-TO-FACE IRVING, TEXAS  DEC. 3-6, 2012 SMART GRID TESTING & CERTIFICATION COMMITTEE GENERAL MEETING

2. WINTER 2012 FACE-TO-FACE IRVING, TEXAS SGTCC Meetings One extended full SGTCC session – no breakout sessions Wednesday, December 5, 2012  1:30 – 3:00: Status reports from leadership and WG leads  3:30 – 5:00: Planning for 2013 activities/deliverables Additional T&C Sessions  T&C Bootcamp Delivered on Monday, December 3 rd  Grid Interop Session on T&C – Thursday, 1:00 – 2:30  T&C Session at Korea Workshop – Friday, 10:00 – 11:30

3. WINTER 2012 FACE-TO-FACE IRVING, TEXAS SGTCC Agenda – Session 1 Welcome and Roll Call – (10 minutes)  Approve minutes of last meeting  New business; old business Opening Remarks and SGTCC Priorities – Rik Drummond – (10 minutes) WG8 - IPRM Implementation Status Report – Kent Donohue (10 minutes) SGTCC Catalog of Standards Review – James Mater (20 minutes) ITCA Development Guide and FAQs – Rudi Schubert (10 minutes) Green Button ITCA Update – Kent/Rudi/Kay (10 minutes) T&C Landscape Draft – Rudi (10 minutes) Discussion – All (10 minutes) Break

4. WINTER 2012 FACE-TO-FACE IRVING, TEXAS SGTCC Agenda – Session 2 2013 SGTCC Plan Discussion  Finalizing Landscape Document  Priority Issues – Gaps/Opportunities  Industry Outreach  CoS and IPRM Implementation Working Groups

5. WINTER 2012 FACE-TO-FACE IRVING, TEXAS 2012 SGTCC Accomplishments Interoperability Process Reference Manual (IPRM) Version 2 released The IPRM implementation working group (WG8) has completed an application/review process for Interoperability Testing and Certification Authorities (ITCAs); provides the foundation to assess ITCAs for their IPRM implementation The SGTCC Catalog of Standards (CoS) working group has completed development of the review process for standards proposed for inclusion in the SGIP CoS, analyzing the characteristics of the standard related to testing/certification Implemented the IPRM/ITCA “implementation for dummies” FAQ White paper on Testing and Certification Importance and Value for the Smart Grid Completed a 2013 Education and Outreach plan for Smart Grid Testing and Certification advocacy

6. WINTER 2012 FACE-TO-FACE IRVING, TEXAS 2010-2011 Accomplishments 2010 – Getting Started  February 2010 – SGTCC formed and launched  First release of the Smart Grid Testing Landscape document and Smart Grid Testing Framework Guidelines  April 2010 – First SGTCC roadmap and deliverable plan released  Interoperability Maturity Assessment Methodology – released in the fall of 2010, this document provided a base set of assessment metrics to analyze standards for their readiness to support associated test programs  Lab Qualifications working group completed recommendations that were later incorporated into the IPRM  December 2010 - First release of the Interoperability Process Reference Manual completed 2011 – Implementing Recommendations  Interoperability Testing & Certification Authorities (ITCAs) began to publically commit to the implementation of the SGTCC recommendations detailed in the IPRM  Five accrediting bodies publically stated their support of the SGTCC recommendations and their intent to develop accreditation services to evaluate ITCA test labs and certification bodies.  Two new working groups launched – End to End Testing and IPRM Implementation End to End Testing group developed and piloted a test plan template for interoperability use cases IPRM implementation group began developing guidance materials to support ITCAs in their IPRM implementation  IPRM Version 2 was under development during the latter half of the year, transitioning from an informational to an operational document for use by ITCAs

7. WINTER 2012 FACE-TO-FACE IRVING, TEXAS Working Group Reports  WG8 – IPRM Implementation Chair: Kent Donohue  CoS working group Chair: James Mater

8. WINTER 2012 FACE-TO-FACE IRVING, TEXAS WG8 – IPRM Implementation Processes, tools and guidance to support IPRM stakeholders

9. WINTER 2012 FACE-TO-FACE IRVING, TEXAS WG8 site Stakeholder tools available on WG8 site  ISO to IPRM mappings (17025 & 17065)  ITCA Program Self Assessment Tool  IPRM link  FAQ's  Accreditation Audit Preparation  Relationship Diagram  IPRM Change Proposal Form http://collaborate.nist.gov/twiki-sggrid/bin/view/SmartGrid/SGTCCIPRMImplementation

10. WINTER 2012 FACE-TO-FACE IRVING, TEXAS WG8 admin of Program List SGTCC List of ITCA Programs – Link from SGTCC home page – Scope and caveats – Application form – Application review process http://collaborate.nist.gov/twiki-sggrid/bin/view/SmartGrid/SmartGridTestingAndCertificationCommittee http://collaborate.nist.gov/twiki-sggrid/bin/view/SmartGrid/SGIPITCAProgramList

11. WINTER 2012 FACE-TO-FACE IRVING, TEXAS WG8 in SGIP 2.0 Maintenance  SGTCC list of ITCA certification programs  Refine site artifacts from experiences  Migrate site information -> SGIP.org New Work  TBD

12. WINTER 2012 FACE-TO-FACE IRVING, TEXAS SGTCC CoS Working Group

13. WINTER 2012 FACE-TO-FACE IRVING, TEXAS CoS Work Group Charter Develop a review process for standards proposed for the SGIP Catalog of Standards Develop a set of evaluation criteria and metrics – what we will look at from a TCC viewpoint Develop a proposal to the TCC for adopting and implementing the CoS Review Process Transform or instigate the on-going standards review work group – move to assessments 13

14. WINTER 2012 FACE-TO-FACE IRVING, TEXAS TCC CoS WG Active Members Rudi Schubert Kent Donohue, UL (process document, NEMA AMI-SG1, SAE) Rolf Bienert, OpenADR Alliance (EMIX) Donny Helm, Oncor (NAESB REQ18) Brent Cain, Itron (NEMA AMI-SG1, SAE) James Mater, QualityLogic (Leadership, EMIX, NAESB REQ 18) 14

15. WINTER 2012 FACE-TO-FACE IRVING, TEXAS TCC Role in CoS Assessment SGAC view CWG view  Security aspects of the standard PAP view  Resolving conflict between standards  Defining new standards to fill gaps and finding homes TCC View  Identify standards that can be implemented  Quality of standard to support interop implementations  Quality of test and certification program, if one exists 15

16. WINTER 2012 FACE-TO-FACE IRVING, TEXAS TCC CoS Assessment Process 16 Can Standard be Implemented No Assessment NO Form Assessment Team and conduct Assessment Yes Note: Some standards require companion standards to implement. This may be noted and the assessment may include those standards. Work Group approves and forwards to TCC Leadership Group Approves and forwards to PMO for addition to CoS

17. WINTER 2012 FACE-TO-FACE IRVING, TEXAS TCC CoS Progress Four initial assessments completed  OASIS Energy Market Information Exchange (EMIX) V1.0  NAESB PAP10 Energy Usage Information Rev 1.0, December, 2010, NAESB REQ 18/WEQ19  NEMA SG-AMI-1-2009  SAE J2847-1 2011 Approved and forwarded to PMO PMO Comment from Stuart:  “This is very exciting, guys. You have really come a long way and this contribution to the CoS will make it a much richer tool for implementers and SSOs.”

18. WINTER 2012 FACE-TO-FACE IRVING, TEXAS PMO Comments on TCC Assessments Some of this information talks about the future and learning about things to come…nervous about having to maintain the documents...put a disclaimer that the review was conducted at such and such a date and the document can be updated if new testing and certification documentation is made available for the standard? The most important item in the review is the SGTCC recommendation…This was nicely done on these reviews. If we score things, there should be some generic comments about what the scores mean. PMO members reviewing – may have other comments.

19. WINTER 2012 FACE-TO-FACE IRVING, TEXAS 2013 TCC CoS Work Plan Continue to review standards already listed in the CoS. Decide our own priorities. Once caught up, we will use the same review prioritization as the other committees. http://collaborate.nist.gov/twiki- sggrid/bin/view/SmartGrid/CoSStandardsReviewQueueAn dTrackingToolhttp://collaborate.nist.gov/twiki- sggrid/bin/view/SmartGrid/CoSStandardsReviewQueueAn dTrackingTool

20. WINTER 2012 FACE-TO-FACE IRVING, TEXAS ITCA Development Guide and FAQs Add link once we post to Twiki end of November Provides a roadmap for an ITCA to follow in their implementation of the IPRM Provides an expanded FAQ section addressing questions received and those anticipated by the SGTCC  Incorporates existing WG8 FAQs with new material Thanks to James Mater/Quality Logic for providing much of the base material for the roadmap

21. WINTER 2012 FACE-TO-FACE IRVING, TEXAS Green Button ITCA Progress UCA released a request for participation to labs, certifiers and accreditors inviting contributions to building the Green Button ITCA program scheme UCA SGTCC members participated in bi-weekly calls with UCA providing review/comment on the RFP and other advice UCA presented plan and had discussions at their October meetings OpenADE progressing the technical material for testing UCA expanding activity to couple their 61850 program IPRM implementation in parallel to Green Button efforts

22. WINTER 2012 FACE-TO-FACE IRVING, TEXAS T&C Landscape Update Draft of the 2012 landscape available for comment  Need more input on a number of standards Goal is a comprehensive set of available information on testing programs/services across the FW 2.0 standards New material on where the FW2.0 standards are positioned across testing maturity – ITCA declared, other industry programs, various test services, nothing or NA

23. WINTER 2012 FACE-TO-FACE IRVING, TEXAS SGTCC – Session 2

24. WINTER 2012 FACE-TO-FACE IRVING, TEXAS SGTCC 2013 Planning Discussion Review proposed deliverables/activities Input/comments from SGTCC attendees Resources/timeline discussion SGTCC participant outreach for testing advocacy

25. WINTER 2012 FACE-TO-FACE IRVING, TEXAS 2013 SGTCC Plan IPRM Implementation working group in operating mode – reviews of ITCAs according to published process and evaluation criteria for recognition on SGIP website; ongoing effort as ITCA applications received SGTCC CoS reviews in operational mode – ongoing reviews of standards for testing aspects as they are proposed for the SGIP CoS  Initially catching up on existing CoS standards; then transition to new candidate standards Develop a Methodology and Priority List for Smart Grid Test Programs  NIST Draft of Prioritization Methodology Scheme for contribution to the SGIP (SGTCC and IMC) for further development  SGIP/SGTCC/IMC refinement of Prioritization Methodology  SGIP/SGTCC/IMC Preliminary Prioritization of test program needs  Individual outreach and dialogue on testing prioritization with key Smart Grid testing stakeholders (e.g. large utilities and test program/laboratory organizations)  Presentation Materials based on above for use at planned industry workshop  Analysis of Business Considerations for selected priority Smart Grid Test Programs Addressing any identified business roadblocks and developing potential solutions 25

26. WINTER 2012 FACE-TO-FACE IRVING, TEXAS 2013 SGTCC Plan (cont’d) Education and Outreach on Smart Grid Testing and Certification  Webinars; conference presentations; publications  Targeted dialogue with key influencers to drive testing demand (e.g. regulators, large vendors and utilities)  Collaboration and workshop participation with accreditation/certifier/lab community Work with Utilities (and other major stakeholder, e.g. vendors) and the SGIP IMC to Identify Test Program Gaps and Develop Proposed Test Program Solutions Expansion of the FAQs and ITCA support tools – guidance, assessment tools and templates to facilitate ITCA implementation  Guidance materials to enhance standards “testability” – level of specificity; test profile and PICS guidance; best practices for repeatability  Advise/support to organizations providing “companion” test specifications/programs (e.g. comparable support as provided to Green Button in 2012)

27. WINTER 2012 FACE-TO-FACE IRVING, TEXAS Major SGTCC Deliverables for 2013 Deliverable #1 – Landscape Document – planned for completion by 3/31/13 Deliverable #2 –Test Program Prioritization Methodology and a Prioritized List of Testing Needs – draft complete by 6/30/13 Deliverable #3 – Industry Workshop to solicit industry input on testing issues and prioritization needs – complete by 6/30/13 Deliverable #4 – Smart Grid Testing and Certification Education and Outreach Plan – complete by 12/31/12

28. WINTER 2012 FACE-TO-FACE IRVING, TEXAS Working Group Plans CoS working group will need to develop a plan for which standards will be reviewed by when for 2013  Recruiting volunteer reviewers WG8 ITCA review schedule will be dependent on applications received

29. WINTER 2012 FACE-TO-FACE IRVING, TEXAS Additional 2013 Considerations Ongoing  Continue collaboration with accreditors to enable availability of industry services for formal assessments of ITCAs/CBs/TLs (Kent)  Broaden industry involvement in the E2E standardized test case efforts (Mark/Donny) Do we re-launch the E2E group? With what goals?  E2E Test Case Repository – (Donny)

30. WINTER 2012 FACE-TO-FACE IRVING, TEXAS 2012 SGTCC Accomplishments Interoperability Process Reference Manual (IPRM) Version 2 released The IPRM implementation working group (WG8) has completed an application/review process for Interoperability Testing and Certification Authorities (ITCAs); provides the foundation to assess ITCAs for their IPRM implementation The SGTCC Catalog of Standards (CoS) working group has completed development of the review process for standards proposed for inclusion in the SGIP CoS, analyzing the characteristics of the standard related to testing/certification Implemented the IPRM/ITCA “implementation for dummies” FAQ White paper on Testing and Certification Importance and Value for the Smart Grid Completed a 2013 Education and Outreach plan for Smart Grid Testing and Certification advocacy

31. WINTER 2012 FACE-TO-FACE IRVING, TEXAS OPEN DISCUSSION