1. Performance Measure Recommendations
Greg Pierce – Chair, Performance Measures Task Force
Compliance and Certification Committee Meeting
September 8-9, 2010

2. Topics PMTF Tasks and Status Performance Measure Recommendations
Performance Measure Trends
Next Steps

3. Tasks
Establish an open, consistent and repeatable metric development process to identify and evaluate metrics
Develop compliance improvement measures at the highest levels to provide insight in terms of a set of compliance principles
Coordinate and work with Regional Entities, RMWG, OC, PC and CIPC to ensure agreement
Recommend how to benefit from the compliance improvement measures

4. Status Adopted RMWG’s open metric development process
Reviewed data source on compliance and other key input factors
Proposed a set of performance measures at high levels
Gathered data and validated preliminary trends
Received feedback from CCC, OC/PC, RMWG, Regional Entities and NERC staff since June 2010
The final report is available at

5. Performance Measure Recommendations.
Self Disclosure
Compare self disclosed versus discovered violations
Timeliness of
CVI/CIQ Resolutions
Average duration of CVI/CIQ and number of lessons learned issued
Mitigation Plan
Average duration for mitigation plan implementation
Violation Risk
Risk factor and severity level weighted average based on unmitigated violations
Feedback Timeliness
and Effectiveness
Actionable lessons learned guidance from audits, operating experience, violations and disturbances
Feedback to Standards
Direct input to standards development, including results-based standards initiative
Audit Results Timeliness
Average duration for no-violation audit report completion
Enforcement Results Timeliness
Average duration for audit reports with potential violations

6. Self Disclosure

7. Self Disclosure (cont’d)

8. Timeliness of CVI/CIQ

9. Timeliness of CVI/CIQ (cont’d)

10. Average Duration of Mitigation Plan Completion

11. Violation Risk Index

12. Timeliness of Lessons-Learned
Special Considerations: The speed by which the lessons learned are completed and issued may also relate to whether a particular lesson is common to the industry or some segment of the industry. The complete data to measure the Timeliness of Lessons Learned is currently not available.

13. Feedback to Standards

14. Average Duration of Audit Report Completion w/ No Violations

15. Average Duration of Audit Report Completion w/ Possible Violations

16. Scope for the Performance Measures Working Group

17. Performance Measures Working Group
Continue to develop and improve performance measures in the areas:
CMEP process efficiency
Direct feedback to Standards
Material timeliness
Reliability enhancements
Risk-informed guidance

18. Scope (cont’d) Define data collection and reporting guidelines
Publish quarterly website updates on compliance performance measures
Provide relevant prioritized feedback to enhance the performance under the compliance program and standards development programs, as well as enhance the reliability of the bulk power system
Provide an annual report assesses trends and recommendations.

19. Recommended Action by CCC

20. Recommended Action by CCC
The PMTF recommends that the Compliance and Certification Committee
Approve the report “Compliance Performance Measure Recommendations”
Approve the scope of the Performance Measures Working Group

21. Questions & Answers