Settlement Replacement Readiness Criteria January 31, 2019 Brent Wilcox, Annette Holbert

Agenda Readiness Criteria Criteria Status Heat Map Q&A

Readiness Criteria Unstructured Testing Performance Accuracy Calendar functionality Member submissions BSS Meter Transmission Ability to process/post results for Settlement day using SMS Member ability to download reports Statements Determinant Transmission Summary EQR FSE Validation Member notifications Ability to consume upstream data (Market) Ability to create/consume upstream data (Transmission)

Readiness Criteria Structured Testing Performance Accuracy Existing determinants RR determinants Member ability to download reports Public Reports Invoices Ability to process and post invoice results using SMS

Readiness Criteria Go Live Performance Accuracy Existing determinants RR determinants Post validation reports for Markets and Transmission Ability to capture audit evidence Ability to create known manual adjustments Ability to consume ETS resettlements as manual adjustments Historical data migration Ability to validate commercial model Transmission model ready in upstream system Ability to consume upstream transmission data Ability to provide data to downstream systems

Readiness Criteria Status (Unstructured and Structured Testing Criteria) Performance Market and Transmission run times are within acceptable range. Market and Transmission extraction times are within acceptable range. Still need to test if performance degrades with more runs. Until all calculations are finalized changes to formulas may continue to impact performance

Readiness Criteria Status (Unstructured and Structured Testing Criteria) Accuracy Issues with accuracy of Market and Transmission bill determinant calculations. Formula accuracy Market – within acceptable range to begin member testing Transmission – within acceptable range to begin member testing SMS calculation consistency Some data is not automatically triggering calculations to fire as expected in all cases.

Readiness Criteria Status (Unstructured and Structured Testing Criteria) Calendar Functionality (Portal & API) Portal functionality ready for testing Internal testing ongoing API functionality still being tested Excel file posted for testing Member Submissions (BSS, Meter, Transmission) UI Testing complete API Testing complete with defects on BSS and Meter (see Known Issues Log for list of defects) Process/post results for Settlement day using SMS Internal testing underway

Readiness Criteria Status (Unstructured and Structured Testing Criteria) Member Reports Meter, Statements, Determinants, Transmission Summary, EQR, FSE Validation, Public Reports, Invoices Internal testing underway for all reports, no significant change from CWG meeting on 01/23/19. Data is now being generated to populate these reports. Member Notifications Testing complete with exception of Meter Agent UI notifications (see Known Issues Log for list of defects) Ability to consume upstream data (Market) Internal testing is ongoing Ability to create/consume upstream data (Transmission) Ability to process and post invoice results Execution of these tests is dependent upon other system test completion

Questions 8 RMS link: https://spprms.issuetrak.com/ Quick Pick: Project Inquiries > Settlement System Replacement 8