Presentation is loading. Please wait.

Presentation is loading. Please wait.

Market Trials Weekly Update – Friday Meeting November 22, 2013.

Similar presentations


Presentation on theme: "Market Trials Weekly Update – Friday Meeting November 22, 2013."— Presentation transcript:

1 Market Trials Weekly Update – Friday Meeting November 22, 2013

2 Agenda IDT Preliminary Debrief: 9:00 – 10:00A Analysis: 10:00 – 10:20A Scenario Analysis Look-Ahead: 10:20 – 10:40A Announcements Release Updates Look-Ahead Updates Release Scorecard Migration Report Known Issues Log Settlements: 10:40 – 11:00A CWG Checkpoint: 11:00 – 11:45A 2

3 Announcements 3 Please submit IDT ‘Management’ suggestions via RMSRMS Next IDT is Dec 3 (Prep Call Dec 2). IDT Reports IDT reports to be posted to spp.org here 7 calendar days after each IDThere spp.org > Integrated Marketplace > Market Trials > Integrated Deployment Test – Reports will be “summarized” on Friday calls one week in arrears Ginny Watson Test DateReport DateReview Date 11/19/1311/26/1312/6/13 (Holiday 11/29) 11/21/1311/28/1312/6/13 (Holiday 11/29) 12/3/1312/10/1312/13/13 12/5/1312/12/1312/13/13 And so on…

4 Deployment Test Reminders Please follow IM setpoints –11/21: NDVERs and DVERs chasing prices  11/21 IDT timeframe was selected because load was flat and NSI changes are minimum. SPP systems worked correctly but, ACE oscillation caused by Resources who do not follow IM setpoints  During the 12/3 IDT, SPP expects to get load pick up; NDVERs and DVERs need to not run at all or make every effort follow IM setpoints BAs should not be following or concerned about your ACE  Please ensure systems are following IM setpoints and not trying to control your own ACE 4 CJ Brown

5 Deployment Test Follow Up ICCP –DVERs:  Can receive follow flag for economic reasons. Please follow it.  Additionally, if DVERS are being “OOMEd,” they will receive a corresponding follow flag, which we except you to follow. DVERs will always receive OOME and follow flag at the same time. –NDVERs:  No such thing as a follow flag  If you are being “OOMEd”, you will receive an OOME only 5 Carrie Simpson

6 11-19-13 Deployment Test Debrief Overall the First Deployment test was a great success –Overall SPP BA ACE and frequency were in acceptable ranges throughout the duration of the test –EIS BA’s had no problems switching from EIS setpoints to IM setpoints and back again – this was the first time this was fully tested –No major problems were reported by SPP or the MPs during the test –Able to start and stop the test on time as scheduled with no delay, reduction or extension 6 CJ Brown

7 11-19-13 Deployment Test Debrief Though a “Success” there are things we can improve upon –MATCHING EIS and IM Offers  MPs need to start matching offers 4 hours prior to IDTs to allow time to work out any mismatches  Up to 30 Minutes prior to the operating hour of the IDT, SPP was still working with MPs to get the A/S offers corrected to assure there was enough Regulation and Operating Reserves available during the test  Regulation needs to be provided by the same Resource it was offered into the EIS market on –Coordinating the cutover better  Some MPs switched to IM setpoints too early – SPP will communicate the cutover timing more clearly  The desire for every IDT is to have the EIS BA’s and MP’s with Resources to be following IM setpoints by the start of the first five-minute interval of the test 7 CJ Brown

8 11-19-13 Deployment Test Debrief Though a “Success” there are things we can improve upon –Minor MP problems were addressed quickly and didn’t create any reliability concerns  Need to assure that MPs know what desk to call for what questions  Added additional phones to make sure we can take the call volume of changes during deployment tests –4 RTBM intervals solved but timed out before being approved  System loading is believed to be part of the root cause. Changes have been made to help address this issue. Issue #504 on the Known Issues Log.  RTGEN continued to issue setpoints based on the last good RTBM regulating for ACE. This worked as designed.  MPs need to know what to do in the case of a failed RTBM interval – they should follow setpoints – During the IDT some MPs reported getting a “zero” XML notifications where they should have not received any updates 8 CJ Brown

9 11-19-13 Deployment Test Debrief Though a “Success” there are things we can improve upon –Some MPs had XML Listener problems  Need to assure that MPs check them early in the day then again right before the tests –One participant had to manually enter setpoints for the first hour of the test due to problems with their EMS  Lead to a slight lag in managing ACE, but didn’t cause any excursions –MPs with DVERs need to know that if they are dispatched down by the IM setpoints they are expected to follow that setpoint –There were 59 non-wind Resources that had turnaround ramp rate of 0.1 or less – we need to discuss relaxing this for subsequent tests 9 CJ Brown

10 11-21-13 Deployment Test Debrief Overall the Second Deployment test was also a great success –Overall SPP BA ACE and frequency were in acceptable ranges throughout the duration of the test –All RTBM intervals solved and were approved on time –No major problems were reported by SPP or the MPs during the test –Able to start and stop the test on time as scheduled with no delay, reduction or extension 10 CJ Brown

11 11-21-13 Deployment Test Debrief Though a “Success” there are things we can improve upon –MPs did much better matching EIS and IM Offers – much improved from the 1 st IDT but can still get better –Flowgate loading was negatively affected by DVERs who were responding to EIS price signals – once this was communicated during the test it improved quickly –SPP’s Control room displays need some fine tuning –Had a single EIS BA that had some problems following IM regulation setpoints with three EIS BAs reporting some type of EMS issue during the test 11 CJ Brown

12 Preliminary Results 12 Scenario 7 Must Offer *Scenario document on spp.org herehere spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents > Scenarios in Parallel Ops From initial analysis it appears that most MPs were short of their demand bids and were in emergency conditions that should trigger Must Offer penalties From here, it is a manual process for the Market Monitor to determine if they were actually short and send out all of the notifications SPP filed tariff language on November 15 th to reflect the determination of Day- Ahead Must Offer compliance at the Asset Owner level. This is important change and SPP will reflect this change in Must Offer Scenario 7. The impact of this change is that the calculations of Net Resource Capacity, Reported Load, and Reserve Obligation will all be made at the Asset Owner level rather than the Market Participant level. Other updates in the document reflect the timing of the metered load data. While this data is available in the SPP Settlements system on OD+4, it is not available to the MMU until OD+8, after the issuance of initial statements. The updates in Section 1.2 reflect a shift of four days in the expected timing of the Scenario. John Hyatt

13 Preliminary Results 13 Scenario 28a Nonfunctional Testing: CMS Outage  CMS was disabled at 10:45 for about 15 or 20 minutes while the MPs continued to submit virtual transactions from the Markets User Interface.  When CMS was disabled, the credit check from Markets was disabled.  When the scenario was over, SPP brought CMS back online, and the DA Markets Desk approved the pending transactions and re-enabled the credit check from the Markets side. That triggered the auto-approve and re-synch process between Markets and CMS, and all processed successfully.  9 virtual transactions were pending credit approval for 6 asset owners. All 9 transactions approved with the operator manual approval action.  The manual notifications were sent successfully  There is a known defect with Enable Link button command. SPP believes this should be corrected with the next PRD release. For Reference Only

14 14 Summary – Scenarios in Parallel Ops: –1 Scenario and 1 Partial Scenario Executed to date:  Scenario 7 Must Offer pending Settlements results  Scenario 28a Successful Summary – Retests Pending: –14 individual retest requests pending  1 MP retesting Scenario 17.3 on 11/25  6 MPs requested retest for Scenario 34  3 MPs requested retest for Scenario 2  1 MP requested retest for Scenario 3  2 MPs requested retest for Scenario 12 (SPP waiting on MPs)  1 MP requested retest for Scenario 33 (SPP waiting on MP) Scenario Tracker as of Nov 21 Alan Adams

15 Announcements 15 Modeling Reports The following reports were available on spp.org during SMT and have been moved permanently to the Marketplace portal: marketplace.spp.org > Public > Marketplace > Modeling Reports SL to Pnode to Zone Mapping SL EIR Mapping SMT FAQ SMT Quick Facts Scheduling Changes 3 Hour IDT Thursday, Dec 12 5:30 – 10:30A CPT (IDT Test 6:30 – 9:30A) Actual test is now 3 hours instead of 4 hours Web mirroring turns off Dec 16 For details, Reference Market Trials Meeting_20131115 on spp.org.Reference Market Trials Meeting_20131115 spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents > Parallel Ops Presentations, Statistics, MP Meetings Ginny Watson

16 Announcements 16 IDT Reports IDT reports to be posted to spp.org here 7 days after each IDThere spp.org > Integrated Marketplace > Market Trials > Integrated Deployment Test – Reports will be “summarized” on Friday calls one week in arrears Ginny Watson Test DateReport DateReview Date 11/19/1311/26/1312/6/13 (Holiday 11/29) 11/21/1311/28/1312/6/13 (Holiday 11/29) 12/3/1312/10/1312/13/13 12/5/1312/12/1312/13/13 And so on…

17 Announcements 17 Settlements Calendar marketplace.spp.org > Public > Settlements > Calendar – The Settlements Parallel Operations calendar on the portal has been updated to reflect the accelerated posting schedule (OD+14)for finals during parallel operations. The accelerated meter and BSS submittal timelines have also been updated accordingly. Ginny Watson

18 Look-Ahead: Nov 25 – Dec 1 18 Market Trials Hotline closes Wednesday Nov 27 Contact the SPP desks (501-614-3900) critical or high issues DA, RUC, RTBM, Balancing desks supported 24 x 7. See the following slide. Parallel Ops Calendar on spp.org Parallel Ops Calendar spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents Settlements details on the Settlements CalendarSettlements Calendar marketplace.spp.org > Public > Settlements > Calendars Mon Nov 25 for OD Tues Nov 26: Scenario 15 – Commitment Mismatch Thurs Nov 28 & Fri Nov 29: SPP Holidays. No SPP staff running DA Market or DA RUC. Quality of solutions may be less than a normal supported day. DA Market and DA RUC: run studies on Wed 11/27 for Thurs 11/28, Fri 11/29 ID-RUC (COP True-UP): run at least every 4 hours RTBM: maintain as normal RTGEN/EMS: maintain as normal Ginny Watson

19 Parallel Ops / IDT Communication Plan 19 Ginny Watson Availability 501-614-3900 Call OptionWhen should I call a specific desk? Balancing Desk24x72 I have any real time issues or questions concerning NSI, Tie Lines or Frequency. I have a real time Load related issue that might impact capacity or operating reserves. I have an ICCP real time related issues. I have a Real Time Reserve Sharing Event questions. Any activities of EIS BAs that could impact SPP BA. Events that impact real time reporting requirements. RTBM Desk24x75 I have a real time Resource related issue that might impact capacity, operating reserves and/or economic dispatch. I have any real time operational discrepancies concerning economic dispatch (XML dispatch, resource plan information, AS offer information). Tariff and Interchang e Desk 8am-5pm Monday-Friday6 My tags are getting denied but I have to have them in by a certain deadline. My transmission requests are getting denied but I have to have them in by a certain deadline. RUC Desk24x77 I have a unit commitment related question or information to communicate to SPP (new commitments, changes to existing commitments, startup issues, shutdown issues). I have a real time Contingency Reserve Deployment question/issue. DA Desk 6am-6pm 7 days a week8 I can't get my DA Bid Offer in by a certain deadline. I have a question concerning the current day's DA Market clearing process. Reliability Coordinati on Desk During IDTs OnlyN/A For Reliability Coordination issues during IDT the IDT conference calls and normal process will be leveraged.

20 Scenario 15 pt 2 Commitment Mismatch 20 *Scenario document on spp.org herehere spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents > Scenarios in Parallel Ops Scenario Description A commitment mismatch occurs when a resource outaged in the RTBM commit status conflicts with the COP status for the resource as committed by the DA market. When there is a commitment mismatch between RTBM commit status and the COP, the RTBM commit status outage will prevail in the RUC solution Expected Result Outaged resources will not be committed in the RUC process for the outaged intervals. SPP operators will update the COP MPs should receive a STOP notification based on when the Resource is to be outaged. Alan Adams

21 Scenario 15 pt 2 Commitment Mismatch 21 MP Activities: Section 2.2. “Outage Commit Status MPs must submit a commit status of “Self” in the DA Market offer to ensure a resource will be committed in the DA Market and therefore be committed in the COP during the DARUC process MPs will submit a Commit Status of “Outage” in the RTBM offer prior to the execution of DARUC (1700) on the resource that cleared in the DA Market MPs will need to review the START/STOP notifications to verify that the resources with a Commit Status of “Outage” received a STOP notification for the beginning hour of the Outage period Please ensure that for Operating Day 11/26, the designated Resource has a Commit Status of “SELF” in the DAMKT Offer. On 11/25, after the closing of the DAMKT, update the RTBM Offer for OD 11/26 to have a Commit Status of “Outage”. Alan Adams

22 Schedule 22 Nov 25 – Dec 1 Nov 26: Scenario 15 Commitment Mismatch Part 2 Nov 28: SPP Holiday Nov 29: SPP Holiday Dec 2 - 8 Dec 2: IDT Prep Call 3:00P Dec 3: IDT 5:30A (test begins at 6:30A) Dec 4: IDT Debrief and Prep Call 3:00P Dec 5: IDT Call 6:30A (test begins at 7:30A) Dec 6: IDT Debrief and Market Trials Call 9:00A Ginny Watson

23 Migration and Maintenance Report 23 Migration and Maintenance Report Migration and Maintenance Report posted to spp.org spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents Annette Holbert

24 24 Release Scorecard Release Scorecard posted to spp.org: spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents Release Scorecard Ginny Watson

25 Known Issues Log 25 Please review the Market Trials Known Issues Log on spp.org Market Trials Known Issues Log spp.org > Integrated Marketplace > Market Trials > Structured/Unstructured Test > Integrated Marketplace Market Trials Project Documentation Folder Carrie Simpson Issue #Component Synopsis Severity 827 Markets UI When the Reserve Requirement is recalculated within the same day and a MP queries for their Reserve Requirement, they will receive all entries. The code should be corrected so that only the most recent entry is pulled. Severity 3: Medium

26 Market Trials Useful Resources Integrated Marketplace Parallel Operations Project Documents spp.org > Integrated Marketplace > Market Trials > Parallel Operations Test> Integrated Marketplace Parallel Operations Project Documents Parallel Ops Presentations, Statistics, MP Meetings Folder Parallel Ops Reference Documents Folder Scenarios in Parallel Ops Folder > Scenarios Schedule Scenarios in Parallel Ops Folder Scenarios Schedule Parallel Ops Communication Plan Parallel Ops MP Guide Parallel Ops Calendar Known Issues Log Release Scorecard Migration Report Integrated Deployment Test (as part of Parallel Ops) spp.org > Integrated Marketplace > Market Trials > Integrated Deployment Test IDT MP Guide Parallel Ops Calendar Additional documents: Settlements Calendar marketplace.spp.org > Public > Settlements > Calendars Settlements Calendar Change Tracker spp.org > Integrated Marketplace > Marketplace Documents Change Tracker Integrated Marketplace Structured/Unstructured Test Project Documents spp.org > Integrated Marketplace > Market Trials > Structured / Unstructured Test> Integrated Marketplace Structured / Unstructured Test Project Documents 26

27 Settlements Status Transition from SMT to Parallel Operations was executed on schedule The first Operating Day of Parallel Operations (11/12) was posted on schedule The accelerated posting schedule for Finals and Resettlements was discussed at the CWG and this week’s SUG. The recommendation was accepted so that is out plan moving forward. The revised Parallel Operations calendar reflecting the change was posted yesterday. 27 Brent Wilcox

28 Market Settlement System (MSS) Known Issues KIL# 828 The invoice date is incorrect. On the Bill determinant report the invoice date matched the operating day--- this is not possible. –This is expected to be fixed in January. 28 Brent Wilcox

29 Market Settlement System (MSS) Known Issues KIL# 838 The Common Bus Flag is not being correctly pulled into ETSE. This will affect any determinants or flags that use the commonbusflg on OD 11/12/13. (i.e XmptDev5minFlg, RtCRDeplFailAmt.)  This is expected to be fixed in January. 29 Brent Wilcox

30 Market Settlement System (MSS) Known Issues KIL# 840 Two decommitment records are being received in table for one commitment period. –Change to POPS so that every decommit has a corresponding commit –A message is needed to WARN analyst that a resource could be re-commited and de-commited again and to check for this possibility  This is expected to be fixed in January. 30 Brent Wilcox

31 Market Settlement System (MSS) Known Issues KIL# 841 The view that is used to populate the customer info (address, long name, etc.) on the invoice pdf needs to be modified to check the effective date of the mp in the spp_cust_def table in case the mp is in that table multiple times w/ different effective dates.This is expected to be fixed in January. –This is expected to be fixed in January. 31 Brent Wilcox

32 Market Settlement System (MSS) Known Issues KIL# 842 Intermittent schema validation issues are occurring when submitting meter data files. MPs may receive error message. Resubmitting usually works fine. –This is expected to be fixed in January. 32 Brent Wilcox

33 Parallel Operations /Go Live Checkpoint November 22, 2013

34 MARKET RELEASE UPDATES Carrie Simpson

35 MOS 1.8 –Standard core regression testing against 1.8 will wrap up early week of 11/25 –Full regression of UI and API is wrapping up –MCE reporting defects found in Certification Testing have been retested –Regression tested the FIT interface improvements with 1.8 Increased Functionality with 1.8 –Wind Resource Forecast displays in MUI (subject to NDA) –Notifications on Secondary Listeners –Special resource logic fixes for BDRs, DVERs, and EDRs –MOI operator usability improvements –Market Control and stability improvements FIT Testing –94% of Markets workstream FIT test cases have passed  Remaining FIT testing is specific commercial model and TLR Level 2  WAUE name issues have been resolved 35 Markets Test Execution

36 MOS 1.9 will include: –FERC Mitigation changes –Emergency Logic fixes –Increased UI and API usability –Additional Market Control, MDB and performance updates MOS 1.9 Test Execution: –Planned full MCE regression test –MMU team will conduct full regression against revised Mitigation functionality Release Schedule: –Delivery to SPP scheduled for Wednesday 11/27 –PROD promotion scheduled for Friday 12/20 36 MOS 1.9 Release

37 SYSTEM FREEZE UPDATE Sam Ellis

38 System Freeze Timeline Update 38

39 MP READINESS CERTIFICATION & SPP READINESS FILING UPDATE Erin Jester

40 Timeline: Integrated Marketplace Readiness Filing 40 2/29/12 Transmittal Letter 10/18/12 FERC Order 3/25/13 Readiness Metrics & Reversion Plan 11/1/13 Updated Readiness Metrics & Reversion Plan 12/20/13 MP Readiness Certification Due 12/27/13 Readiness Certification & Metrics FERC Filing February 2014 Anticipated Final FERC Order(s) 3/1/14 Go-Live

41 Readiness Filing Next Steps SPP’s Integrated Marketplace Readiness Certification –Filing Due Date: December 27, 2013 –SPP’s Assessment of Operational Readiness –Market Readiness Metrics –Status of BA Certification 41

42 MP Certification Form Process Completion of the MP Readiness Certification is an official Readiness Metric filed with FERC (RGL-03) A letter was sent to MOPC Representative (or Executive Sponsor) of each MP on 11/18 to explain the timeline and intent of the MP Readiness Certification The official MP Readiness Certification letter and form was sent on 11/20 via RMS to the Readiness Liaison for each MP –If no Readiness Liaison, then it will be assigned to the CWG Representative –If no CWG Representative, it will be assigned to the Market Trials Liaison or Registration contact Please return the form signed by an authorized signatory of your company as a hard copy by December 20, 2013 –A scanned copy can be emailed in order to make the deadline; a hard copy must be sent after 42

43 READINESS METRICS UPDATE Erin Jester

44 ColorDescription GreyMonitoring of the metric has not begun or not applicable Blue The metric success criteria has been met and no longer requires monitoring, and/or the metric has been completed by the target due date Green The metric is meeting identified success criteria, and/or The metric is on schedule to meet the target due date Yellow The metric has not met the highest level of the identified success criteria, and/or The metric is at risk not meeting the identified target due date RedThe metric has not met the highest or mid-range success criteria as defined, and/or the metric has not been completed by the specified target due date Total Number of Readiness Metrics: 50 Number Complete (Blue): 9 Number on Track (Green): 31 Number at Risk (Yellow/Red): 8 Number Not Started (Gray): 2 Readiness Metrics Overview 44

45 Parallel Operations Readiness Metrics IDMetric NameStatusVariance OPS-02State Estimator AvailabilityY SE not solved for certain times of the day due to network issues, which will be patched after further resting OPS-03State Estimator AccuracyG State Estimator solves 90% of the time with Mismatch level lower than 50 MW for 7 consecutive days prior to Parallel Ops OPS-04STLF AccuracyG Short term load forecast for the SPP market footprint used for RTBM for conforming loads solves 97% of time with +/- 1% accuracy for seven consecutive days prior to Parallel Ops OPS-05aMTLF - 4AM ID RUCG 4am Mid-term load forecast for conforming loads for the SPP market footprint solves 97% of time with +/- 3% accuracy for seven consecutive days prior to Parallel Ops OPS-05bMTLF - 12PM ID RUCG 4am Mid-term load forecast for conforming loads for the SPP market footprint solves 97% of time with +/- 3% accuracy for seven consecutive days prior to Parallel Ops OPS-05cMTLF - 5PM DA RUCG 4am Mid-term load forecast for conforming loads for the SPP market footprint solves 97% of time with +/- 3% accuracy for seven consecutive days prior to Parallel Ops 45

46 Parallel Operations Readiness Metrics 46 IDMetric NameStatusVariance OPS-06a Wind Forecast Accuracy - Pre RTBM G Wind forecast for SPP Market footprint solves with +/-15% accuracy for six out of seven consecutive operating days prior to Parallel Ops OPS-06bWind Forecast Accuracy - RTBMG Wind forecast for SPP Market footprint solves with +/-10% accuracy for six out of seven consecutive operating days prior to Parallel Ops OPS-06cWind Forecast Accuracy - DA RUCY Windfarms in EIS that are not reflected in the IM forecast must be curtailed/directed down. Weather events also cause data to fluctuate OPS-07 Market Flow Calculations Availability - Current Hour G Market Flow Calculations successful ninety-seven percent (97%) of 5 minute solutions for seven consecutive days prior to Parallel Ops OPS-08 Market Flow Calculations Availability - Next Hour G Market Flow Calculations successful ninety-seven percent (97%) of 5 minute solutions for seven consecutive days prior to Parallel Ops OPS-09DA Market Results PostedG Day-Ahead Market results are posted every day by 4pm for 5 consecutive days prior to Parallel Ops

47 Parallel Operations Readiness Metrics 47 IDMetric NameStatusVariance OPS-10 Generate DA LMPs and Settlement Point Prices G LMPs are made available for each settlement location every day by 4pm for 5 consecutive days prior to Parallel Ops OPS-11RTBM Calculation AvailabilityY Real-Time Calculations are not successful ninety- nine percent (99%) of five (5) minute solutions for 7 consecutive days prior to Parallel Ops. (93.8% on 11/10 and 97.9% on 11/16) OPS-12Operating Reserve RequirementsG Operating Reserves are calculated and posted on time for 7 consecutive days prior to Parallel Ops OPS-13Regulation Pre-CertificationGMilestones are tracking on time OPS-14ACE Performance AccuracyR Data, staffing and testing issues causing this metric to pass only 35% of the intervals OPS-15CROW Outage SubmissionR 19/20 of resource-owning MPs have not reported all outages through SCADA and CROW within 30 minutes

48 Parallel Operations Readiness Metrics 48 IDMetric NameStatusVariance OPS-16 MP Response to Deployment Testing 12/3/2013Metric not started OPS-17ICCP Model ValidationY 7/41 of MPs ICCP models are not validated due to not providing SPP with point name and models OPS-18ICCP Control Status TrackingR 61.3% of all MP's control modes submitted correctly between 11/4 and 11/8. Communications have been made to MPs regarding submitting control modes correctly. RSG-01 RSG Member Integration and Testing Complete GMilestones are tracking on time TRL-01Market Trials ParticipationG 90% - 100% of Target Mass is participating in Market Trials TRL-02 Structured/Unstructured Test Complete Y November: 2/3 scenarios passed (28A, 33B passed, 35 failed and will be retested in the vendor DST environment)

49 Parallel Operations Readiness Metrics 49 IDMetric NameStatusVariance TRL-03 Market Trials - Integrated Deployment Testing G The most recently executive Integrated Deployment Test (11/19) was successful CBA-01CBA Certification ActivitiesGMilestones are tracking on time CON-01 TCR Accelerated Connectivity Test Complete C TCR Accelerated Connectivity Testing Exit Criteria has been met CON-02Connectivity Test CompleteCTarget Mass Passed Connectivity Testing CON-03 Data Exchange Certification Complete CData Exchange Passed for Target Mass INT-01Process & ProceduresGAll Process Documentation is now on track

50 Parallel Operations Readiness Metrics 50 IDMetric NameStatusVariance INT-02Organizational Staffing ReadinessG All Integrated Marketplace positions have been filled within 90 days of the due date. INT-03SPP Internal TrainingG 96% of SPP staff performing Integrated Marketplace functions have no incomplete training requirements within 30 days of due date INT-04SPP Operations TrainingG 96% of SPP Operations staff have no incomplete training requirements within 30 days of due date REG-01MP Registration - SPP ActionC100% Target Mass are modeled REG-02MP Registration - MP ActionG Milestones are tracking on time for 100% of Target Mass RGL-01FERC Tariff FilingGMilestones are tracking on time

51 Parallel Operations Readiness Metrics 51 IDMetric NameStatusVariance RGL-02Readiness & Reversion PlanGMilestones are tracking on time RGL-03MP Readiness CertificationG Milestones are tracking on time for 100% of Target Mass TCR-01 Validate Annual TCR Auction Timeline C The TCR annual auction results are posted on time for phase two of TCR Market Trials TCR-02 Validate Monthly TCR Auction Timeline C Post results according to established timeline (includes interim posting dates for Verification and ARR Allocation steps) TCR-03 TCR Production - Abbreviated Annual Auction G Post results according to established timeline (includes posting dates for Verification, ARR Allocation, and TCR Auction steps) TCR-04 TCR Production - Two Monthly Auctions 2/14/2014Metric not started

52 Parallel Operations Readiness Metrics 52 IDMetric NameStatusVariance TCR-05TCR Monthly Trials ParticipationC > 90% of “High Priority” MPs and over 50% of candidate ARRs nominated and participated in the TCR auction either in annual or monthly TCR-06 TCR Monthly Trials October Monthly Participation C 100% of “High Priority” MPs participated in the TCR auction per stated intention to participate STL-01Access & Download StatementsG 100% of Target Mass were able to successfully download a Statement STL-02Access & Download InvoicesG 100% of Target Mass were able to successfully download an Invoice STL-03Submit Meter DataG 100% of meter agents successfully submit meter data for each of their assets STL-05Submit DisputeG 100% of Target Mass successfully submitted a dispute STL-06Settlement Statement TimelinessG Successfully posted Settlement Statements on time, reliably and consistently over Market Trials/Parallel Operations STL-07 SPP Validation of Settlement Charge Types C 100% of Charge Types with calculated results were utilized by Target Mass. Charge Types with calculated results not utilized by Target Mass are explainable.

53 PARALLEL OPS EXIT & MARKETPLACE GO LIVE CRITERIA Erin Jester

54 Parallel Operations Exit and Go Live Criteria 21 DRAFT Go Live Criteria 28 DRAFT Parallel Operations Exit Criteria Please provide feedback via RMS by December 6, 2013 –Be sure to use the “Readiness & Metrics” Quick Pick Posted on Readiness Center in the Go/No-Go Criteria Documents folderGo/No-Go Criteria Documents folder Updates will be posted weekly and reviewed during Checkpoints 54

55 Future Checkpoints CWG checkpoints are posted on the Parallel Operations CalendarParallel Operations Calendar December –Friday, December 13 –Friday, December 20 (CWG) January −Friday, January 3 −Wednesday, January 8 −Friday, January 17 −Friday, January 24 (CWG) −Friday, January 31 55 February −Friday, February 7 −Friday, February 14 (CWG) −Friday, February 21

56


Download ppt "Market Trials Weekly Update – Friday Meeting November 22, 2013."

Similar presentations


Ads by Google