ERCOT Project Update ERCOT Outage Evaluation Phase 2 (SCR745) TDTWG November 5, 2008.

Slides:



Advertisements
Similar presentations
Information Technology Report Dave Pagliai Manager, IT Support Services March 2015 ERCOT Public.
Advertisements

VP, CIO Information Technology
RMS Update to TAC August 7, RMS Update to TAC ► At July 9 RMS Meeting:   RMS Voting Items:
Retail Market Subcommittee Update to TAC Kathy Scott April 24,
Objectives: Upgrade Siebel to a supported application Upgrade Oracle database to current version Deliver all existing user functionality with no degradation.
1 TDTWG Report to RMS SCR 745 ERCOT Unplanned System Outages Wednesday, July 13th.
ERCOT Retail Market IT Update Aaron Smallwood Director, IT Operations Retail Market Subcommittee April 7 th, 2015.
ERCOT PMO Update Robert Connell Director Program Management Fourth Quarter Results (Through 12/31/04) January 11, 2005.
1 TDTWG Update to RMS June 2, MarkeTrak API Performance Metrics Review ERCOT continues work with CenterPoint and Oncor to refine/revise the MT API.
RO Project Priority List Update EDW Projects Update RMS Meeting Adam Martinez Mgr, Market Ops Divisional Projects Organization ERCOT April 12, 2006.
RMS Update to TAC January 3, Goals Update ► Complete and improve SCR745, Retail Market Outage Evaluation & Resolution, implementation and reporting.
RMS Update to TAC May 8, RMS Update to TAC ► At April 9 RMS Meeting:  Antitrust Training  RMS Voting Items: ► NPRR097Changes to Section 8 to Incorporate.
Retail Data Transport Upgrade ERCOT Recommendation ERCOT Public June 2015.
IO – CART Project Status Protocol Revision Subcommittee Update 06/22/06.
1 TDTWG Update to RMS Tuesday January 6, Primary Activities 1.Reviewed ERCOT System Outages and Failures 2.Presented Service Availability and.
Retail Market Subcommittee Update to COPS Kathy Scott July 16,
Market Impact Assessment TF Final Report to RMS June 11, 2008.
Information Technology Update ERCOT Board of Directors Meeting January 17th, 2005.
RMS Update to TAC January 8, Voting Items From RMS meeting on 12/10/2008  RMGRR069: Texas SET Retail Market Guide Clean-up – Section 7: Historical.
1 TDTWG Update to RMS Wednesday December 5, 2007.
1 TDTWG Update to RMS Wednesday November 7, 2007.
1 TDTWG Update to RMS Wednesday February 14 th, 2007.
Objectives: Upgrade Siebel to a supported application Upgrade to Oracle 9i database Deliver all existing user functionality with no degradation in performance.
1 TAC Report to the ERCOT Board October 18, 2005.
ERCOT SCR745 Update ERCOT Outage Evaluation Phase 1 and Phase 2 TDTWG April 2, 2008.
ERCOT Project Update ERCOT Outage Evaluation Phase 2 (SCR745) TDTWG May 7, 2008.
August 9, 2006 Retail Market Subcommittee Meeting Retail Business Processes (RBP) Project Update A Sub-project of the Service Oriented Architecture (SOA)
Information Technology Service Availability Metrics Trey Felton IT Account Manager COPS/RMS September 2009.
PR50121_07 Retail Business Processes (RBP) Project Update Retail Market Subcommittee November 8, 2006 Adam D. Martinez Mgr, Market Operations DPO.
PMO Update to PRS Troy Anderson ERCOT Program Management Office December 17, 2009.
Retail Transaction Processing Year End Review and Recent Issues RMS January 2007.
1 TDTWG Update to RMS Tuesday February 3, Primary Activities Elections 2.ERCOT System Outages and Failures 3.MarkeTrak Performance 4.Discussed.
1 TDTWG Scope and Goals 2015 Wednesday January 8, 2014.
February 20, 2006 Nodal Architecture Overview Jeyant Tamby 20 Feb 2006.
1 New RO Projects Hope Parrish June NEW RO Projects for 2008 Requested by ERCOT - Overview Objective Objective of the following information is to.
1 TDTWG Update to RMS Wednesday August 17, Primary Activities 1.Reviewed ERCOT System Outages and failures 2.Reviewed 2011 SLA 3.ERCOT presented.
Information Technology Report Trey Felton Manager, IT Service Delivery October 2011 ERCOT Public.
1 Market Data Transparency SCR 740 Business & Technical Training SCR 727 Phase II: Web Services ERCOT presents: Market Data Transparency.
PMO Update to PRS Troy Anderson ERCOT Program Management Office January 21, 2010.
Retail Operations 2008 Fund Release Proposal Retail Market Subcommittee June 11 th, 2008 Hope Parrish Market Operations Division Projects Organization.
Retail Market Subcommittee (RMS) Update Kathy Scott April 9, 2013Commercial Operations Subcommittee 1.
June 2010 COPS/RMS Information Technology Report Trey Felton Manager, IT Administration.
May 9 th, 2007 Retail Market Subcommittee Meeting PR50121_07 Retail Business Processes (RBP) Project Update A Sub-project of the Service Oriented Architecture.
Objectives: Upgrade Siebel to a supported application Upgrade Oracle database to current version Deliver all existing user functionality with no degradation.
1 TDTWG Accomplishments 2010 Friday January 28, 2011.
1 Texas Data Transport & MarkeTrak Systems (TDTMS) Update to RMS February 2, 2016 Jim Lee (AEP) – Chair Monica Jones (NRG) – Vice Chair.
1 TDTWG Update to RMS Tuesday March 3, Primary Activities 1.ERCOT System Outages and Failures 2.MarkeTrak Performance 3.Discussed 4 th QTR Performance.
9/13/2006 RMS Duplicate Retail Transactions. RMS9/13/2006 Background Duplicate Retail Transactions Types of duplicate transactions: –PaperFree duplicate.
1 TDTWG Report to RMS Recommended Solutions for SCR 745 ERCOT Unplanned System Outages and Failures Wednesday, August 10th.
Information Technology Service Availability Metrics March 2008.
Retail Market Subcommittee Update to COPS Kathy Scott November 5,
Market Coordination Team Update Retail Market Subcommittee April 11, 2007 Susan Munson Retail Market Liaison.
RMS Update to TAC November 1, RMS Activity Summary RMGRR057, Competitive Metering Working Group Name Change (VOTE) Update on RMS Working Group and.
Information Technology Update Aaron Smallwood Manager, IT Business & Customer Services.
1 Yearly Project Prioritization Process Overview and New RO Projects Troy Anderson et. al. June 2007.
April 2010 COPS/RMS Information Technology Service Availability Metrics Trey Felton Manager, IT Administration.
1 Texas Data Transport & MarkeTrak Systems (TDTMS) Update to RMS March 1, 2016 Jim Lee (AEP) – Chair Monica Jones (NRG) – Vice Chair.
1 TDTWG Update to RMS Wednesday May 6, Primary Activities 1.Reviewed ERCOT System Outages and Failures 2.Reviewed Service Availability 3.Reviewed.
Commercial Operations Sub-Committee Update to TAC January 8, 2009 Lee Starr, BTU.
1 TDTWG Report to RMS SCR Addressing ERCOT System Outages Tuesday, May 10.
TDTWG UPDATE TO RMS 1 Tuesday April 1, Reviewed ERCOT System Outages and failures ERCOT presented the monthly Incident Report Planned/Unplanned.
August 17, 2006 Data Extract Working Group EDW Project Updates 2006 / 2007 MO & RO PPL.
Lead from the front Texas Nodal 1 TDWG Nodal Update – June 6, Texas Nodal Market Implementation Server.
MODPO Project Update Overview of December Implementations & EDW Changes Commercial Operations Subcommittee December 11, 2006.
July 2008 RO Projects Financial Overview Retail Market Subcommittee August 13, 2008 Hope Parrish Market Operations Division Projects Organization.
1 PR70007 – MarkeTrak Ph2 ERCOT Project Strategy 07/30/2007.
Commercial Operations Sub-Committee Update to RMS
Emergency Database Failover: Impacts & Recovery Plan
Troy Anderson ERCOT Program Management Office November 6, 2008
ERCOT SCR745 Update ERCOT Outage Evaluation Phase 1 and Phase 2
Presentation transcript:

ERCOT Project Update ERCOT Outage Evaluation Phase 2 (SCR745) TDTWG November 5, 2008

2 PR60006_01 Phase 2 ERCOT Update - Overview Background: SCR 745: To achieve improved Market performance and reliability through a reduction of ERCOT Retail Systems unplanned outages. This effort was believed to be achievable through the implementation of three efforts: PR60006_01 ERCOT Outage Evaluation PhI: ERCOT Outage Evaluation Phase I and Phase II Phase I, NAESB and Proxy Clustered (Delivered 02/2007-Goal Achieved) Phase II, Paperfree Clustered environment with File Server Redundancy and High Availability (Clustered achieved. Redundancy outstanding) PR60006_02 ERCOT Outage Evaluation PhIII, Database Clustering Solution (agreed to cancel due to stability received from AIX DB Transition)

3 PR60006_01 Phase 2 ERCOT Update – Outages Retail Transaction Processing Unplanned Outages by # of Incidents NAESB Seebeyond TIBCOPaperfreeSiebelTML Retail Databases Total * Based on IT Incident Report on 11/05/2008 and metrics in SCR745 posted on ERCOT.com

4 PR60006_01 Phase 2 ERCOT Update – PF Outage Details (3yrs) Issue Date # min SLA Impacted Applicatio n ImpactedIssue DescriptionRoot Cause Service Impact Service Impact Detail 9/25/06829RetailPaperfreePaperfree File Server not respondingInfrastructureOutage Unplanned Outage 10/2/0618RetailPaperfreePaperfree File Server network outageInfrastructureOutage Unplanned Outage 1/3/07130RetailPaperfree Memory failure in the clustered environmentInfrastructureOutage Unplanned Outage 1/5/07270RetailPaperfreeProblem pulling data from NAESBInfrastructureOutage Unplanned Outage 1/8/07195RetailPaperfree Attempted to replace the Paperfree architecture as identified by the on- going Paperfree issues analysisInfrastructureOutage Unplanned Outage 2/7/0785RetailPaperfree Connectivity issue between application and SANInfrastructureOutage Unplanned Outage 3/20/08105 Retail Market Degradation Issues Post SCR745 Phase 2 solution Polyserve Applicaton/TRXN VolumesOutage Unplanned Outage 3/22/08240 Retail Market Rollback from SCR745 Phase 2 implementation Polyserve Applicaton/TRXN VolumesOutage Unplanned Outage 8/11/0853Retail ERCOT experienced an unplanned outage of the Electronic Data Interface (EDI) server. Paperfee FileserverOutage Unplanned Outage 8/26/0854Retail ERCOT experienced an unplanned outage of the Electronic Data Interface (EDI) server. Paperfree File ServerOutage Unplanned Outage

5 ERCOT Status and Recommendation: Status - ERCOT received and reviewed recommendations from HP for Performance improvements necessary for the Polyserve File Clustering Solution. These recommendations require architectural changes, server rebuilds, and testing which is difficult to deliver in 2009 due to resource and environment constraints from Nodal and Zonal projects. Accomplishments: Paperfree Blades Implementation – 2004 (provided improved scalability) Paperfree 3950 Upgrade – 2007 (Improved processing) Paperfree code changes – 2007 (improved exception processing) Increased monitoring and training for support staff (improved support) – On going AIX implementation (DB stability) Recommendation: ERCOT seeking TDTWG recommendation to close project based on: (A) Reduction in overall outages due to previous efforts above (B) ERCOT evaluating replacement of Paperfree application under Retail Application Upgrade Project due to: File based application There are more efficient products available such as: TIBCO, Inovus TLE, etc… Old application architecture Does not have optimal performance for future growth needs Development has been experiencing issues in upgrading to new version in the development environment PR60006_01 Phase 2 ERCOT Update – Next Steps

6 Risks/Impacts Other impacts from moving forward with Paperfree architectural changes at this time: Nodal – IT resource constraints Distributed Generation, Small Renewables – Code/Resources Advanced Metering, Interim Solution – Code/Resources

7 TDTWG Questions