Data Extracts & Reporting Recent Issues ERCOT Information Technology Data Extracts Working Group 11/27/07.

Slides:



Advertisements
Similar presentations
Information Technology Update Aaron Smallwood Manager, IT Business & Customer Services.
Advertisements

Information Technology Report Dave Pagliai Manager, IT Support Services March 2015 ERCOT Public.
Retail Market Subcommittee Update to TAC February 5, 2004.
Copyright© JSE Limited JSE – Africa’s premier exchange JSE Release C Market Communication NOTEA October 2007 Leanne Parsons.
Profiling Working Group March 13, PWG Update Report By Ernie Podraza of Reliant Energy ERCOT PWG Chair for COPS Meeting March 13, 2007.
Zonal ADR Resettlement & Data Retention ERCOT CSWG 04/20/2015.
Information Technology Report Trey Felton Manager, IT Service Delivery January 2012 ERCOT Public.
ERCOT Billing, Settlement Disputes & Data Extracts
Retail Sub-Committee Update Robert Connell June 14, 2002.
Objectives: Upgrade Siebel to a supported application Upgrade Oracle database to current version Deliver all existing user functionality with no degradation.
ERCOT Retail Market IT Update Aaron Smallwood Director, IT Operations Retail Market Subcommittee April 7 th, 2015.
1 AMS Data Workshop ERCOT Overview of AMS Data Processes June 27, 2014 ERCOT June 27, 2014.
ERCOT Lodestar Extracts Timing Recommendation ERCOT May 24, 2005.
RMS Update to TAC May 8, RMS Update to TAC ► At April 9 RMS Meeting:  Antitrust Training  RMS Voting Items: ► NPRR097Changes to Section 8 to Incorporate.
1 TDTWG Update to RMS Tuesday January 6, Primary Activities 1.Reviewed ERCOT System Outages and Failures 2.Presented Service Availability and.
Lead from the front Texas Nodal 1 External Web Services Update Nodal Implementation Team Presentation July 7, 2009.
Siebel 8.0 Module 5: EIM Processing Integrating Siebel Applications.
Market Impact Assessment TF Final Report to RMS June 11, 2008.
June 22 and 23,  The information and/or flow processes contained in this Power Point presentation: ◦ Were created to allow interested parties to.
September 8, 2008 TPTF Nodal Core Projects Updates Nodal Project Managers.
Objectives: Upgrade Siebel to a supported application Upgrade to Oracle 9i database Deliver all existing user functionality with no degradation in performance.
ERCOT SCR745 Update ERCOT Outage Evaluation Phase 1 and Phase 2 TDTWG April 2, 2008.
TX SET January 21, 2009 Retail Release Items for February 21, 2009 Kathryn Thurman ERCOT.
1Texas Nodal Market Trials Update. 2Texas Nodal LFC Testing Review Review of materials presented at TAC Changes in Market Trials schedule and activities.
Protocol Revision Subcommittee Sandy Morris November 3, 2011.
MISUG Meeting Materials ERCOT 02/14/ Agenda 02/14/ Antitrust AdmonitionJ. Lavas9:30 a.m. 2.IntroductionJ. Lavas9:35 a.m Accomplishments.
Texas SET Version 3.0 Production Implementation Plan.
Information Technology Report Trey Felton Manager, IT Service Delivery September 2011 ERCOT Public.
Information Technology Service Availability Metrics Trey Felton IT Account Manager COPS/RMS September 2009.
PR50121_07 Retail Business Processes (RBP) Project Update Retail Market Subcommittee November 8, 2006 Adam D. Martinez Mgr, Market Operations DPO.
1 ESI ID SERVICE HISTORY AND USAGE DATA EXTRACT SYSTEM CHANGE REQUEST (SCR 727) February 24, 2003.
Retail Transaction Processing Year End Review and Recent Issues RMS January 2007.
12/6/2015 ERCOT Production Issues Update ERCOT Matthew Tozer.
COPS – ERCOT PROJECTS UPDATE WHOLESALE MARKET DEVELOPMENT Paula Feuerbacher February 22, 2005.
Rob Connell May 29, 2002 Retail Sub-Committee Update.
MARS Advanced Metering – ERCOT Market Facing Changes Jackie Ashbaugh Manager Data Integrity and Administration 3/9/2009.
MARS Taskforce RMS Update November 10, Conference Call concerning Settlement Estimates TDSPs held a conference call on October 28, 2010, where we:
Direct Load Control Update Betty Day Manager of Load Profiling and Data Aggregation February 25, 2003 Retail Market Subcommittee.
9/17/2012 CSWG CSWG – ERCOT Update ERCOT. 2 Settlements Project & Operational Updates February 27, 2012 NPRR 347: Combined Daily Invoice –Still on track.
1 Transaction or Issue Clean Up. 2 Customer Protection and 814_08 Issue (Phase 2 – Potentially Late 08s) Background Completed Items Next Steps.
1 Next Steps to Reduce the RTM Settlement Timeline COPS Workshop August 29, 2013 Mandy Bauld ERCOT Director, Settlement & Retail Operations (512)
June 2010 COPS/RMS Information Technology Report Trey Felton Manager, IT Administration.
1 RMS Update By Don Bender January 9, RMS Approved Resolution Upon TAC approval, suspend further True-up settlements for True-up resettlement.
Commercial Operations Sub-Committee Update to TAC April 4, 2008.
Student Centered ODS ETL Processing. Insert Search for rows not previously in the database within a snapshot type for a specific subject and year Search.
February 10, 2010 RMS ERCOT 1/24/10 Production Issue Overview and Lessons Learned Karen Farley Manager, Retail Customer Choice.
01/09/2007 Extract Delays. 2 01/09/2007 EIS Extract Delays Problem –Extracts of Lodestar data from the ODS to the market have been delayed due to above.
Demand Response Task Force. 2 2 Outline  Overview of ERCOT’s role in the CCET Pilot  Overview of Stakeholder Process – What’s been done to date?  Questions.
1 TX SET Mass Transition Project RMS Update March 15, 2006.
Information Technology Service Availability Metrics Trey Felton IT Account Manager COPS/RMS January 2010.
1 ERCOT Retail Release Overview. 2 How Are Changes Managed? Retail Testing Business Teams Development Teams Release Management Management of: Migration.
Direct Load Control Update Betty Day Manager of Load Profiling and Data Aggregation February 25, 2003 Retail Market Subcommittee.
Information Technology Service Availability Metrics March 2008.
1 New MO Projects June COMS Extract, Report & Web Services Monitoring & Usage Statistics Jackie Ashbaugh.
3 rd Party Registration & Account Management SMT Update To AMWG February 23, 2016.
Information Technology Update Aaron Smallwood Manager, IT Business & Customer Services.
Safe Schools Infinite Campus Interchange Windy L. Newton Office of Next Generation Schools & Districts, Division of Student Success.
1 Nodal Stabilization Market Call December 16, 2010.
RMGRR058 Overview RMS Meeting – August 15, Background / Reference PUCT Substantive Rule 25.43(n)(8) Protocol Customer Billing Contact.
Information Technology Service Availability Metrics RMS August 2008 Trey Felton.
1 Customer Objections in Complete Status (CCO Clean-up Phase 3) Background Next Steps.
COPS JULY 2013 UPDATE TO TAC 07/02/2013 Harika Basaran, Chair Jim Lee, Vice Chair.
June 5, 2008 TAC Texas Nodal Market Implementation Program Update Jerry Sullivan.
3 rd Party Registration & Account Management SMT Update To AMWG May 24, 2016.
Lead from the front Texas Nodal 1 Texas Nodal EDS4 - Approach 11/28/2007.
Role of Account Management at ERCOT EIS Project Updates Jackie Ashbaugh Mgr., Commercial Operations Data Integrity & Administration DEWG October 19, 2006.
Settlement Timeline Workshop
Information Technology Service Availability Metrics
ERCOT SCR745 Update ERCOT Outage Evaluation Phase 1 and Phase 2
CEO Report Thomas F. Schrader ERCOT Board of Directors May 17, 2005
Presentation transcript:

Data Extracts & Reporting Recent Issues ERCOT Information Technology Data Extracts Working Group 11/27/07

Agenda TML API Outage 9/29/07-10/1/07 Market Notice Review –M-A –R-A –M-A –M-C –M-A Update regarding the search for a new EIS manager

TML API Issue Issue: Market connectivity issues to TML via the API –Issue Dates: 9/29/07 – 10/1/07 –Market Notice: Issue was not experienced market-wide. –Root Cause: A greater than allowed number of connections to the API caused the Enterprise Application Integration (EAI) layer to refuse some connection requests. –Resolution: Increasing the number of connection threads in the EAI layer allowed all requests to be handled appropriately. Monitoring: ERCOT has added additional monitoring to capture and correct this prior to becoming a market impacting issue.

10/29/ /26/07 Extract Issues Issue: ERCOT experienced delays with posting several data extracts –Notice Dates: 10/31/07-11/9/07 –Market Notice: M-A –Root Cause: ERCOT batch process delays due to Oracle bug when running database statistics. –Resolution: Utilize Oracle recommended workaround for running database statistics. Further information and timeline on next slide

10/29/ /26/07 Extract Issues Market Notice: M-A (cont’d) Incident Timeline 10/21 – Server consolidation performed during maintenance outage 10/27 – Database statistics fail – first time running statistics on new platform, causes batch process to run slowly 10/28 – Daylight Savings Time adjustment issue with batch scheduling application 10/29 – Partial rollback of database statistics –Severity 1 Technical Assistance Request opened with Oracle –Batch process continuing to run slowly 10/30 – Events –0615 – decision made to rerun database statistics, batch held from 0745 until 1030 when statistics estimated to have completed –1030 – reinstated batch while statistics were still refreshing –1915 – terminated statistics refresh, attempted statistics with smaller database sample –1945 – full rollback to old statistics – batch performs at expected levels »Also began making adjustments to batch schedule in attempt to make up time which caused issue described in Market Notice M-C /5 – Estimated catch up date 11/9 – Actual catch up date 11/16 – Oracle confirms issue that caused statistics refresh to run for so long was due to a software bug

10/29/ /26/07 Extract Issues Issue: Additional ESI ID Extract to post from some Market Participants –Notice Date: 11/9/07 –Market Notice: R-A Extracts - Retail –Root Cause: The 727 delete objects (esiidservicehist_delete, lschannelcutheader_delete, esiidusage_delete) only pull rows that have been actually deleted. The extract views explicitly only pull rows that have an ov_row_status of 'ID' or 'UD‘. –Resolution: Removal of the " and ov_row_status in ('ID' or 'UD') " criterion from the delete extract views. To correct the missed rows, a supplemental extract is created.

10/29/ /26/07 Extract Issues Issue: ERCOT is experiencing delays with posting several extracts –Notice Date: 11/12/07-11/13/07 –Market Notice: M-A –Root Cause: Complications with the batch scheduling software encountered while completing an ERCOT requested rerun of the 11/8 batch (10/31 trade date) resulted in the 11/8 batch running on Sunday 11/10 and completing on 11/11. We moved forward with the 11/9 batch and it completed at approximately 5:00 p.m. on Saturday. When Lodestar batch ran out of order, the controls table was not accurately populated. –Resolution: The control table rows were manually entered. A SIR has been requested to modify the control record creation process.

10/29/ /26/07 Extract Issues Issue: Data for operating day 10/31 was not included in the Load Generation, Settlements and Billing extracts posted on 11/12 –Notice Date: 11/14/07 – 11/15/07 –Market Notice: M-C –Root Cause: Complications with the batch scheduling software encountered while completing an ERCOT requested rerun of the 11/8 batch (10/31 trade date) resulted in the 11/8 batch running on Sunday 11/10 and completing on 11/11. We moved forward with the 11/9 batch and it completed at approximately 5:00 p.m. on Saturday. When Lodestar batch ran out of order, the controls table was not accurately populated. –Resolution: Control table rows previously manually entered did not take into account that the 11/8 batch day data was not complete until 11/11. Related to market notice M-A A SIR has been requested to modify the control record creation process.

10/29/ /26/07 Extract Issues Issue: Delays with posting several data extracts/reports –Notice Date: 11/21/07 - present –Market Notice: M-A –Root Cause: Extracts are posting one day behind due to batch run delays. –Resolution: Currently analyzing several key areas including correcting an issue with backups and tuning database performance.