Download presentation
Presentation is loading. Please wait.
Published byRussell Wilcox Modified over 9 years ago
1
Enterprise Information Services (EIS) - Review Ray Chase Manager, EIS
2
EIS Vision Provide reliable, innovative, centralized, and comprehensive decision support and business intelligence systems to ERCOT, the Market, and the PUCT.
3
Why? Protocol Requirements – Market Data Collection and Use (section 17) Collect an Accurate Historical Record of all Source Systems Intra-day Capture – All Data Auditability Single System Source Data Integration Opportunity to Offset Source System Load Robust Reporting Environment Ease of Use Centralized Tools One Version of the Truth Data Modeling Oversight Future ERCOT and Market Decision Support Opportunities
4
Overview Data Collection Data Archiving/Roll-off Data Integration Data Transparency and Delivery SOA Framework Data Modeling and Analysis Business Intelligence and Reporting Legacy System Transition Current Project Relationships Current Statistics
5
Data Collection All Operational Source Systems feed into ODS Replication is near real-time All intra-day transactions Nearly all tables (rules) Paper Free Lodestar lodstar Lodestar lodstar Lodestar lodstar Siebel TCH RSS Lodestar lodstar EMMS omsappdev EMMS ercot EMMS his_user Siebel Paper Free TCH ODS TCR
6
Data Archiving/Roll-off Uses a table based, data partitioning strategy Performance Long-term Historical Data Archiving Source SystemODSRSS Record Insert, Update, Update, Update Insert Insert Insert Current History Table_A 200101 200102 200103 Long-term Tape
7
Multi-source system data integration Removes fragmentation of solutions Single version of the truth Reusability Various 2005 projects with integration 50017 – Collateral Calc 50130 – ESIID Lookup 40015 – TCR Reporting 50001 – BI Foundations Data Integration Business Intelligence ODS Lodestar lodstar EMMS omsappdev TCR Collateral Calculation
8
Portal Views Data Transparency and Delivery Single Design - Multiple Solutions Large Scale Market Participant Extraction Public Data Extraction Market Reporting Tool (2006) Web Service Delivered Data (50024 – SCR740, ESIID) Type-1 – Scheduled Data Delivery Type-2 – Real-time Data Delivery Business Intelligence RSSODS CDW Market Data Extracts Web Services Report Tool
9
ERCOT Service Orientated Architecture Framework URLXML MP System URLXML MP System SOAP Request SOAP Reply ERCOT’s Service Orientated Architecture Framework will provide four methods to access ERCOT’s information and services Use an ERCOT supplied Web Interface URLXML XSLT URLHTML Build your own interface utilizing our XML REST Web Services System to System utilizing our XML REST Web Services System to System utilizing our SOAP Web Services SOA Framework www.amazon.com/gp/browse.html?node=3435361
10
Data Modeling and Analysis Provides a framework for decision support, business intelligence, and data modeling and analysis Business Intelligence RSSODS CDW PC.xls PC.xls PC.xls Legacy Current Lodestar EMMS PC MS Access.xls PC MS Access.xls PC MS Access. xls Business Logic …
11
Data Modeling and Analysis Data Warehouse Marts Business Intelligence ODS TCH Siebel CDW Proposed Lodestar lodstar EMMS omsappdev EMMS ercot EMMS his_user ETS Data Mart PC.xls PC.xls PC.xls
12
Data Modeling and Analysis Potential External Data Source Additions Business Intelligence RSSODS CDW PC.xls PC.xls PC.xls Census Geographic Detailed Weather
13
Business Intelligence & Reporting Centralized view foundation Provides standardized querying of all data Secure - Prevents direct access to the ODS database objects Ensures all private data is protected by the ODS security layer Application Security Operational Data Store (ODS) API Views API Ref Cursor In-Bound Out- Bound Application Security Conformed Data Warehouse (CDW) API Views API Ref Cursor In-Bound Out- Bound
14
Business Intelligence & Reporting Web-based tool for universal use B.I. tool allows “drilling-thru” to lower levels of granularity Extremely efficient for quickly & visually going from “10,000 foot” view to “extreme close-up” Prompts provide a way quickly choosing your selection criteria
15
Operational Data Stores Replicated Source Systems EIS Systems & Applications ETS Report Net Summary Reporting Business Intelligence Foundation Application Replication & Security Framework Security Foundations Standard Views Standard APIs Custom Views Custom APIs & BLAPIs Application Administration Data Delivery Module (DDM) Web Service Based Data Delivery Lodestar ODS EMMS ODS TCR ODS EIS System Transition Siebel ODS Paperfree ODS TCH ODS Lodestar RSS EMMS RSS Lodestar EMMS TCR Siebel Paperfree TCH Siebel RSS Paperfree RSS TCH RSS Detailed Reporting Extracts Data Mart Real-Time Reporting Conformed Data Warehouse (CDw) Data Transparency T D 6 D D 6 6 66 6 6 6 D
16
Current Project Relationships P P P P P Initiated Project Completed Project Cancelled or Deferred Project Planning Project Executing Project Legend MO CO SO IO RO Project NOT Started P Affected by Parsing P
17
Proposed 2006 EIS Projects SourceCommitteeSrc DocProjectProj. No.Impact Area Add' l I n f o Priority Ran k PUCTIO EDW BI Foundation P2 - Repl Reserves Market Ad-hoc Reporting50001_03 Market Monitor ing EDW1.1a22 PUCTIO EDW BI Foundation P2 - Ad-hoc Access to QSE Rpt Data50001_04 Market Monitor ing EDW1.1a23 PUCTIO EIS BI Foundations IIINew Market Monitor ing EDW1.1a24 PUCTIO EIS Conformed Data Warehouse FoundationsNew Market Monitor ing EDW1.1a27 PUCTIO EIS CDW Data MartsNew Market Monitor ing EDW1.1a28 ERCOTRO EDW Siebel Transition50059 InfrastructureEDW1.1b48 ERCOTRO EDW TCH (Transaction Clearinghouse) Transition50060 InfrastructureEDW1.1b49 ERCOTRO EDW EAI Transition (inc. PaperFree & NAESB)50061 InfrastructureEDW1.1b50 ERCOTRO ETS (ESIID Tracking System) Transition to EDW50088 InfrastructureEDW1.1b51 ERCOTIO EDW Lodestar Decommission50030 InfrastructureEDW1.1b67 ERCOTIO EDW EMMS Decommission50031 InfrastructureEDW1.1b68 ERCOTIO EIS Reporting Tool IINew Market Monitor ing EDW1.1b69 ERCOTMO Lodestar Web ServicesNew Market ImpactEDW1.293
18
Current ODS Statistics Migration - ~2 billion historical transactions from Lodestar and EMMS Replication – no lost information to date Daily Average ~15 million transactions Total transactions posted Developed/Installed Code Base Source SystemReplicated LODSTAR1,273,023,928 EMMS890,651,313 HIS_USER181,868,288 2,345,543,529 ObjectCountLines INDEX787 PACKAGE1,501150,935 PACKAGE BODY1,500610,481 PROCEDURE68245,400 TABLE794 TRIGGER76269,763 VIEW3,535103,208 9,561979,787
19
Conclusion Comments? Questions? Thank You!
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.