Enterprise Information Services Ray Chase Manager, EIS
EIS Vision Provide reliable, innovative, centralized, and comprehensive decision support and business intelligence systems to ERCOT, the Market, and the PUCT.
Overview Data Collection Data Integration Data Modeling and Analysis Data Transparency and Delivery The Future of Extracts Data Formats and Payload Size EIS System Transition
Data Collection All Operational Source Systems feed into ODS Replication is near real-time All intra-day transactions Nearly all tables (rules) Paper Free Lodestar lodstar Lodestar lodstar Lodestar lodstar Siebel TCH RSS Lodestar lodstar EMMS omsappdev EMMS ercot EMMS his_user Siebel Paper Free TCH ODS TCR
Multi-source system data integration Removes fragmentation of solutions Single version of the truth Reusability Various 2005 projects with integration – Collateral Calc – ESIID Lookup – TCR Reporting – BI Foundations Data Integration Business Intelligence ODS Lodestar lodstar EMMS omsappdev TCR Collateral Calculation
Data Modeling and Analysis Data Warehouse Marts Business Intelligence ODS TCH Siebel CDW Proposed Lodestar lodstar EMMS omsappdev EMMS ercot EMMS his_user ETS Data Mart PC.xls PC.xls PC.xls
Data Modeling and Analysis Potential External Data Source Additions Business Intelligence RSSODS CDW PC.xls PC.xls PC.xls Census Geographic Detailed Weather
Portal Views Data Transparency and Delivery Single Design - Multiple Solutions Large Scale Market Participant Extraction Public Data Extraction Market Reporting Tool (2006) Web Service Delivered Data (50024 – SCR740, ESIID) Type-1 – Scheduled Data Delivery Type-2 – Real-time Data Delivery Business Intelligence RSSODS CDW Market Data Extracts Web Services Report Tool
Portal Views The Future of Extracts Data Extraction will remain a vital part of information services between ERCOT and the Market for the foreseeable future Methods of generation, formats, and delivery capabilities will evolve over time Creating an efficient and effective environment for Transparency in generation Flexibility in format and delivery Market Data Extracts Web Services Report Tool Database Process DDM BI MID Report Net MIR Marts CSVs Today XSD XML XSL Future
Data Formats and Payload Size Working to create a highly flexible formatting capability through the use of XML XSL may be applied to XML at any time or place Internal to ERCOT (set delivery format) External to ERCOT (based on the customer’s need) Formats Existing extracts will remain available in CSV Future formats will be decided on, as needed, with a push to generate as much as possible in XML Sizing REST delivery Small, individual transactions obtained and navigated, based on domain Batch delivery Still reviewing what size limitations we have Current opinion is to handle 50GB Based on generation demands and persistency
Operational Data Stores Replicated Source Systems EIS Systems & Applications ETS Report Net Summary Reporting Business Intelligence Foundation Application Replication & Security Framework Security Foundations Standard Views Standard APIs Custom Views Custom APIs & BLAPIs Application Administration Data Delivery Module (DDM) Web Service Based Data Delivery Lodestar ODS EMMS ODS TCR ODS EIS System Transition Siebel ODS Paperfree ODS TCH ODS Lodestar RSS EMMS RSS Lodestar EMMS TCR Siebel Paperfree TCH Siebel RSS Paperfree RSS TCH RSS Detailed Reporting Extracts Data Mart Real-Time Reporting Conformed Data Warehouse (CDw) Data Transparency T D 6 D D D
Conclusion Comments? Questions? Thank You!