Download presentation
Presentation is loading. Please wait.
Published byTobias Bailey Modified over 9 years ago
1
Overview of MID, MIR, & Extracts for DEWG 9/24/07 Steve Cox
2
2 9/24/2007 Acronyms and Definitions MID – Market Information Distribution system. The overall process for selecting, processing, and presenting reports and extracts to TML. MIR – Market Information Repository. The data base that stores the reports and extracts within MID. ODS – Operation Data Store. The data base that is the “data warehouse” for ERCOT’s source systems, ie, EMMS, Lodestar, Siebel, Paperfree, EIF, and TCR. DDM – Data Distribution Module. The software platform that maintains what reports and extracts are available to be generated from the ODS and for whom. Also stored within the DDM is the actual PL/SQL code and processing audit trails. PL/SQL – Oracle’s procedural language extension to the structured query language that provides an interface to relational data bases. TIBCO – A software platform that enables systems integration and interoperability via asynchronous message transfer – referred to as the “Data Bus”. Appworx – A software platform for job scheduling and business process automation.
3
3 9/24/2007 High Level Process Flow 1) Developer – Registers* a report/extract with the system 3) Control Model - Incorporate opt-in data into the system 2) Portal - Market Participant opts-in for the report/extract via portal 4) Enterprise Scheduler - Run report/extract 7) Processing Layer - Log Audit Information 6) Processing Layer – Compress to Zip files 5) Processing Layer - Generate data files 8) Processing Layer - Post for portal access Post to Market * Assumes the report/extract has already been designed, coded, and tested.
4
4 9/24/2007 High Level Architecture DDM Registration Info PL/SQL Audit Files DDM metadata Appworx Enterprise Scheduler The Market Ercot.com Digital Cert Verification Texas Market Link (TML) Report Explorer Drop off points/folders EMMS Lodestar Siebel Paperfree EIF TCR MIR ODS Tibco Data Bus Web Services Browse Download Note: Other applications post files/reports to MIR
5
5 9/24/2007 Data Bases and Data Flow
6
6 9/24/2007 Daily ODS Extracts -- 33 AS DeploymentsDAILY Ancillary Services – DAILYDAILY Bids and Schedules – DAILYDAILY DC TIE AutomationDAILY Daily Siebel Service Order Extract 1DAILY Daily Siebel Service Order Extract 2DAILY Disclosure of Local Congestion - Instructions/EnergyQuantitiesDAILY Disclosure of Local Congestion – InstructionsDAILY Energy SchedulesDAILY ESIID Extract Daily Supplemental kVA 1DAILY ESIID Extract Daily Supplemental kVA 2DAILY Forecast Data DailyDAILY GEN_DailyDAILY LOD_DailyDAILY Market Information DailyDAILY PRDE ExtractDAILY Recorder - DAILYDAILY Resource ID - DAILYDAILY ESIID ExtractDAILY ESIID Extract SupplementalDAILY Market Shadow Prices (SHP) ExtractDAILY Settlement Input Data (SID) ExtractDAILY SNB_DailyDAILY Daily Scheduled and Actual LoadDAILY Daily Self-Scheduled Energy ServicesDAILY Actual Resource OutputDAILY Commercially Significant Constraints (CSC) 1DAILY Commercially Significant Constraints (CSC) 2DAILY Dynamic Load Obligations and Generation ResourcesDAILY Tradable Generation Rights (TGR) 1DAILY Tradable Generation Rights (TGR) 2DAILY Zonal Operational Constraints (OC1) 1DAILY Zonal Operational Constraints (OC1) 2DAILY
7
7 9/24/2007 On-Demand ODS Extracts -- 34 DATA_AGGR_ALL_ES_WSProvide all ESIID extract records ESH_ALL_ES_WSProvide all ESIID extract records ESH_AUDIT_LGKLST_ES_WSProvide all ESIID extract records ESH_TD_ALL_ES_WS Provide CMZONE assignments for a trade date ESIID_ALL_ES_WSProvide ESIID account records ESIID_AUDIT_ALL_ES_WSProvide ESIID account records ESIID_AUDIT_CNT_ES_WSProvide ESIID account records ESIID_AUDIT_LGKLST_ES_WS Provide ESIID extract records for Logical Keys ESIID_AUDIT_LGK_ES_WS Provide ESIID extract records for Logical Keys ESIID_CMZONE_LST_ES_WS Provide ESIID extract records for Logical Keys ESIID_ESH_ALL_ES_WS Provide ESIID extract records for Logical Keys ESIID_ESH_TD_ALL_ES_WS Provide ESIID extract records for Logical Keys ESIID_TD_ALL_ES_WSProvide ESIIDs I own for a trade date ESIID_TD_LST_ES_WSProvide ESIIDs I own for a trade date ESUG_AUDIT_LGKLST_ES_WSProvide ESIIDs I own for a trade date IDR_DATA_LSCH_ES_WSProvide ESIIDs I own for a trade date IDR_DATA_LSCH_LSCD_ES_WS Provide ESIIDs where IDR usage data not loaded for a trade date IDR_DATA_LST_ES_WS Provide ESIIDs where Non-IDR usage data not loaded for a trade date IDR_DATA_NOTLOADED_LST_WS Provide ESIIDs where Non-IDR usage data not loaded for a trade date IDR_DATA_TWOTD_LSCH_ES_WS Provide IDR transaction data for ESIIDs I own IDR_DATA_TWOTD_LSCH_LSCD_ ES_WS Provide IDR transaction data for ESIIDs I own IDR_TRAN_LSCH_ES_WS Provide IDR transaction data for ESIIDs I own IDR_TRAN_LSCH_LSCD_ES_WSProvide IDR usage data for a trade date IDR_TRAN_LST_ES_WSProvide IDR usage data for a trade date LSCD_AUDIT_LGKLST_ES_WSProvide IDR usage data for a trade date LSCH_AUDIT_LGKLST_ES_WS Provide IDR usage data for particular ESIIDs I own NIDR_DATA_ALL_ES_WS Provide IDR usage data for particular ESIIDs I own NIDR_DATA_LST_ES_WS Provide Non-IDR transaction data for ESIIDs I own NIDR_DATA_NOTLOADED_ALL_ES _WS Provide Non-IDR transaction data for ESIIDs I own NIDR_DATA_NOTLOADED_LST_ES _WS Provide Non-IDR usage data for a trade date NIDR_DATA_TWOTD_ALL_ES_WS Provide Non-IDR usage data for a trade date NIDR_TRAN_ALL_ES_WS Provide Non-IDR usage data for ESIIDs I own NIDR_TRAN_LST_ES_WSProvide public data extract PUBLIC_REQUEST_ES_WS Verify records used in data aggregation for a trade date
8
8 9/24/2007 Other ODS Extracts -- 23 Ancillary Services - INITIALINITIAL Bids and Schedules - INITIALINITIAL Forecast Data InitialINITIAL GEN_InitialINITIAL Initial Siebel Service Order ExtractINITIAL Initial Siebel Service Order ExtractINITIAL Initial Siebel TDSP ESIID extractINITIAL LOD_InitialINITIAL Market Information InitialINITIAL Resource ID - INITIALINITIAL ESIID ExtractINITIAL SNB_InitialINITIAL Ancillary Services SchedulesMONTHLY Generation OutagesMONTHLY Individual AS BidsMONTHLY Individual BES BidsMONTHLY Individual RPRS BidsMONTHLY Resource Plan DetailsMONTHLY Weekly Siebel Service Order ExtractWEEKLY Weekly Siebel Service Order ExtractWEEKLY Weekly Siebel TDSP ESIID extractWEEKLY Daily Total Exposure COLLATERAL_CALC Weekly EAL by QSE COLLATERAL_CALC
9
9 9/24/2007 Market Extracts Stats (averages over last 6 months) StatisticDailyWeeklyMonthlyAnnually Zip Files Generated 1,3249,26839,720483,260 CSV Files Generated 8,00856,056240,2402,922,920 Total Records (Rows) Generated 12,044,82884,313,796361,344,8404,396,362,220 90 - Number of Possible Extracts 1,306 - Number of Registered Recipients 1,745 - Daily Opt-In Count
10
10 9/24/2007 Questions?
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.