Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012.

Slides:



Advertisements
Similar presentations
Scoping the Framework Guidelines on Interoperability Rules for European Gas Transmission Geert Van Hauwermeiren Workshop, Ljubljana, 13 Sept 2011.
Advertisements

Campaign Planning – Direct Wines Using historic data to improve planning and forecasting TFM&A 2014 David Lockwood: Direct Wines Terry Hogan: Golden Orb.
DIGIDOC A web based tool to Manage Documents. System Overview DigiDoc is a web-based customizable, integrated solution for Business Process Management.
1 Madrid, 2 nd Nov th IG Meeting South Gas Regional Initiative VI. MIBGAS.
Update on Transparency Obligations Martin Reisner Junior Adviser, Transparency ENTSOGs Transparency Workshop Brussels – 11 September 2012.
The role of ACER In the Regional Initiatives Steve Gordon Head Of the Gas Department North West Regional Initiatives 2011.
ERGEG Advice Comitology Guidelines on Fundamental Electricity Data Transparency Florence Forum 13 December 2010 Bente Danielsen.
Benoît Esnault (CRE) NW Region – governmental meeting 6 May 2010 Pilot framework guideline on capacity allocation mechanisms.
CBA Results Files Filling in the templates. 2 We highly encourage you to >Read the CBA Methodology:  Annex F on Methodology of TYNDP 2015
P.Labra – EWEA March 2012 ENTSO-E’s & TYNDP’s vision on adapting European Transmission Grid to large amounts of wind power.
Walter Boltz, Vice-President CEER 20 th Madrid Forum September 2011 Gas Target Model State of play.
CBA Results Files Getting started. 2 We highly encourage you to >Read the CBA Methodology:  Annex F on Methodology of TYNDP 2015
Update on GSE Activities Klaus-Dieter Barbknecht GSE President GIE General Assembly Madrid 21 November 2007.
Infrastructure projects Initial proposals for SJWS #5 ENTSOG offices – Brussels Stakeholder Joint Working Session – 20 April 2012.
1 South Gas Regional Initiative Work Plan Raúl Yunta Huete, South GRI Chairman 20 th Madrid Forum Madrid, 26 September 2011.
Cost-Benefit Analysis Modelling: indicators & Monetization TYNDP/CBA SJWS 6 – 13 May 2014.
CBA Results Files Analysing the results. 2 We highly encourage you to >Read the CBA Methodology:  Annex F on Methodology of TYNDP 2015
Market Integration & SoS Initial proposals for SJWS #5 ENTSOG offices – Brussels Stakeholder Joint Working Session – 20 March 2012.
Global Competitiveness in a Liberalised EU Energy Market Wim Groenendijk, Member of the Board Brussels, 22 November 2011 Gas infrastructure and Markets.
Training Workshop on the use of the CRF Reporter for European Community Experts Introduction Copenhagen – 12 September 2005 James Grabert Inventories sub-programme.
Update on transit compensation mechanism application in Baltics Arnis Staltmanis Head of International Project Department 16 September 2009, Vilnius.
Agricultural Market Information System (AMIS): State of Play AMIS First Meeting of the Rapid Response Forum 11 April 2012 Mexico City Abdolreza Abbassian,
TYNDP SJWS #3 Demand TYNDP – 3 rd SJWS 08 March 2012 ENTSOG offices -- Brussels.
Transparency requirements in accordance with the provisions of Regulation 715 M.Sc. Aleš Osrajnik Ljubljana, 13 September, 2012 ACER Workshop on Transparency.
TYNDP SJWS #1 Infrastructure Projects -- Supply & Demand TYNDP st SJWS 24 January 2012 ENTSOG offices -- Brussels.
TYNDP SJWS #2 Security of Supply – Market Integration TYNDP – 2 nd SJWS 15 February 2012 ENTSOG offices -- Brussels.
EUROPEAN COMMISSION Transparency – Proposal to amend chapter 3 of the Annex of Regulation 1775/2005 EUROPEAN COMMISSION H. Hick, DG TREN C 2 NW GRI 5th.
Capacity allocation in natural gas transmission networks Framework Guideline (Pilot) Dr. Stefanie Neveling, ACER Workstream Co-Chair Walter Boltz, ACER.
1 Gas Regional Investment Plan North West Europe GRI Meeting, November 25 th 2011.
Concept of Transparency Platform Martin Reisner Junior Adviser, Transparency ENTSOG’s Transparency Workshop Brussels – 11 September 2012.
Listen to Your Meters! Pradeep Murthy SunTec Business Solutions.
Benoît Esnault Commission de Régulation de l’Energie (CRE) - ERGEG 19th Madrid Forum, March 2011 Energy Infrastructure Package ERGEG preliminary.
TYNDP concept SJWS #7 – conclusion on TYNDP concept TYNDP Stakeholder Joint Working Session – 29 May 2012.
TYNDP SJWS #5 Demand & Supply – Infrastructure Projects TYNDP – 5 th SJWS 20 April 2012 ENTSOG offices -- Brussels.
GRIP South South Region Gas Regional Investment Plans SGRI – 30 th April 2013.
XVI th Madrid Forum Madrid, 28 May 2009 Walter Boltz (Gas Working Group Chair) Transparency guidelines and GRI transparency work.
Does the Third Package provide the European TSO associations with the tools necessary to find solutions to the European energy challenge ? Nigel Sisman,
Benoît Esnault Commission de Régulation de l’Energie (CRE) - ERGEG 19th Madrid Forum, March 2011 Preparatory work for Framework Guideline Tariffs.
Implementation of Transparency Guidelines Martin Reisner Advisor Current Status and future Challenges Ljubljana – 13 September 2012.
Gas Regional Initiative Region North-West Transparency Project Nicola Meheran, Ofgem.
Biomethane and the European gas infrastructure EBA Workshop 3 September 2015 Thierry Deschuyteneer Executive Secretary.
1 South Gas Regional Initiative 16 th Dec 2011 South Gas Regional Initiative 16 th Dec 2011.
Transparency GRI SSE -- 7th Stakeholder Group Meeting Vienna, 16 October 2009 Andrea Ćirlićová GTE+ Senior Adviser.
Tahir Kapetanovic ENM TF Co-Chair XIX Florence Forum, December 2010 ERGEG Opinion on the ENTSO-E pilot TYNDP.
Cost-Benefit Analysis Economic Performance Indicators TYNDP/CBA SJWS 6 – 13 May 2014.
Walter Boltz, Chairman ERGEG Gas Working Group 18 th Madrid Forum 28 September 2010 Pilot framework guideline on capacity allocation in natural gas transmission.
1 The Spanish Gas Industry and the 3 rd Package Antoni Peris Mingot – Sedigas President GIE Annual Conference – Madrid.
Transparency Platform Project introduction Panagiotis Panousos Business Area Manager, System Operation ENTSOG’s Transparency Workshop Brussels – 11 September.
GTE+ progress towards ENTSOG Jacques Laurelut GTE President & GTE+ Transition Manager GIE Annual Conference 2009, Groningen.
MIPI European Transparency Project (ETP) Transmission Workstream 7 th October 2010.
Renewable Energy Statistics Keep-on-Track! 1 st Policy Workshop 23 January
SOUTH SOUTH-EAST GAS REGIONAL INITIATIVE WORK PLAN Francesco Cariello, AEEG 20 th Madrid Forum, September 2011.
Gas Roads & GTE Colin Hamilton (European Policy) 2 nd July 2009.
Projects and topology Ádám Balogh Adviser How does your data submission translate into a Project in the topology TYNDP 2017 SJWS Energy Community.
European Ten Year Network Development Statement Volker Schippers GTE+ Senior Adviser GTE+ Workshop on GTE+ Work Programme 24 June 2008.
European Developments Transmission Workgroup 1 st December 2011.
Click to edit Master title style 1 Neta Meidav Manager, Ofgem GRI NW 9 th Stakeholder Group Meeting 25 November 2011, Rotterdam GRI NW Transparency Project.
Gas storage: GB experience and future trends Sonia Brown Director, European Strategy and Environment GSE Conference - May 2007.
Scoping the Framework Guidelines on Interoperability Rules for European Gas Transmission Geert Van Hauwermeiren 20 th Madrid Forum, 26 Sept 2011.
1 IT system and data validation process in Latvian CPI/HICP Prepared by Oskars Alksnis, Central Statistical Bureau of Latvia EU Twinning Project Forwarding.
How the PCIs are developed Céline Heidrecheid System Development Business Area Manager TYNDP perspective on project progress Copenhagen – 24 June 2016.
Geert Van Hauwermeiren Workshop, Ljubljana, 13 Sept 2011
10 year investment plan ERGEG approach and contribution
Capacity allocation in natural gas transmission networks Pilot framework guideline - Public consultation results and new content of guidelines - Dr.
Ben Voorhorst, President, ENTSO-E
Transparency from a practical point of view ENTSOG Transparency Workshop Brussels, September 11, 2012.
ACER opinion on ENTSOG’s 2011 Ten-Year Network Development Plan
EURELECTRIC transparency requirements
European Winter Outlooks 2008/2009 and 2009/2010
Update on WS3 Activities
Presentation transcript:

Concept of Data Collection Vincent Scherrer Junior Adviser, System Development ENTSOG’s Transparency Workshop Brussels – 11 September 2012

2 Main goals of the project Current Situation Expected PDWS improvements Conclusion

3

4 Improve scope and quality New Transparency Guidelines >Binding publication >More relevant points (distribution systems, storages, production facilities...) >More data (physical flows, auction requests...) More detailed ENTSOG deliverables >Demand breakdown (CCGT, final customers, industry) >More scenarios and cases >More accurate modelling Upcoming tasks >Cost-benefit analysis >Gas quality

5 Streamline the data collection processes Data collection among members >Automation >Web-based interfaces >Eliminated redundancy >Warning system ENTSOG internal data collection >Single repository of data >Versioning >User-friendly manual import mechanisms >More time for analysis and better deliverables

6 Availability and openness DataWarehouse Transparency Platform Transparency Platform Operational data Future projects Interruptions TYNDP data Auction results Information should be meaningful, exploitable, and consistent

7 Main goals of the project Current Situation Expected PDWS improvements Conclusion

8 Various data sources Transparency TYNDP Forecast data Infrastructure projects Other data Outlook&Review Historical data Outlook&Review Historical data System Development files and databases Transparency Platform/DB TSOs Promoters Third parties (GSE, GLE, …) Scattered environment, intensive treatment, insulated data

9 Complex aggregation procedures Balancing zones Relevant points System enhancem ents Demand Supply Technical capacities Flows (Re)Nominations Technical capacities Flows (Re)Nominations

10 Historical data analysis Detailed analysis of historical data and a comparison of multiple periods is a regular part of data processing

Understanding the data and changes to them is crucial >Different calculation assumptions ? >Uploaded at different points in time ? >Unmatched system enhancements ? 11 Data quality issues

12 Forecast vs Historical > Data questionnaire corrupted ? > Non-Standard Gross Calorific Value ? > What to do ?

13 Varying data from different data sources Spread ?

14 Main goals of the project Current Situation Expected PDWS improvements Conclusion

Manual data collection : Web-based 15

16 Automated imports : Monitoring Monitor the flow of messages >TSOs : direct access to the system, warning per mail ? >Detect an inform about odd values >Detect missing values >…

17 Data consistency and data views Quality control and good datawarehouse practices will enable us to look at the data from many different angles >Entry flows in a country ? >Exit flows out of a country ? >Aggregated EU-27 demand >For a particular relevant point, what infrastructure projects are planned ? >Analyze cross-border flows and loads >What are the most congested cross-border connections ? >What happened during the 2012 cold snap ? >Maximal and minimal demand over the last 52 weeks for each country ? At the EU level ? >What is the net demand per country on a daily basis ? >What are the planned infrastructure projects per country ? Per infrastructure type ?

18 Data consistency : Infrastructure projects Available as a Transparency Module >Different views but same data >Advanced search capabilities

19 Data consistency : Different time scales From day… To month… To year

20 Odd values Detect odd values with… >Fixed constraints >Comparison with the past >Check if missing >Comparison with previous versions of the same data Treat odd values with… >Quarantine dubious values >Each value has a state >Associate with workflows (manual or automatic)

21 Data availability Excel XML RSS Conform to best practices >Push and pull mechanisms >Most common formats >Flexible data sets >Quantitative and qualitative analysis

22 Export flexibility

23 Analysis

24 Aggregation LNG imports Hub-to-Hub

25 Main goals of the project Current Situation Expected PDWS improvements Conclusion

The new system will facilitate data collection and processing and should significantly improve ENTSOG’s ability to deliver reports such as TYNDP, Outlooks and reviews >Comprehensive quality control... >Drastically expanded analysis possibilities for ENTSOG, members, stakeholders, 3 rd parties… >Flexible data extracts and reports… >Better deliverables from ENTSOG Benefits Sound technical basis to face current and future Transparency Requirements

27 Do you have any questions ?

Thank You for Your Attention ENTSOG -- European Network of Transmission System Operators for Gas Avenue de Cortenbergh 100, B-1000 Brussels EML: WWW: Vincent Scherrer Junior Adviser