Training Materials for National Greenhouse Gas Inventories Consultative Group of Experts (CGE) CGE Training Materials National Greenhouse Gas Inventories.

Slides:



Advertisements
Similar presentations
Uncertainties in Greenhouse Gas Inventories - Helsinki Sept 2005 Current IPCC Guidance Jim Penman Global Atmosphere Division UK Defra.
Advertisements

Key sources of uncertainty in forest carbon inventories Raisa Mäkipää with Mikko Peltoniemi, Suvi Monni, Taru Palosuo, Aleksi Lehtonen & Ilkka Savolainen.
Climate Change Committee WG1 QA/QC terminology and requirements from the IPCC Good Practice Guidance and the Guidelines for National Inventory Systems.
Enhancing Data Quality of Distributive Trade Statistics Workshop for African countries on the Implementation of International Recommendations for Distributive.
Task Force on National Greenhouse Gas Inventories Tier 3 Approaches, Complex Models or Direct Measurements, in Greenhouse Gas Inventories Report of the.
VERTIC/REC Workshop Fulfilling the monitoring and reporting requirements under the UNFCCC and Kyoto Protocol QA/QC Procedures in National GHG Inventory.
Training Materials for National Greenhouse Gas Inventories Consultative Group of Experts (CGE) CGE Training Materials National Greenhouse Gas Inventories.
Inventory Management Systems Developing a National System for GHG Inventories Lisa Hanle U.S. Environmental Protection Agency October 29, 2004 Panama City,
1 Workshop on Quality Control and Quality Assurance of Greenhouse Gas Inventories and the Establishment of National Inventory Systems 2-3 September 2004.
2 CGE Greenhouse Gas Inventory Hands-on Training Workshop for the African Region - Building an Inventory Management System - Pretoria, South Africa
National Inventory System in Finland Workshop on QC and QA of GHG Inventories and the Establishment of National Inventory Systems 2-3 September 2004, Copenhagen.
1 Introduction, reporting requirements, workshop objectives Workshop on greenhouse gas and ammonia emission inventories and projections from agriculture.
New Delhi COP8, October 2002 Katarina Mareckova SHMU, Tinus Pulles TNO IPCC project on Establishment of a Database on GHG Emission Factors.
WMO UNEP INTERGOVERNMENTAL PANEL ON CLIMATE CHANGE NATIONAL GREENHOUSE GAS INVENTORIES PROGRAMME WMO UNEP IPCC Good Practice Guidance Simon Eggleston Technical.
Climate Change Committee WG1 QA/QC procedures and – programme for the EC inventory process André Jol, EEA 2 September 2004.
The UNFCCC guidelines on national GHG inventories (Decision 17/CP.8) Panama City, Panama 25 – 29 October 2004 Dominique Revet (UNFCCC)
6.1 Module 6 Reporting of Mitigation Assessments in National Communications Ms. Emily Ojoo-Massawa CGE Chair.
| Slide | Slide 2 QA/QC and NIS in Austria WG1 WS on QA/QC and National Systems, 2/3 September 2004 Copenhagen Manuela Wieser.
Activities of IPCC Task Force on National Greenhouse Gas Inventories (TFI) 1st Meeting of the reconstituted Consultative Group of Experts on National Communications.
ALU Software Stephen M. Ogle, Ph.D. Research Scientist and Associate Professor Colorado State University Natural Resource Ecology Laboratory Fort Collins,
Reporting on Policies and Measures Introductory presentation by the UNFCCC secretariat Workshop on the preparation of fourth national communications from.
Development of GHG projections guidelines Melanie Sporer, EEA.
Training Materials for National Greenhouse Gas Inventories Consultative Group of Experts (CGE) CGE Training Materials National Greenhouse Gas Inventories.
Training Workshop on the use of the CRF Reporter for European Community Experts Introduction Copenhagen – 12 September 2005 James Grabert Inventories sub-programme.
What is an Inventory Program for? Dr. Emilio Moceo Ph.D Director of Studies Meet international obligations and expectations Inform international, national,
Finland’s national system for estimating, reporting and archiving greenhouse gas inventory information UNFCCC Workshop on National Systems under Article.
Air Quality Governance in the ENPI East Countries Training on emission inventories The EMEP/EEA Guidebook General chapters January, 2014, Chișin.
How to Write a Critical Review of Research Articles
INTERNATIONAL LABOUR ORGANIZATION Conditions of Work and Employment Programme (TRAVAIL) 2012 Module 13: Assessing Maternity Protection in practice Maternity.
Training Materials for National Greenhouse Gas Inventories Consultative Group of Experts (CGE) CGE Training Materials National Greenhouse Gas Inventories.
Quality assurance / Quality control system for the Greek GHG emissions inventory Yannis Sarafidis, Elena Georgopoulou UNFCCC Workshop on National Systems.
INTERGOVERNMENTAL PANEL ON CLIMATE CHANGE NATIONAL GREENHOUSE GAS INVENTORIES PROGRAMME WMO UNEP Volume I General Guidance and Reporting Bonn, 18 may 2006.
Basics of GHG inventory preparation and Introduction to the IPCC Guidelines and Good Practice Guidelines UNFCCC Workshop on the use of the guidelines.
Inventory Planning in Norway UNFCCC Workshop on National Systems Audun Rosland 11 – 12 April 2005.
Malé Declaration 2 nd emissions inventory workshop AIT, Bangkok, 26 th – 28 th February 2007 Session 5 – Quality assurance and Quality control (QA/QC)
Ucertainty estimates as part of the inventory process Kristin Rypdal, CICERO.
Statistics Finland as the national authority for Finland’s national greenhouse gas inventory – experiences and future challenges UNECE Meeting on Climate.
1 National Greenhouse Gas Inventories Dominique REVET Programme Officer UNFCCC secretariat Reporting.
SEVERAL ISSUES OF CAPACITY BUILDING FOR CDM IN RESEARCH AGENCIES AND UNIVERSITIES Mr. Nguyen Mong Cuong Institute of Meteorological and Hydrology Mr. Bui.
Training Materials for National Greenhouse Gas Inventories Consultative Group of Experts (CGE) CGE Training Materials National Greenhouse Gas Inventories.
Chap. 5 Building Valid, Credible, and Appropriately Detailed Simulation Models.
ARC Seibersdorf research GmbH Treatment of uncertainty in greenhouse gas emission inventories: General approach and specific experience for Austria Wilfried.
Quality Management in the Finland’s Greenhouse Gas Inventory Leena Raittinen, Statistics Finland UNFCCC Workshop on National Systems April 2005 Bonn,
The Swedish air emission inventory system Karin Kindbom IVL Swedish Environmental Research Institute Russian-Swedish bilateral cooperation project: “Development.
1 Developed by U.S. Environmental Protection Agency (U.S. EPA) January 2014 Setting up a Sustainable National GHG Inventory Management System.
The Swedish air emission inventory system Karin Kindbom IVL Swedish Environmental Research Institute Russian-Swedish bilateral cooperation project: “Development.
Lexile Project Guidelines for Data Collection and Analysis.
1 NATIONAL SYSTEMS UNFCCC Workshop on National Systems under Article 5, paragraph 1, of the Kyoto Protocol 11–12 April 2005 Wissenschaftszentrum, Bonn,
UNDP Guidance for National Communication Project Proposals UNFCCC Workshop on the Preparation of National Communications from non-Annex I Parties Manila,
Informal Summary of LULUCF Technical Briefing: SBSTA 39 Overview of presentations and discussion.
UNFCCC Workshop on the Use of the Guidelines for the Preparation of National Communications from non-Annex I Parties National GHG Inventories Port Louis,
EU Workshop on Uncertainties in GHG inventories Uncertainty estimation of MS Anke Herold, ETC-ACC Suvi Monni, VTT Technical Research Centre, Finland Sanna.
Air Quality Governance in the ENPI East Countries Training on emission inventories Systems for calculating emissions December, 2013, Tbilisi, Georgia.
Building Valid, Credible & Appropriately Detailed Simulation Models
VTT TECHNICAL RESEARCH CENTRE OF FINLAND 1 VTT PROCESSES Workshop on uncertainties in GHG inventories 5 -6 September, 2005 Helsinki IPCC 2006 Guidelines.
Establishing by the laboratory of the functional requirements for uncertainty of measurements of each examination procedure Ioannis Sitaras.
Approaches to Data Collection
Uncertainty Analysis in Emission Inventories
Quality Assurance/Quality Control and Verification
Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 3. Session 9. Periodic data collection methods.
Methodological Choice and Key Categories Analysis
IPCC Emission Factor Database (EFDB)
Time Series Consistency
Time Series Consistency
Approaches to Data Collection Consultative Group of Experts (CGE)
Quality Assurance / Quality Control and Verification
IPCC Emission Factor Database (EFDB)
IPCC Inventory Software
Uncertainty Analysis in Emission Inventories
Uncertainty management
Presentation transcript:

Training Materials for National Greenhouse Gas Inventories Consultative Group of Experts (CGE) CGE Training Materials National Greenhouse Gas Inventories Uncertainty Analysis Version 2, April 2012

Target Audience and Objective of the Training Materials  These training materials are suitable for people with beginner to intermediate level knowledge of national greenhouse gas (GHG) inventory development.  After having read this presentation, in combination with the related documentation, the reader should:  Have an overview of how to conduct uncertainty assessment  Have a general understanding of the methods and tools available, as well as of the main challenges of GHG inventory development in that particular area  Be able to determine which methods suit their country’s situation best  Know where to find more detailed information on the topic discussed.  These training materials have been developed primarily on the basis of methodologies developed, by the IPCC; hence the reader is always encouraged to refer to the original documents to obtain further detailed information on a particular issue. 2 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Acronyms and Abbreviations  FAOFood and Agriculture Organization of the United Nations  GHGGreenhouse Gas  IEAInternational Energy Agency  OECDOrganisation for Economic Co-operation and Development  QA/QCQuality Assurance/Quality Control 3 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Structure of this presentation  Overview of guidance  Some thoughts on this guidance in practice  Overview of verification 4 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Thoughts on Uncertainty Analysis  Why?  Why is uncertainty analysis needed? Is it important?  We need clear justification.  What?  What is involved. What do the results mean?  We should show that uncertainty analysis is practical for all.  When?  Uncertainty analysis should be an integral part of inventory compilation – not an “add on” at the end!  How?  The method chosen should be matched to resources and expertise, while giving useful information. 5 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Benefits of Uncertainty Analysis 6 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Uncertainty Estimation - Overview Gather Information Collect uncertainty information on activity data and emission factors Decide approach to use Error Propagation Monte Carlo Perform Inventory Analysis Spreadsheet Software tool 7 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Specifying Uncertainty  Uncertainty is quoted as the 2.5 and 97.5 percentile i.e. bounds around a 95% confidence interval.  This can be expressed as:  234 ± 23%  (- 50%, + 100%)  2000 (a factor of 2) (i.e. - 50%, + 100%)  An order of magnitude (i.e. 1 to 100). 8 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Probability Density 9 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Probability Density 10 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Inventory Cycle 11 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories Report inventory Start New Estimate Building on experience of previous inventory (if any) Setup and implement quality control Identify key categories Check inventory through QA Select methods and data considering uncertainty and time-series consistency Conduct key category analysis Uncertainty: Evaluate input data and assess overall inventory Collect data and estimate emissions and removals Compile inventory Make necessary revisions (if any)

Sources of Uncertainty  Assumptions and methods  These method may not accurately reflect the emission. Good practice requires that biases be reduced as much as possible. Guidelines aim to be as unbiased and complete as possible.  Input data  Measured values have errors and emission factors may not be truly representative.  Calculation errors  Implement good QA/QC to stop these. 12 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Uncertainties Arise in Input Data Because of…  Lack of data  Use of proxies, extrapolation etc.  Missing data.  Data not truly representative  Statistical random sampling error  Measurement error  Misreporting. Consideration of these during data collection phase will minimise errors. 13 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Uncertainty Information 14 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Sources of Data  National statistical agencies  Sectoral experts, stakeholder organizations  Other national experts  IPCC Emission Factor Database  Other international experts  International organizations publishing statistics e.g., United Nations, FAO, IEA, OECD and the IMF (which maintains international activity as well as economic data)  Reference libraries (national libraries)  Scientific and technical articles in environmental books, journals and reports.  Universities  Web search for organizations and specialists  National Inventory Reports from Parties to the United Nations Framework Convention on Climate Change  Ministries, local and traditional authorities. 15 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Expert Judgement  Expert judgement on methodological choice and choice of input data to use is ultimately the basis of all inventory development.  Experts with suitable backgrounds can be found in government, industrial trade associations, technical institutes, industry and universities.  The goal of expert judgement may be choosing the:  Proper methodology  Parameter value and uncertainty from ranges provided  Most appropriate activity data to use  Most appropriate way to apply a methodology  Or determining the appropriate mix of technologies in use.  Expert judgement is always required since one must judge whether the data are a representative random sample and, if so, what methods to use to analyse the data.  This requires both technical and statistical judgement. 16 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Working With Experts  Wherever possible, expert judgement should be elicited using an appropriate protocol (e.g. Stanford/SRI protocol):  Motivating: Establish a rapport with the expert, describe the context, explain the most commonly occurring biases.  Structuring: Clearly define the quantities for which judgements are to be sought (e.g. resulting emissions or removals should be for typical conditions averaged over a one- year period).  Conditioning: Work with the expert to identify and record all relevant data, models and theory relating to the formulation of the judgements.  Encoding: Request and quantify the expert’s judgement (may differ but should include uncertainty information).  Verification: Analyse and feedback conclusions regarding their judgement. Is what has been encoded really what the expert meant?  Document! 17 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Remember…  Producing high quality “good practice” emission and removal estimates is paramount.  Efforts on uncertainty analysis should be small in comparison with the efforts on the inventory estimates themselves.  Data collection activities should consider data uncertainties:  This will ensure the best data is collected and ensures good practice estimates  As you collect data you should assess how “good” it is.  At its simplest, a well-planned uncertainty assessment should only take a few extra hours! 18 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Methods to Combine Uncertainties  Error propagation  Simple - standard spreadsheet can be used  Guidelines give explanation and equations  Difficult to deal with correlations  Strictly (standard deviation/mean) < 0.3  A simple solution is provided.  Monte-Carlo Simulation  More complex - Use specialized software  Needs shape of probability density function (pdf)  Suitable where uncertainties are large, non-Gaussian, complex algorithms, correlations exist and uncertainties vary with time. 19 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Enter emissions data Enter uncertainties Data calculated using simple equations 20 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories Error Propagation - Example

Note short list of source/sinks Emission factor uncertainties based on defaults in guidelines Activity data uncertainties based on source of data

Error Propagation: example of results 22 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Error Propagation: example of results (continued) 23 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Monte-Carlo Method – Simplified Approach: example  Key requirements  Not just uncertainties but also probability density function (pdf)  Mean  Width  Shape (e.g. normal, log-normal, Weibul, gamma, uniform, triangular, fractile  Principle  Select random values of input parameters from their pdf and calculate the corresponding emission. Repeat many times and the distribution of the results is the pdf of the result, from which mean and uncertainty can be estimated. 24 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Monte-Carlo Method – Simplified Approach: example (continued) 25 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Monte-Carlo Method – Simplified Approach: 1 run 26 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Monte-Carlo Method – Simplified Approach: 10 runs 27 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Monte-Carlo Method – Simplified Approach: 20 runs 28 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Monte-Carlo Method – Simplified Approach: 50 runs 29 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Monte-Carlo Method – Simplified Approach: 100 runs 30 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Monte-Carlo Method – Simplified Approach: 500 runs 31 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Monte-Carlo Method – Simplified Approach: 1000 runs 32 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Monte-Carlo Method – Simplified Approach: 5000 runs 33 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Monte-Carlo Method – Simplified Approach: 10,000 runs 34 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Monte-Carlo Method – Simplified Approach: summary results 35 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Summary  Even simple uncertainty estimates give useful information - If they are performed well!  Assessment of uncertainty in the input parameters should be part of the standard data collection QA/QC:  Careful consideration will improve estimates as well as providing input data for uncertainty analysis.  If resources are limited: amounts spent on uncertainty analysis should be small compared with total effort.  For simple estimates:  Uncertainty in activity data assessed as data collected  Uncertainty in emission factors from guidelines if readily available  Aggregate categories/gases to independent groups of sources/sinks  Use Approach 1 – the spreadsheet requires little statistical knowledge. 36 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories

Thank you Diagrams © IPCC Except where noted otherwise 37 Consultative Group of Experts (CGE) Training Materials for National Greenhouse Gas Inventories