Automated Supply-Use Balancing in the United Kingdom: A New Approach

Slides:



Advertisements
Similar presentations
The Stability of a Good Clustering Marina Meila University of Washington
Advertisements

1 1 Slide STATISTICS FOR BUSINESS AND ECONOMICS Seventh Edition AndersonSweeneyWilliams Slides Prepared by John Loucks © 1999 ITP/South-Western College.
Statistics and Data Analysis Professor William Greene Stern School of Business IOMS Department Department of Economics.
Simultaneous Estimation of Microphysical Parameters and State Variables with Radar data and EnSRF – OSS Experiments Mingjing Tong and Ming Xue School of.
Chapter 3 Analysis of Variance
Estimating Multiple- Discrete Choice Models: An Application to Computerization Returns Presentation by Le Chen, Zhen Huo, Bernabe Lopez-Martin, Shihui.
Control Charts for Variables
Fall 2006 – Fundamentals of Business Statistics 1 Chapter 8 Introduction to Hypothesis Testing.
Jana van Greunen - 228a1 Analysis of Localization Algorithms for Sensor Networks Jana van Greunen.
Statistical Methods in Computer Science Hypothesis Testing I: Treatment experiment designs Ido Dagan.
Statistical Methods in Computer Science Hypothesis Testing II: Single-Factor Experiments Ido Dagan.
Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc Chapter 11 Introduction to Hypothesis Testing.
Chapter 12 Inferential Statistics Gay, Mills, and Airasian
LU Decomposition 1. Introduction Another way of solving a system of equations is by using a factorization technique for matrices called LU decomposition.
Moderation in Structural Equation Modeling: Specification, Estimation, and Interpretation Using Quadratic Structural Equations Jeffrey R. Edwards University.
©2012 Pearson Education, Auditing 14/e, Arens/Elder/Beasley Audit Sampling for Tests of Details of Balances Chapter 17.
1 SVY207: Lecture 18 Network Solutions Given many GPS solutions for vectors between pairs of observed stations Compute a unique network solution (for many.
Single Sample Inferences
1 Introduction to Hypothesis Testing. 2 What is a Hypothesis? A hypothesis is a claim A hypothesis is a claim (assumption) about a population parameter:
1 FORMULATION OF TECHNICAL, ECONOMIC AND ENVIRONMENTAL EFFICIENCY MEASURES THAT ARE CONSISTENT WITH THE MATERIALS BALANCE CONDITION by Tim COELLI Centre.
A multivariate Denton method for Benchmarking Large Data Sets Jacco Daalmans and Nino Mushkudiani 20 February 2009.
Jeroen Pannekoek - Statistics Netherlands Work Session on Statistical Data Editing Oslo, Norway, 24 September 2012 Topic (I) Selective and macro editing.
Job scheduling algorithm based on Berger model in cloud environment Advances in Engineering Software (2011) Baomin Xu,Chunyan Zhao,Enzhao Hua,Bin Hu 2013/1/251.
Efficient computation of Robust Low-Rank Matrix Approximations in the Presence of Missing Data using the L 1 Norm Anders Eriksson and Anton van den Hengel.
Multivariate Statistics Confirmatory Factor Analysis I W. M. van der Veld University of Amsterdam.
Types of Hypotheses Research Hypothesis –a statement of what the researcher believes will be the outcome of an experiment or a study. Statistical Hypotheses.
Exploring Microsimulation Methodologies for the Estimation of Household Attributes Dimitris Ballas, Graham Clarke, and Ian Turton School of Geography University.
Nonlinear differential equation model for quantification of transcriptional regulation applied to microarray data of Saccharomyces cerevisiae Vu, T. T.,
September 28, 2000 Improved Simultaneous Data Reconciliation, Bias Detection and Identification Using Mixed Integer Optimization Methods Presented by:
Simon Compton Methodology Directorate Office for National Statistics
MCE: Eigen Values Calculations from Pair Wise Comparisons. Addition to Exercise 2-8.
©2012 Prentice Hall Business Publishing, Auditing 14/e, Arens/Elder/Beasley Audit Sampling for Tests of Details of Balances Chapter 17.
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Statistical Interpretation of Least Squares ASEN.
Education 793 Class Notes ANCOVA Presentation 11.
SketchVisor: Robust Network Measurement for Software Packet Processing
Chapter 11 Analysis of Variance
Learning to Align: a Statistical Approach
Logic of Hypothesis Testing
Analysis Manager Training Module
Effect Sizes.
Step 1: Specify a null hypothesis
Introduction Edited by Enas Naffar using the following textbooks: - A concise introduction to Software Engineering - Software Engineering for students-
Algorithms II Software Development Life-Cycle.
Independent-Samples t-test
Simultaneous Reconciliation of a Large Disaggregated Time Series of Accounts with an Application to the U.S. Input-Output Accounts Baoline Chen1 Tommaso.
Flexible and Interactive Tradeoff Elicitation Procedure
Reconciling the System of National Accounts for the U. S
(5) Notes on the Least Squares Estimate
School of Geography, University of Leeds
Statistical Quality Control, 7th Edition by Douglas C. Montgomery.
Hybrid Cloud Architecture for Software-as-a-Service Provider to Achieve Higher Privacy and Decrease Securiity Concerns about Cloud Computing P. Reinhold.
Chapter 2 Simple Comparative Experiments
CJT 765: Structural Equation Modeling
Introduction Edited by Enas Naffar using the following textbooks: - A concise introduction to Software Engineering - Software Engineering for students-
Chapter 10: Solving Linear Systems of Equations
Hypothesis Tests for a Population Mean,
1 Department of Engineering, 2 Department of Mathematics,
Principles of Supply Chain Management: A Balanced Approach
1 Department of Engineering, 2 Department of Mathematics,
1 Department of Engineering, 2 Department of Mathematics,
Unit 4 Project Design, implementation and evaluation
What is Regression Analysis?
Randomized Complete Block and Repeated Measures (Each Subject Receives Each Treatment) Designs KNNL – Chapters 21,
OVERVIEW OF LINEAR MODELS
The Implications of Misreporting for Longitudinal Studies of SNAP
Chapter 9 Hypothesis Testing: Single Population
Retrieval Performance Evaluation - Measures
Alan Girling University of Birmingham, UK
Business Statistics For Contemporary Decision Making 9th Edition
Chapter 9 Test for Independent Means Between-Subjects Design
Presentation transcript:

Automated Supply-Use Balancing in the United Kingdom: A New Approach

Introduction SU balancing is the reconciliation of data sources to provide a GDP estimate It should depend on the quality of each data source Traditionally, this has been done manually But better computers are helping NSIs automate this So how to specify the algorithm?

Quadratic Programming - A Model QP is a well-established algorithm with multiple easily-available software implementations But what constraints and objective to use? Usual model Weight the objective (squared adjustments) for relative quality Accounting constraints Optional soft constraints for economic ratios

Literature Review Chen (2012) presents this model in matrix algebra terms Key points: Covariance matrix between initial estimates and true values must be known; initial estimates must be unbiased estimators of true values; if so, model produces unique best solution Similar conclusions in Bikker et al (2013) and van Tongeren and Picavet (2016)

The UK Position We do not know the covariance matrix (Chen) Nor do we know the standard errors of the underlying dist. of the initial estimates – or even whether they are normally distributed (Bikker et al, van Tongeren and Picavet) So can we develop a model suited to these conditions?

An Alternative Model Consider the matrices and vectors underlying the SU system For each cell, we should be able to allocate upper and lower bounds (eg, the UK agriculture industry produces less than £100 trillion for each product, and more than £0 for the agriculture product) Real bounds are much narrower So we can apply these as additional constraints in a LP/QP model No weights on the objective

Comparison of Models This model does not guarantee a unique best solution (indeed, the solution may not be unique – but this is unlikely) And, if the constraints are not set correctly, the problem can be infeasible These are consequences of the unavailable information So we can’t guarantee the outcome will be as good as the other model – but we don’t have to make its assumptions

Testing Testing was done on past UK SU tables Upper and lower bounds based on manual adjustments – if a cell had been manually adjusted by + or – x%, the upper and lower bounds were set as +/- x% Some different treatment based on different manual procedures (eg trade in goods)

Results See tables in paper For the 4 main SU aggregates (GDP(P), GDP(I), total supply, and total demand) total adjustments were lower for all except GDP(I) At the lower level, the lower manual GDP(I) adjustments were the result of higher (in absolute terms) adjustments netting off So results are positive

Conclusions Automation of the SU process is viable ONS is still not able to deliver the more ambitious aims of the alternative model That requires more work to establish the needed metadata This work should be a top priority for ONS and the other NSIs working on automated balancing