New and Emerging Methods

Slides:



Advertisements
Similar presentations
Handling attrition and non- response in longitudinal data Harvey Goldstein University of Bristol.
Advertisements

Migration of a large survey onto a micro-economic platform Val Cox April 2014.
Harvard Center for Population and Development Studies1 Census Editing and the Art of Motorcycle Maintenance Michael J. Levin Center for Population and.
Editing and Imputing VAT Data for the Purpose of Producing Mixed- Source Turnover Estimates Hannah Finselbach and Daniel Lewis Office for National Statistics,
Stratification (Blocking) Grouping similar experimental units together and assigning different treatments within such groups of experimental units A technique.
Deliverable 2.8: Outliers Gary Brown Office for National Statistics UK.
SLICE 1.5: A software framework for automatic edit and imputation Ton de Waal Statistics Netherlands UN/ECE Work Session on Statistical Data Editing,
Sullivan – Fundamentals of Statistics – 2 nd Edition – Chapter 1 Section 2 – Slide 1 of 22 Chapter 1 Section 2 Observational Studies, Experiments, and.
UNECE Work Session on Statistical Data Editing Vienna April 2008 Topic ii – Editing Administrative Data and Combined Sources.
1 Editing Administrative Data and Combined Data Sources Introduction.
NLSCY – Non-response. Non-response There are various reasons why there is non-response to a survey  Some related to the survey process Timing Poor frame.
Lecture 24 Multiple Regression (Sections )
11 Populations and Samples.
PowerPoint presentation to accompany Research Design Explained 4th edition ; ©2000 Mark Mitchell & Janina Jolley Chapter 7 The Multiple Group Experiment.
Editing of mixed source data for turnover statistics Jeffrey Hoogland (SN) Work Session on Statistical Data Editing (Ljubljana, Slovenia, 9-11 May 2011)
Data Editing United Nations Statistics Division (UNSD) 16 March 2011 Santiago, Chile.
Vienna, 23 April 2008 UNECE Work Session on SDE Topic (v) Editing on results (post-editing) 1 Topic (v): Editing based on results Discussants: Maria M.
Eurostat Repeated surveys. Presented by Eva Elvers Statistics Sweden.
Eurostat Statistical Data Editing and Imputation.
The Edit Anders Norberg, Statistics Sweden (SCB) Work Session on Statistical Data Editing Ljubljana, Slovenia, 9-11 May 2011.
THE MAIN INNOVATIONS OF DATA EDITING AND IMPUTATION FOR THE 2010 ITALIAN AGRICULTURAL CENSUS G. Bianchi, R. M. Lipsi, P. Francescangeli, G. Ruocco, A.
Physics 270 – Experimental Physics. Standard Deviation of the Mean (Standard Error) When we report the average value of n measurements, the uncertainty.
New and Emerging Methods Maria Garcia and Ton de Waal UN/ECE Work Session on Statistical Data Editing, May 2005, Ottawa.
Topic (ii): New and Emerging Methods Maria Garcia (USA) Jeroen Pannekoek (Netherlands) UNECE Work Session on Statistical Data Editing Paris, France,
Challenges in Collecting Police-Reported Crime Data Colin Babyak Household Survey Methods Division ICES III - Montreal – June 20, 2007.
Jeroen Pannekoek - Statistics Netherlands Work Session on Statistical Data Editing Oslo, Norway, 24 September 2012 Topic (I) Selective and macro editing.
Topic (vi): New and Emerging Methods Topic organizer: Maria Garcia (USA) UNECE Work Session on Statistical Data Editing Oslo, Norway, September 2012.
Mediation: Solutions to Assumption Violation
Oslo, 24–26 September 2012 Work Session on Statistical Data Editing APPLICATION OF THE DEVELOPED SAS MACRO FOR EDITING AND IMPUTATION AT.
Inference for 2 Proportions Mean and Standard Deviation.
CBS-SSB STATISTICS NETHERLANDS – STATISTICS NORWAY Work Session on Statistical Data Editing Oslo, Norway, September 2012 Jeroen Pannekoek and Li-Chun.
A discussion of Comparing register and survey wealth data ( F. Johansson and A. Klevmarken) & The Impact of Methodological Decisions around Imputation.
G Class 11 Statistical Methods for the Analysis of Change Administrative Issues Why study change? Overview of methodological issues Overview of.
Topic (iii): Macro Editing Methods Paula Mason and Maria Garcia (USA) UNECE Work Session on Statistical Data Editing Ljubljana, Slovenia, 9-11 May 2011.
Outlining a Process Model for Editing With Quality Indicators Pauli Ollila (part 1) Outi Ahti-Miettinen (part 2) Statistics Finland.
Evaluating the Quality of Editing and Imputation: the Simulation Approach M. Di Zio, U. Guarnera, O. Luzi, A. Manzari ISTAT – Italian Statistical Institute.
Heather Wagstaff and Thomas Burg Topic (vi) Methodologies for Editing Census Data INTRODUCTION UNECE Work Session on Statistical Data Editing:Vienna
New and Emerging Methods UN/ECE Work Session on Statistical Data Editing Vienna April 21-23, 2008.
Generic Statistical Data Editing Models (GSDEMs) Workshop on the Modernisation of Official Statistics The Hague, 24 November 2015.
Sullivan – Statistics: Informed Decisions Using Data – 2 nd Edition – Chapter 1 Section 2 – Slide 1 of 21 Chapter 1 Section 2 Observational Studies, Experiments,
Automatic Editing Data. A New Version of DIA System Prepared by J.M. Gomez Presented by D.Lorca National Statistical Institute of Spain.
Lecture 1 Introduction to econometrics
Elaborating on the Business Architecture of SN Robbert Renssen Statistics Netherlands Standard Process Steps.
Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 1 Topic (vii): New and emerging methods Discussion Discussants: Rudi.
Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 1 Topic (vii): New and emerging methods Introduction Session organizers:
How to deal with quality aspects in estimating national results Annalisa Pallotti Short Term Expert Asa 3st Joint Workshop on Pesticides Indicators Valletta.
Carlo Drago1 CEO Compensation and Performance in Family Firms by Barontini and Bozzi Carlo Drago SIDE-ISLE Annual Conference 2009 University of Naples.
GS/PPAL Research Methods and Information Systems
Theme (v): Managing change
Improvements in editing methods and processes for use of Value Added Tax data in UK National Accounts Martina Portanti and Robert Breton Office for National.
Generic Statistical Data Editing Models (GSDEMs)
Theme (i): New and emerging methods
The treatment of uncertainty in the results
Multiple Imputation using SOLAS for Missing Data Analysis
An R package for selective editing based on a latent class model
UNITED NATIONS ECONOMIC COMMISSION FOR EUROPE CONFERENCE OF EUROPEAN STATISTICIANS Work Session on Statistical Data Editing April 2017 The Hague,
Lecture Slides Elementary Statistics Eleventh Edition
Physics 114: Lecture 10 Error Analysis/ Propagation of Errors
Guidelines on the use of estimation methods for the integration of administrative sources DIME/ITDG meeting 2018/02/22.
Statistics 1: Elementary Statistics
A way of collecting, organizing, and interpreting data
Lecture Slides Elementary Statistics Twelfth Edition
Lecture Slides Elementary Statistics Twelfth Edition
Non response and missing data in longitudinal surveys
Jeroen Pannekoek, Sander Scholtus and Mark van der Loo
From Samples to Populations
MANOVA Control of experimentwise error rate (problem of multiple tests). Detection of multivariate vs. univariate differences among groups (multivariate.
The role of metadata in census data dissemination
Statistical Power.
UNECE Work Session on Statistical Data Editing, Paris, 2014
Presentation transcript:

New and Emerging Methods Possible discussion points

Automatic editing Which errors are more important? random errors? systematic errors? Do we need new methodology for detecting random errors? based on edit rules? based on statistical outlier detection? What are the experiences with respect to detecting and correcting systematic errors at other agencies? What kinds of systematic errors can we distinguish?

Imputation Is imputation under edit restrictions an important new topic? Is imputation preserving known totals an important new topic? Is multiple imputation the way of the future? to smooth variability of single imputations? to estimate (co)variances?

Detection of influential errors/selective editing In this session only one paper on selective editing Is selective editing no longer “new and emerging”? Are we near the end of the theoretical development of selective editing? Should selective editing be based on complicated methods or do simple methods suffice?

Impact of editing Should we focus more on measuring the impact of (changing) the edit strategy? What are the experiences at other agencies in this respect? Can we improve on the Snowdon-X approach?

Data Is the focus shifting to periodic data/time series? Is the focus shifting to longitudinal data?

Software development How should we develop software? Open source Commercial of the shelf Find commercial vendor to develop software for us Develop software together in international projects Each agency develops its own software

Edit and imputation Is error localization more important than imputation? Is imputation more important than error localization?