Riku Salonen Regression composite estimation for the Finnish LFS from a practical perspective.

Slides:



Advertisements
Similar presentations
Re-design of the trade in commercial services program in Canada October 2010 OECD Working Party on Trade in Goods and Services.
Advertisements

Evaluating the Effects of Business Register Updates on Monthly Survey Estimates Daniel Lewis.
Innovation data collection: Methodological procedures & basic forms Regional Workshop on Science, Technology and Innovation (STI) Indicators.
Innovation data collection: Advice from the Oslo Manual South East Asian Regional Workshop on Science, Technology and Innovation Statistics.
Innovation Surveys: Advice from the Oslo Manual South Asian Regional Workshop on Science, Technology and Innovation Statistics Kathmandu,
Innovation Surveys: Advice from the Oslo Manual National training workshop Amman, Jordan October 2010.
Producing monthly estimates of labour market indicators exploiting the longitudinal dimension of the LFS microdata R. Gatto, S. Loriga, A. Spizzichino.
Outline of talk The ONS surveys Why should we weight?
Longitudinal LFS Catherine Barham and Paul Smith ONS.
Stratified Sampling Module 3 Session 6.
Overview of Sampling Methods II
SADC Course in Statistics Overview of Sampling Methods I (Session 03)
Using Business Taxation Data as Auxiliary Variables and as Substitution Variables in the Australian Bureau of Statistics Frank Yu, Robert Clark and Gabriele.
provide information Longitudinal Weights for the Production of Transitions and Flow Estimates Katrin Baumgartner Angelika Meraner Alexander.
ISTAT - Italian National Institute of Statistics Labour Force Survey Division Unit “Methods for LFS data treatment” 5 th Workshop on LFS methodology Paris,
Sampling Strategy for Establishment Surveys International Workshop on Industrial Statistics Beijing, China, 8-10 July 2013.
1 STRATIFIED SAMPLING Stratification: The elements in the population are divided into layers/groups/ strata based on their values on one/several.
Geographic Oversampling for Race/Ethnicity Using Data from the 2010 Census Presented to WSS Sixia Chen December 3, 2014.
Optimal Sampling Strategies for Multidomain, Multivariate Case with different amount of auxiliary information Piero Demetrio Falorsi, Paolo Righi 
Weighting sample surveys with Bascula Harm Jan Boonstra Statistics Netherlands.
Chapter 7 Sampling Distributions
STAT262: Lecture 5 (Ratio estimation)
Stratified Simple Random Sampling (Chapter 5, Textbook, Barnett, V
STAT 4060 Design and Analysis of Surveys Exam: 60% Mid Test: 20% Mini Project: 10% Continuous assessment: 10%
Ka-fu Wong © 2004 ECON1003: Analysis of Economic Data Lesson6-1 Lesson 6: Sampling Methods and the Central Limit Theorem.
Formalizing the Concepts: STRATIFICATION. These objectives are often contradictory in practice Sampling weights need to be used to analyze the data Sampling.
Improving Quality in the Office for National Statistics’ Annual Earnings Statistics Pete Brodie & Kevin Moore UK Office for National Statistics.
Administrative Data at Statistics Canada – Current Uses and the Way Forward 27 th Voorburg Group Meeting Warsaw, Poland André Loranger October 4, 2012.
The Labour Force Survey Process- The Jamaican Experience CARICOM 2 nd High Level Advocacy Forum on Statistics Presented by: Carol Coy The Statistical Institute.
Sample Design Establishments Surveys Stuart Brown Research, Design & Evaluation January 2013 STATISTICAL INSTITUTE OF JAMAICA.
Definitions Observation unit Target population Sample Sampled population Sampling unit Sampling frame.
Producing Hours Worked for the SNA in order to Measure Productivity: the Canadian Experience By Jean-Pierre Maynard, Andrée Girard and Marc Tanguay Canadian.
9 th Workshop on Labour Force Survey Methodology – Rome, May 2014 The Italian LFS sampling design: recent and future developments 9 th Workshop on.
Use of Administrative Data in Statistics Canada’s Annual Survey of Manufactures Steve Matthews and Wesley Yung May 16, 2004 The United Nations Statistical.
Optimal Allocation in the Multi-way Stratification Design for Business Surveys (*) Paolo Righi, Piero Demetrio Falorsi 
Monthly estimates from a practical perspective Experiences from Finnish LFS LFS Methodology Work Shop, Paris 2010 Kalle Sinivuori, Statistics Finland.
Discussion of Hujer, R. and S. Thomsen (2006). “How Do Employment Effects of Job Creation Schemes Differ with Respect to the Foregoing Unemployment Duration?”
ESEC Conference Using the classification in the case of the LFS Bled, June 2006 Natasa Kozlevcar.
European Conference on Quality in Official Statistics Roma, July 8-11, 2008 New Sampling Design of INSEE’s Labour Force Survey Sébastien Hallépée Vincent.
ISTAT - Italian National Institute of Statistics Labour Force Survey Division Unit “Methods for LFS data treatment” European Conference on Quality in Official.
Conducting and Analysing Labour Force Surveys for Monitoring of the Labour Market, ِِ Amman November 2012 Challenges and Opportunities Labour Force.
CZECH STATISTICAL OFFICE | Na padesátém 81, Prague 10 | czso.cz1/16 Ondřej Nývlt, Ilona Nováková, Lukáš Savko EFFECTIVE DISTRIBUTION OF SAMPLE OVER.
Multiple Imputation Methods for Imputing Earnings in the Survey of Income and Program Participation (SIPP) María García, Chandra Erdman, and Ben Klemens.
1 Enhancing Small Area Estimation Methods Applications to Istat’s Survey Data Ranalli M.G. ~ Università di Perugia D’Alo’ M., Di Consiglio L., Falorsi.
National design, fieldwork and data harmonization for Labour Force Survey Irena Svetin Statistical Office of the Republic of Slovenia September 2014.
Sampling Design and Analysis MTH 494 LECTURE-12 Ossam Chohan Assistant Professor CIIT Abbottabad.
Using administrative registers in sample surveys European Conference on Quality in Official Statistics 3-–6 May 2010 Kaja Sõstra Statistics Estonia.
Dag van de Lokale Rekenkamer “Weighting the consequences” Martijn Souren Consistent LFS weighting Statistics Netherlands LFS workshop, Paris.
ICES 2007 Labour Cost Index and Sample Allocation Outi Ahti-Miettinen and Seppo Laaksonen Statistics Finland (+ University of Helsinki) Labour cost index.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc.. Chap 7-1 Chapter 7 Sampling Distributions Basic Business Statistics.
Estimation of preliminary unemployment rates by means of multiple imputation UN/ECE-Work Session on Data Editing Vienna, April 2008 Thomas Burg, Statistics.
The challenge of a mixed-mode design survey and new IT tools application: the case of the Italian Structure Earning Surveys Fabiana Rocci Stefania Cardinleschi.
Improving of Household Sample Surveys Data Quality on Base of Statistical Matching Approaches Ganna Tereshchenko Institute for Demography and Social Research,
Rome, May 2014 Structural variables Weighting the Spanish annual subsample.
 When every unit of the population is examined. This is known as Census method.  On the other hand when a small group selected as representatives of.
INFO 4470/ILRLE 4470 Visualization Tools and Data Quality John M. Abowd and Lars Vilhuber March 16, 2011.
Rotating Panels – Especially with Regards to Business Statistics Peter Tibert Stoltze Statistical Methodology Forum for Sample Survey and Estimation April.
ПРОБЛЕМЫ ПЕРЕСЧЁТА КВЕД 2005 – КВЕД 2010 Bronislava Kaminskienė.
Small area estimation combining information from several sources Jae-Kwang Kim, Iowa State University Seo-Young Kim, Statistical Research Institute July.
Research proposal (Lecture 3) Dr.Rehab F Gwada. Objectives of the Lecture The student at the end of this lecture should Know Identify Target Population.
Weighting issues in EU-LFS
STRATIFIED SAMPLING.
Regression composite estimation for the Finnish LFS from a practical perspective Riku Salonen.
2. Stratified Random Sampling.
Estimation of Employment for Cities, Towns and Rural Districts
Updating inclusion probabilities for the sampling units
Sampling and estimation
Correcting for non-response bias using socio-economic register data
SMALL AREA ESTIMATION FOR CITY STATISTICS
Workshop on best practices for EU-SILC revision, −
Presentation transcript:

Riku Salonen Regression composite estimation for the Finnish LFS from a practical perspective

May , 20142LFS Workshop in Rome Outline Design of the FI-LFS The idea of RC-estimator Empirical results Conclusions and future work

May , 20143LFS Workshop in Rome The FI-LFS Monthly survey on individuals of the age Sample size is divided into 5 waves It provides monthly, quarterly and annual results Sampling design is stratified systematic sampling The strata: Mainland Finland and Åland Islands In both stratum systematic random selection is applied to the frame sorted according to the domicile code Implicit geographic stratification

May , 20144LFS Workshop in Rome Rotation panel design Partially overlapping samples Each sample person is in sample 5 times during 15 months The monthly rotation pattern: 1-(2)-1-(2)-1-(5)-1-(2)-1 No month to month overlap 60% quarter to quarter theoretical overlap 40% year to year theoretical overlap Independence: monthly samples in each three-month period quarterly sample consists of separate monthly samples

May , 20145LFS Workshop in Rome Sample allocation (1) The half-year sample is drawn two times a year It is allocated into six equal part - one for the next six months The half-year sample (e.g. Jan-June 2014) Jan Mar Apr May June The monthly sample (e.g. Jan 2014) Wave (1) Wave (2) Wave (3) Wave (4) Wave (5) ”Sample bank” Earlier samples Feb

May , 20146LFS Workshop in Rome Sample allocation (2) The monthly sample is i) divided into five waves wave (1) come from the half-year sample waves (2) to (5) come from ”sample bank” ii) distributed uniformly across the weeks of the month (4 or 5 reference weeks) The quarterly sample (usually 13 reference weeks) consist of three separate and independent monthly samples.

May , 20147LFS Workshop in Rome Weighting procedure The weighting procedure (GREG estimator) of the FI-LFS on monthly level is whole based on quarterly ja annual weighting also. For this purpose i) the monthly weights need to be divided by three to create quarterly weights and ii) the monthly weights need to be divided by twelve to create annual weights. This automatically means that monthly, quarterly and annual estimates are consistent.

May , 20148LFS Workshop in Rome The idea of RC-estimator Extends the current GREG estimator used FI-LFS. To improve the estimate by incorporating information from previous wave (or waves) of interview. Takes the advantage of correlations over time.

May , 20149LFS Workshop in Rome RC estimation procedure The technical details and formulas of the RC estimation method with application to the FI-LFS are summarized in the workshop paper and in Salonen (2007). RC estimator introduced by Singh et. al, Fuller et. al and Gambino et. al (2001). Examined further by Bocci and Beaumont (2005).

May , LFS Workshop in Rome RC estimation system implementation The RC estimator can be implemented within the FI-LFS estimation system by adding control totals and auxiliary variables to the estimation program. It can be performed by using, with minor modification, standard software for GREG estimation, such as ETOS. It yields a single set of estimation weights.

May , LFS Workshop in Rome Control totals of auxiliary variables Population control totals Assumed to be population values Composite control totals Estimated control totals

May , LFS Workshop in Rome Population control totals Population totals taken from administrative registers sex (2) age (12) region (20) employment status in Ministry of Labour's job-seeker register (8) Obs! Weekly balancing of weights on monthly level is also included in the calibration (4 or 5 reference weeks).

May , LFS Workshop in Rome Composite control totals Composite control totals are estimates from the previous wave of interview Employed and unemployed by age/sex groups (8) Employed and unemployed by NUTS2 (8) Employment by Standard Industrial Classification (7)

May , LFS Workshop in Rome Table 1. Population and composite control totals for RC estimation

May , LFS Workshop in Rome Composite auxiliary variables Overlapping part of the sample Variables are taken from the previous wave of interview Non-overlapping part of the sample The values of variables are imputed

May , LFS Workshop in Rome Example 1. Overlapping January 2014 Wave 1 Wave 2 Wave 3 Wave 4 Wave 5 Previous interview none October 2013 (July 2013) October 2013 Dependence: Theoretical overlap wave-to-wave is 4/5 (80%)

May , LFS Workshop in Rome Empirical results We have compared the RC estimator to the GREG estimator in the FI-LFS real data ( ) Here we have used the ETOS program for point and variance estimation (Taylor linearisation method). Relative efficiency (RE) can be formulated as A value of RE greater than 100 indicates that the RC estimator is more efficient than the GREG estimator.

May , LFS Workshop in Rome Table 2. Distribution of calibrated weights for GREG and RC estimators (e.g 2nd quarter of 2006) The calibrated weights are obtained by the ETOS program. The results show that the variation of the RC weights is smaller than that of the GREG weights.

May , LFS Workshop in Rome Table 3. Relative efficiency (RE, %) of estimates for the quarterly level of employment and unemployment by sex

May , LFS Workshop in Rome Table 4. Relative efficiency (RE, %) of estimates for the monthly level of employment and unemployment by industrial classification

May , LFS Workshop in Rome Table 5. Relative efficiency (RE, %) of estimates for the quarterly level of employment and unemployment by industrial classification

May , LFS Workshop in Rome Conclusions (1) For the variables that were included as composite control totals, there are substantial gains in efficiency for estimates For some variables it is future possible to publish monthly estimates where only quarterly estimates are published now? Leading to internal consistency of estimates Employment + Unemployment = Labour Force Labour Force + Not In Labour Force = Population 15 to 74

May , LFS Workshop in Rome Conclusions (2) It can be performed by using, with minor modification, standard software for GREG estimation, such as ETOS It yields a single set of estimation weights The results are well comparable with results reported from other countries Chen and Liu (2002): the Canadian LFS Bell (2001): the Australian LFS

May , LFS Workshop in Rome Future work Analysis of potential imputation methods for the non- overlapping part of the sample? Analysis of alternative variance estimators (Dever and Valliant, 2010)? Incorporating information from all potential previous waves of interview

May , LFS Workshop in Rome MAIN REFERENCES BEAUMONT, J.-F. and BOCCI, C. (2005). A Refinement of the Regression Composite Estimator in the Labour Force Survey for Change Estimates. SSC Annual Meeting, Proceedings of the Survey Methods Section, June CHEN, E.J. and LIU, T.P. (2002). Choices of Alpha Value in Regression Composite Estimation for the Canadian Labour Force Survey: Impacts and Evaluation. Methodology Branch Working Paper, HSMD E, Statistics Canada. DEVER, A.D., and VALLIANT, R. (2010). A Comparison of Variance Estimators for Poststratification to Estimated Control Totals. Survey Methodology, 36, FULLER, W.A., and RAO, J.N.K. (2001). A Regression Composite Estimator with Application to the Canadian Labour Force Survey. Survey Methodology, 27, GAMBINO, J., KENNEDY, B., and SINGH, M.P. (2001). Regression Composite Estimation for the Canadian Labour Force Survey: Evaluation ja Implementation. Survey Methodology, 27, SALONEN, R. (2007). Regression Composite Estimation with Application to the Finnish Labour Force Survey. Statistics in Transition, 8, SINGH, A.C., KENNEDY, B., and WU, S. (2001). Regression Composite Estimation for the Canadian Labour Force Survey with a Rotating Panel Design. Survey Methodology, 27,