Workshop LFS, April 15 2010 Estimating the non-response bias using exogenous data on employment Etienne Debauche Corinne Prost.

Slides:



Advertisements
Similar presentations
Longitudinal LFS Catherine Barham and Paul Smith ONS.
Advertisements

Survey Methodology Nonresponse EPID 626 Lecture 6.
provide information Longitudinal Weights for the Production of Transitions and Flow Estimates Katrin Baumgartner Angelika Meraner Alexander.
How are we doing? Sort the types of error into sampling and non-sampling errors, then match the situations to the types of error.
An Assessment of the Impact of Two Distinct Survey Design Modifications on Health Insurance Coverage Estimates in a National Health Care Survey Steven.
Conference on Irish Economic Policy Union membership and the union wage Premium in Ireland Frank Walsh School of Economics University College Dublin
An example of longitudinal LFS weights
ISTAT - Italian National Institute of Statistics Labour Force Survey Division Unit “Methods for LFS data treatment” 5 th Workshop on LFS methodology Paris,
1 European Conference on Quality in Official Statistics Rome, 8-11 July 2008 Improving the quality and the quality assessment of the Labour Force Survey.
STATISTICS FOR MANAGERS LECTURE 2: SURVEY DESIGN.
Estimation of unrecorded employment using administrative data Ágota Scharle Bálint Szabó Ministry of Finance Budapest.
NLSCY – Non-response. Non-response There are various reasons why there is non-response to a survey  Some related to the survey process Timing Poor frame.
Consumer Expenditure Survey Redesign Jennifer Edgar Bureau of Labor Statistics COPAFS Quarterly Meeting March 4, 2011.
Why do Mexicans prefer informal jobs? Eliud Diaz Romo, Durham University 8 of July, 2015.
Formalizing the Concepts: STRATIFICATION. These objectives are often contradictory in practice Sampling weights need to be used to analyze the data Sampling.
~ Draft version ~ 1 HOW TO CHOOSE THE NUMBER OF CALL ATTEMPTS IN A TELEPHONE SURVEY IN THE PRESENCE OF NONRESPONSE AND MEASUREMENT ERRORS Annica Isaksson.
REPRESENTATIVE RESPONSE Some Examples ITSEW Peter Lundquist Statistics Sweden.
FINAL REPORT: OUTLINE & OVERVIEW OF SURVEY ERRORS
Producing migration data using household surveys Experience of the Republic of Moldova UNECE Work Session on Migration Statistics, Geneva, October.
ECONOMIC AND ENVIRONMENTAL IMPACTS OF THE GOGEBIC TACONITE MINE Aleksei Bogdanov and Zamira Simkins, PhD 2013 Wisconsin Economic Association Annual Meeting.
18/08/2015 Statistics Canada Statistique Canada Responsive Collection Design (RCD) for CATI Surveys and Total Survey Error (TSE) François Laflamme International.
Arun Srivastava. Types of Non-sampling Errors Specification errors, Coverage errors, Measurement or response errors, Non-response errors and Processing.
Estimating the Labour Force Trinidad and Tobago 28 th May 2014 Sterling Chadee Director of Statistics.
Target population-> Study Population-> Sample 1WWW.HIVHUB.IR Target Population: All homeless in country X Study Population: All homeless in capital shelters.
Producing Hours Worked for the SNA in order to Measure Productivity: the Canadian Experience By Jean-Pierre Maynard, Andrée Girard and Marc Tanguay Canadian.
Copyright 2010, The World Bank Group. All Rights Reserved. Estimation and Weighting, Part I.
Use of survey (LFS) to evaluate the quality of census final data Expert Group Meeting on Censuses Using Registers Geneva, May 2012 Jari Nieminen.
21/09/2015 Wages and accessibility: the impact of transport infrastructure Anna Matas Josep LLuis Raymond Josep LLuis Roig Universitat Autònoma de Barcelona.
TURKISH STATISTICAL INSTITUTE Social Sector Statistics Department Tourism Statistics Group
1 Item 7: National Accounts And Employment Data Using Employment Statistics in the Russian National Accounts Alexander Surinov Deputy Head of Rosstat Joint.
9 th Workshop on Labour Force Survey Methodology – Rome, May 2014 The Italian LFS sampling design: recent and future developments 9 th Workshop on.
Chapter 6 Lecture 3 Sections: 6.4 – 6.5.
The Effect of Questionnaire Length on Response Rates and Level of Estimates in the German Job Vacancy Survey Hans Kiesl Institute for Employment Research.
European Conference on Quality in Official Statistics Roma, July 8-11, 2008 New Sampling Design of INSEE’s Labour Force Survey Sébastien Hallépée Vincent.
ISTAT - Italian National Institute of Statistics Labour Force Survey Division Unit “Methods for LFS data treatment” European Conference on Quality in Official.
© 2010 Pearson Prentice Hall. All rights reserved Chapter Data Collection 1.
Bias in Surveys MDM4U – Mathematics of Data Management.
European Conference on Quality in Official Statistics Session 26: Quality Issues in Census « Rome, 10 July 2008 « Quality Assurance and Control Programme.
CZECH STATISTICAL OFFICE | Na padesátém 81, Prague 10 | czso.cz1/16 Ondřej Nývlt, Ilona Nováková, Lukáš Savko EFFECTIVE DISTRIBUTION OF SAMPLE OVER.
Collecting the household data as a sub-sample. Rome May 2014 Jonas Kylov Gielfeldt.
The Challenge of Non- Response in Surveys. The Overall Response Rate The number of complete interviews divided by the number of eligible units in the.
CHAPTER 12 Descriptive, Program Evaluation, and Advanced Methods.
Dag van de Lokale Rekenkamer “Weighting the consequences” Martijn Souren Consistent LFS weighting Statistics Netherlands LFS workshop, Paris.
Household consumption survey
Reliability, Validity, and Bias. Reliability Reliability Reliability is the extent to which an experiment, test, or any measuring procedure yields the.
1 Using National Accounts Data for Productivity Analysis François Lequiller OECD.
Statistics & Econometrics Statistics & Econometrics Statistics & Econometrics Statistics & Econometrics Statistics & Econometrics Statistics & Econometrics.
ONS Labour Market Statistics on Nomis by Bob Watson and Sinclair Sutherland.
Supporting Poverty Measurement In Europe and Central Asia Cesar Cancho Poverty GP ECA Workshop “Measuring Poverty - Concepts, Challenges and Recommendations”
EMPLOYMENT AND EARNINGS James and Clayton. Topic of Interest Describes the economic status of all businesses in Canada (trends) Helps with determining.
Improving of Household Sample Surveys Data Quality on Base of Statistical Matching Approaches Ganna Tereshchenko Institute for Demography and Social Research,
Expert Group Meeting on MDG, Astana, 5-8 Oct.2009 MDG 3.2: Share of women in wage employment in the non-agricultural sector Sources of discrepancies between.
Representativity Indicators for Survey Quality Programme: Cooperation Theme: Socio-economic sciences and Humanities Activity: Socio-economic and scientific.
© John M. Abowd 2005, all rights reserved Assessing Data Quality John M. Abowd April 2005.
Chapter 6 Lecture 3 Sections: 6.4 – 6.5. Sampling Distributions and Estimators What we want to do is find out the sampling distribution of a statistic.
15-April-10 Johan van der Valk Sub sample of persons in Labour Force household Survey Just an idea.
Design and Implementation of Labour Force and Informal Sector Surveys : the case of Madagascar Patrick Léon Randriankolona Madagascar.
Overview of the Final Report and Findings from the Review of Sampling Methods in Extrapolated New Base-Year Generation Studies May 11-12, 2004.
1 1 Using administrative registers to evaluate the effects of proxy interviews in the Norwegian Labour Force Survey Øyvin Kleven, Ib Thomsen and Ole Villund.
Workshop on MDG, Bangkok, Jan.2009 MDG 3.2: Share of women in wage employment in the non-agricultural sector National and global data.
Sinclair Sutherland Labour supply: Finding and using statistics.
The European Statistical Training Programme (ESTP)
The effects of rotational design and attrition
Reliability, Validity, and Bias
Informal Caregiving Formal Employment.
The European Statistical Training Programme (ESTP)
Chapter: 9: Propensity scores
Mode effects in mixed-mode data collection WP2
Chapter 5: The analysis of nonresponse
Presentation transcript:

Workshop LFS, April Estimating the non-response bias using exogenous data on employment Etienne Debauche Corinne Prost

Workshop LFS, April Response rate in the French LFS › large variability in space and in time › special event in 2007

Workshop LFS, April Response rate in the French LFS › non-response survey: - « light » PAPI survey, sent to the non-respondents - around 20% of the non-respondents answer to this survey - they are more often employed than the respondents of the main survey › question: is the correction of non-response in the weighting scheme efficient enough to correct for non-response bias?

Workshop LFS, April Response rate in the French LFS › one study done in 2007: very small effect of the response rate on the measure of the unemployment rate › geographical analysis › problem: the response rate is endogenous: employment rate and response rate are both impacted by the business cycle

Workshop LFS, April Employment in the French LFS › Employment: differences between the LFS estimate and the official employment estimate, coming from administrative database

Workshop LFS, April Employment in the French LFS › a lot of reasons why both estimates are different: - concepts: ILO employment / job statistics; differences for sick leaves, maternity or paternity leaves - scope: total employment / private employment; frontier workers; collective households - quarterly average / average of the number of jobs at the end of the quarters › And errors in the LFS: sampling errors; non- response bias; bias due to the proxy answerings

Workshop LFS, April Modeling the non-response rate › behavior of the interviewers: they start with easier interviewees (for instance non-active ones). They stop when the cost of search exceeds the benefit. C n

Workshop LFS, April Using the administrative data employment estimates to assess the non-response bias Response rate: Administrative data employment: LFS employment:

Workshop LFS, April Using the administrative data employment estimates to assess the non-response bias

Workshop LFS, April Using the administrative data employment estimates to assess the non-response bias › estimation at the region level (NUTS2 and NUTS3), with region and time fixed effects: the effect of the response rate is identified within the regions, independently of the national business cycle › estimation on the employment rates › weight: population of the region

Workshop LFS, April Effect of the response rate

Workshop LFS, April Effect of the response rate › robustness check thanks to the natural experiment of 2007: the increase of the response rate on 2007 is due to the controversy. It should be exogenous.

Workshop LFS, April Effect of the response rate

Workshop LFS, April Conclusion › There is a significant effect; can the correction for non-response be improved? › The effect is not large. In particular, it only explains a small part of the discrepancies between LFS employment and administrative data employment. Can the other sources of discrepancies be quantified?

Workshop LFS, April Discussion › similar results in other countries? › do some countries use external administrative data employment in the weighting scheme (grossing factor)?