1 On cost efficiency - Tracking and tracing in the Norwegian EU-SILC Are the benefits from achieving one more respondents worth the effort? Bengt Oscar.

Slides:

Advertisements

Similar presentations

Survey Response Rates: Trends and Standards Karen Donelan, ScD Senior Scientist in Health Policy Massachusetts General Hospital/Harvard Medical School.

Advertisements

ESRC Research Methods Festival, Oxford, July 2006 The Hunt for the Last Respondent How to decrease response rates and increase bias Ineke Stoop.

Survey Methodology Nonresponse EPID 626 Lecture 6.

Brian A. Harris-Kojetin, Ph.D. Statistical and Science Policy

The English Longitudinal Study of Ageing (ELSA) Sample design & response Shaun Scholes NatCen.

Quality indicators for measuring and enhancing the composition of survey response Q2008 – Special topic session, July 9 Jelke Bethlehem and Barry Schouten.

Challenges to Surveys Non-response error –Falling response rates over time Sample coverage –Those without landline telephones excluded –Growing.

1 1 Effects of attrition in the Norwegian Survey on statistics on income and living conditions Marit Wilhelmsen Statistics Norway Q European Conference.

Measuring nonresponse bias in a cross-country enterprise survey

Measuring Interviewer Effects on Survey Error in SHARE Annelies Blom Julie Korbmacher Ulrich Krieger.

NLSCY – Non-response. Non-response There are various reasons why there is non-response to a survey  Some related to the survey process Timing Poor frame.

Documentation and survey quality. Introduction.

Quantitative Methods in the Social Sciences (QMSS) Lugano August 2005 Increasing response rates Ineke Stoop SCP.

~ Draft version ~ 1 HOW TO CHOOSE THE NUMBER OF CALL ATTEMPTS IN A TELEPHONE SURVEY IN THE PRESENCE OF NONRESPONSE AND MEASUREMENT ERRORS Annica Isaksson.

REPRESENTATIVE RESPONSE Some Examples ITSEW Peter Lundquist Statistics Sweden.

FINAL REPORT: OUTLINE & OVERVIEW OF SURVEY ERRORS

08/08/2015 Statistics Canada Statistique Canada Paradata Collection Research for Social Surveys at Statistics Canada François Laflamme International Total.

18/08/2015 Statistics Canada Statistique Canada Responsive Collection Design (RCD) for CATI Surveys and Total Survey Error (TSE) François Laflamme International.

Responsive Design for Household Surveys: Illustration of Management Interventions Based on Survey Paradata Robert M. Groves, Emilia Peytcheva, Nicole Kirgis,

1 1 Management Tools for Enhancing the Composition of Survey Response Q2008 European Conference on Quality in Official Statistics Rome, July 2008 Anne.

Addressed Based Sampling as an Alternative to Traditional Sampling Approaches: An Exploration May 6, 2013.

Sampling Techniques LEARNING OBJECTIVES : After studying this module, participants will be able to : 1. Identify and define the population to be studied.

Fieldwork efforts  Monitoring fieldwork efforts  Monitoring fieldwork efforts: Did interviewers /survey organisations implement fieldwork guidelines.

Yield Ratios Comparison of applicants across stages of the recruiting process: # applicants # Initial contacts # interviews # final interviews # offers.

Emerging methodologies for the census in the UNECE region Paolo Valente United Nations Economic Commission for Europe Statistical Division International.

Quality strategies in cross- national surveys The case of the European Social Survey Ineke Stoop.

Curb-stoning, a Too Neglected and Very Embarrassing Survey Problem Comments Jaki S. McCarthy Senior Cognitive Research Methodologist US Department of Agriculture.

WHO ARE KENYANS PREPARED TO VOTE FOR AS OF NOW? SPEC BAROMETER RESULTS November 9th 2007.

We provide information Comparing income data from survey and register Richard Heuberger Statistics Austria Directorate Social Statistics.

1 1 Web in mix-mode surveys in Norway Bengt Oscar Lagerstrøm Symposium on General Population Surveys on the web, London November 2011.

Panel Study of Entrepreneurial Dynamics Richard Curtin University of Michigan.

We provide information Model based estimation of indicators of poverty and social exclusion Thomas Glaser Statistics Austria Directorate.

Understanding the Respondent – a Key to Improve our Data Collection Strategies? Seminar on Statistical Data Collection 26 th September 2013 Anton Johansson,

The Challenge of Non- Response in Surveys. The Overall Response Rate The number of complete interviews divided by the number of eligible units in the.

Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section A 1.

Chapter 15 Sampling and Sample Size Winston Jackson and Norine Verberg Methods: Doing Social Research, 4e.

Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section B 1.

A Theoretical Framework for Adaptive Collection Designs Jean-François Beaumont, Statistics Canada David Haziza, Université de Montréal International Total.

Handbook on Precision Requirements and Variance Estimation for ESS Household Surveys Denisa Florescu, Eurostat European Conference on Quality in Official.

Building Wave Response Rates in a Longitudinal Survey: Essential for Nonsampling Error Reduction or Last In - First Out? Steven B. Cohen Fred Rohde and.

Impact of T-ACASI on Estimates of Youth Smoking Prevalence: Results of UMASS Tobacco Study Lois Biener, 1 Charles F. Turner, 2 & Amy L. Nyman 1 1 Center.

3.14 X AXIS 6.65 BASE MARGIN 5.95 TOP MARGIN 4.52 CHART TOP LEFT MARGIN RIGHT MARGIN ©TNS 2013 Are ‘better’ interviewers more successful at.

11 How Much of Interviewer Variance is Really Nonresponse Error Variance? Brady T. West Michigan Program in Survey Methodology University of Michigan-Ann.

Determinants of Changing Behaviors of NERICA Adoption: An Analysis of Panel Data from Uganda Yoko Kijima (University of Tsukuba) Keijiro Otsuka (FASID)

Towards an improvement of current migration estimates for Italy Domenico Gabrielli, Maria Pia Sorvillo Istat - Italy Joint UNECE-Eurostat Work session.

Pre-printing experiences at Statistics Sweden Anders Holmberg Department of Research & Development Statistics Sweden SE Örebro Sweden Tel:

CASE STUDY: NATIONAL SURVEY OF FAMILY GROWTH Karen E. Davis National Center for Health Statistics Coordinating Center for Health Information and Service.

Sampling technique  It is a procedure where we select a group of subjects (a sample) for study from a larger group (a population)

Assessing Nonresponse Bias and Measurement Error Using Statistical Matching John Dixon U.S. Bureau of Labor Statistics June 15, 2010 The opinions.

Response rates and disposition coding PHC 6716 June 8, 2011 Chris McCarty.

2007 Census Test – Analysis of Coverage Owen Abbott Methodology Directorate.

Minimizing interviewer effects and reducing refusal rates at Statistics Iceland Anton Örn Karlsson.

1 1 Using administrative registers to evaluate the effects of proxy interviews in the Norwegian Labour Force Survey Øyvin Kleven, Ib Thomsen and Ole Villund.

COMBINING SURVEY AND ADMINISTRATIVE DATA IN THE ITALIAN EU-SILC EXPERIENCE: POSITIVE AND CRITICAL ASPECTS National Institute of Statistics - Italy Claudio.

Common Pitfalls in Randomized Evaluations Jenny C. Aker Tufts University.

1 Survey Nonresponse Survey Research Laboratory University of Illinois at Chicago March 16, 2010.

Marc Hamel and Julie Trépanier May 21, 2014 Canadian Statistical Demographic Database: A research project.

Context for the experiment?

Interviewers’ role and their effects on reducing refusals in face to face surveys Working Group on Living Conditions Preventing Non Response in HBS Eurostat.

Nonresponse Bias in a Nationwide Dual-Mode Survey

Planning the change to a targeted survey design

The European Statistical Training Programme (ESTP)

Nonresponse and Measurement Error in Employment Research

Organization of efficient Economic Surveys

Mining Interviewer Observation

Changes in the Canadian Census of Population Program

Chapter 5: The analysis of nonresponse

Workshop on best practices for EU-SILC revision, −

Presentation transcript:

1 On cost efficiency - Tracking and tracing in the Norwegian EU-SILC Are the benefits from achieving one more respondents worth the effort? Bengt Oscar Lagerstrøm, Statistics Norway Paper presented at q2014, Vienna 1

Motivation 1 2

Motivation 2 Non-response in itself is not a good measure of nonresponse errors (Curtin, Presser and Singer 2000, Groves and Dipko 2004). Heerwegh, Abts and Loosveld (2007) show that although the non-response rate is higher than the non-contact rate, the proportion of non-response error is significantly larger due to non-contact than to refusal. 3

Steinsson and Lagerstrøm (2010) Non-response in current wave under-estimates social indicators (Gini-index, at-risk-of-poverty, S80/S20) Drop outs in the next wave has higher social indicators then respondents in both current wave and the next wave. Both drop-outs and late respondent have higher variation in their income distribution Non-response under estimates the income distribution in both Iceland and Norway and higher non-response rates increase the difference 4

Karlsson, Jónasdóttir and Lagerstrøm (2013) Manual tracing of telephone numbers increase the representativeness (age under 45, single households, non- natives) Only minor effects on a large set of indicators (Norway) 5

Contact rate, cooperation rate and response rate after source of telephone number Contact rateCooperation rateResponse rate Working numbers without errors (automated)0,8740,7240, Working numbers with errors (automated)0,8450,4370, Manual traced numbers0,7180,6510,

Contact rate after number of calls after different types of numbers

Distribution of time use InterviewContact and recruiting Working numbers without errors (automated) Working numbers with errors (automated) Manual traced numbers ,124 (31.2)6,876 (68.8) 8

Contact and recruiting hours and costs per completion (mean) CRHPC (min)CRHPC (€)Ratio (€) Working numbers without errors (automated) Working numbers with errors (automated) Manual traced numbers

New strategy to improve effect of tracing and reduce cost due to no contact –Increase efforts to identify non-effective numbers  Monitoring of the call-history during data collection  Maximum call-bakcs on a lower level  Interviewers –Increase efforts to ensure effective tracing  Identify effective tracing procedures  centralized tracers –Increase use of new sources for telephone numbers  Administrative registers 10