Mode effects in mixed-mode data collection WP2

Slides:



Advertisements
Similar presentations
An example of longitudinal LFS weights
Advertisements

1 WORLD TOURISM ORGANIZATION (UNWTO) MEASURING TOURISM EXPENDITURE: A UNWTO PROPOSAL SESRIC-UNWTO WORKSHOP ON TOURISM STATISTICS AND THE ELABORATION OF.
GLOBAL ASSESSMENT OF STATISTICAL SYSTEM OF KAZAKHSTAN ZHASLAN OMAROV DEPUTY CHAIRMAN, STATISTICS AGENCY OF REPUBLIC OF KAZAKHSTAN. 4.3.
Centraal Bureau voor de Statistiek Challenges of redesigning household surveys and maintaining output quality Menno Cuppen Paul van der Laan Wim van Nunspeet.
Supporting Poverty Measurement In Europe and Central Asia Cesar Cancho Poverty GP ECA Workshop “Measuring Poverty - Concepts, Challenges and Recommendations”
Workshop LFS, April Estimating the non-response bias using exogenous data on employment Etienne Debauche Corinne Prost.
Miami, Florida, 9 – 12 November 2016
Quality assurance in official statistics
Workshop on Statistical Data Collection 2017
Modernisation of European social statistics
The second wave of the new design of the Dutch EU-SILC: Possibilities and challenges Judit Arends.
Chapter 2: The nonresponse problem
AES progress report and future plans
The European Statistical Training Programme (ESTP)
Multi-Mode Data Collection Approach
EU SURVEY ON HEALTH AND SOCIAL INTEGRATION: SCENARIOS FOR IMPLEMENTATION AGENDA POINT 2.4 Meeting of the Directors of Social Statistics (DSS) September.
The European Statistical Training Programme (ESTP)
13th Workshop on Labour Force Survey Methodology
Effect of Panel Length and Following Rules on Cross-Sectional Estimates of Income Distribution: Empirical Evidence from FI-SILC Marjo Pyy-Martikainen Workshop.
Chapter 7: Reducing nonresponse
The European Statistical Training Programme (ESTP)
Chapter 14: Mixed-mode datacollection
Richard Heuberger, Nadja Lamei Statistics Austria
Marina Signore Director of Research Data Collection Directorate, Istat
The impact of using web in The Danish LFS
Background to the development of a European Victimisation Survey
Information Society Statistics
National needs for AES Purpose - describe participation in learning during a 12 months period. The main parameters are; Participation rates in different.
Census Planning and Management
LAMAS Working Group 29 June-1 July 2016
2011 POPULATION AND HOUSING CENSUS PREPARATORY WORKS
Agenda Introduction IRIA: Key elements Results Conclusions.
Passenger Mobility Statistics 2017
DATELINE PMWG Meeting, Luxembourg, 24/25 April 2003
LAMAS Working Group 29 June-1 July 2016
Modernisation of social statistics Roadmaps for SILC, LFS, Education/health and population Agenda point 3.5 DSS Meeting April.
The change of data sources in the Spanish SILC
« LFS series breaks with the adoption of the IESS FR How is Statistics Portugal planning to tackle the issue? 13th Workshop on Labour Force Survey Methodology.
Task Force 4: Cultural Practices and Social Aspects
The Safety Monitor in The Netherlands
Project on translating and testing a victimisation survey module
Implementing mixed mode questionnaire in FI-SILC
Agenda item 5.2 Methodology
CONSUMER SURVEY RESEARCH
SURVEY RESEARCH.
What do Samples Tell Us Variability and Bias.
Vlasta Zucha, STATISTICS AUSTRIA,
The European Statistical Training Programme (ESTP)
ROME April 11th | 12th MIMOD Mixed-Mode Designs for Social Surveys
Laura Sauli MIMOD Final workshop 12 April 2019
Hanna Gembarzewska, Monika Grabani
ROME April 11th | 12th MIMOD Mixed-Mode Designs for Social Surveys
Key Considerations for Planning and Management of Census Operations
Mode bias/mode effect and its adjustment: General Overview WP2
MIMOD – Project overview
Quick statistics - how to deal with quality?
Multi-Mode Data Collection
Overview of objectives
Deciding the mixed-mode design WP1
Mobile device sensor data in ESS surveys WP5
MIMOD – A look ahead MIMOD Mixed-Mode Designs for Social Surveys
WP3 Case Management Systems
PRESENTATION OF MONTENEGRO
Overview of objectives WP5
Chapter 2: The nonresponse problem
Adaptive mixed-mode design WP1
Chapter 5: The analysis of nonresponse
Item 5 Modernisation of the EU-SILC Production
Workshop on best practices for EU-SILC revision, −
Stratification, calibration and reducing attrition rate in the Dutch EU-SILC Judit Arends.
Presentation transcript:

Mode effects in mixed-mode data collection WP2 ROME April 11th | 12th 2019 MIMOD Mixed-Mode Designs for Social Surveys FINAL WORKSHOP Mode effects in mixed-mode data collection WP2 Paweł Szymankiewicz Statistics Poland

Mode effects in mixed-mode data collection The term "mode effect" usually refers to effects that are due to the use of one mode compared to another, or a combination of modes to a single mode, or to a different combination of the same or other modes. MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

Mixed mode simultaneously generates: Mode effects in mixed-mode data collection Mode effects Mixed mode simultaneously generates: nonresponse error (selection effects), measurement error (measurement effects). MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

Mode effects in mixed-mode data collection selection effects – caused by the selection mechanism of a mixed-mode survey design, resulting in partitioning the sample into respondents and nonrespondents. Selection effects appear when different types of respondents choose different modes to complete the survey. MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

Mode effects in mixed-mode data collection Mode effects (cont.): measurement effects (measurement bias, pure mode effects) – caused by specifics of the modes in the survey and affect the recorded responses to the surveys questions. In other words, measurement effects refer to the influence of a survey mode on the answers (the same respondent gives different answers to the same questions in different modes). MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

adjustment for mode effects. Mode effects in mixed-mode data collection Problems described in documents prepared by WP2 within the framework of the MIMOD Project: detection and estimation of mode effects (including separation of selection effects from measurement effects), adjustment for mode effects. MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

Mode effects in mixed-mode data collection Some measures reported by countries participating in the MIMOD Project: to assess mode effects: pre-tests, experiments on questionnaire design, pilot surveys, differences in distributions of socio-demographic or target variables, pre-tests, experiments on sensitive or core questions etc., to adjust for mode effects: weight adjustments, calibration to fixed mode distributions, estimate measurement errors and correct responses to a benchmark mode etc. Source: WP 2 Methodological Report MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

MIXED-MODE DESIGNS IN POLISH SOCIAL SAMPLE SURVEYS Mixed-mode data collection MIXED-MODE DESIGNS IN POLISH SOCIAL SAMPLE SURVEYS MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

Law of 29 June 1995 on Official Statistics, Mixed-mode designs in Polish social sample surveys LEGAL BASIS: Law of 29 June 1995 on Official Statistics, Regulation of the Council of Ministers concerning the programme of statistical surveys of official statistics MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

Mixed-mode designs in Polish social sample surveys in 2019 No. of the survey in the programme of surveys Questionnaires in use Sample size Methods in use EU-LFS (BAEL), including module Work organisation and working time arrangements 1.23.01, 1.23.18 ZD, ZG ZD-C ≈ 55,000 CAPI, CATI, PAPI Household Budget Survey 1.25.01 BR-01, BR-01a, BR-01b, BR-04 3,132 CAPI, CAWI, PAPI EU-SILC 1.25.08 EU-SILC-G EU-SILC-I 18,000 41,800 CAPI, PAPI Household Condition (consumers’ attitudes) 1.25.02 KGD 2,700 CAPI, CATI Participation of Polish Residents in Travels 1.30.18 PKZ 18,750 ICT (Information Society Indicators) 1.43.14 SSI-10G SSI-10I 8,100 12,000 CAPI, CAWI MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

Mixed-mode designs in Polish social sample surveys in 2019 EU-LFS (BAEL) EU-SILC Household Budgets Household Condition Participation of Polish Residents in Travels Concurrent ICT (Information Society Indicators): CAWI: 18.03.2019 – 07.04.2019, CAPI: 08.04.2019 – 31.05.2019 Sequential MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

Mixed-mode designs in Polish social sample surveys MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

Mixed-mode designs in Polish social sample surveys Number of "permanent” interviewers in statistical offices (Dec. 31th, 2018) MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019

Mixed-mode designs in Polish social sample surveys MIMOD project - Mixed-Mode Designs in Social Surveys Rome, 11-12 April 2019