The Missing Link: From Concepts to Questions in Economic Surveys Ger Snijkers – Statistics Netherlands Diane K. Willimack – US Census Bureau 2nd European Establishment Statistics Workshop (EESW) 12-14 September 2011, Neuchatel, Switzerland
From theory to data: in theory From theory to data: in practice Overview From theory to data: in theory From theory to data: in practice Methods Iterative approach Missing Link: Conceptualisation and Operationalisation EESW2011, 12 Sept 2011
From Theory to Data: How? Empirical world: Theoretical world: ? X Theory Data file Missing Link: Conceptualisation and Operationalisation EESW2011, 12 Sept 2011
From Theory to Data: in theory Empirical world: Operationalisation Survey measurement Data processing Theoretical world: Conceptualisation Theory Data file Processing errors Response Concepts Measurement & Non-response errors Pre-testing Questionnaire Specification errors Operationalisation errors Attributes Question(s) Operational definition Missing Link: Conceptualisation and Operationalisation EESW2011, 12 Sept 2011
From Theory to Data: in practice Empirical world: Operationalisation Survey measurement Data processing Theoretical world: Conceptualisation Theory Data file Processing errors Response Concepts Measurement & Non-response errors Pre-testing Questionnaire Missing link! Specification errors Operationalisation errors Attributes Question(s) Operational definition Missing Link: Conceptualisation and Operationalisation EESW2011, 12 Sept 2011
2. From Theory to Data: in practice Consequences: Missing variables Measurement errors: variability and bias Non-response Response burden and trust Missing Link: Conceptualisation and Operationalisation EESW2011, 12 Sept 2011
3. Conceptualisation and Operationalisation Approaches: Top-down: 2. Bottom-up: - Theory driven - Data driven - Reasoning - Using observations (quantitative and qualitative; not only survey data) Empirical world Theoretical world Missing Link: Conceptualisation and Operationalisation EESW2011, 12 Sept 2011
3.1 . Theory-driven approaches Dimension/Attribute analysis Content Development Techniques Theoretical world: Conceptualisation Theory Concepts Attributes Missing Link: Conceptualisation and Operationalisation EESW2011, 12 Sept 2011
3.2 . Data-driven approaches Questionnaire Sampling Early-stage Scoping Interviews / Exploratory Focus Groups Concept Mapping Feasibility studies Accounting Expert Reviews Record Keeping Studies Exploring concepts and attributes, with increasing degree of specification Missing Link: Conceptualisation and Operationalisation EESW2011, 12 Sept 2011
Iterative Approach Empirical world: Operationalisation Theoretical world: Conceptualisation Theory Data file 1. Theory-driven methods Response 3. Relating Q to theory Concepts 4. Pre-testing Questionnaire 2. Theory-driven & Data-driven methods Attributes Question(s) Operational definition Missing Link: Conceptualisation and Operationalisation EESW2011, 12 Sept 2011
Thank you Missing Link: Conceptualisation and Operationalisation EESW2011, 12 Sept 2011