Self-performed objective measures of activity in an online panel survey: feasibility, response and data quality Accelerometers in the LISS panel Annemarie Koster, Maastricht university Annette Scherpenzeel, CentERdata Arie Kapteyn, USC Dornsife center for economic and social research Joris Mulder, CentERdata 11/10/2018
Biomarkers in survey research Usually administered by nurses or trained interviewers Not always efficient: time-consuming and costly More efficient: self-performed measures 11/10/2018
Accelerometer study Goals of the study: Why not only self-report? A more realistic and complete picture of physical activity when objective measures and self-report are combined Relationship health & physical activity Comparison with ELSA (UK) & ALP (USA) Why not only self-report? Daily activities and sedentary behavior missed Limited, only certain activity aspects Cognitive and social desirable biased Cultural and socio-economic differences 11/10/2018
Accelerometer Developed by GENEActiv (UK) Measures: - acceleration X-Y-Z axis - body temperature - light intensity Device wears as a watch, waterproof 11/10/2018
Pilot & main study Pilot: 200 Rs, 100 devices, 7 weeks feasibility: willingness Rs, develop and test instructions, response, panel management software, logistics Main study: 1011 panel members 300 devices 13 weeks data collection Device worn for 8 days, 24/7 11/10/2018
Flow of the project Configure device Send device, instructions 8 days 24/7, 2 DRM & affect questionnaires Telephone call 1: start wearing device Telephone call 2: return device Extract data Sedentary & vignettes questionnaire Clean and recharge 11/10/2018
11/10/2018
Invitation to participate Questionnaire: Period to wear device: 8 days 15 euros incentive scarcity: not enough meters for everyone refusals: refusal conversion screens stats: weight, hight, left/right handedness, wrist preference 11/10/2018
Refusal conversion screens tailored arguments 11/10/2018
Response and participation Pilot Main study Total invited N= 845 N= 2559 Completed invitation questionnaire 624 (73.8%) 1970 (76.9%) Yes to ACM study 375 1130 Hesitant1 22 639 Selected to receive device 212 1011 Wore and returned device 197 (92.9%) 906 (89.6%) 1Pilot : hesitant Rs were telephoned to give more information Main study: refusal conversion screens 11/10/2018
Collected data Device: 60Hz, 8 days, 24/7 DRM & affect questionnaires ± 4 GB for each participant 1200 Rs ≈ 5 TB raw data DRM & affect questionnaires 1 week day, 1 weekend day (randomly selected) Daily Reconstruction Method Sedentary & vignettes questionnaire Administered in month after device was worn Self-report of sedentary behavior Anchoring vignettes (cultural & socio-economic) 11/10/2018
DRM & affect questionnaires Self-report questionnaires: 2 random days, 1 weekday, 1 weekendday Physical activity: vigorous , sedentary Sleep: period and were you well-rested? Did they take off device? Normal day? Good or bad things happened? Social activities, alone or not? 11/10/2018
Sedentary questionnaire & anchoring vignettes Sleeping and sitting activities (e.g. nap, reading, listening to music, watch TV, behind computer, do administration, sit in car etc. Self report of overall activity level (not at all active - very active) Anchoring vignettes: Describing physical activity of hypothetical people and situations to create baseline Compare with ELSA (UK) & ALP (USA) 11/10/2018
Feedback participants (1) 11/10/2018
Feedback participants (2) 11/10/2018
Feedback participants (3) 11/10/2018
Combined data More complete image of physical activity Free to use for scientific purposes Data available at request (in the future) 11/10/2018
More information Come to our CentERdata stand Fact sheets of innovate studies in survey research (accelerometers, weighing scales, mobile phones) 11/10/2018