2. Self-performed objective measures of activity in an online panel survey: feasibility, response and data quality
Accelerometers in the LISS panel
Annemarie Koster, Maastricht university
Annette Scherpenzeel, CentERdata
Arie Kapteyn, USC Dornsife center for economic and social research
Joris Mulder, CentERdata
11/10/2018

3. Biomarkers in survey research
Usually administered by nurses or trained interviewers
Not always efficient: time-consuming and costly
More efficient: self-performed measures
11/10/2018

4. Accelerometer study Goals of the study: Why not only self-report?
A more realistic and complete picture of physical activity when objective measures and self-report are combined
Relationship health & physical activity
Comparison with ELSA (UK) & ALP (USA)
Why not only self-report?
Daily activities and sedentary behavior missed
Limited, only certain activity aspects
Cognitive and social desirable biased
Cultural and socio-economic differences
11/10/2018

5. Accelerometer Developed by GENEActiv (UK)
Measures: - acceleration X-Y-Z axis
- body temperature
- light intensity
Device wears as
a watch, waterproof
11/10/2018

6. Pilot & main study Pilot: 200 Rs, 100 devices, 7 weeks
feasibility: willingness Rs, develop and test instructions, response, panel management software,
logistics
Main study: panel members
300 devices
13 weeks data collection
Device worn for 8 days, 24/7
11/10/2018

7. Flow of the project Configure device Send device, instructions
8 days 24/7,
2 DRM & affect questionnaires
Telephone call 1: start wearing device
Telephone call 2: return device
Extract data
Sedentary & vignettes questionnaire
Clean and recharge
11/10/2018

8. 11/10/2018

9. Invitation to participate
Questionnaire:
Period to wear device: 8 days
15 euros incentive
scarcity: not enough meters for everyone
refusals: refusal conversion screens
stats: weight, hight, left/right handedness,
wrist preference
11/10/2018

10. Refusal conversion screens tailored arguments
11/10/2018

11. Response and participation
Pilot
Main study
Total invited
N= 845
N= 2559
Completed invitation questionnaire
624
(73.8%)
1970
(76.9%)
Yes to ACM study
375
1130
Hesitant1 22
639
Selected to receive device
212
1011
Wore and returned device
197
(92.9%)
906
(89.6%)
1Pilot : hesitant Rs were telephoned to give more information
Main study: refusal conversion screens
11/10/2018

12. Collected data Device: 60Hz, 8 days, 24/7 DRM & affect questionnaires
± 4 GB for each participant
1200 Rs ≈ 5 TB raw data
DRM & affect questionnaires
1 week day, 1 weekend day (randomly selected)
Daily Reconstruction Method
Sedentary & vignettes questionnaire
Administered in month after device was worn
Self-report of sedentary behavior
Anchoring vignettes (cultural & socio-economic)
11/10/2018

13. DRM & affect questionnaires
Self-report questionnaires:
2 random days, 1 weekday, 1 weekendday
Physical activity: vigorous , sedentary
Sleep: period and were you well-rested?
Did they take off device?
Normal day? Good or bad things happened?
Social activities, alone or not?
11/10/2018

14. Sedentary questionnaire & anchoring vignettes
Sleeping and sitting activities (e.g. nap, reading, listening to music, watch TV, behind computer, do administration, sit in car etc.
Self report of overall activity level
(not at all active - very active)
Anchoring vignettes:
Describing physical activity of hypothetical people and situations to create baseline
Compare with ELSA (UK) & ALP (USA)
11/10/2018

15. Feedback participants (1)
11/10/2018

16. Feedback participants (2)
11/10/2018

17. Feedback participants (3)
11/10/2018

18. Combined data More complete image of physical activity
Free to use for scientific purposes
Data available at request (in the future)
11/10/2018

19. More information Come to our CentERdata stand
Fact sheets of innovate studies in survey research (accelerometers, weighing scales, mobile phones)
11/10/2018