1. Covering the general population by Internet interviewing Marcel Das 19-9-2015 1

2. MESS Project core element: LISS panel other key elements: - core study - experimental modules - new forms of data collection - links with administrative data - special groups 19-9-2015 2

3. Core element: LISS panel  Online panel of 5,000 households  8,000 individuals (>= 16 years)  Questionnaires each month, 30 min.  Incentive 15 euro an hour (average)  For scientific use, at no cost 19-9-2015 3

4. LISS panel  Online interviews as method, but:  Probability sample drawn from address sampling frame of Statistics Netherlands  Includes households without Internet access (less than 15%): CentERdata provides equipment  Contacted by letter, telephone or visit 19-9-2015 4

5. simPC Very small and silent Only the most frequently used functions Automatic maintenance, safety Simple operation and readable screens Installation and support 19-9-2015 5

6. 6 Internet interviews letter and brochure short interview simPC and adsl households with Internet households without Internet confirmation panel question Recruitment

7. 19-9-2015 7 Internet interviews letter and brochure short interview simPC and adsl confirmation panel question Primary response target: 80% Secondary response target: 60% Tertiary response target: 53% Response

8. Recruitment experiment 19-9-2015 8 CATI = Computer Assisted Telephone Interviewing CAPI = Computer Assisted Personal Interviewing

9. 19-9-2015 9 Pilot experimental groups 1.CATI: special letter - no incentive - Panel in letter and brochure 2.CATI: special letter - promised incentive E. 50 - Panel introduced after interview 3.CATI: Standard letter - prepaid incentive E. 10 - Panel in letter and brochure 4.CATI: Standard letter - prepaid incentive E. 20 – Panel introduced after interview 5.CAPI: special letter - prepaid incentive E. 50 – Panel introduced after interview 6.CAPI: special letter - no incentive - Panel in letter and brochure 7.CAPI: Standard letter - promised incentive E. 10 - Panel in letter and brochure 8.CAPI: Standard letter - promised incentive E. 20 - Panel introduced after interview

10. 19-9-2015 10 Pilot natural groups CAPI 1.Unknown or no telephone number: 30% CATI and CAPI 2.Known (landline) telephone number: 70%

11. 19-9-2015 11 Effect of mode (1)

12. 19-9-2015 12 Effect of mode (2)

13. 19-9-2015 13  incentives increase response rates - effect is large from 0 to 10 euro (increase of 15%) - effect is not significant from 10 to 20, 20 to 50 euro (about 3%)  prepaid works better than promised Effect of incentives

14. 19-9-2015 14 Effect of information  no effect of letter content  no effect of timing panel introduction  effect of seeing/reading brochure

15. Set up main recruitment Combination CATI – CAPI, follow up CAPI Prepaid 10 euro incentive Promised extra 10 euro incentive for starting Attention to design letter and brochure 19-9-2015 15

16. Results 19-9-2015 16

17. Non-response patterns Similar to those of other leading scientific panels Superior to commercial access and volunteer panels: - no coverage problems - no selfselection 19-9-2015 17

18. Attention for difficult groups  Correction by oversampling in refreshment of 2009 (with Statistics Netherlands)  New immigrant panel (with Cross-cultural Psychology, Tilburg University and Statistics Netherlands) 19-9-2015 18

19. Correction of bias by stratified refreshment sample 2009 19-9-2015 19 Group Population 2007 % April 2008 Bias April 2009 Bias Jan 2010 Bias Age >=7011.6-5.4 -2.8 Living alone19.2-5.4-5.0-2.4 Non-western immigrant 9.6-5.1-4.8-3.7 Persons

20. New forms of data collection 19-9-2015 20

21. Use of graphical or animated presentation 19-9-2015 21

22. Biomarkers pilot study: blood cholesterol, saliva cortisol, and waist circumference 19-9-2015 22

23. More biomarker experiments... -accelerometers -advanced scales (based on bioelectrical impedance) link objective data with self-report data high frequency measurement 19-9-2015 23

24. Use of the LISS panel 19-9-2015 24

25. Questionnaires  The “household box”  Experimental modules open to academic researchers at no cost  Core study 19-9-2015 25

26. Experimental modules  Who can use the LISS panel: every researcher who wants to collect data for scientific, policy or societal relevant research Scientific research: Academic researchers, irrespective of nationality, can use the LISS panel at no cost  Proposals can be submitted throughout the year 19-9-2015 26

27. 19-9-2015 27 Examples: subsample  Effects of illness babies in first year on labour participation parents:  Pregnant women, follow 3 years!  Adolescent/teen identity and the Internet:  12-18 year olds  Random subsample or experimental groups

28. 19-9-2015 28 Procedure:  Submit to: a.c.scherpenzeel@uvt.nl  Typically be between 2 and 5 pages  Evaluation: Board of Overseers  Decision: 1-3 months  Accept  Revise and resubmit  Reject (http://www.lissdata.nl/lissdata/Proposals/How_to_Submit_a_Proposal)

29. 19-9-2015 29 Criteria:  Scientific potential:  predicated on literature; sound analytical framework  Fit in LISS panel:  value of using an Internet survey  Feasibility:  questions doable for respondents?  Burden:  length and target sample (http://www.lissdata.nl/lissdata/Proposals/How_to_Submit_a_Proposal)

30. 19-9-2015 30 Requirements:  Data protection statement  Single user access  Publication list  Data available to other researchers!

31. Proposals: Summary (May 2010) 19-9-2015 31 Decision Board of OverseersCount Undecided (in review or revision) 14 Accepted49 Rejected 10 Total73

32. Proposals: Examples 19-9-2015 32

33. Available data  Who can use the LISS data: every researcher who wants to use data for scientific, policy or societal relevant research  Use of data is free of charge (unless data are used for research funded by means of external sources)  Available data:  longitudinal core study  proposed studies 19-9-2015 33

34. Longitudinal core study  Household and family  Economic situation and housing  Work and schooling  Social integration and leisure  Health  Personality  Religion and ethnicity  Politics and values 19-9-2015 34

35. LISS data  Disseminated through website / data archive: http://www.lissdata.nl  Database is based on an internationally used specification for describing social science data (DDI)  One of the first implementations of DDI version 3 19-9-2015 35

36. 8-6-2010 36 Why use DDI? A lot more work?  Simple links to datasets and codebooks: fine for single datasets and once-a-year panel studies  LISS data: complex and extensive  Will the data and documentation still be accessible in 10 years?

37. 8-6-2010 37 Complex data Q5Q5 Panel members Q8Q8 Q7Q7 Q6Q6 Q1Q1 Q2Q2 Q3Q3 Q4Q4 Core questionnaire Proposals Q9Q9

38. 8-6-2010 38 Extensive data  Example: “Do you know which panel members are vegetarian?”  Asked somewhere, but in which study?  Example: “Did you ever measure political efficacy?”  Asked sometime, but when exactly?  Example: “Can I estimate the housing expenditure of impulsive persons?”  Which items measured impulsiveness?

39. 8-6-2010 39 DDI 3 & LISS website  Search entry with keyword and on concept, topic, and study (relational)  Can handle longitudinal data (waves)  Exchangeable with other data archives  Flexibility for future applications (Example: iPod version)

48. October 2010 Publisher: Routledge / Taylor & Francis Group 19-9-2015 48