1. Numeracy & Quantitative Methods Laura Lake

2. Increasing use is being made of new technologies – specifically computing-related technologies – in managing and collecting survey data. Here, considering: Computer-assisted interviewing Web surveys. New Technologies

3. Two main formats of computer-assisted interviewing computer-assisted personal interviewing (CAPI) computer-assisted telephone interviewing (CATI) computer-assisted self-interviewing (CASI) Computer-Assisted Interviewing

4. CAPI: interviewers collect survey data in-person from respondents (i.e. face-to-face interviewing) and use a computer to administer the survey and capture the answers on the computer. CATI: interviewers work from scripted questionnaires programmed into computers and read the questions displayed on their monitors to respondents over the phone and directly record the answers into the computer. Computer-Assisted Interviewing

5. CASI: respondents operate a computer that displays the questions on screen and/or plays recordings of the questions to the respondent who enter answers directly into a database on the computer. Computer-Assisted Interviewing

6. For all: offer greater degree of control, particularly to face- to-face interviewing, over the interview process (i.e. filtering to the appropriate question, not missing questions out). For all: instant data from survey responses. For CAPI and CASI: Reduces field work costs (no paper printing) Computer-Assisted Interviewing: Advantages

7. For all: high set up costs and often contracted out to specialist agencies. For CAPI: extra interviewer IT training as opposed to face-to- face. For CASI: not accessible for all population groups not familiar with computers. Computer-Assisted Interviewing: Disadvantages

8. Web Surveys: respondents visit a website where they can complete a questionnaire online. Email Surveys: embedded (questions in the main body of the email) and attached questionnaires (as an attachment to an email) sent to respondents by email. Becoming more widely used. Electronic Surveys: Web and Email Delivery

9. Multiple options for formatting including use of radio buttons, pull-down menus, instant tick boxes. Room for open questions using specific boxed areas. Better format for filtering in self-completion surveys than paper- based – the ‘skipping to the next question’ can be made automatic. Can be programmed so respondents can or cannot read the whole questionnaire, unlike paper-based. Instant access to survey data. Low cost. Web Surveys: Advantages

10. Sampling: restricted to online populations only – implications for biased samples and generalisability? Accurate access to populations via email accounts (multiple accounts & ISPs). Difficulties with using probability sampling frames. Confidentiality – data trace of respondents. Response rate: evidence that it is the same or lower than postal self-completion (Sheehan, K. 2001). But, this is driven by the population being surveyed. Web Surveys: Disadvantages

11. Embedded surveys: easier for respondents to return than attached surveys. Attached surveys: easier to format and constructed a survey that will look the same for each respondent using word processing packages such as Microsoft Word. Low cost. Email: Advantages

12. Embedded surveys: displaying formatting is dependent on operating systems and can be lost when opening emails. Response rate of both depends on the population. A higher response rate may be achieved with an embedded survey for those more familiar with technology than those who are not. Ethics: electronic responses are never truly anonymous as researchers know the respondents' e-mail addresses. Self-selection and the loss of complete randomness to some degree. Email: Disadvantages

13. Web surveys and paper-based surveys. Example: 2011 Census. The 2011 Census is for the first time open for completion via both paper and online. The paper questionnaire includes an internet access code to enable secure access to the online service. The online questionnaire will automatically skip any questions that don't apply to and give hints and tips. Does not have to be completed in one go. Using Mixed Methods

14. Potential benefits: greater coverage, lower costs and higher response rates. Potential difficulties: how to identify measurement differences between the two modes of delivery (factors of selection bias, non- response etc in each mode) thereby how to make statistical adjustments based on the data from the two modes. Using Mixed Methods

15. Betts, P. and Lound, C. (2010) ‘The Application of Alternative Modes of Data Collection in UK Government Social Surveys’, Survey Methodology Bulletin, 67. Available online: http://www.statistics.gov.uk/ssd/ssmb/smb67.pdf http://www.statistics.gov.uk/ssd/ssmb/smb67.pdf Bryman, A. (2008) Social Research Methods. 3 rd Ed. Oxford: Oxford University Press. David, M. and Sutton, C. (2004) Social Research :The Basics. London: Sage. ESRC Survey Measurement Programme. Online: available from Survey Resource Network http://www.surveynet.ac.uk/http://www.surveynet.ac.uk/References

16. Fielding, N.G., Lee, R.M. and Blank, G. (2008) SAGE Handbook of Internet and Online Research Methods. London: Sage. Oppenheim, A. (2000) Questionnaire Design, Interviewing and Attitude Measurement. London: Continuum Sheehan, K. (2001) ‘Email Survey Response Rates: A Review’, Journal of Computer-Mediated Communication, 6(2). Available online: http://jcmc.indiana.edu/vol6/issue2/sheehan.htmlhttp://jcmc.indiana.edu/vol6/issue2/sheehan.htmlReferences

17. This resource was created by the University of Plymouth, Learning from WOeRk project. This project is funded by HEFCE as part of the HEA/JISC OER release programme.Learning from WOeRk This resource is licensed under the terms of the Attribution-Non-Commercial-Share Alike 2.0 UK: England & Wales license (http://creativecommons.org/licenses/by-nc-sa/2.0/uk/).http://creativecommons.org/licenses/by-nc-sa/2.0/uk/ The resource, where specified below, contains other 3 rd party materials under their own licenses. The licenses and attributions are outlined below: 1.The name of the University of Plymouth and its logos are unregistered trade marks of the University. The University reserves all rights to these items beyond their inclusion in these CC resources. 2.The JISC logo, the and the logo of the Higher Education Academy are licensed under the terms of the Creative Commons Attribution -non-commercial-No Derivative Works 2.0 UK England & Wales license. All reproductions must comply with the terms of that license. Author Laura Lake InstituteUniversity of Plymouth Title Numeracy & Quantitative Methods Management & Data Collection: New technologies in surveys Description Key issues in developing structured interviewing for surveys using telephone survey administration methods. Date Created March 2011. Educational Level Level 5 Keywords UKOER LFWOERK UOPCPDRM Learning from Woerk WBL Work Based Learning CPD Continuous Professional Development Computer-assisted interviewing, web surveys, computer-assisted personal interviewing (CAPI), computer-assisted telephone interviewing (CATI), computer- assisted self-interviewing (CASI), Creative Commons License Attribution-Non-Commercial-Share Alike 2.0 UK: England & Wales license Back page originally developed by the OER phase 1 C-Change project ©University of Plymouth, 2010, some rights reserved