Qualtrics for data collection Nathan R. Jones, PhD Senior Project Director University of Wisconsin Survey Center nrjones@ssc.wisc.edu

Goals of the Course Day 1 Overview of survey research concepts, principles, and terminology Qualtrics orientation to introduce workflow from questionnaire design to final data

Goals of the Course Day 2 – Apr 14, 2-4p General tips for questionnaire design Orientation to Qualtrics tools for writing and formatting survey questions

Goals of the Course Day 3 – Apr 19, 10a-12p Advice on fielding and managing surveys Qualtrics tools for launching surveys and keeping track of sample members

Why do you want to do a survey?

So, we’re doing surveys… Principal parts of a survey Mode Instrument Respondents

Examples Typical Qualtrics links look like this: Follow along! https://uwmadison.co1.qualtrics.com/SE/?SID=SV_6MuZXppPN92uci9 https://uwmadison.qualtrics.com/SE/?Q_SS=26a4uQdaiUswgjr_9ZvZae9DCmf8ost&_=1 Follow along! http://bit.ly/1ZSwk6J

What is a GOOD survey?

What is a GOOD questionnaire? Achieve your study goals Collect the data you need to answer your question(s) Allow sufficiently complex analysis Do not reinvent the wheel Great questions, indices, tools already exist Plan for external comparison unless you have a great reason to innovate Low burden Ask questions that are easy to answer Do not waste time

To describe a population Why do a survey? To describe a population Census Probability sample Standardized interview schedule To test for changes or effects Case-control studies Clinical trials May use multiple modes

Why can’t we just talk to people? Probability sample Why can’t we just talk to people?

Probability sample Identify the population of interest. Obtain a list of members of the population. (This list is called the sample frame) Select units so that all units have a known probability of selection that is greater than 0.

Principal parts of a survey Study Design Sample Design Mode of administration Instrument development Pretesting, testing, IRB Data collection Data preparation - weighting, processing, delivery Documentation Analysis Budget

A Survey From a Process Perspective (Groves et al. 2004)

Other than surveys….? With some creativity, Qualtrics can be used for other purposes. data entry training quality control evaluation market research pre/post-event feedback and other uses with some creativity

Other than surveys….? With some creativity, Qualtrics can be used for other purposes. data entry

Other than surveys….? Never / Sometimes / Often / Always With some creativity, Qualtrics can be used for other purposes. data entry Never / Sometimes / Often / Always

Respondent interaction How many times will you collect data? Once Cross-sectional Sample population at single point in time Many times Trend – Repeated cross-sections Cohort – Follow a group over time Panel – Follow several groups over time

Pre-Testing, Testing, IRB Develop standardized questions Pre-test candidate questions Test entire instrument Obtain permission to conduct survey Keep records and documentation!

Field Procedures Initial contact and obtaining cooperation Incentives Training interviewers Follow-up procedures after survey Supervision and reporting Re-contacting methods for longitudinal studies Procedures for protecting respondents

You can use your data! And finally… But do not forget final documentation Sampling procedures, special cases Instrument bugs Field procedures, decisions, and materials Coding, decisions, and special cases Data cleaning Weighting

Qualtrics workflow Create survey Draft and revise instrument Activate survey Upload contact information Draft survey invitations Send initial email Check progress Draft reminder emails Send reminder emails Download data and summary reports

Qualtrics interface

Switch to Qualtrics

A Survey From a Process Perspective (Groves et al. 2004)

Questions?

Senior Project Director Thank you! Nathan R. Jones Senior Project Director University of Wisconsin Survey Center nrjones@ssc.wisc.edu