Qualtrics and Mturk Workshop Matthew W. Baldwin & Lucas A. Keefer

Qualtrics What is Qualtrics? – An intuitive, online utility for data collection with a variety of options Why use it? – Online data collection is… – Fast – Easy – Allows you to selectively sample – Allows you to have more diverse samples

Before you can begin… Go to kuclas.qualtrics.com Make an account using your KU address Log-in (either from the home page or from the KU portal)

Front Page When you log in, you will have a complete list of your surveys (if you have made any) Plus tabs to – Create a new survey – Edit an existing survey – Distribute – Look at your data, and more

The Rich Text Editor allows you to change font, text size, bold/italicize/underline, etc. any text Piped text allows you to use text given in a previous response

Just write choices in here Change type of question (e.g. how many responses) and appearance (e.g. vertical v. horizontal

Types of items in the matrix and appearance options, like MC Items

If you want a running sum to total some fixed number (e.g. 100)…

Number of Items and Labels If you don’t want numbers on top

Just write the things you want people to rank How many items people rank

Side by Side items let you put two scales together (e.g. Y/N & How certain are you?) Number of statements and columns

Write any items or group names to left, determine how many of each on the right “Participant Defined” allows participants to create their own category labels

Other Item Types There are many, many other options for items as well. For example, Heat mapping allows participants to click anywhere on an image and records where people click Qualtrics can time how long Ps stay on any page (in seconds) Qualtrics can allow you to use parts of images as response items (or use images as responses to MC questions)

Under Survey Flow, you can determine the order in which items are presented to Ps. Block labels are important for keeping track of item placement.

Add new blocks to Survey Editor Add a branching path to the survey flow (e.g. different versions for M/F) Randomize the presentation of blocks

The Randomizer function allows you to effectively create online experiments

Qualtrics gives you an anonymous link composed of random letters/numbers For long term data collection (e.g. diary studies) you can create lists for surveys

Qualtrics is also well- integrated with a number of social networking platforms, if you would like to distribute your survey that way

General reports on data (e.g. item means) and open-ended responses List of individual responses (with completion times) You can click here to download your data Completion statistics

When you are done, your data will be available anywhere with an internet connection in either.csv or.sav (SPSS) format You can select only a subset of items or responses

Qualtrics Key things to remember: – Browse the list of item types…you’ll find something to fit your needs – Label Blocks AND Questions. Block labels are useful for Flow and Question Labels are used in your data file – Collaborate to get feedback from others

Qualtrics Key things to remember: – Build a survey library with measures you frequently use – Online survey research must be short – What we gain in sample, we lose in control!