Qualtrics: Skimming the Surface Presented by: Dr. Amanda Lynn-Bakley Estey Postdoctoral Research Associate, Professional Development albakley@iastate.edu, 515.294.7033

Webinar Objectives: At the end of this webinar, participants will be able to: Identify the 5 steps of writing a survey Write purposeful survey questions Explain the purpose/ benefits of Qualtrics Access Qualtrics on the ISU directory Begin building a survey in Qualtrics (next webinar)

Before You Pick Up The Pen… Step 1: Establish goals What is the purpose of the survey? What do you want to measure? (What is it you want to know?) Who is the intended audience? What will you do with the data results?

Developing Questions Step 2: Develop questions Only ask what you intend to measure The ideal question accomplishes three goals: It measures the underlying concept it is intended to tap It does not measure other concepts It means the same thing to all respondents

Developing Questions Two types of questions: Open-ended questions allows the greatest variety of responses Closed-ended questions delimit the responses

Developing Questions Avoid the following: Jargon/Abbreviations/Technical questions Ex: Are you affiliated with FNP? Ex: How do you conceptualize human capital flight in your community? Leading/Biased questions Ex: How do you cope with public speaking anxiety? Ex: Why do you think Qualtrics is hard to learn? Double-barreled questions Ex: To what extent did the facilitator and the material used in the training help you learn the material? Ex: When was the last time you upgraded your computer and printer?

Developing Questions Vague/ Ambiguous questions Ex: Are you a farmer? Ex: What do you do? Be specific in your definitions—do not just assume Keep the questions simple (20 words max) Keep the survey short (*length will vary depending on what you want to measure)

Keep Question Order in Mind Start with an introductory piece Provide a title for each section Begin with general questions first Things mentioned early in the survey can impact answers later Ask sensitive questions last Demographic information

Response & Rating Scales Step 3: Develop Responses/ Scales Think about the order of response categories Primacy Effect Answer scales should be ordinal Answer choices should anticipate all possibilities Be specific in response definitions Randomize or rotate responses

Final Steps Step 4: Pilot test for validity & reliability measures Share a draft Preview the survey in Qualtrics Step 5: Reevaluate each question as needed Proofread, pilot, and proofread some more 

What Is Qualtrics? Qualtrics is a web-based survey tool to conduct survey research, evaluations and other data collection activities Helps you get the data and insight you need to make better decisions

Qualtrics Offers: Easy accessibility Over 85 question types Many question and survey templates to choose Tools for basic and advanced users and surveys Ability to upload graphics and multimedia content in your surveys Online posting allows for a wider audience Multiple surveys can be posted at the same time and in 48 different languages

Qualtrics Offers: Built-in dynamic reporting tools Ability to export data directly to Word, Excel, and PowerPoint Free online training webinars Capability for respondents to stop in mid-survey and resume later Live support from customer service 

*https://www.qualtrics.com/ is the main website Accessing Qualtrics Located under Q on the University website directory *Login in with ISU username and password/ may prompt to start an account *https://www.qualtrics.com/ is the main website

Additional Tools Writing Good Survey Questions: https://www.surveymonkey.com/mp/writing-survey-questions/ Tip Sheet on Question Wording: http://psr.iq.harvard.edu/book/questionnaire-design-tip-sheet Additional Survey Information: https://www.qualtrics.com/support/survey-platform/faqs/survey/ Customer Support Team SUN 3PM - FRI 6PM // SAT 9AM - 5PM MST +1 800 340 9194 +1 385 203 4999

Interested In Learning More? March 21: Survey Basics and Design Basics of creating and designing a survey Previewing a survey Sharing a survey April 18: Data and Reporting Identifying best practices to distribute a survey Developing and design a report Downloading a report to a PDF/ Office document May 31: 3 Advanced Techniques/ Features Creating master files Creating hoovers Creating personalized end of survey messages

June 7: Working Face-to-Face Workshop Face-to-Face hands-on workshop developing and designing a survey (please bring a computer) Participants must have participated in at two of the three webinars (webinars will be archived) Limited to 20 participants Contact Linda Young, lindakay@iastate.edu to register

Summary Remember the five steps: Establish goals Develop questions Develop responses/ scales Pilot test for validity & reliability measures Reevaluate each question as needed Qualtrics is a web-based survey tool that can be assessed under the ISU directory Now, pick up your pen and start crafting 

Questions?