1. Qualtrics 110: Building Beyond the Foundation
"If we always do what we've always done, we will get what we've always got."- Mary Senter
“The most important thing about assessment is that it promotes dialogue.”- Adam Urbanski
Presented by: Dr. Amanda Lynn-Bakley Estey
Postdoctoral Research Associate, Professional Development

2. Workshop Objectives:
At the end of this workshop, participants will be able to:
Explain the purpose and benefits of using Qualtrics
Write purposeful survey questions
Apply concepts and skills learned from the webinar series to build and design a survey in Qualtrics
Feel more confident in distributing, collecting and downloading survey data to design a report
Utilize several advanced techniques/tools in Qualtrics
Develop goals for using Qualtrics in future programming, etc.

3. Introductions Write your name in the middle of the index card
Write three adjectives that best describes you as a person around your name
Above and below your name, write one or two short sentences/phrases of what you hope to learn today
Paperclip the “nametag” to your shirt
Mingle and connect with someone who shares a similar adjective or learning objective as you
Stay with that person and wait for additional instructions (but feel free to chat about anything on your nametags )

4. You found your learning partner for the day!
Congratulations!
You found your learning partner for the day!
Now, each pair to briefly introduce each other by sharing his/her:
Name
Title/position within Extension
Fun/unique fact about himself/herself
And one thing he/she hopes to learn from taking this workshop

5. Quiz Time… What is the purpose of Qualtrics?
What are five of the many benefits Qualtrics offers its users?
Where can an ISU Extension and Outreach employee access Qualtrics?
How do I access Qualtrics? (Hint, access has changed.)
What is the first and most important step when developing a survey?

6. Crafting the Survey: 5 Crucial Steps
Step 1: Establish goals
What is the purpose of the survey?
What do you want to measure? (What is it you want to know?)
Who is the intended audience?
What will you do with the data results?

7. Developing Questions Step 2: Developing effective/purposeful questions
Only ask what you intend to measure
The ideal question accomplishes three goals:
It measures the underlying concept it is intended to tap
It does not measure other concepts
It means the same thing to all respondents

8. Developing Questions Two main types of questions:
Open-ended questions allows the greatest variety of responses
Closed-ended questions delimit the responses

9. Developing Questions Avoid the following:
Jargon/Abbreviations/Technical questions
Ex: Are you affiliated with ANR?
Ex: How do you conceptualize human capital flight in your community?
Leading/Biased questions
Ex: How do you cope with public speaking anxiety?
Ex: Why do you think the Miss Rodeo Coronation is the best event at the county fair?
Double-barreled questions
Ex: To what extent did the facilitator and the material used in the training help you learn the material?
Ex: When was the last time you upgraded your computer and printer?

10. Developing Questions Vague/Ambiguous questions Ex: Are you a farmer?
Ex: What do you do?
Be specific in your definitions—do not just assume
Keep the questions simple (*20 words max)
Keep the survey short (*length will vary depending on what you want to measure)

11. Keep Question Order in Mind
Start with an introductory piece
Provide a title for each section
Begin with general questions first
Things mentioned early in the survey can impact answers later
Ask sensitive questions last

12. Developing Your Questions
With your partner, share your developing questions or ideas of your survey/project
Share your questions with your learning partner and discuss the following:
Are the questions simple and easy to understand?
Are the questions free of biases, jargon, etc.?
Is each question under 20 words?
Do the questions reflect the purpose of the survey?
Will the respondents’ answers more than likely provide the data you are seeking to collect?
How will this information change or impact what you will do?

13. Response & Answer Scales
Step 3: Develop Responses/Answer Scales
Think about the order of response categories
Answer scales should be ordinal
Answer choices should anticipate all possibilities
Be specific in response definitions

14. Time to Start Building Webinar 2: Survey Development and Design
Please log into your Qualtrics account
Create a new survey (or log into a current project)
Give your survey a title (if new)
Let’s start with the introductory piece…

15. Final Steps Once the Survey is Developed
Step 4: Pilot test for validity & reliability measures
Share a draft
Preview the survey in Qualtrics
Pilot test
Step 5: Reevaluate each question as needed
Proofread, pilot, and proofread some more 

16. Webinar 2: Distributing and Reporting Data
What is the best way to reach to your audience?
Do you want your responses to by kept anonymous?
Will there be a time frame for respondents to take the survey?
What are you going to do with the data?
Who is going to see the report?

17. Webinar 3: Advanced Techniques
Creating a master survey
Selecting an appropriate end of survey option
Creating hoverboxes using javascript
Triggers
Piping

18. Additional Tools for Developing Survey Questions
Writing Good Survey Questions:
Tip Sheet on Question Wording:
Customer Support Team
SUN 3PM - FRI 6PM // SAT 9AM - 5PM MST

19. Additional Resources: Webinar 1
Webinars for Developing a Survey:
Learn Qualtrics in 5 simple steps:
Survey Tools Overview:

20. Additional Resources: Webinar 2
Learn Qualtrics in 5 simple steps:
Distribution Module:
Data & Analysis Module:
Reports Module:

21. Additional Resources: Webinar 3
Combining survey responses into one Master/survey file:
Survey termination options:
Combining responses from dissimilar surveys:
Javascript:
Javascript series of simple and free tutorials at

22. Summary Today, you learned how to:
Explain the purpose and benefits of using Qualtrics
Write purposeful survey questions
Apply concepts and skills learned from the webinar series to build and design a survey in Qualtrics
Feel more confident in distributing, collecting and downloading survey data to design a report
Utilize several advanced techniques/tools in Qualtrics
Develop goals for using Qualtrics in future programming, etc.

23. I appreciate your time!