1. Overview of Qualtrics at Yale University Brian Fried Kevin Callender November 2, 2012

2. Introduction Brian & Kevin How many of you have used Qualtrics? Who is in the room?

3. Getting Started Official Yale Qualtrics site: yalesurvey.qualtrics.com yalesurvey.qualtrics.com www.qualtrics.com http://www.qualtrics.com/university/researchsuite/ – Start with Overview Videos – View Specific Training Videos and Tutorials Setting up an account & Logging in

4. Navigating Qualtrics The “My Surveys” Home Screen Create a survey – From Scratch – Library – Copy

5. Adding Questions How to add Create a new question Canned question from library Different types Examples of using Additional Options – Page Break – Forced response – Adding a Text Entry to Choices Moving & Deleting Questions

6. Blocks Purpose of Blocks Naming Blocks Organizing Survey Create a New Block – With Current Questions Logic – Within Survey – Within Survey Flow (more to come) – Loop & Merge (more to come)

7. Basic Logic Avoid using double logic Using skip and display: if changed= double work Display – Single question – CAUTION: And vs. Or – Based on answer to current questions – Can be used to skip rest of a block or to end of survey

8. Other Features of Questions Content Validation Using for test/quiz – Text entry options: number, email, etc Carry forward – repeat responses Piping Text Loop & Merge – What is it? – How to set it up – Working with blocks

9. Survey Customization “Look and Feel” – Style – Progress Bar Survey Options – Access – Protection: passwords and ballot stuffing – Closing Messages Survey Flow

10. Survey Design and Flow Length Introduction and conclusion IRB Changing Block Location Adding Logic and Conditions

11. Sharing and Testing Your Instrument Adding Collaborators Preview Survey using Link Different ways to test Creating a Modification Log when collaborating – Needs depend on access: excel vs Gdocs Quality Control and Pilot Testing Reviewing Data

12. Distribute Activate a survey Anonymous survey link Email survey Panels Social Media

13. A few words on using MTurk What is Mturk? Advantages/disadvantages Linking with qualtrics: http://reactiontimes.wordpress.com/2012/01/31 /just-a-test/ http://reactiontimes.wordpress.com/2012/01/31 /just-a-test/ Social Media as an alternative

14. Results View Reports – Report Options – Export Data (Word, PowerPoint, Excel, PDF) – Text vs Numeric – Randomization Responses Download Data (CSV, SPSS, Text, XML, HTML) Cross Tabs

15. Overview Of Library Qualtrics Library Group Library Saving a survey to the Library Using a survey from the Library Using a question from the Library

16. Polls Tab Polls are useful for gathering a small amount of information quickly Create Edit Look and Feel Insert into web site

17. Final Thoughts? Questions Comments Contact Us: – Brian: brian.fried@yale.edu – Kevin: kevin.callender@yale.edu For more in-depth information about Survey Design please contact Sherlock Campbell at the StatLab stathelp@yale.edustathelp@yale.edu