Qualitative Methods vs. Quantitative Methods

Qualitative Methods? Quantitative Methods?

(Some) Qualitative Methods (Participant) Observation Structural Analysis Case Studies Interviewing Questionnaires/Surveys

Surveys and Questionnaires Why would you use Questionnaires and how would you create and administer them?

Surveys and Questionnaires Why? –One of the most common ways to gather data –Can be tailored to your needs –Can be an effective research source

Surveys and Questionnaires How? –Need to know Difference between question types Techniques for question wording Techniques for overall design of questionnaire Finding a sample population Effective ways to distribute and enhance the return rate of questionnaires

Surveys and Questionnaires Question Type The more structured a question, the easier it is to analyze Many types of questions, but seven main ones 1.Verbal (or “Open”) 2.List 3.Category 4.Ranking 5.Scale 6.Quantity 7.Grid

Surveys and Questionnaires Question Wording –What to watch: Ambiguity, Imprecision, & Assumption Perceived Commonality –In-situ example: How much time, on average, do you spend studying? a) a great deal; b) a little bit; c) not at all Memory Knowledge Double Questions: e.g., “Do you attend math and chemistry classes?” Leading Questions: e.g., “Do you agree that mature students earn better grades?”

Question Wording –What to watch: Ambiguity, Imprecision, & Assumption Presuming Questions are usually formed by a researcher’s strong opinions or feelings – and not everyone feels that way; e.g., “Does the University provide Adequate Counseling?” Hypothetical Questions: “If you had no family responsibilities and plenty of money, what would you do with your life?” Offensive/Sensitive Issues (e.g., specific age, sexual orientation, grades, etc.) Surveys and Questionnaires

Question Design –No matter how perfectly worded, a questionnaire will lose much of its impact if it looks untidy –Some guidelines: Typed; nice, easy-to-read font Clear instructions Spacing (white space) between questions Check boxes? Order of questions is very important Allow space for computer scoring (if applicable); make certain of its impression

Surveys and Questionnaires Finding a Sample –Dependent on your time and project –Location –Should be representative of population in your project

Distribution and Return of Questionnaires –Face to face is best Can explain questionnaire and take-back immediately once complete –If must leave-out/mail, include: Explain the purpose of the study Outline anonymity, if applicable What approvals have been given (and by whom) Indicate what will be done with the information Surveys and Questionnaires

Reliability How reliable is your test, measurement, or survey? The extent to which a test (or survey or measurement) produces similar results under constant conditions on all occasions How to “test” for reliability –Test-retest –Alternate forms –Split-half

Validity Are the parts of your test, measurement, or survey a valid? Makes sure that an item measures what it’s supposed to measure –Unreliable = invalid; BUT reliable does not necessarily = validity –Examine your items critically: Surveys and Questionnaires

Example of a Survey: Good or Bad? Evaluation of GCU674, Geographic Techniques for Teachers Instructor:_____________________________ Date:_____________________________ Please rate the following: "Great!""Pretty Good" "Just OK" "Not Very Helpful" "Total Waste of Time" The information presented helped me understand basic techniques used in geography The presenter clearly explained the information The handouts were helpful Do you still need to talk with your instructor to help clarify information about geographic techniques? Would you use any of the information in your future research endeavors? YesNo Comments:

IRB…or, is the Survey Harmful?

Institutional Review (IRB) An Institutional Review Board is a diverse group of scientific and non-scientific individuals who conduct the initial and ongoing review of behavioral and clinical research studies involving human subjects. It is the responsibility of the IRB to review all material related to a study to be sure standards of ethics are maintained. This is especially important in items that will be viewed by the study patient, such as the Informed Consent document, advertisements, diaries, and informational brochures.

Often follow the “scientific method” –Create hypotheses, theories, models –Construct instruments and/or methods for measurement and/or testing of hypotheses –Attempt to investigate, manipulate, and/or control variables –Compile data –Replicate/Model and analyze data –Assess outcomes Stats, models, graphs, charts, tables, etc. (Some) Quantitative Methods

Quantitative Data?

What is an Index? A way to Quantify the Unquantifiable Examples: –From everyday Life? Ranking movies, ranking hotels, ranking restaurants, best schools, best cities –From schooling? SAT, your GPA, grading scales in classes –From geography? Palmer Drought Severity index, Moh’s hardness scale, sand mobility index, soil development index

Qualitative vs. Quantitative Can they overlap? “Mixed method” approach –Can use one or the other, or both –Must use each correctly –What if no previous research exists?

Reading Tufte, Edward The Visual Display of Quantitative Information.