PRINCIPLES OF WRITING AND CLASSIFICATION OF QUESTIONS Training course on developing and using questionnaires for agricultural surveys PRINCIPLES OF WRITING AND CLASSIFICATION OF QUESTIONS Principles of writing questions Istanbul, 18-21 July 2011 1

principles of writing and classification of questions The ways the question are asked have a major impact on behavior of respondent and, consequently on data quality The researcher should be concerned on providing questions that globally contribute to minimize errors due to the questionnaire. The questionnaire should be friendly both for respondent and interviewer In this step it is assumed that the specification of the objectives, concepts and definitions have been translated in indicators and variables to be observed (conceptualization and operationalization of the survey) Istanbul, 18-21 July 2011 2

The respondent should: Clearly understand what he/she is being asked principles of writing and classification of questions The respondent should: Clearly understand what he/she is being asked In principle be able to answer to the question and Understand how to answer has to be given This principles have to be applied to any type of units (individuals, enterprise, institutions, etc.) Istanbul, 18-21 July 2011 3

Social desiderability Fatigue point principles of writing and classification of questions The following effects can affect the quality of the answers. They should be considered in writing the questions: Context Memory Sensitivity Social desiderability Fatigue point Even if they are expressed in a form that suggest they have been identified in the context of surveys on individual, they can be applied to the case of enterprises and farms too. Istanbul, 18-21 July 2011 4

Some recommendations: principles of writing and classification of questions Context: This effects comprise the influences that other questions or information might have on the respondent’s interpretation of the question A respondent chooses an answer according to the purpose he/she think his/her answer will be used for. Some recommendations: Grouping all questions on the same topic in a section of the questionnaire; Supply an introduction to the questionnaire and to the section to explain the purposes and the use of such questions Istanbul, 18-21 July 2011 5

Some recommendations: Reduce the reference period principles of writing and classification of questions Memory: forgetting and telescoping are two causes of errors in reporting answers. Such problems can be reduced by a good formulations of the questions. The short memory is the part of memory mainly used in responding to a questionnaire Some recommendations: Reduce the reference period The reference period should be well specified at the beginning of the questions Use memory aids and cues in the question Istanbul, 18-21 July 2011 6

Embarrassing or highly sensitive topics can produce inaccurate answers principles of writing and classification of questions Sensitivity: Embarrassing or highly sensitive topics can produce inaccurate answers People may provide response they believe more “acceptable” Recommendations: Reassuring respondents that the information they provide is confidential Self-administered interview can produce more reliable responses than an interview Interviewers must be trained carefully Istanbul, 18-21 July 2011 7

This behavior can produce data distortions principles of writing and classification of questions Social desirability: Respondent may supply only the information he/she think can give a better picture of themselves. This behavior can produce data distortions Recommendations: Reassuring respondents at the beginning of the interview that all response are equally good and acceptable Istanbul, 18-21 July 2011 8

principles of writing and classification of questions Fatigue point: Each obstacle met during the questionnaire can cause a fatigue for the respondent. Such fatigues accumulate during the interview. Such fatigue can accumulate until a point is reached when it becomes too much and person no longer cares about what goes on in the questionnaire Istanbul, 18-21 July 2011 9

Classification of questions (types of information) Factual questions principles of writing and classification of questions Classification of questions (types of information) Factual questions these questions concerns fact based information, such as possessions of items Behavioral questions these questions require information about activity of respondent or business Opinion questions (not very important for agricultural surveys) these questions seek to measure subjective opinions rather than facts Hypothetical questions (not very important for agricultural surveys) these questions are of the form “what would you do…” Istanbul, 18-21 July 2011 10

principles of writing and classification of questions Open-ended questions What? Why? How? No predetermined responses given Able to answer in own words Useful exploratory research and to generate ideas Flexible Requires skill in asking questions and interpreting results Answers can lack uniformity and be difficult to analyze These questions are more demanding both for respondents and researchers. Some examples of answers could be supplied in the questionnaire It should be made clear what to do in case nonresponse, not applicable or zero answer applies Istanbul, 18-21 July 2011 11

principles of writing and classification of questions Close-ended questions The possible answers are supplied to the respondents. They need only to choose the most appropriate answer Designed to obtain predetermined responses Easy to count and analyze Easy interpret May not have catered for all possible answers Questions may not be relevant or important All possible alternatives have to be supplied; Each possible category should not be overlap with other answers (mutually exclusive) Istanbul, 18-21 July 2011 12

principles of writing and classification of questions Close-ended questions Some examples of closed questions are: Limited choice: (yes/no) (good/bad) etc. Multiple choice: respondent is required to choose between a number of response categories provided (only one choice) Checklist: more than one answers can be chosen Partially closed: a set of answers are supplied and the last alternative is “other, please specify” (difficulties in recording and analyzing the answers) Istanbul, 18-21 July 2011 13

Discussion principles of writing and classification of questions Translation of previous ideas to the case of business and farms surveys Example of embarrassing or sensitive questions in agriculture Examples of behavior questions in agriculture Administrative data can be confidential? examples of open-ended questions, close-ended questions, filter questions Istanbul, 18-21 July 2011 14