1. PRINCIPLES OF WRITING AND CLASSIFICATION OF QUESTIONS
Training course on developing and using questionnaires for agricultural surveys
PRINCIPLES OF WRITING AND CLASSIFICATION OF QUESTIONS
Principles of writing questions
Istanbul, July 2011 1

2. principles of writing and classification of questions
The ways the question are asked have a major impact on behavior of respondent and, consequently on data quality
The researcher should be concerned on providing questions that globally contribute to minimize errors due to the questionnaire.
The questionnaire should be friendly both for respondent and interviewer
In this step it is assumed that the specification of the objectives, concepts and definitions have been translated in indicators and variables to be observed
(conceptualization and operationalization of the survey)
Istanbul, July 2011 2

3. The respondent should: Clearly understand what he/she is being asked
principles of writing and classification of questions
The respondent should:
Clearly understand what he/she is being asked
In principle be able to answer to the question and
Understand how to answer has to be given
This principles have to be applied to any type of units (individuals, enterprise, institutions, etc.)
Istanbul, July 2011 3

4. Social desiderability Fatigue point
principles of writing and classification of questions
The following effects can affect the quality of the answers. They should be considered in writing the questions:
Context
Memory
Sensitivity
Social desiderability
Fatigue point
Even if they are expressed in a form that suggest they have been identified in the context of surveys on individual, they can be applied to the case of enterprises and farms too.
Istanbul, July 2011 4

5. Some recommendations:
principles of writing and classification of questions
Context:
This effects comprise the influences that other questions or information might have on the respondent’s interpretation of the question
A respondent chooses an answer according to the purpose he/she think his/her answer will be used for.
Some recommendations:
Grouping all questions on the same topic in a section of the questionnaire;
Supply an introduction to the questionnaire and to the section to explain the purposes and the use of such questions
Istanbul, July 2011 5

6. Some recommendations: Reduce the reference period
principles of writing and classification of questions
Memory:
forgetting and telescoping are two causes of errors in reporting answers. Such problems can be reduced by a good formulations of the questions.
The short memory is the part of memory mainly used in responding to a questionnaire
Some recommendations:
Reduce the reference period
The reference period should be well specified at the beginning of the questions
Use memory aids and cues in the question
Istanbul, July 2011 6

7. Embarrassing or highly sensitive topics can produce inaccurate answers
principles of writing and classification of questions
Sensitivity:
Embarrassing or highly sensitive topics can produce inaccurate answers
People may provide response they believe more “acceptable”
Recommendations:
Reassuring respondents that the information they provide is confidential
Self-administered interview can produce more reliable responses than an interview
Interviewers must be trained carefully
Istanbul, July 2011 7

8. This behavior can produce data distortions
principles of writing and classification of questions
Social desirability:
Respondent may supply only the information he/she think can give a better picture of themselves.
This behavior can produce data distortions
Recommendations:
Reassuring respondents at the beginning of the interview that all response are equally good and acceptable
Istanbul, July 2011 8

9. principles of writing and classification of questions
Fatigue point:
Each obstacle met during the questionnaire can cause a fatigue for the respondent. Such fatigues accumulate during the interview.
Such fatigue can accumulate until a point is reached when it becomes too much and person no longer cares about what goes on in the questionnaire
Istanbul, July 2011 9

10. Classification of questions (types of information) Factual questions
principles of writing and classification of questions
Classification of questions (types of information)
Factual questions
these questions concerns fact based information, such as possessions of items
Behavioral questions
these questions require information about activity of respondent or business
Opinion questions (not very important for agricultural surveys)
these questions seek to measure subjective opinions rather than facts
Hypothetical questions (not very important for agricultural surveys)
these questions are of the form “what would you do…”
Istanbul, July 2011 10

11. principles of writing and classification of questions
Open-ended questions
What? Why? How?
No predetermined responses given
Able to answer in own words
Useful exploratory research and to generate ideas
Flexible
Requires skill in asking questions and interpreting results
Answers can lack uniformity and be difficult to analyze
These questions are more demanding both for respondents and researchers.
Some examples of answers could be supplied in the questionnaire
It should be made clear what to do in case nonresponse, not applicable or zero answer applies
Istanbul, July 2011 11

12. principles of writing and classification of questions
Close-ended questions
The possible answers are supplied to the respondents. They need only to choose the most appropriate answer
Designed to obtain predetermined responses
Easy to count and analyze
Easy interpret
May not have catered for all possible answers
Questions may not be relevant or important
All possible alternatives have to be supplied;
Each possible category should not be overlap with other answers (mutually exclusive)
Istanbul, July 2011 12

13. principles of writing and classification of questions
Close-ended questions
Some examples of closed questions are:
Limited choice: (yes/no) (good/bad) etc.
Multiple choice: respondent is required to choose between a number of response categories provided (only one choice)
Checklist: more than one answers can be chosen
Partially closed: a set of answers are supplied and the last alternative is “other, please specify” (difficulties in recording and analyzing the answers)
Istanbul, July 2011 13

14. Discussion principles of writing and classification of questions
Translation of previous ideas to the case of business and farms surveys
Example of embarrassing or sensitive questions in agriculture
Examples of behavior questions in agriculture
Administrative data can be confidential?
examples of open-ended questions, close-ended questions,
filter questions
Istanbul, July 2011 14