1. 26/12/2009 Dr Salwa Tayel 1

2. 26/12/2009 Dr Salwa Tayel 2 Questionnaire Design By Associate Professor Family and Community Medicine Department King Saud University

3. 26/12/2009 3Dr Salwa Tayel Data collection tools The quality of research depends to a large extent on the quality of the data collection tools. The quality of research depends to a large extent on the quality of the data collection tools. Interviewing and administering questionnaires are probably the most commonly used research techniques. Interviewing and administering questionnaires are probably the most commonly used research techniques. Therefore designing good ‘questioning tools’ forms an important and time-consuming phase in the development of most research proposals. Therefore designing good ‘questioning tools’ forms an important and time-consuming phase in the development of most research proposals.

4. 26/12/2009 4Dr Salwa Tayel Factors to be considered in the design include: a. study objectives and major research questions; b. study hypotheses: c. data to be collected; d. plans for analysis and dummy tables so that no important information is missed; e. budget; and f. the audience or target population: age, sex, religion, language, traditionalism, stranger in the house (can a wife be interviewed in the absence of the husband?)

5. 26/12/2009 5Dr Salwa Tayel TYPES OF QUESTIONS Open-ended questions, Open-ended questions, Closed questions. Closed questions.

6. 26/12/2009 6Dr Salwa Tayel They permit free responses which should be recorded in the respondents’ own words. They are useful for social enquiries. They are useful for social enquiries. Some of the questions in medical surveys may be open-ended, but the fewer the better. Some of the questions in medical surveys may be open-ended, but the fewer the better. They require special coding after the end of the study, thus lengthening the time for analysis. They require special coding after the end of the study, thus lengthening the time for analysis. a. Open-ended questions

7. 26/12/2009 7Dr Salwa Tayel They have the advantages of being: - focused and relevant to the study objectives, - easy to administer, - uniform, - precoded and thus easy to analyse, and - analysed in a short time. They are preferred in medical studies. b. Structured / closed questions

8. 26/12/2009 8Dr Salwa Tayel Forms of structured questions Structured questions may offer: a. a dichotomous choice of ‘yes’ or ‘no’, ‘approve’ or ‘disapprove’, or ‘effective’ or ‘not effective’. Questions of this type should always include a ‘don’t know’ response category.

9. 26/12/2009 9Dr Salwa Tayel Forms of structured questions b. multiple choice: Example: To whom do you go first for advice on contraceptive methods? - the daya; - your friends or neighbours; - your mother-in-law; - the nurse; - the doctor; - the pharmacist; - others (specify).

10. 26/12/2009 10Dr Salwa Tayel c. A rating scale such as the multiple-step scale that requires the respondents to grade their answers between two extremes (e.g. ‘bad’ versus ‘good’; ‘approve’ versus ‘disapprove’). Example: Bad 1 2 3 4 5 6 7 Good Approve 1 2 3 4 5 Disapprove Such extended ranges are artefactual and are certainly beyond the comprehension of many people. d. a numerical answer, e.g. ‘How old are you?’

11. 26/12/2009 11Dr Salwa Tayel Language and wording style The language of the questions should be pitched to the level of the respondent. The language of the questions should be pitched to the level of the respondent. A common, everyday, conversational style should be used. A common, everyday, conversational style should be used. Avoid leading questions, e.g. ‘Don’t you think that the intrauterine device is safer than the pill?’ It would be better to ask: Avoid leading questions, e.g. ‘Don’t you think that the intrauterine device is safer than the pill?’ It would be better to ask: ‘Which do you think is safer, the intrauterine device or the pill?’ Avoid professional jargon and abbreviations. Avoid professional jargon and abbreviations.

12. 26/12/2009 12Dr Salwa Tayel Coding responses to questions The response categories should include all possible responses. The response categories should include all possible responses. This usually means including a ‘don’t know’ or ‘sometimes’ or ‘maybe’ category. This usually means including a ‘don’t know’ or ‘sometimes’ or ‘maybe’ category. Much time can be saved in the analysis if responses are scaled at the same time as they are recorded. Much time can be saved in the analysis if responses are scaled at the same time as they are recorded. For example, responses to the question: For example, responses to the question: ‘Is there a physician present when you visit the clinic?’ could be coded: Always 4 Usually 3 Sometimes 2 Don’t know 1 Never 0

13. 26/12/2009 13Dr Salwa Tayel The response categories must be mutually exclusive, that is, the answer categories must not overlap. There should be no blank left in any coding space, since a blank could mean that the question was either inadvertently omitted or purposely skipped. For this reason, all questions that may be skipped by certain categories of respondents (e.g. ages of children for childless couples) should be provided with an ‘NA’ (not applicable) code, usually 9 or 99.

14. 26/12/2009 14Dr Salwa Tayel Some data can best be obtained through a ‘cascade’ format. Have you ever seen a sign or poster for family planning anywhere? No 1GO TO QUESTION 10 Yes The last time you saw such a poster did you read the information on it? No 2GO TO QUESTION 10 Yes Did the poster give you new information about family planning that you didn’t already know? No 3 Don’t know 4 Yes 5

15. 26/12/2009 15Dr Salwa Tayel Length of questionnaire Most survey experts agree that a questionnaire of reasonable length is one that would take Most survey experts agree that a questionnaire of reasonable length is one that would take half an hour or less to administer in a structured interview. Lengthy interviews leads to fatigue and biasing the responses. Lengthy interviews leads to fatigue and biasing the responses.

16. 26/12/2009 16Dr Salwa Tayel Reliability of questionnaires Two means of ensuring reliability can be used: a. in-built reliability, which is achieved by repeating certain questions, rephrasing the second inquiry while maintaining the same or comparable response codes; and b. repeat reliability, which is achieved by repeating the interview with a small percentage of the respondents (chosen at random).

17. 26/12/2009 17Dr Salwa Tayel Validity/consistency checks Certain items in a questionnaire may be validated in special surveys. Another type of validity check is the consistency or cross-check. If a woman is 18 years old, she cannot possibly have a child aged 10 or 15; a woman with two single pregnancies cannot have three infant deaths. This tedious job can be done by computer.

18. 26/12/2009 18Dr Salwa Tayel Layout of questionnaire The layout of the questionnaire should be physically pleasant and artistically tasteful. The layout of the questionnaire should be physically pleasant and artistically tasteful.

19. 26/12/2009 19Dr Salwa Tayel Sequencing of questions The questions should be asked in a proper sequence. The questions should be asked in a proper sequence. The following are some general guidelines: a. Introduction: A clear and concise but relevant introduction to the questionnaire is helpful. It should indicate the purpose of the questionnaire It should indicate the purpose of the questionnaire

20. 26/12/2009 20Dr Salwa Tayel

21. 26/12/2009 21Dr Salwa Tayel b. Cover sheet or identification page. This page usually carries: - the name of the survey and the responsible organization; - the code for the respondent or household; and - the name of the interviewer and date of the interview.

22. 26/12/2009 22Dr Salwa Tayel c. Warm-up questions or statements should start the questionnaire itself. Do not start with threatening questions about income and other sensitive issues. d. The transition from one section to the other should be smooth. e. Instructions: Two possibilities: (i) a separate instruction manual may be used, or (ii) instructions may be included in the questionnaire itself.

23. 26/12/2009 23Dr Salwa Tayel Pretesting the questionnaire A pretest is a try-out of the questionnaire. Pre-testing is carried out on a small number of respondents who are comparable with the sample of correspondents but are not part of it. The results of pre-testing are incorporated into the rewriting of the questionnaire. Even if a standardized questionnaire is used, it should be pre-tested in the population being studied, and a reliability coefficient calculated.

24. 26/12/2009 24Dr Salwa Tayel Training of interviewers Interviewers must be carefully selected and properly trained. In survey research, they become the backbone of data collection. Instructions should be given about confidentiality of information, patience and being pleasant, with a positive attitude, following instructions, etc. Interviewers should always be supervised (one supervisor to four to six interviewers).

25. 26/12/2009 25Dr Salwa Tayel Call-backs Call-backs or repeat visits to non-respondents are most helpful in minimizing the non-response rate. The time of the call-back should coincide with the time that the respondent is most likely to be home. Perhaps two or three call-backs to non- respondent are enough.

26. 26/12/2009 26Dr Salwa Tayel Editing and coding Questionnaires should be checked by supervisors at the end of each day for omissions, incomplete answers, unclear statements or illegible writing. Interviewers may have to go back to collect missing or unclear information. Responses are then carefully coded, with verification.

27. 26/12/2009 27Dr Salwa Tayel Thank you Website http://faculty.ksu.edu.sa/73234/default.aspx salwatayel@hotmail.com The End