1. Chapter 14
Data Collection in the Field, Response Error, and Questionnaire Screening

2. Nonsampling Error in Marketing Research
Nonsampling error includes
All types of nonresponse error
Data gathering errors
Data handling errors
Data analysis errors
Interpretation errors

3. Nonsampling Errors

4. Possible Errors in Field Data Collection
Field worker error: errors committed by the persons who administer the questionnaires
Respondent error: errors committed on the part of the respondent

5. Possible Errors in Field Data Collection
Field-Worker Errors
Intentional
Intentional field worker error: errors committed by the persons when a data collection person willfully violates the data collection requirements set forth by the researcher
Interviewer cheating: occurs when the interviewer intentionally misrepresents respondents
Leading respondents: occurs when interviewer influences respondent’s answers through wording, voice inflection, or body language

6. Possible Errors in Field Data Collection
Field-Worker Errors
Unintentional
Unintentional field worker error: errors committed when an interviewer believes he or she is performing correctly
Interviewer personal characteristics: occurs because of the interviewer’s personal characteristics such as accent, sex, and demeanor
Interviewer misunderstanding: occurs when the interviewer believes he or she knows how to administer a survey but instead does it incorrectly
Fatigue-related mistakes: occur when interviewer becomes tired

7. Possible Errors in Field Data Collection
Respondent Errors
Intentional
Intentional respondent error: errors committed when there are respondents that willfully misrepresent themselves in surveys
Falsehoods: occur when respondents fail to tell the truth in surveys
Nonresponse: occurs when the prospective respondents fails to take part in or to answer specific questions on the survey

8. Possible Errors in Field Data Collection
Respondent Errors
Unintentional
Unintentional respondent error: errors committed when a respondent gives a response that is not valid but that he or she believes is the truth

9. Possible Errors in Field Data Collection
Respondent Errors
Unintentional…cont.
Respondent misunderstanding: occurs when a respondent gives an answer without comprehending the question and/or the accompanying instructions
Guessing: occurs when a respondent gives an answer when he or she is uncertain of its accuracy
Attention loss: occurs when a respondent’s interest in the survey wanes
Distractions: (such as interruptions) may occur while questionnaire administration takes place
Fatigue: occurs when a respondent becomes tired of participating in a survey

10. } { How to Control Data Collection Errors
Types of Errors Control Mechanisms
Intentional Field Worker Errors
Cheating Supervision
Leading respondent Validation
Unintentional Field Worker Errors
Interviewer Characteristics Selection and training of interviewers
Misunderstandings Orientation sessions and role playing
Fatigue Require breaks and alternate surveys } {

11. { How to Control Data Collection Errors…cont. {
Types of Errors Control Mechanisms
Intentional Respondent Errors
Assuring anonymity and confidentiality
Falsehoods Incentives
Validation checks
Third person technique
Nonresponse Incentives { {

12. } { How to Control Data Collection Errors…cont. { {
Types of Errors Control Mechanisms
Unintentional Respondent Errors
Well-drafted questionnaire
Misunderstandings Direct Questions
Guessing Response options (e.g., “unsure”)
Attention loss Reversal of scale endpoints
Distractions
Fatigue Prompters { { } {

13. Data Collection Errors with Online Surveys
Multiple submissions by the same respondent
Bogus respondents and/or responses
Misrepresentation of the population

14. Nonresponse Error
Nonresponse: failure on the part of a prospective respondent to take part in a survey or to answer specific questions on the survey
Refusals to participate in survey
Break-offs during the interview
Refusals to answer certain questions (item omissions)
Completed interview must be defined.

15. Nonresponse Error…cont.
Response rate: enumerates the percentage of the total sample with which the interviews were completed
Refusals to participate in survey
Break-offs during the interview
Refusals to answer certain questions (item omissions)

16. Nonresponse Error…cont.
CASRO response rate formula:

17. Reducing Nonresponse Error
Mail surveys:
Advance notification
Monetary incentives
Follow-up mailings
Telephone surveys:
Callback attempts

18. Preliminary Questionnaire Screening
Unsystematic and systematic checks of completed questionnaires
What to look for in questionnaire inspection :
Incomplete questionnaires
Nonresponses to specific questions (item omissions)
Yea- or nay-saying patterns
Middle-of-the-road patterns

19. Unreliable Responses
Unreliable responses are found when conducting questionnaire screening, and an inconsistent or unreliable respondent may need to be eliminated from the sample.