Common sampling errors

Slides:



Advertisements
Similar presentations
Sampling.
Advertisements

Census and Statistics Department Introduction to Sample Surveys.
Where do data come from and Why we don’t (always) trust statisticians.
How to survey data without adding bias.
Sampling Partially Adapted from The Research Methods Knowledge Base, William Trochim (2006). & Methods for Social Researchers in Developing Counries, The.
OCR Nationals Level 3 Unit 3. March 2012 M Morison Know what is meant by ‘bias’ in a study Understand that bias needs to be eliminated from a study so.
Literary Digest Poll 1936 election: Franklin Delano Roosevelt vs. Alf Landon Literary Digest had called the election since 1916 Sample size: 2.4 million!
About BIAS…. Bias A systematic error in measuring the estimateA systematic error in measuring the estimate favors certain outcomesfavors certain outcomes.
Copyright ©2011 Brooks/Cole, Cengage Learning Sampling: Surveys and How to Ask Questions Chapter 5 1.
Chapter 14 Data Collection in the Field, Response Error, and Questionnaire Screening.
Potential Uses of Social Surveys n objective info. re. how many of what type of people/activities are located in various places n behavioral information/from.
Documentation and survey quality. Introduction.
Chapter 7 Selecting Samples
Information from Samples Alliance Class January 17, 2012 Math Alliance Project.
LT 4.1—Sampling and Surveys Day 3 Notes--Bias
Copyright © 2011 Pearson Education, Inc. Samples and Surveys Chapter 13.
(Source: Causeweb.org). Elementary Survey Sampling 7 th Edition By Scheaffer, Mendenhall, Ott and Gerow.
Sampling Designs Vocabulary for sampling types. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective.
Chapter 6 Surveys and Sampling - Stangor. Surveys Survey – a series of self-report measures administered through either an interview or a written questionnaire.
Nonsampling Error in Marketing Research
4.2 Statistics Notes What are Good Ways and Bad Ways to Sample?
 Sampling Design Unit 5. Do frog fairy tale p.89 Do frog fairy tale p.89.
Chapter 4 Designing Studies
Surveys and Questionnaires Government agencies, news organizations, and marketing companies often conduct surveys. The results can be factual or subjective.
DATA COLLECTION METHODS Sampling
Pitfalls of Surveys. The Literary Digest Poll 1936 US Presidential Election Alf Landon (R) vs. Franklin D. Roosevelt (D)
Sampling: Surveys and How to Ask Questions Chapter 4.
Chapter 2 Sampling Design. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective (future)
Sampling Design Notes Pre-College Math.
Sampling. Sampling Can’t talk to everybody Select some members of population of interest If sample is “representative” can generalize findings.
Survey Design and Data Collection Most Of the Error In Surveys Comes From Poorly Designed Questionnaires And Sloppy Data Collection Procedures.
CHAPTER 8: Producing Data Sampling ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
Statistics Section 2-3 Day 1 - Sampling in the Real World.
Lecture 9 Prof. Development and Research Lecturer: R. Milyankova
The Challenge of Non- Response in Surveys. The Overall Response Rate The number of complete interviews divided by the number of eligible units in the.
Chapter 2 Lesson 2.2a Collecting Data Sensibly 2.2: Sampling.
Chapter 15 Sampling and Sample Size Winston Jackson and Norine Verberg Methods: Doing Social Research, 4e.
Control Measures for Non Sampling Errors 1. Sampling Errors arise due to: POPULATION SPECIFICATION ERROR—when the researcher does not understand who (s)he.
AP STATISTICS Section 5.1 Designing Samples. Objective: To be able to identify and use different sampling techniques. Observational Study: individuals.
Chapter 2 Sampling Design. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective (future)
Survey Research Chapter 7. The Nature of Surveys  Definition  Advantages  Disadvantages –Errors.
Political Beliefs and Public Opinion. Political efficacy The belief that one’s political participation really matters.
© 2012 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
SECTION 4.1. INFERENCE The purpose of a sample is to give us information about a larger population. The process of drawing conclusions about a population.
Data Collection: Enhancing Response Rates & Limiting Errors Chapter 10.
I can identify the difference between the population and a sample I can name and describe sampling designs I can name and describe types of bias I can.
Sampling Design and Analysis MTH 494 Ossam Chohan Assistant Professor CIIT Abbottabad.
 An observational study observes individuals and measures variable of interest but does not attempt to influence the responses.  Often fails due to.
Chapter 3 Surveys and Sampling © 2010 Pearson Education 1.
Chapter 5 Sampling and Surveys. Section 5.3 Sample Surveys in the Real World.
Bias in Survey Sampling. Bias Due to Unrepresentative Samples A good sample is representative. This means that each sample point represents the attributes.
SWBAT: Explain how undercoverage, nonresponse, and question wording can lead to bias in a sample survey. Do Now: An airline that wants to assess customer.
STATS IN THE REAL WORLD Statistics, Representation, and Interpretation.
Copyright © 2014, 2011 Pearson Education, Inc. 1 Chapter 13 Samples and Surveys.
Chapter 10 Sampling Design. How do we gather data? Surveys Opinion polls InterviewsStudies –Observational –Retrospective (past) –Prospective (future)
Chapter 11 Sample Surveys. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective (future)
Sampling Chapter 5. Introduction Sampling The process of drawing a number of individual cases from a larger population A way to learn about a larger population.
Ten percent of U. S. households contain 5 or more people
Chapter 5 Sampling Design. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective (future)
Unit 4--Lesson 2. Lesson Objectives At the end of the lesson, students can: Identify common issues with sampling and surveys Design an experiment using.
Sampling Design. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective (future) Experiments.
Statistics – Chapter 1 Data Collection
Sources of Bias 1. Voluntary response 2. Undercoverage 3. Nonresponse
Sampling Design.
Collecting Data and Planning Observational Studies
Bias On-Level Statistics.
Inference for Sampling
Chapter 4 Sampling Design.
Warmup.
Inference for Sampling
Presentation transcript:

Common sampling errors

POPULATION SPECIFICATION ERROR This error occurs when the researcher does not understand who she should survey. For example, imagine a survey about breakfast cereal consumption. Who should she survey? It might be the entire family, the mother, or the children. The mother probably makes the purchase decision, but the children influence her choice.

SAMPLE FRAME ERROR A frame error occurs when the wrong sub-population is used to select a sample. A classic frame error occurred in the 1936 presidential election between Roosevelt and Landon. The sample frame was from car registrations and telephone directories. In 1936, many Americans did not own cars or telephones and those who did were largely Republicans. The results wrongly predicted a Republican victory.

SELECTION ERROR This occurs when respondents self select their participation in the study – only those that are interested respond. Selection error can be controlled by going extra lengths to get participation. A typical survey process includes initiating pre-survey contact requesting cooperation, actual surveying, post survey follow-up if a response is not received, a second survey request, and finally interviews using alternate modes such as telephone or person to person.

NON-RESPONSE Non-response errors occur when respondents are different than those who do not respond. This may occur because either the potential respondent was not contacted or they refused to respond. The extent of this non-response error can be checked through follow-up surveys using alternate modes.

SAMPLING ERRORS These errors occur because of variation in the number or representativeness of the sample that responds. Sampling errors can be controlled by (1) careful sample designs, (2) large samples, and (3) multiple contacts to assure representative response.

Good Questions no inflammatory language, no jargon or technical terms, short, simple, each question measures ONE idea,

http://mailer.fsu.edu/~slosh/MethodsSampling.html