Sources of Bias 1. Voluntary response 2. Undercoverage 3. Nonresponse

Slides:



Advertisements
Similar presentations
Where do data come from and Why we don’t (always) trust statisticians.
Advertisements

About BIAS…. Bias A systematic error in measuring the estimateA systematic error in measuring the estimate favors certain outcomesfavors certain outcomes.
Sampling Designs Vocabulary for sampling types. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective.
4.2 Statistics Notes What are Good Ways and Bad Ways to Sample?
 Sampling Design Unit 5. Do frog fairy tale p.89 Do frog fairy tale p.89.
DATA COLLECTION METHODS Sampling
Designing Social Inquiry week 4 I36005 Soohyung Ahn Case Study 1936 PRESIDENTIAL ELECTION : Roosevelt VS Landon.
Pitfalls of Surveys. The Literary Digest Poll 1936 US Presidential Election Alf Landon (R) vs. Franklin D. Roosevelt (D)
Chapter 2 Sampling Design. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective (future)
Sampling Design Notes Pre-College Math.
CHAPTER 8: Producing Data Sampling ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
Statistics Section 2-3 Day 1 - Sampling in the Real World.
Chapter 2 Lesson 2.2a Collecting Data Sensibly 2.2: Sampling.
Chapter 12 Sampling Design. How do we gather data? SurveysSurveys Opinion pollsOpinion polls InterviewsInterviews StudiesStudies –Observational –Retrospective.
AP Statistics Monday, 28 September 2015 OBJECTIVE TSW explore sampling design. TESTS are graded. AGENDA: 09/28/15 – 10/02/15 –MONDAYRead Ch. 11 (pp )
Chapter 2 Sampling Design. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective (future)
Bias in Sampling. Definitions Bias = where the results of the sample are not representative of the population Three sources of Bias in Sampling –Sampling.
SECTION 4.1. INFERENCE The purpose of a sample is to give us information about a larger population. The process of drawing conclusions about a population.
Common sampling errors
Sampling Design.
Designing Studies In order to produce data that will truly answer the questions about a large group, the way a study is designed is important. 1)Decide.
Bias in Survey Sampling. Bias Due to Unrepresentative Samples A good sample is representative. This means that each sample point represents the attributes.
Copyright © 2014, 2011 Pearson Education, Inc. 1 Chapter 13 Samples and Surveys.
Chapter 2 Sampling Design. How do we gather data? SurveysSurveys Opinion pollsOpinion polls InterviewsInterviews StudiesStudies –Observational –Retrospective.
Chapter 10 Sampling Design. How do we gather data? Surveys Opinion polls InterviewsStudies –Observational –Retrospective (past) –Prospective (future)
Chapter 11 Sample Surveys. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective (future)
Ten percent of U. S. households contain 5 or more people
MATH Section 6.1. Sampling: Terms: Population – each element (or person) from the set of observations that can be made Sample – a subset of the.
Chapter 5 Sampling Design. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective (future)
Math III U9D5 Warm-up: 1. Decide which method of data collection you would use to collect data for the study (observational study, experiment, simulation,
Unit 4--Lesson 2. Lesson Objectives At the end of the lesson, students can: Identify common issues with sampling and surveys Design an experiment using.
Chapter 2 Sampling Design. How do we gather data? SurveysSurveys Opinion pollsOpinion polls InterviewsInterviews StudiesStudies –Observational –Retrospective.
+ Homework READ p COMPLETE (p.227)  19, 21, 23, 25, 27-29, 31, 33, 35 CHECK your answers in the back of the book Please Complete the Following.
Sampling Design. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective (future) Experiments.
Random Sampling All statistical sampling designs have in common the idea that chance not human choice is used to select the sample. [notes for days 2 and.
Sampling Design. Do River Project Will take two days From Josh Tabor Notes.
Sampling Design. How do we gather data? SurveysSurveys Opinion pollsOpinion polls InterviewsInterviews StudiesStudies –Observational –Retrospective (past)
is used to select the sample.
Chapter 4 Sampling Design.
Sampling Design.
Sampling Design.
Sampling Design.
Collecting Data and Planning Observational Studies
Sampling Design.
Section 5.1 Designing Samples
CHAPTER 4 Designing Studies
Bias and Error What can go wrong?.
Chapter 5 Sampling Design.
Bias On-Level Statistics.
Sampling Bias Terminology
Chapter 12 Sample Surveys
Inference for Sampling
Chapter 4 Sampling Design.
MA151 Lecture 2: Sampling methods
Section 5.1 Designing Samples
Sampling and Surveys How do we collect data? 8/20/2012.
Unit 1 Day 4 Biased or Unbiased in Sampling
Chapter 2 Sampling Design.
a) Survey c) Simulation e) Simulation b) Observation d) Experiment
Sampling Design.
Sampling and Study Design
WARM – UP Use LINE 5 of the random digit table. 30. The World Series.
Designing Samples Statistical techniques for producing data open the door to formal statistical inference, which answers specific questions with a known.
5.3 Errors.
MATH 2311 Section 6.1.
Designing Samples Statistical techniques for producing data open the door to formal statistical inference, which answers specific questions with a known.
Inference for Sampling
Chapter 2 Sampling Design.
5.3 Errors.
MATH 2311 Section 6.1.
Presentation transcript:

Sources of Bias 1. Voluntary response 2. Undercoverage 3. Nonresponse 4. Response bias 5. Convenience sample

Bias ERROR favors certain outcomes Anything that causes the data to be wrong! It might be attributed to the researchers, the respondent, or to the sampling method!

Sources of Bias things that can cause bias in your sample we cannot do anything with bad data

Remember – the way to determine voluntary response is: An example would be the surveys in magazines that ask readers to mail in the survey. Remember, the respondent selects themselves to participate in the survey! Remember – the way to determine voluntary response is: Self-selection!! People choose to respond Usually only people with very strong opinions respond

People with unlisted phone numbers Undercoverage some groups of population are left out of the sampling process People without phone numbers –usually low-income families Suppose you take a sample by randomly selecting names from the phone book – some groups will not have the opportunity of being selected! People with ONLY cell phones – usually young adults

Nonresponse Because of huge telemarketing efforts in the past few years, telephone surveys have a MAJOR problem with nonresponse! occurs when an individual chosen for the sample can’t be contacted or refuses to cooperate telephone surveys 70% nonresponse People are chosen by the researchers, BUT refuse to participate. NOT self-selected! This is often confused with voluntary response! One way to help with the problem of nonresponse is to make follow contact with the people who are not home when you first contact them.

Response bias Suppose we wanted to survey high school students on drug abuse and we used a uniformed police officer to interview each student in our sample – would we get honest answers? occurs when the behavior of respondent or interviewer causes bias in the sample wrong answers Response bias occurs when for some reason (interviewer’s or respondent’s fault) you get incorrect answers.

Wording Bias wording can influence the answers that are given The level of vocabulary should be appropriate for the population you are surveying Questions must be worded as neutral as possible to avoid influencing the response. wording can influence the answers that are given connotation of words use of “big” words or technical words – if surveying children then you should avoid complex vocabulary. – if surveying doctors, then use more complex, technical wording.

Convenience sampling Ask people who are easy to ask The data obtained by a convenience sample will be biased – however this method is often used for surveys & results reported in newspapers and magazines! Ask people who are easy to ask Produces bias results An example would be stopping friendly-looking people in the mall to survey. Another example is the surveys left on tables at restaurants - a convenient method!

Source of Bias? 1) Before the presidential election of 1936, FDR against Republican ALF Landon, the magazine Literary Digest predicted Landon winning the election in a 3-to-2 victory (A survey of 10 million people.) George Gallup surveyed only 50,000 people and predicted that Roosevelt would win. The Digest’s survey came from magazine subscribers, car owners, telephone directories, etc. Undercoverage – since the Digest’s survey comes from car owners, etc., the people selected were mostly from high-income families and thus mostly Republican! (other answers are possible)

Convenience sampling – easy way to collect data 2) Suppose that you want to estimate the total amount of money spent by students on textbooks each semester at Texas A&M. You collect register receipts for students as they leave the bookstore during lunch one day. Convenience sampling – easy way to collect data or Undercoverage – students who buy books from on-line bookstores are excluded.

(other answers are possible) 3) To find the average value of a home in Sugar Land, one averages the price of homes that are listed for sale with a realtor. Undercoverage – leaves out homes that are not for sale or homes that are listed with different realtors. (other answers are possible)

4) City police set up a road block in an area of the city to check cars for up-to-date registration and insurance. They check every car passing through that road. Identify the following: The population: Parameter of interest: Sampling frame: Sample: Sampling method: Any sources of bias: Cars in that city Registration and insurance List of all cars driven in that city Cars traveling in that road Cluster