Bias in Sampling. Definitions Bias = where the results of the sample are not representative of the population Three sources of Bias in Sampling –Sampling.

Slides:



Advertisements
Similar presentations
Where do data come from and Why we don’t (always) trust statisticians.
Advertisements

Section 4 Introduction-1
By:Heather Gubser Objective 26i
How to survey data without adding bias.
Public Opinion Polling How Public Opinion is Measured (and Mismeasured)
Sampling.
Sections – 1.4: Other Effective Sampling Methods – 1.5: Bias in Sampling – 1.6: The Design of Experiments General goals – Collect data effectively – Avoid.
OCR Nationals Level 3 Unit 3. March 2012 M Morison Know what is meant by ‘bias’ in a study Understand that bias needs to be eliminated from a study so.
Drawing Samples in “Observational Studies” Sample vs. the Population How to Draw a Random Sample What Determines the “Margin of Error” of a Poll?
Introduction to Data Analysis.
Literary Digest Poll 1936 election: Franklin Delano Roosevelt vs. Alf Landon Literary Digest had called the election since 1916 Sample size: 2.4 million!
About BIAS…. Bias A systematic error in measuring the estimateA systematic error in measuring the estimate favors certain outcomesfavors certain outcomes.
LT 4.1—Sampling and Surveys Day 3 Notes--Bias
How We Form Political Opinions Political Opinions Personal Beliefs Political Knowledge Cues From Leaders.
Copyright © 2011 Pearson Education, Inc. Samples and Surveys Chapter 13.
Sampling Designs Vocabulary for sampling types. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective.
C1, L2, S1 Design Method of Data Collection Surveys and Polls Experimentation Observational Studies.
4.2 Statistics Notes What are Good Ways and Bad Ways to Sample?
SAMPLING Nuances of sample size determination Brett Oppegaard, Washington State University Vancouver Language, Texts and Technology, Spring 2011.
Copyright © 2009 Pearson Education, Inc. Publishing as Longman. The 1936 Literary Digest Presidential Election Poll Case Study: Special Topic Lecture Chapter.
 Sampling Design Unit 5. Do frog fairy tale p.89 Do frog fairy tale p.89.
7. Logic of Sampling Jin-Wan Seo, Professor Dept. of Public Administration, University of Incheon.
Homework Read pages Page 467: 1 – 16, 29 – 34, 37, 38, 59.
Chapter 12 Designing Good Samples. Doubting the Holocaust? An opinion poll conducted in 1992 for the American Jewish Committee asked: Does it seem possible.
Measurements, Mistakes and Misunderstandings in Sample Surveys Lecture 1.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 4 Gathering Data Section 4.2 Good and Poor Ways to Sample.
Population We are almost always interested in knowledge about a population. We would have little interest in samples if we could always ask everyone.
An Overview of Statistics
DATA COLLECTION METHODS Sampling
Designing Social Inquiry week 4 I36005 Soohyung Ahn Case Study 1936 PRESIDENTIAL ELECTION : Roosevelt VS Landon.
Statistical Inference: Making conclusions about the population from sample data.
Warm Up The Ohio Department of Health wishes to estimate the percentage of Ohio State students who smoke cigarettes at each of Ohio State's campuses. 100.
Pitfalls of Surveys. The Literary Digest Poll 1936 US Presidential Election Alf Landon (R) vs. Franklin D. Roosevelt (D)
Sampling Design Notes Pre-College Math.
Visual Analytics Detect the Expected Discover the Unexpected A Tutorial for Middle School and High School Teachers Module 3- Misinformation and Lying with.
Sampling. Sampling Can’t talk to everybody Select some members of population of interest If sample is “representative” can generalize findings.
Advanced Math Topics 8.2 Selecting a Random Sample.
© 2010 Pearson Prentice Hall. All rights reserved Chapter Data Collection 1.
Statistics Section 2-3 Day 1 - Sampling in the Real World.
Statistics for fun and profit Chris Williams, Ph.D. Department of Statistics University of Idaho.
Chapter 2 Lesson 2.2a Collecting Data Sensibly 2.2: Sampling.
Public Opinion. What is Public Opinion Definition: The distribution of the population’s beliefs about politics and policy issues When there is a generally.
Level of Knowledge *. Most Important News Source, 1959 – 2005.
STT 421 Day 7: September 28, 2015 September 28, 2015
SECTION 4.1. INFERENCE The purpose of a sample is to give us information about a larger population. The process of drawing conclusions about a population.
 Elections: The voice of the people. › Frequently interpreted as voters acceptance or rejection of a party platform. › Affected by many factors and give.
Lesson Sources of Errors in Sampling. Objectives Understand how error can be introduced during sampling.
Bias in Survey Sampling. Bias Due to Unrepresentative Samples A good sample is representative. This means that each sample point represents the attributes.
STATS IN THE REAL WORLD Statistics, Representation, and Interpretation.
BIAS IN SURVEYS AND EXPERIMENTS. Literary Digest Poll of 1936 ■The Literary Digest’s straw poll predictions regarding presidential elections had a perfect.
Copyright © 2014, 2011 Pearson Education, Inc. 1 Chapter 13 Samples and Surveys.
Chapter 11 Sample Surveys. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective (future)
Ten percent of U. S. households contain 5 or more people
Lies, Damn Lies, and Statistics.
Math III U9D5 Warm-up: 1. Decide which method of data collection you would use to collect data for the study (observational study, experiment, simulation,
THE EFFECT OF SAMPLING BIAS ON BIG DATA BY USING THE READERS DIGEST POLL OF THE 1936 ELECTION AS A CASE STUDY, WE EXAMINE HOW THE SAMPLE OF DATA USED AFFECTS.
LOOKING AT SOME BASICS Can you tell the difference?
By Boon Xuan, Mei Ying and Fatin
Sources of Error In Sampling
Sources of Bias 1. Voluntary response 2. Undercoverage 3. Nonresponse
Bias On-Level Statistics.
Objectives Estimate population means and proportions and develop margin of error from simulations involving random sampling. Analyze surveys, experiments,
Inference for Sampling
“Do Now” In your notebook,
Chapter 4 Sampling Design.
a) Survey c) Simulation e) Simulation b) Observation d) Experiment
Sampling and Study Design
Section 1.5 Bias in Sampling.
Inference for Sampling
Bias in Studies Section 1.4.
Presentation transcript:

Bias in Sampling

Definitions Bias = where the results of the sample are not representative of the population Three sources of Bias in Sampling –Sampling bias –Nonresponse bias –Response bias

Sampling Bias Means that the technique used to obtain the sample’s individuals tends to favor one part of the population over another. Can also occur from undercoverage, which occurs when the proportion of one segment of the population is lower in a sample than it is in the population.

Nonresponse Bias Exists when individuals selected to be in the sample who do not respond to the survey have different opinions from those who do. Ways to Avoid: callbacks, rewards

Response Bias Exists when the answers on a survey do not reflect the true feelings of the respondent. Ways this happens: Interviewer error, misrepresented answers, wording of the questions, ordering of questions or words, type of question (open or closed), and data- entry error

Definitions Nonsampling errors result from undercoverage, nonresponse bias, response bias, or data-entry error. Sampling errors results from using a sample to estimate information about a population.

1. Determine the type of bias and suggest a remedy In 1936, the American Literary Digest magazine collected over two million postal surveys and predicted that the Republican candidate in the U.S. presidential election, Alf Landon, would beat the incumbent president, Franklin Roosevelt by a large margin. The result was the exact opposite. The Literary Digest survey represented a sample collected from readers of the magazine, supplemented by records of registered automobile owners and telephone users. This sample included an over-representation of individuals who were rich, who, as a group, were more likely to vote for the Republican candidate. Source: Wikipedia

2. Determine the type of bias and suggest a remedy An is sent out randomly to 300 managers asking them how many hours they are working per week. The results indicate that the average work week for managers is 40.

3. Determine the type of bias and suggest a remedy 1948 Presidential Election. On Election night, the Chicago Tribune printed the headline DEWEY DEFEATS TRUMAN, which turned out to be mistaken. In the morning the grinning President-Elect, Harry S. Truman, was photographed holding a newspaper bearing this headline. The reason the Tribune was mistaken is that their editor trusted the results of a phone survey. Survey research was then in its infancy, and few academics realized that a sample of telephone users was not representative of the general population. Telephones were not yet widespread, and those who had them tended to be prosperous and have stable addresses. Source: Wikipedia

4. Determine the type of bias and suggest a remedy A pollster heads to a particular corner of Ark City and selects 20 houses to find out income levels.

5. Determine the type of bias and suggest a remedy An instructor decides to use his class as a sample and asks them how many hours they study.

6. Determine the type of bias and suggest a remedy A doctor’s survey asks new patients how many hours they exercise per week.

7. Determine the type of bias and suggest a remedy The instructor received the following survey through Pearson is committed to providing you with the most comprehensive and effective textbooks for the computer aided drawing courses that you teach. To that end, we are trying to determine the courses offered in your program and the challenges and trends that you feel are affecting your courses going forward, etc. Could you please spare a few minutes now and complete our short online questionnaire. In return, your name will be entered into a drawing to win one of THREE $50 Amazon.com E-gift certificates. The survey is posted at:

8. Determine the type of bias and suggest a remedy A survey is given to 30 students at random to inquire how many times they have been arrested