Sections – 1.4: Other Effective Sampling Methods – 1.5: Bias in Sampling – 1.6: The Design of Experiments General goals – Collect data effectively – Avoid.

Slides:



Advertisements
Similar presentations
Where do data come from and Why we don’t (always) trust statisticians.
Advertisements

By:Heather Gubser Objective 26i
How to survey data without adding bias.
Sample Data Population Inference A very common paradigm in statistical studies:
Section 1.3 Experimental Design © 2012 Pearson Education, Inc. All rights reserved. 1 of 61.
Section 1.3 Experimental Design.
OCR Nationals Level 3 Unit 3. March 2012 M Morison Know what is meant by ‘bias’ in a study Understand that bias needs to be eliminated from a study so.
Introduction to Data Analysis.
Literary Digest Poll 1936 election: Franklin Delano Roosevelt vs. Alf Landon Literary Digest had called the election since 1916 Sample size: 2.4 million!
About BIAS…. Bias A systematic error in measuring the estimateA systematic error in measuring the estimate favors certain outcomesfavors certain outcomes.
The eternal tension in statistics.... Between what you really really want (the population) but can never get to...
Section Decision Making with Data  NOT ALL DATA IS GOOD DATA!  “Do not put faith in what statisticians say until you have carefully considered.
LT 4.1—Sampling and Surveys Day 3 Notes--Bias
Dear Readers, If you had it to do all over again, would you have children? Ann Landers Ann Landers posed the question to the readers of her advice column.
Copyright © 2011 Pearson Education, Inc. Samples and Surveys Chapter 13.
C1, L2, S1 Design Method of Data Collection Surveys and Polls Experimentation Observational Studies.
4.2 Statistics Notes What are Good Ways and Bad Ways to Sample?
Famous Quotes There are three kinds of lies: lies, damned lies and statistics. Benjamin Disraeli Figures don’t lie; liars figure. Mark Twain Statistics.
SAMPLING Nuances of sample size determination Brett Oppegaard, Washington State University Vancouver Language, Texts and Technology, Spring 2011.
Copyright © 2009 Pearson Education, Inc. Publishing as Longman. The 1936 Literary Digest Presidential Election Poll Case Study: Special Topic Lecture Chapter.
 Sampling Design Unit 5. Do frog fairy tale p.89 Do frog fairy tale p.89.
Experimental Design 1 Section 1.3. Section 1.3 Objectives 2 Discuss how to design a statistical study Discuss data collection techniques Discuss how to.
7. Logic of Sampling Jin-Wan Seo, Professor Dept. of Public Administration, University of Incheon.
Homework Read pages Page 467: 1 – 16, 29 – 34, 37, 38, 59.
Chapter 12 Designing Good Samples. Doubting the Holocaust? An opinion poll conducted in 1992 for the American Jewish Committee asked: Does it seem possible.
Measurements, Mistakes and Misunderstandings in Sample Surveys Lecture 1.
DATA COLLECTION METHODS Sampling
Designing Social Inquiry week 4 I36005 Soohyung Ahn Case Study 1936 PRESIDENTIAL ELECTION : Roosevelt VS Landon.
Decision Making with Data Section 8.4. Evaluate data collection procedures Sample size Random assignment Validity –Did the test measure what it was supposed.
Pitfalls of Surveys. The Literary Digest Poll 1936 US Presidential Election Alf Landon (R) vs. Franklin D. Roosevelt (D)
Chapter 12 Sample Surveys *Sample *Bias *Randomizing *Sample Size.
Sampling Design Notes Pre-College Math.
Visual Analytics Detect the Expected Discover the Unexpected A Tutorial for Middle School and High School Teachers Module 3- Misinformation and Lying with.
Sampling. Sampling Can’t talk to everybody Select some members of population of interest If sample is “representative” can generalize findings.
Collection of Data Chapter 4. Three Types of Studies Survey Survey Observational Study Observational Study Controlled Experiment Controlled Experiment.
Statistics for fun and profit Chris Williams, Ph.D. Department of Statistics University of Idaho.
Chapter 2 Lesson 2.2a Collecting Data Sensibly 2.2: Sampling.
STT 421 Day 7: September 28, 2015 September 28, 2015
Section 2.1: Taking a Good Sample. Sampling Design  Design of a sample refers to the method used to collect the data.  A proper sampling design must.
Bias in Sampling. Definitions Bias = where the results of the sample are not representative of the population Three sources of Bias in Sampling –Sampling.
Political Beliefs and Public Opinion. Political efficacy The belief that one’s political participation really matters.
SECTION 4.1. INFERENCE The purpose of a sample is to give us information about a larger population. The process of drawing conclusions about a population.
 Elections: The voice of the people. › Frequently interpreted as voters acceptance or rejection of a party platform. › Affected by many factors and give.
Section 1.3 Experimental Design.
Bias in Survey Sampling. Bias Due to Unrepresentative Samples A good sample is representative. This means that each sample point represents the attributes.
STATS IN THE REAL WORLD Statistics, Representation, and Interpretation.
Copyright © 2014, 2011 Pearson Education, Inc. 1 Chapter 13 Samples and Surveys.
Chapter 11 Sample Surveys. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective (future)
Ten percent of U. S. households contain 5 or more people
Section 1.3 Objectives Discuss how to design a statistical study Discuss data collection techniques Discuss how to design an experiment Discuss sampling.
Math III U9D5 Warm-up: 1. Decide which method of data collection you would use to collect data for the study (observational study, experiment, simulation,
THE EFFECT OF SAMPLING BIAS ON BIG DATA BY USING THE READERS DIGEST POLL OF THE 1936 ELECTION AS A CASE STUDY, WE EXAMINE HOW THE SAMPLE OF DATA USED AFFECTS.
LOOKING AT SOME BASICS Can you tell the difference?
Unit 4--Lesson 2. Lesson Objectives At the end of the lesson, students can: Identify common issues with sampling and surveys Design an experiment using.
Last lecture summary Five numbers summary, percentiles, mean Box plot, modified box plot Robust statistic – mean, median, trimmed mean outlier Measures.
By Boon Xuan, Mei Ying and Fatin
Sources of Error In Sampling
A very common paradigm in statistical studies:
Sources of Bias 1. Voluntary response 2. Undercoverage 3. Nonresponse
Political Attitudes and Public Opinion
Bias On-Level Statistics.
Inference for Sampling
Chapter 4 Sampling Design.
MA151 Lecture 2: Sampling methods
a) Survey c) Simulation e) Simulation b) Observation d) Experiment
The Language of Sampling
Sampling and Study Design
The Language of Sampling
Chapter 2.1 Research Methods
Presentation transcript:

Sections – 1.4: Other Effective Sampling Methods – 1.5: Bias in Sampling – 1.6: The Design of Experiments General goals – Collect data effectively – Avoid bad data – Clever ways to best answer the question at hand

A local news radio station invites morning listeners to respond to a opinion question about a current news issue. The listeners are given one of two phone numbers: one for if you “agree” and another if you “disagree”. This is an example of: A.Stratified sampling B.Systematic sampling C.Cluster sampling D.Convenience sampling

Suppose I wanted to find out HSU students’ opinion about their knowledge of the Jack Pass for the local bus system. Using student records, I randomly selected 20 first year students, 20 second year students, 20 third year students, and 20 student who were fourth or greater year students. This is an example of: A.Stratified sampling B.Systematic sampling C.Cluster sampling D.Convenience sampling

What would a possible cluster sampling design look like for surveying students about their bus use?

In attempt to predict the 1936 presidential election, The Literary Digest surveyed a sample collected from its readers and from a registry of car owners and telephone users. The survey predicted the Republican candidate Alf Landon would easily beat Democrat president Franklin Roosevelt. (source: Wikipedia). You’ve likely never had heard of Alf Landon, so obviously the survey was off in its prediction. What went wrong?

Where did it go wrong? Nonresponse bias: Only 2.3 million of the 10 million readers responded to survey Sampling bias: The ownership of cars and phones excluded many poor and/or rural people.

Suppose a public health survey is being designed to learn about people’s sexual behavior and their perceived risk for acquiring and/or transmitting STDs. Question: What type of bias(es) should researchers be concerned about? A.Sampling & Nonresponse B.Nonresponse & Response C.Sampling & Response D.Sampling & Nonresponse & Response

To test the effect of caffeine and blood pressure (bp), 100 volunteers were given a placebo pill one day and then had their bp measured. Likewise, on an adjacent day each person was given a caffeine pill and their bp measured. The order of placebo or caffeine was randomly set.

This is an example of: A.Matched-pairs design B.Multistage sampling C.Double blind study D.Systematic sampling

Some big ideas about designing a study: Determine the question. Determine the parameter of interest. Determine the population. Be aware of and avoid bias Control for what you can (blocking, matched- pairs, etc) and randomize the rest. Think of confounding variables, especially in observational studies. Play “Devil’s advocate” and then redesign.