4.2 Statistics Notes What are Good Ways and Bad Ways to Sample?

Slides:



Advertisements
Similar presentations
Collecting Data Sensibly
Advertisements

Where do data come from and Why we don’t (always) trust statisticians.
GrowingKnowing.com © Sampling A sample is a subset of the population In a sample, you study a few members of the population In a census, you study.
Sampling.
GATHERING DATA Chapter Experiment or Observe?
Literary Digest Poll 1936 election: Franklin Delano Roosevelt vs. Alf Landon Literary Digest had called the election since 1916 Sample size: 2.4 million!
About BIAS…. Bias A systematic error in measuring the estimateA systematic error in measuring the estimate favors certain outcomesfavors certain outcomes.
Chapter 12 Sample Surveys. At the end of this chapter, you should be able to Identify populations, samples, parameters and statistics for a given problem.
Chapter 4 How to get the Data Part1 n In the first 3 lectures of this course we spoke at length about what care we should take in conducting a study ourselves.
CHAPTER 7, the logic of sampling
Copyright © 2011 Pearson Education, Inc. Samples and Surveys Chapter 13.
Sampling Designs Vocabulary for sampling types. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective.
SOCI 1301: Introduction to Sociology Social Research Methods.
C1, L2, S1 Design Method of Data Collection Surveys and Polls Experimentation Observational Studies.
Famous Quotes There are three kinds of lies: lies, damned lies and statistics. Benjamin Disraeli Figures don’t lie; liars figure. Mark Twain Statistics.
SAMPLING Nuances of sample size determination Brett Oppegaard, Washington State University Vancouver Language, Texts and Technology, Spring 2011.
Sampling Defined / The idea – Making inference about a larger population What is the population – Some particular value in the population estimating.
Copyright © 2009 Pearson Education, Inc. Publishing as Longman. The 1936 Literary Digest Presidential Election Poll Case Study: Special Topic Lecture Chapter.
 Sampling Design Unit 5. Do frog fairy tale p.89 Do frog fairy tale p.89.
Political Science 30: Political Inquiry Drawing a Good Sample.
Chapter 12 Designing Good Samples. Doubting the Holocaust? An opinion poll conducted in 1992 for the American Jewish Committee asked: Does it seem possible.
Measurements, Mistakes and Misunderstandings in Sample Surveys Lecture 1.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 4 Gathering Data Section 4.2 Good and Poor Ways to Sample.
DATA COLLECTION METHODS Sampling
Designing Social Inquiry week 4 I36005 Soohyung Ahn Case Study 1936 PRESIDENTIAL ELECTION : Roosevelt VS Landon.
Pitfalls of Surveys. The Literary Digest Poll 1936 US Presidential Election Alf Landon (R) vs. Franklin D. Roosevelt (D)
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.1 Samples and Surveys.
Sampling Design Notes Pre-College Math.
Sampling. Sampling Can’t talk to everybody Select some members of population of interest If sample is “representative” can generalize findings.
Advanced Math Topics 8.2 Selecting a Random Sample.
Random and Non-Random samples 12/3/2013. Readings Chapter 6 Foundations of Statistical Inference (Pollock) (pp )
Chapter 12 Sample Surveys
Agresti/Franklin Statistics, 1 of 56 Chapter 4 Gathering data Learn …. How to gather “good” data About Experiments and Observational Studies.
CHAPTER 8: Producing Data Sampling ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
CHAPTER 8: Producing Data Sampling ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
Statistics Section 2-3 Day 1 - Sampling in the Real World.
Making Inferences. Sample Size, Sampling Error, and 95% Confidence Intervals Samples: usually necessary (some exceptions) and don’t need to be huge to.
STT 421 Day 7: September 28, 2015 September 28, 2015
Section 2.1: Taking a Good Sample. Sampling Design  Design of a sample refers to the method used to collect the data.  A proper sampling design must.
Bias in Sampling. Definitions Bias = where the results of the sample are not representative of the population Three sources of Bias in Sampling –Sampling.
SECTION 4.1. INFERENCE The purpose of a sample is to give us information about a larger population. The process of drawing conclusions about a population.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. 1 In an observational study, the researcher observes values of the response variable and explanatory.
1. When I give you the signal, you will have 10 seconds to look at a slide and make a guess as to the average number of m&m’s per pile. Do not use pencil.
Common sampling errors
Lesson Sources of Errors in Sampling. Objectives Understand how error can be introduced during sampling.
7: The Logic of Sampling. Introduction Nobody can observe everything Critical to decide what to observe Sampling –Process of selecting observations Probability.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.1 Samples and Surveys.
CHAPTER 7, THE LOGIC OF SAMPLING. Chapter Outline  A Brief History of Sampling  Nonprobability Sampling  The Theory and Logic of Probability Sampling.
Chapter 5 Sampling and Surveys. Section 5.3 Sample Surveys in the Real World.
Designing Studies In order to produce data that will truly answer the questions about a large group, the way a study is designed is important. 1)Decide.
Chapter 4: Designing Studies... Sampling. Convenience Sample Voluntary Response Sample Simple Random Sample Stratified Random Sample Cluster Sample Convenience.
Copyright © 2014, 2011 Pearson Education, Inc. 1 Chapter 13 Samples and Surveys.
Unit 4 Gathering Data LESSON SAMPLING WHAT ARE GOOD WAYS AND POOR WAYS TO SAMPLE?
Chapter 11 Sample Surveys. How do we gather data? Surveys Opinion polls Interviews Studies –Observational –Retrospective (past) –Prospective (future)
Ten percent of U. S. households contain 5 or more people
THE EFFECT OF SAMPLING BIAS ON BIG DATA BY USING THE READERS DIGEST POLL OF THE 1936 ELECTION AS A CASE STUDY, WE EXAMINE HOW THE SAMPLE OF DATA USED AFFECTS.
LOOKING AT SOME BASICS Can you tell the difference?
Unit 4--Lesson 2. Lesson Objectives At the end of the lesson, students can: Identify common issues with sampling and surveys Design an experiment using.
AP Statistics C5 D1 HW: p.285 #19-24 Quiz in 2 class days Obj: to choose a simple random sample Do Now: What is the difference between a sample and a population?
Last lecture summary Five numbers summary, percentiles, mean Box plot, modified box plot Robust statistic – mean, median, trimmed mean outlier Measures.
Sources of Error In Sampling
Sampling.
Sources of Bias 1. Voluntary response 2. Undercoverage 3. Nonresponse
Bias On-Level Statistics.
Inference for Sampling
Chapter 4 Sampling Design.
MA151 Lecture 2: Sampling methods
Sampling Population – any well-defined set of units of analysis; the group to which our theories apply Sample – any subset of units collected in some manner.
Chapter 2.1 Research Methods
Presentation transcript:

4.2 Statistics Notes What are Good Ways and Bad Ways to Sample?

Sampling Frame and Design  Sampling Frame – list of all subjects in the population from which to sample  Sampling design – method of selecting subjects for the sample  It is important that the subjects in the sample are representative of the subjects in the population

Simple Random Sampling (SRS)  Simple Random Sampling (SRS) each subject in the population has the same chance of being selected for the sample  A SRS will usually give you a sample that is representative of the population

Random Number Tables  An easy way to conduct a simple random sample is to use a table of random numbers or random numbers generated from a computer.  To use a random number table, use the following steps:  1. Number all subjects in the sampling frame, using numbers of the same length (ex: 1 could be 01)  2. Select numbers of that length from the random number table  3. Include in the sample those subjects whose numbers match the numbers selected from the random number table  Turn to p.157 in the textbook

Methods of Collecting Data in Sample Surveys MethodAdvantagesDisadvantages Personal Interview Subjects are more likely to participate High Cost Subjects are less likely to answer sensitive questions Telephone Interview Low cost Shorter interview Subjects are less likely to participate Self- Administered Questionnaire Low cost Subjects are less likely to participate

Margin of Error  The accuracy of the results of the sample depends on the sample size  The larger the sample, the more accurate your results, the smaller your margin of error  We will learn detailed calculations for specific situations in later chapters, but for now we will estimate the margin of error for a simple random sample to be: 1/√n 1/√n

Bias  Bias – results from the sample are not representative of the population  Types of Bias  Sampling Bias – bias resulting from the sampling method  Nonresponse bias – subjects willing to participate may be different than subjects not willing to participate  Response bias – subject gives an incorrect response (lying, misleading questions)

Convenience Sample  Convenience Sample – when one samples those that are convenient (not random)  A convenience sample is usually not representative of the population and should be avoided if possible

1936 Literary Digest Poll  In 1936, the Literary Digest conducted a poll to see who would win the presidential election between FDR and Alf Landon.  They sent out 10 million surveys to addresses they got from telephone directories, car registrations, and country club memberships.  They got back 2.7 million surveys that predicted Alf Landon would win with 57% of the vote.  In actuality he only received 37% of the vote and FDR won by a landslide. The Literary Digest went out of business shortly thereafter.  What was wrong with the way they sampled?