Political Science 30: Political Inquiry Drawing a Good Sample.

Slides:



Advertisements
Similar presentations
Section 1-4 Data Collection & Sampling Techniques.
Advertisements

STAT Section 5 Lecture 3 Professor Hao Wang University of South Carolina Spring 2012.
Confidence Intervals for Population Means
Chapter 7: Data for Decisions Lesson Plan
AP Stat Trivia Review.
GATHERING DATA Chapter Experiment or Observe?
* Students will be able to identify populations and samples. * Students will be able to analyze surveys to see if there is bias. * Students will be able.
Drawing Samples in “Observational Studies” Sample vs. the Population How to Draw a Random Sample What Determines the “Margin of Error” of a Poll?
SamplingSampling. Samples and populations Sample: –the participants actually included in a study Population: –the larger group from which the sample is.
JAMM 444: Public Opinion Survey methodology Comparing survey methods Planning your surveys.
Copyright ©2005 Brooks/Cole, a division of Thomson Learning, Inc. How to Get a Good Sample Chapter 4.
Austin Cole February 16, Outline I. Sampling a. Bad Sampling Methods b. Random Sampling II. Experiments III. Applying Sample to a Population IV.
Producing Data: Sampling BPS chapter 8 © 2006 W.H. Freeman and Company.
Copyright © 2011 Pearson Education, Inc. Samples and Surveys Chapter 13.
Voluntary Sampling  Voluntary samples are surveys where members of a population are invited to respond voluntarily.  Responses are not mandatory.
Chapter 4 Gathering data
Qualitative and Quantitative Sampling
From Sample to Population Often we want to understand the attitudes, beliefs, opinions or behaviour of some population, but only have data on a sample.
4.2 Statistics Notes What are Good Ways and Bad Ways to Sample?
BPS - 5th Ed. Chapter 81 Producing Data: Sampling.
–Population: The collection of objects or individuals. N-value: The number of individuals in the population. N-value: The number of individuals.
Where Do Data Come From? ● Conceptualization and operationalization of concepts --> measurement strategy --> data. ● Different strategies --> different.
AP Statistics Section 5.1 Designing Samples. In an observational study, we simply observe individuals and measure variables, but we do not attempt to.
THE WHO AND HOW. Opinion Polling. Who does polling? News organizations like CNN, Fox News, ABC, and NBC. Polling organizations like Rasmussen, Gallup,
Copyright © 2009 Pearson Education, Inc. Publishing as Longman. The 1936 Literary Digest Presidential Election Poll Case Study: Special Topic Lecture Chapter.
Statistics: Concepts and Controversies What Is a Confidence Interval?
The 6 Sample Survey Methods September 26, So far, we have discussed two BAD methods… 1. Voluntary Response Method People who respond usually have.
Homework Read pages Page 467: 1 – 16, 29 – 34, 37, 38, 59.
Chapter 12 Designing Good Samples. Doubting the Holocaust? An opinion poll conducted in 1992 for the American Jewish Committee asked: Does it seem possible.
Measurements, Mistakes and Misunderstandings in Sample Surveys Lecture 1.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 4 Gathering Data Section 4.2 Good and Poor Ways to Sample.
DATA COLLECTION METHODS Sampling
Introducing Communication Research 2e © 2014 SAGE Publications Chapter Eight Sampling: Who, What and How Many?
Sampling Design Notes Pre-College Math.
Section 2-1 Samples, Good and Bad. Remember: We select a sample in order to get information about some population (entire group of individuals about which.
Chapter 7: Data for Decisions Lesson Plan Sampling Bad Sampling Methods Simple Random Samples Cautions About Sample Surveys Experiments Thinking About.
Section 1.2 Random Samples 1.2 / 1. Sampling techniques Simple Random Sampling Stratified Sampling Systematic Sampling Cluster Sampling Convenience Sampling.
Agresti/Franklin Statistics, 1 of 56 Chapter 4 Gathering data Learn …. How to gather “good” data About Experiments and Observational Studies.
Agresti/Franklin Statistics, 1 of 33 Chapter 1 Statistics: The Art and Science of Learning from Data Learn …. What Statistics Is Why Statistics Is Important.
Lecture # 6:Designing samples or sample survey Important vocabulary Experimental Unit: An individual person,animal object on which the variables of interest.
BPS - 5th Ed. Chapter 81 Producing Data: Sampling.
Section 2.1: Taking a Good Sample. Sampling Design  Design of a sample refers to the method used to collect the data.  A proper sampling design must.
Sampling. Population vs. Sample Population – The entire group you want to study Sample – The portion of the population you select to study Parameter –
Producing Data: Sampling BPS chapter 8 © 2010 W.H. Freeman and Company.
Sampling Techniques Governments, companies, and news agencies often want to know the public’s opinion on pertinent questions. Elections offer an excellent.
The Language of Sampling Lecture 6 Sections 2.1 – 2.4 Fri, Jan 26, 2007.
Statistics 100 Lecture Set 2. Lecture Set 2 Chapter 2 … please read Will be doing chapter 3 in the next lecture set Some suggested problems: –Chapter.
Unit 7: Producing Data Mr. Evans Statistics Part 2.
Chapter 3 Producing Data. Observational study: observes individuals and measures variables of interest but does not attempt to influence the responses.
Chapter 7 Data for Decisions. Population vs Sample A Population in a statistical study is the entire group of individuals about which we want information.
The Language of Sampling Lecture 6 Sections 2.1 – 2.4 Fri, Aug 31, 2007.
Chapter 12 Vocabulary. Matching: any attempt to force a sample to resemble specified attributed of the population Population Parameter: a numerically.
SWBAT: Identify and select a Simple Random Sample (SRS) Do Now: Complete the survey and the questions to follow.
Bias in Survey Sampling. Bias Due to Unrepresentative Samples A good sample is representative. This means that each sample point represents the attributes.
Plan for Today: Chapter 1: Where Do Data Come From? Chapter 2: Samples, Good and Bad Chapter 3: What Do Samples Tell US? Chapter 4: Sample Surveys in the.
Sampling Chapter 5. Introduction Sampling The process of drawing a number of individual cases from a larger population A way to learn about a larger population.
MATH Section 6.1. Sampling: Terms: Population – each element (or person) from the set of observations that can be made Sample – a subset of the.
Political Science 30: Political Inquiry. The Magic of the Normal Curve Normal Curves (Essentials, pp ) The family of normal curves The rule of.
 A popular magazine that began presidential public opinion polls in 1916  One of the first public opinion polls in the US  Was hailed as “amazing right”
 Confidence Intervals  Around a proportion  Significance Tests  Not Every Difference Counts  Difference in Proportions  Difference in Means.
Collecting Data Backbone of Statistics. It’s all about the Vocabulary!  Population: the entire group that we are interested in  Sample: some.
Political Science 30: Political Inquiry
The Language of Sampling
Producing Data: Sampling
Chapter 12 part 1 Sample surveys.
Select and draw conclusions from samples
Lesson#1 Gathering Data
Political Science 30 Political Inquiry
MATH 2311 Section 6.1.
Presentation transcript:

Political Science 30: Political Inquiry Drawing a Good Sample

Finishing Up Polling Random Sampling Margin of Error Nonrandom methods of drawing a sample or HOW NOT TO DO A POLL Convenience sample Voluntary response sample

How to Draw a Random Sample A simple random sample gives all members of the population an equal chance to be drawn into the sample. Draw names out of a hat, a really big hat Label every case in the population with a number, then draw some random numbers In a telephone poll, random digit dialing uses a random number generator to get even those with unlisted numbers.

How to Draw a Random Sample WARNING! Random sampling and random assignment are different! Random sampling selects which cases in your population you will study. Random assignment starts with a sample, then divides it into two or more groups. Observational studies may use random sampling, but not random assignment, and this hurts their internal validity.

How to Draw a Random Sample Sampling bias is consistent deviation of the sample statistic from the parameter Sampling variability describes how far apart statistics are over many samples.

What Determines the “Margin of Error” of a Poll? If we have drawn a truly random sample: Sample Population Proportion + Proportion = Random Error

What Determines the “Margin of Error” of a Poll? The margin of error is calculated by:

What Determines the “Margin of Error” of a Poll? In a poll of 505 likely voters, the Field Poll found 55% support for the recall.

What Determines the “Margin of Error” of a Poll? The margin of error for this poll was plus or minus 4.4 percentage points. This means that if we took many samples using the Field Poll’s methods, 95% of the samples would yield a statistic within plus or minus 4.4 percentage points of the true population parameter.

Nonrandom methods of drawing a sample (Note: These are Bad!) A voluntary response sample includes the members of the population who voice their desire to be included in the sample “Literary Digest Poll” mailed 10 million ballots to magazine readers to volunteer participate in their Presidential election survey. 2 million surveys came back, predicting that FDR would lose 43%-57%. FDR won, 61%-39%.

Nonrandom methods of drawing a sample (Note: These are Bad!) A convenience sample studies the segment of the population that is easiest for the researcher to reach. Polls only of people who have telephones. (Less of a problem than it used to be). Studies by college students of their dormmates. Internet polls at or

Example: Internet Polls Some internet polls ask the opinions of those who have logged on to: More professional internet polls advertise with banners on a variety of web sites to recruit people into their sample.

Example: Internet Polls “Knowledge Networks” is an internet- administered survey that recruited its sample by using random digit dialing. To give those without an internet connection the chance to participate, they offered a free “Web TV” console to participants. Those in the 50,000 person sample are given the chance to participate in polls about subjects like hard liquor or politics.

Surveys of a Sub-Population Many researchers do not want to generalize to the population of “all Americans.” They begin by defining the population that they want to study, such as “likely voters,” “Asian-Americans voters,” or “Lesbian, Gay, Bisexual, and Transgendered California adults.”

Surveys of a Sub-Population Option #1. Take a random sample of the entire population, ask the respondent if he or she fits into the category, and then continue the interview if you find a match Option #2. Begin with a list that approximates the entire subpopulation (registered voters with Asian surnames) and then take a random sample.