6.5 Compare Surveys, Experiments, and Observational Studies p. 414 How do you accurately represent a population? What is an experimental study? What is.

Slides:



Advertisements
Similar presentations
Andrea M. Landis, PhD, RN UW LEAH
Advertisements

Do you think Research in psychology is Important? Why or why not?
Chapter 12: Statistics and Probability
Stats: Modeling the World
Data Gathering Techniques
7-3F Unbiased and Biased Samples
Splash Screen. Lesson Menu Five-Minute Check (over Chapter 11) Then/Now New Vocabulary Example 1:Real-World Example: Classify a Random Sample Example.
The number of minutes each of 26 students in a class spent to complete an obstacle course is shown below. 5,2,5,5,8,12,6,7,5,5,6,5,5,5,6,10,7,5,5,7,5,7,5,7,6,6.
Experiments and Observational Studies.  A study at a high school in California compared academic performance of music students with that of non-music.
Psychology and Scientific Research. Experimental Science Definition: inquiry in seeking facts and the search for truth through testing of theories and.
Warm Up Lesson Presentation Lesson Quiz
Intimate Relationships © 2010, W. W. Norton & Company, Inc. Thomas N. Bradbury Benjamin R. Karney Tools for Studying Intimate Relationships Chapter 2.
Chapter One: Instructions, History, and Research Methods
MR. GONZALEZ ALGEBRA 2 Intro to Statistics. Population and Sample What’s the difference?  A population is all the members of a set.  A sample is part.
Pg Exploratory data analysis describes what data say by using graphs and numerical summaries. What if we want to ask a large group of individuals.
Evaluating a Research Report
The Research Enterprise in Psychology
Warm-Up Aug. 28th Grab a bias worksheet off the stool and begin reading the scenarios. Also make sure to grab other materials (workbook, spiral.
Identify the population and the sample.
Part III Gathering Data.
Research Methods in Psychology Group Activity Friday August 5, 2011.
MDM4U - Collecting Samples Chapter 5.2,5.3. Why Sampling? sampling is done because a census is too expensive or time consuming the challenge is being.
Lesson  Rebecca and Tova have math class right after lunch.  Rebecca always eats a hot lunch on days when she has an exam, because she has a theory.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 4 Gathering Data Section 4.3 Good and Poor Ways to Experiment.
Thinking About Psychology: The Science of Mind and Behavior.
Defining Success Understanding Statistical Vocabulary.
Module 2 Research Strategies.
SAMPLING METHODS. Remember: How do we pick our sample? 6 main kinds of sampling The kind of sampling you choose depends on the type of survey you are.
Chapter 3.1.  Observational Study: involves passive data collection (observe, record or measure but don’t interfere)  Experiment: ~Involves active data.
Surveys, experiments, and observational studies
Notes.  A population is a large group of individuals you want information about.  An individual is defined to include people, animals, or objects that.
Research Strategies. Why is Research Important? Answer in complete sentences in your bell work spiral. Discuss the consequences of good or poor research.
Module 2 Research Strategies. Scientific Method A method of learning about the world through the application of critical thinking and tools such as observation,
Biology 1.3 The Scientific Process. Scientific Process  Steps of the Scientific Process 1. Identify the Problem 2. Gather information 3. Form Hypothesis.
Introduction Studies are important for gathering information. In this lesson, you will learn how to effectively design a study so that it yields reliable.
Collection of Data Jim Bohan
CHAPTER 9 Producing Data: Experiments BPS - 5TH ED.CHAPTER 9 1.
Holt McDougal Algebra 2 Surveys, Experiments, and Observational studies How do I focus on the commonalities and differences between surveys, experiments,
The student council wants students to help decide on a theme for a costume dance. Students can choose one of the councils three ideas from the options.
Types of Bias How to pick the right sample. What is bias? Bias is any inconsistencies in using a sample to make inferences about the entire population.
Module 2 Research Strategies. Scientific Method A method of learning about the world through the application of critical thinking and tools such as observation,
Types of Samples. Samples Population – the main group or set from which observations or opinions can be made Sample – a small part of a population from.
Producing Data: Experiments BPS - 5th Ed. Chapter 9 1.
We’ve been limited to date being given to us. But we can collect it ourselves using specific sampling techniques. Chapter 12: Sample Surveys.
4.1 Statistics Notes Should We Experiment or Should We Merely Observe?
Unit 4: Gathering Data LESSON 4-4 – EXPERIMENTAL STUDIES ESSENTIAL QUESTION: WHAT ARE GOOD WAYS AND POOR WAYS TO EXPERIMENT?
Statistics I ( 2-1). What is Data? Consist of information coming from observations, counts, measurements, or responses. “People who eat three daily.
MATH Section 6.1. Sampling: Terms: Population – each element (or person) from the set of observations that can be made Sample – a subset of the.
Psychology as a Science. Scientific Method  How is it used in psychology? It helps us separate true claims about the world from mere opinion It helps.
Experiments Textbook 4.2. Observational Study vs. Experiment Observational Studies observes individuals and measures variables of interest, but does not.
Chapter 29 Conducting Market Research. Objectives  Explain the steps in designing and conducting market research  Compare primary and secondary data.
SAMPLING METHODS UNIT QUESTION: How do you use probability to make plans and predict for the future? Today’s Question: How do we take a random sample,
Holt McDougal Algebra 2 Surveys, Experiments, and Observational studies Warm Up Identify the population and the sample. 1. Fifty teenagers are randomly.
CREATING A SURVEY. What is a survey questionnaire? Survey questionnaires present a set of questions to a subject who with his/her responses will provide.
Collecting Data Backbone of Statistics. It’s all about the Vocabulary!  Population: the entire group that we are interested in  Sample: some.
What Is Statistics? Statistics is the science concerned with developing and studying methods for collecting, analyzing, interpreting and presenting.
Splash Screen.
Learning Goal: (S-IC.B.3)
6.5 Compare Surveys, Experiments, and Observational Studies
Homework Log Thurs 5/26 Lesson 11 – 8 Learning Objective:
8-3 Warm Up Lesson Presentation Lesson Quiz
Samples, Experimental , & Observational Studies
Samples, Experimental , & Observational Studies
Experimental Design.
Experimental Design.
MATH 2311 Section 6.1.
8-3 Warm Up Lesson Presentation Lesson Quiz
Samples, Experimental , & Observational Studies
Randomization and Bias
Samples and Surveys population: all the members of a set sample: a part of the population convenience sample: select any members of the population who.
Presentation transcript:

6.5 Compare Surveys, Experiments, and Observational Studies p. 414 How do you accurately represent a population? What is an experimental study? What is an observational study?

ANSWER Self-selected; biased; the results show only the feelings of students who volunteer for the survey. 1. Identify the type of sample described. Then tell if the sample is biased. Explain your reasoning. A school newspaper posts an online survey on their website about the food served in the cafeteria. They present the results of the students who respond.

ANSWER Systematic; unbiased; the sample is representative of the shoppers. 2. Identify the type of sample described. Then tell if the sample is biased. Explain your reasoning. A grocery store wants customers to rate their customer service. The store manager surveys every twentieth customer leaving the store during the day.

Survey Questions Poorly designed questions may not accurately reflect the opinions or actions of those being surveyed. Biased questions- Biased questions--questions that are flawed in a way that leads to inaccurate results.

Biased Questions biased Questions may be biased in the following ways:  The wording of the question may encourage or pressure the respondent to answer in a particular way.  The question may be perceived as too sensitive to answer truthfully.  The questions may not provide the respondent with enough information to give an accurate opinion.  The order the questions are asked.  Respondents giving answers they believe will please the questioner.

Tell why the question may be biased or otherwise introduce bias into the survey. Describe a way to correct the flaw. a. This question assumes that the respondent is familiar with the proposal. To get accurate results that lead to valid conclusions, state the proposal clearly using neutral language before asking the question.

b. Tell why the question may be biased or otherwise introduce bias into the survey. Describe a way to correct the flaw. Patients who brush less than twice per day or do not floss daily may be afraid to admit this since the dentist is asking the question. One improvement would be to have patients answer questions about dental hygiene on paper and put the paper anonymously into a box.

Experimental Studies experimental study An experimental study imposed a treatment on individuals in order to collect date on their response to the treatment.  Treatment may be a medical treatment, or it can be any action that might affect a variable in the experiment. (ex: adding methanol to gasoline and measuring its effect on fuel efficiency.)

Observational Studies observational study An observational study observes individuals and measure variables without controlling the individuals or their environment.  It may be difficult to control or isolate the variable being studied.  It may be unethical to subject people to a certain treatment or to withhold it from them.

Determine whether each situation is an example of an experiment or an observational study. Explain. a. A researcher asks college students how many hours of sleep they get on an average night and examines whether the number of hours of sleep affects students’ grades. The researcher gathers data without controlling the individuals or applying a treatment. The situation is an observational study.

Determine whether each situation is an example of an experiment or an observational study. Explain. b. A Parks Department employee wants to know if latex paint is more durable than non-latex paint. She has 50 park benches painted with latex paint and has 50 park benches painted with non-latex paint. A treatment (painting benches with latex paint) is applied to some of the individuals (benches) in the study. The situation is an experiment.

Tell whether the survey question below may be biased or otherwise introduce bias into the survey. Explain. 1. “Do you, like most people your age, enjoy watching the latest music videos?” This question may be biased because a respondent may feel pressured to answer a certain way. By answering “no,” a respondent may feel as if he or she is not like most people of the same age.

Determine whether the situation described in the research summary shown at the right is an example of an experiment or an observational study. Explain. 2. Experiment; a treatment (use of a new Web site) is imposed on some individuals (Web site users).

Controlled Experiments controlled experiment In a controlled experiment, two groups are studied under identical conditions with the exception of over variable.  Control group  Control group—a group under ordinary conditions.  Treatment group  Treatment group—a group that is subjected to the treatment.

Randomized Comparative Experiment randomized comparative experiment In a randomized comparative experiment, individuals are randomly assigned to the control group or the treatment group. The comparison of the control group and the treatment group makes it possible to determine any effects of the treatment. Randomization minimizes bias and produces groups of individuals that are theoretically similar in all ways before the treatment is applied. Conclusions drawn from an experiment that is not a randomized comparative experiment may not be valid.

Determine whether the study described in the health bulletin below is a randomized comparative experiment. If it is, describe the treatment, the treatment group, and the control group. If it is not, explain why not and discuss whether the conclusions drawn from the study are valid.

The study is not a randomized comparative experiment because the individuals were not randomly assigned to a control group and a treatment group. (In fact, the study is an observational study, not an experiment, since no treatment is imposed.) SOLUTION The study’s conclusion that milk fights cavities may or may not be valid. There may be other reasons why students who chose milk had fewer cavities. For example, students who voluntarily choose milk at lunch may be more likely to have other healthy eating or dental care habits that could affect the number of cavities they have.

SOLUTION The study is a randomized comparative experiment; treatment is use of a new Web site; treatment group is individuals using the new Web site; control group is individuals using old Web site. 3. Determine whether the study described in the research summary for Guided Practice Exercise 2 is a randomized comparative experiment. If it is, describe the treatment, the treatment group, and the control group. If it is not, explain why not and discuss whether the conclusions drawn from the study are valid.

Well Designed Studies The key element of well designed studies is randomization. Notice the part randomization plays in each of the studies. Sample survey Sample survey –a random sample is selected to be surveyed from the population surveyed. Surveys do not compare groups and do not address cause and effect. Observational survey Observational survey—as possible,, random samples can be selected for the groups being studies. These studies and surveys are good to compare data from two or more groups looking for a relationship between variables. Experiment Experiment—Individuals are assigned at random to the treatment group of the control group. A well designed experiment can determine a cause-and-effect relationship.

Comparative Studies and Causality An observational study can identify correlation between variables, but not causality. Variables other than what is being measured may be affecting the results. (a vigorous exercise in older people correlates with longer life, but comparing groups only on exercise and lifespan ignores other factors, such as that people who are unhealthy to begin with may not be able to exercise vigorously. A rigorous randomized comparative experiment, by eliminating sources of variation other than the controlled variable, can make valid cause-and-effect conclusions possible.

Explain whether the following research topic is best investigated through an experiment or an observational study. Then explain how you would design the experiment or observational study. You want to know if listening to music using earphones for more than one hour per day affects a person’s hearing. SOLUTION The treatment (listening to music using earphones for more than one hour a day) may affect an individual’s hearing, so it is not ethical to assign individuals to a control or treatment group. Use an observational study.

Randomly choose one group of individuals who already listen to music using earphones for more than one hour per day. Randomly choose one group of individuals who do not listen to music using earphones for more than one hour per day. Monitor the hearing of the individuals in both groups at regular intervals. SOLUTION

6.5 Assignment Page 418, 2-8, 13-16