Eyal Shahar, MD, MPH Professor (credit to Doron Shahar, BS) December 5, 2013.

Slides:



Advertisements
Similar presentations
DESIGNING EXPERIMENTS
Advertisements

MAT 1000 Mathematics in Today's World. Last Time 1.What does a sample tell us about the population? 2.Practical problems in sample surveys.
Placebo and experimenter effects
Objectives (BPS chapter 9)
The Experimental Method
Research Methods in Psychology
Statistical Methods Lecture 30
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
OBJECTIVE 6: STUDENTS WILL DEMONSTRATE UNDERSTANDING BY EXPLAINING EXPERIMENTATION METHODS EXPERIMENTS.
Thoughts on ratio variables and other algebraic manipulations of raw variables (Second draft) DAG-perspective Eyal Shahar April 2008.
How Science Works Glossary AS Level. Accuracy An accurate measurement is one which is close to the true value.
EXPERIMENTS AND OBSERVATIONAL STUDIES Chance Hofmann and Nick Quigley
The Experimental Method in Psychology Explaining Behaviour
Introduction to the Design of Experiments
Chapter 2 Research Methods. The Scientific Approach: A Search for Laws Empiricism: testing hypothesis Basic assumption: events are governed by some lawful.
Experiments and Observational Studies.  A study at a high school in California compared academic performance of music students with that of non-music.
Drug trials Learning Outcome: DESCRIBE THE USE OF OPEN LABEL, BLIND AND DOUBLE BLIND TESTS IN HUMAN TRIALS (HIGHER) AND THE USE OF PLACEBOS.
Chapter 2 Research Methods. The Scientific Approach: A Search for Laws Empiricism: testing hypothesis Basic assumption: events are governed by some lawful.
Chapter 13: Experiments and Observational Studies
Copyright © 2010 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
Experiments and Observational Studies. Observational Studies In an observational study, researchers don’t assign choices; they simply observe them. look.
Copyright © 2010 Pearson Education, Inc. Slide
Chapter 13 Notes Observational Studies and Experimental Design
Chapter 13 Observational Studies & Experimental Design.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 13 Experiments and Observational Studies.
Producing data: experiments BPS chapter 8 © 2006 W. H. Freeman and Company.
CHAPTER 6- DESIGNING EXPERIMENTS. SECTION 6.1 Experiment vs. Observational Study (again!) * Experiment = treatment applied to all subjects * Obs. Study.
Research Study Design. Objective- To devise a study method that will clearly answer the study question with the least amount of time, energy, cost, and.
Slide 13-1 Copyright © 2004 Pearson Education, Inc.
Experimental Design. Anecdotal Evidence (and worse!)… What’s wrong with this? Anecdotal Evidence: based on haphazardly selected individual cases. No.
LT 4.2 Designing Experiments Thanks to James Jaszczak, American Nicaraguan School.
5.2 Designing Experiments
Grobman, K. H. "Confirmation Bias." Teaching about. Developmentalpsychology.org, Web. 16 Sept Sequence Fits the instructor's Rule? Guess.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 4 Gathering Data Section 4.3 Good and Poor Ways to Experiment.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
WHS AP Psychology Research Methods: Experiments. I CAN ANSWER How do psychologists use the scientific method to study behavior and mental processes? What.
Designing Experiments Section Starter In late 1995, a Gallup survey reported that Americans approved sending troops to Bosnia by 46 to 40.
Warm Up 2/20/2014. Principles of Experimental Design (CRR) 1)Control the effects of lurking variables on the response, most simply by comparing.
Lecture PowerPoint Slides Basic Practice of Statistics 7 th Edition.
5.2 Day 2: Designing Experiments
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
Introduction Studies are important for gathering information. In this lesson, you will learn how to effectively design a study so that it yields reliable.
Special Topics Section 7.6. Observational Study An observational study does not try to manipulate the environment (such as by assigning treatments to.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 4 Designing Studies 4.2Experiments.
Chapter Five Vocabulary. Page 1 (1) A Census of the Population This would be ideal – we would actually KNOW the values of the parameters! Really hard.
Silent Do Now (5 minutes) *Before you begin, grab a new weekly sheet and take out your homework!  An opinion poll calls 2000 randomly chosen residential.
Unit 4: Gathering Data LESSON 4-4 – EXPERIMENTAL STUDIES ESSENTIAL QUESTION: WHAT ARE GOOD WAYS AND POOR WAYS TO EXPERIMENT?
Statistics 100 Lecture Set 4. Lecture Set 4 Chapter 5 and 6 … please read Read Chapter 7 … you are responsible for all of this chapter Some suggested.
Ten things about Experimental Design AP Statistics, Second Semester Review.
Experiments Textbook 4.2. Observational Study vs. Experiment Observational Studies observes individuals and measures variables of interest, but does not.
CHAPTER 4 Designing Studies
Research Methods: Experiments
Evidence-Based Medicine Appendix 1: Confidence Intervals
CHAPTER 4 Designing Studies
Design of Experiments.
CHAPTER 4 Designing Studies
Psych Immersions? (Connections to something else in psychology, another text, or your world.) Critical questions from the reading?
Ten things about Experimental Design
Chapter 4: Designing Studies
CHAPTER 4 Designing Studies
Statistical Reasoning December 8, 2015 Chapter 6.2
Introduction to the Design of Experiments
CHAPTER 4 Designing Studies
1.1.2 The Scientific Method.
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
Presentation transcript:

Eyal Shahar, MD, MPH Professor (credit to Doron Shahar, BS) December 5, 2013

Outline Principles of causal diagrams What is “placebo”? What is the “placebo effect”? The expectation effect rather than the placebo effect Previous study designs Suggested study design

Principles of causal diagrams Name the variables T OFFERED T TAKEN D … Draw postulated arrows (from cause to effect) Depict theories of confounding bias Depict theories of effect modification

Example D Q R q r T OFFERED T TAKEN C Confounder Modifier

Example: an elaborated diagram* T OFFERED D E R B b t ( TAKEN ) t ( OFFERED ) b T TAKEN e Blinding status Expectation All possible causes of the offered treatment *Note theories of effect modification

A successful double-blinded randomized trial T OFFERED D E R B t ( TAKEN ) t ( OFFERED ) B =blinded: null effect T TAKEN e = blinded

Outline Principles of causal diagrams What is “placebo”? What is the “placebo effect”? The expectation effect rather than the placebo effect Previous study designs Suggested study design

What is “placebo”? Too many definitions to cover All allude to “effect” or “lack of effect” Yet, most cannot be encoded in a causal diagram A VERY BAD SIGN!

What is “placebo”? “A treatment that does not objectively affect the outcome” A meaningless adverb No such thing as “objectively affect” No such thing as “subjectively affect” Can’t depict in a diagram Not rigorous enough for science

What is “placebo”? “An inert/inactive/ineffective treatment” Really? How do you know, in advance, that something doesn’t have an effect? And what about the “placebo effect”? Can’t depict in a diagram Not rigorous enough for science

What is “placebo”? “A treatment that on its own has no beneficial effect” What exactly is “on its own”? Can’t depict in a diagram Not rigorous enough for science

Placebo: a possible definition “A treatment is called placebo if the effect of that treatment (versus no treatment) is null when the patient has no particular expectation about the outcome.”

t 0 below (a value of T TAKEN ) is “placebo” T OFFERED T TAKEN D=d E t E=indifference: null effect t 0 vs. nothing

So, what is the desired definition of placebo? Who cares? Definitions are much less important than we tend to think We don’t really need the term to acquire knowledge

Outline Principles of causal diagrams What is “placebo”? What is the “placebo effect”? The expectation effect rather than the placebo effect Previous study designs Suggested study design

The placebo effect At least 6 definitions All are clear (for a change…) Can be depicted in a causal diagram Some refer to placebo Which requires a clear definition of placebo… Some do not refer to placebo at all! Can be organized in two groups

Group 1: Some effect of a treatment variable on some value of the outcome variable T TAKEN D=d E placebo vs. nothing T TAKEN D=d E = e placebo vs. nothing D=d placebo vs. nothing T OFFERED t TAKEN

Group 2: Some effect of the expectation variable on some value of the outcome variable E D=d E T TAKEN T TAKEN = placebo E D=d T TAKEN = t T TAKEN

Outline Principles of causal diagrams What is “placebo”? What is the “placebo effect”? The expectation effect rather than the placebo effect Previous study designs Suggested study design

The expectation effect T OFFERED D E R B t ( TAKEN ) t ( OFFERED ) B =blinded: null effect T TAKEN e = blinded

The expectation effect No need to mention the word “placebo” E D=d T TAKEN = t T TAKEN e The effect of expectation might vary according to the treatment taken The effect of the treatment taken might vary according to the level of expectation

Expectation: two kinds of questions Causes of expectation Effects of expectation E A B C D E W X Y Z And don’t forget the possibility of effect modification for each arrow

Outline Principles of causal diagrams What is “placebo”? What is the “placebo effect”? The expectation effect rather than the placebo effect Previous study designs Suggested study design

Previous study designs Claim to estimate the “placebo effect” Don’t estimate the same effect Don’t estimate well the expectation effect

Previous study designs Drug or placebo Neither drug nor placebo Drug Nothing Drug Placebo DrugPlacebo Drug Treatment Patient told Treatment Patient told Placebo Nothing Three arms Concealed treatment Balanced placebo design

What’s the problem? “TELLING” and “EXPECTING” are different variables Telling the patient something affects expectation, but does not fully determine expectation There are other causes of expectation: Trust Prior beliefs Education None of these designs estimates well the expectation effect

Outline Principles of causal diagrams What is “placebo”? What is the “placebo effect”? The expectation effect rather than the placebo effect Previous study designs Suggested study design

Measure expectation! T OFFERED D E R B t ( TAKEN ) t ( OFFERED ) B =blinded: null effect T TAKEN e = blinded E*E*

What is “expectation”? A single variable or multiple variables? Don’t know Have psychologists figured it out? Maybe (or maybe not) How do we measure the variable(s)? I am no expert in psychology and mental state variables

Conclusions (1) “Placebo” and “placebo effect” are vague terms Stop using them; they are poorly defined Stop using them; neither is needed to advance knowledge The “placebo” pill is made up of something. Call it by its name (its chemical composition)

Conclusions (2) Measure expectation! Study the causes and effects of expectation!! Use an observational cohort within a blinded randomized trial!!! Deal with confounding bias and explore effect- modification

Thank you Causal diagrams, the placebo effect, and the expectation effect. Shahar E, Shahar DJ. Int J Gen Med Sep 27;6:821-8 PMID: [PubMed] Free PMC ArticleFree PMC Article