N = 1, Cross-Over Trials and Balanced Designs. N = 1 Trials Trials can be undertaken with just one participant. If the condition is a chronic relapsing.

Slides:



Advertisements
Similar presentations
Bias in Clinical Trials
Advertisements

Statistics Review – Part II Topics: – Hypothesis Testing – Paired Tests – Tests of variability 1.
Research Study Designs
Unequal Randomisation
Use of Placebos in Controlled Trials. Background The traditional ‘double-blind’ RCT uses a placebo to conceal allocation. There are a number of advantages.
Meta-analysis: summarising data for two arm trials and other simple outcome studies Steff Lewis statistician.
DESIGNING EXPERIMENTS
Sample size issues & Trial Quality David Torgerson.
Objectives (BPS chapter 9)
External Validity of Trials. Background External or ecological validity refers to whether the results of the trial can be generalised to the general clinical.
Estimating the Effects of Treatment on Outcomes with Confidence Sebastian Galiani Washington University in St. Louis.
Chapter 15 Comparing Two Populations: Dependent samples.
Objective: To test claims about inferences for two sample means from matched-pair tests or blocked samples, under specific conditions.
‘Cohort multiple RCT’ design workshop Clare Relton & Jon Nicholl School of Health and Related Research (ScHARR) Faculty of Medicine University of Sheffield.
Clinical Trials Importance in future therapies. What are the Requirements to Produce New Drugs? Drug must work significantly better than a control treatment.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
Design and Analysis of Clinical Study 12. Randomized Clinical Trials Dr. Tuan V. Nguyen Garvan Institute of Medical Research Sydney, Australia.
January 7, afternoon session 1 Multi-factor ANOVA and Multiple Regression January 5-9, 2008 Beth Ayers.
2: Types of Studies1. 2 In Chapter 2: 2.1 Surveys 2.2 Comparative Studies.
Meta-analysis & psychotherapy outcome research
Clinical Trials Hanyan Yang
Pragmatic Randomised Trials. Background Many clinical trials take place in artificial conditions that do not represent NORMAL clinical practice. Often.
Factorial Designs. Background Factorial designs are when different treatments are evaluated within the same randomised trial. A factorial design has a.
Pre-randomisation consent (Zelen’s method)
Sample Size Determination
Statistical Analysis. Purpose of Statistical Analysis Determines whether the results found in an experiment are meaningful. Answers the question: –Does.
Professor of Epidemiology and Biostatistics
Statistical Analysis Statistical Analysis
 Be familiar with the types of research study designs  Be aware of the advantages, disadvantages, and uses of the various research design types  Recognize.
Chapter 4 Gathering data
Critical Reading. Critical Appraisal Definition: assessment of methodological quality If you are deciding whether a paper is worth reading – do so on.
CHP400: Community Health Program - lI Mohamed M. B. Alnoor Research Methodology STUDY DESIGNS Observational / Analytical Studies Present: Disease Past:
Copyright © 2010 Pearson Education, Inc. Chapter 13 Experiments and Observational Studies.
Experiments and Observational Studies. Observational Studies In an observational study, researchers don’t assign choices; they simply observe them. look.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 13 Experiments and Observational Studies.
Producing data: experiments BPS chapter 8 © 2006 W. H. Freeman and Company.
Some terms Parametric data assumptions(more rigorous, so can make a better judgment) – Randomly drawn samples from normally distributed population – Homogenous.
Chapter 5: Producing Data “An approximate answer to the right question is worth a good deal more than the exact answer to an approximate question.’ John.
LT 4.2 Designing Experiments Thanks to James Jaszczak, American Nicaraguan School.
CHP400: Community Health Program - lI Research Methodology STUDY DESIGNS Observational / Analytical Studies Present: Disease Past: Exposure Cross - section.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 4 Gathering Data Section 4.3 Good and Poor Ways to Experiment.
Sample Size And Power Warren Browner and Stephen Hulley  The ingredients for sample size planning, and how to design them  An example, with strategies.
Chapter 3.1.  Observational Study: involves passive data collection (observe, record or measure but don’t interfere)  Experiment: ~Involves active data.
Adaptive randomization
Statistics: Unlocking the Power of Data Lock 5 STAT 250 Dr. Kari Lock Morgan Collecting Data: Randomized Experiments SECTION 1.3 Control/comparison group.
Essential Question:  How do scientists use statistical analyses to draw meaningful conclusions from experimental results?
통계적 추론 (Statistical Inference) 삼성생명과학연구소 통계지원팀 김선우 1.
University of East London Chronic Illness Research Team - University of East London Treating people with IBS: a randomised double-blind placebo controlled.
C HAPTER 5: P RODUCING D ATA DESIGNING EXPERIMENTS.
EXPERIMENTAL EPIDEMIOLOGY
Section 5.2 Designing Experiments. Observational Study - Observes individuals and measures variables of interest but DOES NOT attempt to influence the.
Section 10.1 Estimating with Confidence AP Statistics February 11 th, 2011.
Critical Reading. Critical Appraisal Definition: assessment of methodological quality If you are deciding whether a paper is worth reading – do so on.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 10 Comparing Two Groups Section 10.1 Categorical Response: Comparing Two Proportions.
Compliance Original Study Design Randomised Surgical care Medical care.
Hypothesis Testing Introduction to Statistics Chapter 8 Feb 24-26, 2009 Classes #12-13.
1 Chapter 11 Understanding Randomness. 2 Why Random? What is it about chance outcomes being random that makes random selection seem fair? Two things:
Silent Do Now (5 minutes) *Before you begin, grab a new weekly sheet and take out your homework!  An opinion poll calls 2000 randomly chosen residential.
1.3 Experimental Design. What is the goal of every statistical Study?  Collect data  Use data to make a decision If the process to collect data is flawed,
Uses of Diagnostic Tests Screen (mammography for breast cancer) Diagnose (electrocardiogram for acute myocardial infarction) Grade (stage of cancer) Monitor.
Objectives (Chapter 20) Comparing two proportions  Comparing 2 independent samples  Confidence interval for 2 proportion  Large sample method  Plus.
Journal Club Curriculum-Study designs. Objectives  Distinguish between the main types of research designs  Randomized control trials  Cohort studies.
Ch. 13 – Experiments and Observational Studies Part III – Gathering Data.
Chapter 5 Data Production
How to read a paper D. Singh-Ranger.
Confidence Intervals and p-values
Article & Final Reviews
Geir Smedslund, Ph.D.: Diakonhjemmet Hospital (DH)
Baseline characteristics of HPS participants by prior diabetes
Q&A – studying medicine or health-related topics at university
Presentation transcript:

N = 1, Cross-Over Trials and Balanced Designs

N = 1 Trials Trials can be undertaken with just one participant. If the condition is a chronic relapsing problem the unit of randomisation can be the ‘episode’ of treatment. For example, n = 1 trials have been used among people with rheumatoid arthritis to ‘try out’ different pain relieving drugs.

Migraine Trial A trial could be mounted to allocate a test treatment for each migraine attack. Placebo or open treatment could be used. Once the individual senses an attack coming on he contacts an independent ‘statistician’ and she gives him the allocation.

Blinding of allocation Important to blind allocation as the migraine sufferer may ask for treatment at different stages of the attack if he knew which allocation might come up. Placebo might be useful but any effect including a ‘placebo’ effect is worthwhile.

Example Some suggestion that blood sugar falls prior a migraine perhaps boosting this with glucose tablets may limit attack? Randomised to either 2 asprin or 2 asprin plus 3 gluscose tables. Outcome return to ‘normal’ activity.

Sample Size This is kept small (18 migraines) because it is paired data (within the individual) so variance is low. Low significance level p = 0.20 (treatment harmless, consequences of Type I error low, Type II error large).

Blocking? Not used although one could stratify by severity, but due to single individual could easily lead to prediction of block size. A simple allocation schedule used which is a single balanced block of 20 migraines to avoid prediction of last few allocations.

Time lines Average migraine once a month so trial is unavoidably long (approx 2 years). But dramatic effect could lead to early stopping. Sadly no such occurrence.

Cross-over trials Cross-over studies are when participants are randomly allocated to one treatment for a period of time and then ‘cross-over’ to the other treatment for the second period of time. Some HRT trials for treatment of menopausal symptoms have used cross over designs.

Advantages The advantages of a cross-over trial is that is substantially strengthens the inference of an effect as essentially one is repeating the trial twice and because data are paired within individuals usually smaller sample sizes are needed.

Disadvantages Can’t be used in many if not most circumstances. Can’t cross people over from a cancer treatment to a placebo and vice versa. Even when they are feasible there is can be a problem with ‘washout’ or contamination if the drug remains in the patients’ system will dilute the effects.

Disadvantages (cont) If there is a dramatic effect of treatment people may refuse to cross over to new treatment. For example, an RCT of dietary exclusion of foods for IBS suffers versus sham diet, found a big effect in the first period BUT those in the ‘real’ diet who benefited refused to cross to a sham diet.

Balanced Incomplete Block Designs Trials of guidelines or educational packages may use an incomplete block design.

Avoiding Hawthorne Effects One way of avoiding a Hawthorne effect is to use a balanced design whereby the ‘control’ group also gets an intervention. This can be done using a balanced design.

Example A guidelines trial might look at the effectiveness of guidelines for Angina. Just giving guidelines to GPs might affect practice irrespective of the ‘benefit’ of guidelines. We can balance this possibility by giving ‘guidelines’ say on diabetes to the control group.

Balanced Design This design will balance out the Hawthorne effects of guidelines being given to one group alone. Also allows the evaluation of two sets of guidelines for the ‘price’ of one study.

Example Verstappen et al wanted to control for the Hawthorne effect in a trial looking at an intervention for test ordering from GPs. They also undertook some methodological research to see if the ‘Hawthorne’ effect was real. Verstappen et al. J Clin Epidemiol 2004;57:1119

Design GP teams randomised into 3 arms. A tests = feedback on test ordering for cardiovascular, upper and lower abdominal problems; B tests = feedback on test ordering for: pulmonary, non-organ related and joint complaints. C = minimal intervention control group.

Results A comparison between B vs A test groups shows a small (not significant, p = 0.29) difference. B vs C shows a much bigger nearly statistically significant difference ( p = 0.07)

Conclusion The change in test ordering was exaggerated by process of research compared with the actual intervention itself. Whilst the intervention had an effect this was relatively modest.

Summary Both n of 1 trials and cross-over studies are not widely used. N of 1 trials can be combined with several individuals leading to a greater power and shorter study. Balanced designs are useful in eliminating the possibility of Hawthorne effects.