Addressing the Issue of Subject Confusion Due to the Use of two Visual Analog Scales in Human Abuse Potential Studies Ling Chen, Ph.D. FDA/CDER/OTS/DBVI.

Slides:



Advertisements
Similar presentations
Regulatory Clinical Trials Clinical Trials. Clinical Trials Definition: research studies to find ways to improve health Definition: research studies to.
Advertisements

Comparator Selection in Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)
A Flexible Two Stage Design in Active Control Non-inferiority Trials Gang Chen, Yong-Cheng Wang, and George Chi † Division of Biometrics I, CDER, FDA Qing.
U.S. Food and Drug Administration Notice: Archived Document The content in this document is provided on the FDA’s website for reference purposes only.
Clinical Trials Hanyan Yang
Luveris ® New Drug Application ( ) Kate Meaker, M.S. Statistical Reviewer Division of Biometrics II Kate Meaker, M.S. Statistical Reviewer Division.
 Be familiar with the types of research study designs  Be aware of the advantages, disadvantages, and uses of the various research design types  Recognize.
FPP Chapters Design of Experiments. Main topics Designed experiments Comparison Randomization Observational studies “control” Compare and contrast.
BIOE 301 Lecture Seventeen. Guest Speaker Jay Brollier World Camp Malawi.
Study Design. Study Designs Descriptive Studies Record events, observations or activities,documentaries No comparison group or intervention Describe.
Research Study Design. Objective- To devise a study method that will clearly answer the study question with the least amount of time, energy, cost, and.
Consumer behavior studies1 CONSUMER BEHAVIOR STUDIES STATISTICAL ISSUES Ralph B. D’Agostino, Sr. Boston University Harvard Clinical Research Institute.
Grobman, K. H. "Confirmation Bias." Teaching about. Developmentalpsychology.org, Web. 16 Sept Sequence Fits the instructor's Rule? Guess.
1 OTC-TFM Monograph: Statistical Issues of Study Design and Analyses Thamban Valappil, Ph.D. Mathematical Statistician OPSS/OB/DBIII Nonprescription Drugs.
1 Statistics in Drug Development Mark Rothmann, Ph. D.* Division of Biometrics I Food and Drug Administration * The views expressed here are those of the.
BIOE 301 Lecture Seventeen. Progression of Heart Disease High Blood Pressure High Cholesterol Levels Atherosclerosis Ischemia Heart Attack Heart Failure.
Welcome to Workshop #5: Accelerated Approval (AA) in Rare Diseases: Review of a White Paper Proposal Emil D. Kakkis, M.D., Ph.D. President and Founder.
EXPERIMENTAL EPIDEMIOLOGY
Biostatistics in Practice Peter D. Christenson Biostatistician Session 6: Case Study.
1 Study Design Issues and Considerations in HUS Trials Yan Wang, Ph.D. Statistical Reviewer Division of Biometrics IV OB/OTS/CDER/FDA April 12, 2007.
A Pharmacokinetic Drug Interaction Study of Drug-72 and Drug-12 Department of Mathematic & Statistics York University Yufeng Lin Xiaofeng Zhou.
Statistical Criteria for Establishing Safety and Efficacy of Allergenic Products Tammy Massie, PhD Mathematical Statistician Team Leader Bacterial, Parasitic.
Biostatistics Case Studies 2006 Peter D. Christenson Biostatistician Session 1: Demonstrating Equivalence of Active Treatments:
PROBLEM SOLVING. Definition The act of defining a problem; determining the cause of the problem; identifying, prioritizing and selecting alternatives.
Survey Methodology Reliability and Validity
Do antidepressants really work?
Evaluation of new medical school curricula: identifying and treating
Types of Research Studies Architecture of Clinical Research
Improving Adverse Drug Reaction Information in Product Labels
Clinical Trials Medical Interventions
RELIABILITY OF QUANTITATIVE & QUALITATIVE RESEARCH TOOLS
RESEARCH METHODS 8-10% 250$ 250$ 250$ 250$ 500$ 500$ 500$ 500$ 750$
Chapter 8: Inference for Proportions
Chapter 10: Comparing Two Populations or Groups
Multiple Endpoint Testing in Clinical Trials – Some Issues & Considerations Mohammad Huque, Ph.D. Division of Biometrics III/Office of Biostatistics/OPaSS/CDER/FDA.
Diacerein orphan drug development for epidermolysis bullosa simplex: A phase 2/3 randomized, placebo-controlled, double-blind clinical trial  Verena Wally,
Regulatory perspective
Clinical Trials.
Experiments and Observational Studies
One-Way Analysis of Variance: Comparing Several Means
Unit 6 - Comparing Two Populations or Groups
DR. ELIZABETH ANTHONY HUMANITIES DEPARTMENT FSTPi, UTHM
Mark Rothmann U.S. Food and Drug Administration September 14, 2018
AP Stats Check In Where we’ve been… Chapter 7…Chapter 8…
Hypothesis Testing Two Proportions
Sign critical appraisal course: exercise 2
Understanding Experiments
CHAPTER 4 Designing Studies
Chapter 18: Experimental and Quasi-Experimental Research
Experimental Research
Chapter 10: Comparing Two Populations or Groups
Chapter 10: Comparing Two Populations or Groups
Development Plans: Study Design and Dose Selection
Primary research methods
Secondary Progressive Multiple Sclerosis: What Do We Know and Where Are We Heading?
Experimental Research
Chapter 10: Comparing Two Populations or Groups
Chapter 10: Comparing Two Populations or Groups
Chapter 10: Comparing Two Populations or Groups
Chapter 10: Comparing Two Populations or Groups
Designing Experiments
Chapter 10: Comparing Two Populations or Groups
Do Now Watch the placebo effect video
Chapter 10: Comparing Two Populations or Groups
Regulatory Perspective of the Use of EHRs in RCTs
Chapter 10: Comparing Two Populations or Groups
Use of Piecewise Weighted Log-Rank Test for Trials with Delayed Effect
Gregory Levin, FDA/CDER/OTS/OB/DBIII
Sharon C. Murray, PhD JSM 29 July 2019
How Should We Select and Define Trial Estimands
Presentation transcript:

Addressing the Issue of Subject Confusion Due to the Use of two Visual Analog Scales in Human Abuse Potential Studies Ling Chen, Ph.D. FDA/CDER/OTS/DBVI www.fda.gov

Disclaimer This presentation reflects the views of the author and should not be construed to represent FDA’s views or policies.

Outline Brief introduction to human abuse potential (HAP) study Abuse potential measures used in HAP studies Example of subject confusion due to two visual analog scales (bipolar versus unipolar) Methods to prevent such confusion Remarks www.fda.gov

Human Abuse Potential Studies The primary objective of a HAP study is to provide information on the relative abuse potential of a test drug (generally a central nervous system (CNS)-active new molecule entity (NME)) in humans. Study subjects are not patients. They are recreational drug users. The design of a HAP study typically includes a Screening Phase, a Qualification Phase, a Treatment Phase, and Follow-up. The Treatment Phase is usually designed as a randomized, double-blind, placebo- and positive-controlled, crossover study. Treatments include placebo, one or two doses of the positive control and at least three doses of the test drug. If the test drug has multiple mechanisms of action that may produce a constellation of abuse-related psychoactive effects, or has a CNS-active major metabolite with a different mechanism of action, it may be appropriate to consider including a second positive control. www.fda.gov

Comparisons Claim for no abuse potential of test drug Study Validation X T1 P Y1 P T2 Y2 T3 Claim for less abuse potential of test drug compared to positive controls Dose response T1 T1 X Y1 T2 Y1 T3 Y2 T2 T3 Y2

Subjective Measures Drug Liking Visual Analog Scale (VAS) – 0-100 Bipolar Scale Question: “Do you like the drug effect you are feeling now?” 0 = “Strong disliking” ; 50 = “Neither like nor dislike”; 100 = “Strong liking” Primary Measure(s) High VAS – 0–100 Unipolar Scale Question: “How high are you now?” 0 = “None”; 100 = “Extremely” Stoned – cannabinoids Hallucinations – hallucinogens Sedation – CNS depressants Stimulated – simulants Secondary measures Overall Drug Liking VAS (bipolar) Take Drug Again VAS (bipolar) Similarity www.fda.gov

Data collection After a single dose administration, subjects will answer many questionnaires at multiple time points. Before the study started, subjects were trained to answer questions for different scales. However, during a treatment session, they may still be confused by scales, especially by bipolar and unipolar visual analog scales. www.fda.gov

Example It was a single-dose, randomized, double-blind, placebo- and positive-controlled crossover study. The primary objective was to evaluate the abuse potential of single doses of test drug (TL, TM, TH) compared to each dose of positive control (CL and CH) and placebo (P) in recreational stimulant users. Forty-eight subjects were randomized to the treatment phase. Of these, 35 subjects completed study. Primary endpoint was maximal score of Drug Liking (Drug Liking Emax). The secondary endpoints were High Emax, Energized Emax, and Good Effects Emax. Note that Drug Liking Emax was on a bipolar VAS, and three secondary endpoints were on a unipolar VAS.

Heat map display by treatment Drug Liking Emax High Emax

Continued… Good Effects Emax Energized Emax

Placebo Response? After carefully examining the data, I found that many subjects were confused by scales (unipolar versus bipolar) in this study. Among 14 subjects who had High Emax greater than 20 to placebo, 10 of these subjects had a High Emax of 50 or 51. Similar situations were also observed for Energized Emax and Good Effects Emax. A score around 50 is a possible response to test drug and positive control. We have no way to know if scores around 50 for these treatments were also due to scale confusion. www.fda.gov

Another issue Calculation of the endpoint Emax Time course profile of placebo for High VAS Data collected at multiple time points. Emax is the maximal score given a period of time. A subject only needs to be confused by the scale at one time point for this response to be the Emax of placebo for this subject. Obviously, training subjects for the scale before the study may not be sufficient to prevent the potential problem of scale confusion.

Serious consequences of “placebo responses” The “placebo responses” would reduce the mean difference between positive control and placebo, hence there may be a risk of failure for the validation test. The “placebo responses” may reduce the mean difference between test drug and placebo, and hence there may be a serious consequence of concluding no abuse potential of the test drug, when it may not be true.

Be Careful with Screen Design Screen for High VAS 1. Move cursor to 0 to begin. 2. Put “Unipolar Scale” on the screen. When subject response is near 50, as a reminder, make the “Unipolar Scale” blink, and allow the subject to change or confirm his/her selection. 3. Properly designing the test screen will improve data quality. www.fda.gov

Using color visual analog scales Drug Liking VAS 0=Strong disliking, 50=Neither like nor dislike, and 100=Strong liking Unipolar High VAS 0=None, and 100=Extremely 50

Remarks Statisticians should examine data quality before performing statistical analyses. Statisticians should also contribute to the improvement of data quality.

Thank you !