Secondary outcomes in pharmacological and behavioral treatment trials standardized or tailored to intervention type? Kevin M. Gray, M.D. Professor and.

Slides:



Advertisements
Similar presentations
Innovation data collection: Advice from the Oslo Manual South East Asian Regional Workshop on Science, Technology and Innovation Statistics.
Advertisements

Discuss strategies to build resilience. Resilience programs typically target the promotion of protective factors such as parenting skills, academic tutoring.
Comparator Selection in Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)
Benefits and limits of randomization 2.4. Tailoring the evaluation to the question Advantage: answer the specific question well – We design our evaluation.
Challenges and Successes Treating Adolescent Substance Use Disorders Janet L. Brody, Ph.D. Center for Family and Adolescent Research (CFAR), Oregon Research.
Program Evaluation: Entre Familia. Entre Familia: Program Description  Gender- and culture-specific residential treatment program (6 to 12 months duration,
How to Develop the Right Research Questions for Program Evaluation
Community Input Discussions: Measuring the Progress of Young Children in Massachusetts August 2009.
Research Problem.
Striving for Quality Using continuous improvement strategies to increase program quality, implementation fidelity and durability Steve Goodman Director.
A substance used in the diagnosis, treatment, or prevention of a disease or as a component of a medication A substance used in the diagnosis, treatment,
1 Introduction to Grant Writing Beth Virnig, PhD Haitao Chu, MD, PhD University of Minnesota, School of Public Health December 11, 2013.
HSA 171 CAR. 1436/ 7/4  The results of activities of an organization or investment over a given period of time.  Organizational Performance: ◦ A measure.
Raymond F. Anton, MD for The COMBINE Study Research Group
Children and Families Act OutcomesWorkshop SEN & disability conference Philippa Stobbs, Council for Disabled Children.
Rigorous Quasi-Experimental Evaluations: Design Considerations Sung-Woo Cho, Ph.D. June 11, 2015 Success from the Start: Round 4 Convening US Department.
EXPERIMENTAL EPIDEMIOLOGY
Against the Grain: Adolescent Help-Seeking as a Path to Adult Functional Independence Introduction David E. Szwedo David E. Szwedo 1,2,
Introduction Results and Conclusions On counselor background variables, no differences were found between the MH and SA COSPD specialists on race/ethnicity,
DrugEpi 3-5 Fundamentals of Study Design Module 3 Introduction Content Area: Analytical Epidemiology Essential Question (Generic): Is there an association.
Pilot and Feasibility Studies NIHR Research Design Service Sam Norton, Liz Steed, Lauren Bell.
Erik Augustson, PhD, National Cancer Institute Susan Zbikowski, PhD, Alere Wellbeing Evaluation.
Research for Patient Benefit Preparing a research proposal What makes a good proposal? Professor Scott Weich, Panel Chair.
The NIMH Research Domain Criteria Initiative (RDoC): A Framework for Psychopathology Research February 20, 2014 Jill Heemskerk, PhD Deputy Director, Division.
Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 10. Evaluation.
PRAGMATIC Study Designs: Elderly Cancer Trials
Researching Innovation.  By definition, an innovation means that you are testing out something new to see how effective it is.  This also means that.
POMH-UK Topic 2e supplementary audit Screening for metabolic side effects of antipsychotic drugs in patients under the care of assertive outreach teams.
© Crown copyright 2007 Study Plus training. © Crown copyright 2007 Aims of Study plus To accelerate the progress of pupils who are not on track to attain.
Myotonic Dystrophy Research: What’s Next
Incorporating Evaluation into a Clinical Project
Predictors of study retention in drug abuse treatment trials
Patient Focused Drug Development An FDA Perspective
Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 3. Session 9. Periodic data collection methods.
Classroom Assessment A Practical Guide for Educators by Craig A
MRC’s Translational Research Funding
The scope and focus of the Research
Hadley KEY SLIDES 9-5 7:45-8:15 PM
Working with Adolescents: Additional Considerations
Reducing bias in randomised controlled trials involving therapists:
APHA 135th Annual Meeting and Expo November 3-7, 2007 Washington, DC
Intervention Development in Elderly Adults (IDEA)
Supplementary Table 1. PRISMA checklist
Babson, et al., in progress Isabella Romero
Sample Size Estimation
Community Mental Health Authority of Clinton, Eaton, Ingham Counties
MaryCatherine Jones, MPH, Public Health Consultant, CVH Team
Child Outcomes Summary (COS) Process Module
Telling Your SSIP Story
Community Input Discussions:
11/20/2018 Study Types.
Unit 1 Lesson 4: Surveys, Experiments, and Observational Studies
USE OF COMPOSITE VARIABLES: AN EPIDEMIOLOGICAL PERSPECTIVE
McGraw-Hill/Irwin Copyright © 2008 by The McGraw-Hill Companies, Inc. All rights reserved.
DAY 2 Single-Case Design Drug Intervention Research Tom Kratochwill
Although adverse childhood events may account for only a small proportion of the current obesity epidemic in the U.S. (Alvarez et al., 2007), risk of obesity.
Performance Improvement Projects: PIP Library
ABAB Design Ethical considerations
Provider Perspective Shift
Evaluating the Evidence
How to apply successfully to the NIHR HTA Board?
NAMRATA TIWARI-12 NISHANT KUMAR-06 Research Problem 1.
Standard for Teachers’ Professional Development July 2016
Group Experimental Design
Child Outcomes Summary (COS) Process Module
Treatment for PTSD and SUD:
DAY 2 Single-Case Design Drug Intervention Research Tom Kratochwill
Future Directions – Big Data Team
Misc Internal Validity Scenarios External Validity Construct Validity
Presentation transcript:

Secondary outcomes in pharmacological and behavioral treatment trials standardized or tailored to intervention type? Kevin M. Gray, M.D. Professor and Director of Child and Adolescent Psychiatry Medical University of South Carolina

Disclosures Research support from National Institutes of Health

A few considerations What stage of investigation? What kind of treatment? What kind of trial? What target population? What do we think is important?

What stage of investigation?

What stage of investigation? We typically think of earlier-stage trials being more focused on mechanistic outcomes, observed in highly controlled settings Later-stage trials are then more focused on whether those mechanistic outcomes translate to meaningful substance use and/or related functional outcomes in the (complicated / messy / noisy) real world Is there a way to consider both mechanistic and functional outcomes across stages of trials?

What kind of treatment? Could be parsed by pharmacological/somatic versus behavioral/psychosocial Could be parsed by behavioral or neurobiological mechanism Mechanism has bearing on both “big picture” and “small picture” outcomes

What kind of trial? Must consider outcomes that can be feasibly attained, observed, and collected within the context of the trial’s design (length of treatment, setting, etc.) Must be mindful of participant and staff burden, and the liabilities of trying to collect too many outcomes (do we image everybody, collect blood samples at all visits, etc.?)

What target population? What are meaningful mechanistic and functional outcomes within a particular population? May be quite different to consider the most important outcomes across populations CUD + co-occurring psychiatric disorders CUD + co-occurring SUDs Adolescents, young adults, older adults, etc.

What do we think is important? Ultimately, outcome selection should be guided by what is judged to be important in observing/ detecting response to a treatment What constitutes a meaningful response? Mechanistic Cannabis use Functional

So . . . STANDARDIZED or TAILORED outcomes?

STANDARDIZED outcomes Benefits Allows for comparison across trials, meta-analyses, etc. Provides guidance for future trials Limitations May miss important markers of improvement for specific populations and/or interventions What if the standardized outcome isn’t relevant for the study’s specific target population? What if the standardized outcome does not reflect the mechanism by which the intervention is purported to work?

TAILORED outcomes Benefits Limitations If an intervention (either pharmacological or behavioral) has a known/specific mechanism, a tailored outcome would be important to measure, particularly in earlier-phase studies Limitations Impairs the potential for comparison across trials, and may hamper efforts to develop coherence for planning of future trials

STANDARDIZED + TAILORED

STANDARDIZED + TAILORED As with most things, the best approach is likely somewhere between the extremes The ideal trial would be designed to test for both standardized (across trials) outcomes and tailored (specific to purported mechanism of the intervention) outcomes The challenge is to find a way to design an overall trial that reliably allows observation and measurement of both types of outcomes (and hopefully doesn’t overburden participants with too many modes of data collection)

STANDARDIZED + TAILORED We may potentially need to study combinations of mechanistically distinct interventions (with the idea of additive or synergistic overall effects on cannabis use and/or functional outcomes) Examples might include: Treatment A to reduce withdrawal severity Treatment B to reduce relapse drug seeking/craving Treatment C to enhance skills to avoid and manage high-risk situations for cannabis use

STANDARDIZED + TAILORED In these cases, we may test for tailored outcomes at different stages/phases of the trial, but still aim for an overall standardized outcome This may become more cumbersome/complicated if varying exposure to the various component treatments (i.e., a 2×2 factorial design)

But how the heck do we pull this off? If we determine a list of standardized + tailored outcomes, we ideally will power the trial to test the most ambitious outcome, and then secondarily be able to test for the less challenging/ambitious outcomes May fall short based on limitations in funding, time, etc., but this may be reasonable, particularly in earlier-stage or proof-of-concept trials In these cases we ought to at least test for effect sizes and variability in relevant outcomes to inform future trials

Questions / Discussion