Exposure Definition and Measurement in Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)

Slides:



Advertisements
Similar presentations
Chapter 3 Introduction to Quantitative Research
Advertisements

Chapter 3 Introduction to Quantitative Research
Andrea M. Landis, PhD, RN UW LEAH
Agency for Healthcare Research and Quality (AHRQ)
Evidence-Based Medicine
Study Size Planning for Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)
Study Objectives and Questions for Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)
Protocol Development.
Comparator Selection in Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)
Introduction to the User’s Guide for Developing a Protocol for Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research.
Study Designs in Epidemiologic
Social Research Methods
Sensitivity Analysis for Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)
Some comments on the 3 papers Robert T. O’Neill Ph.D.
Estimation and Reporting of Heterogeneity of Treatment Effects in Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare.
Elements of a clinical trial research protocol
Potential Roles and Limitations of Biomarkers in Alzheimer’s Disease Richard Mayeux, MD, MSc Columbia University.
Writing a Research Protocol Michael Aronica MD Program Director Internal Medicine-Pediatrics.
SMART Experimental Designs for Developing Adaptive Treatment Strategies S.A. Murphy ISCTM, 2007.
FOUNDATIONS OF NURSING RESEARCH Sixth Edition CHAPTER Copyright ©2012 by Pearson Education, Inc. All rights reserved. Foundations of Nursing Research,
Chapter Three Research Design.
By Dr. Ahmed Mostafa Assist. Prof. of anesthesia & I.C.U. Evidence-based medicine.
Selection of Data Sources for Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)
Critical Appraisal of an Article by Dr. I. Selvaraj B. SC. ,M. B. B. S
Studying treatment of suicidal ideation & attempts: Designs, Statistical Analysis, and Methodological Considerations Jill M. Harkavy-Friedman, Ph.D.
Covariate Selection for Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)
Manuscript Writing for epidemiological studies
BC Jung A Brief Introduction to Epidemiology - XI (Epidemiologic Research Designs: Experimental/Interventional Studies) Betty C. Jung, RN, MPH, CHES.
Validity and Reliability Dr. Voranuch Wangsuphachart Dept. of Social & Environmental Medicine Faculty of Tropical Medicine Mahodil University 420/6 Rajvithi.
Criteria and Standard.
STrengthening the Reporting of OBservational Studies in Epidemiology
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 7: Gathering Evidence for Practice.
C M Clarke-Hill1 Collecting Quantitative Data Samples Surveys Pitfalls etc... Research Methods.
Epidemiology The Basics Only… Adapted with permission from a class presentation developed by Dr. Charles Lynch – University of Iowa, Iowa City.
Self-reported cognitive and emotional effects and lifestyle changes shortly after preventive cardiovascular consultations in general practice Dea Kehler.
Study Designs Afshin Ostovar Bushehr University of Medical Sciences Bushehr, /4/20151.
Evidence-Based Public Health Nancy Allee, MLS, MPH University of Michigan November 6, 2004.
Systematic Review Module 7: Rating the Quality of Individual Studies Meera Viswanathan, PhD RTI-UNC EPC.
Experimental Research Methods in Language Learning Chapter 16 Experimental Research Proposals.
 2008 Johns Hopkins Bloomberg School of Public Health Evaluating Mass Media Anti-Smoking Campaigns Marc Boulay, PhD Center for Communication Programs.
Successful Concepts Study Rationale Literature Review Study Design Rationale for Intervention Eligibility Criteria Endpoint Measurement Tools.
Criteria to assess quality of observational studies evaluating the incidence, prevalence, and risk factors of chronic diseases Minnesota EPC Clinical Epidemiology.
1 Copyright © 2011 by Saunders, an imprint of Elsevier Inc. Chapter 8 Clarifying Quantitative Research Designs.
A short introduction to epidemiology Chapter 10: Interpretation Neil Pearce Centre for Public Health Research Massey University, Wellington, New Zealand.
1 The Theoretical Framework. A theoretical framework is similar to the frame of the house. Just as the foundation supports a house, a theoretical framework.
Instructor Resource Chapter 11 Copyright © Scott B. Patten, Permission granted for classroom use with Epidemiology for Canadian Students: Principles,
System error Biases in epidemiological studies FETP India.
1 Updates on Regulatory Requirements for Missing Data Ferran Torres, MD, PhD Hospital Clinic Barcelona Universitat Autònoma de Barcelona.
CHAPTER 2 Research Methods in Industrial/Organizational Psychology
C82MST Statistical Methods 2 - Lecture 1 1 Overview of Course Lecturers Dr Peter Bibby Prof Eamonn Ferguson Course Part I - Anova and related methods (Semester.
SIMAD University Chapter one Introduction Ali Yassin Sheikh.
3-1 Copyright © 2010 Pearson Education, Inc. Chapter Three Research Design.
Signal identification and development I.Ralph Edwards.
Writing A Review Sources Preliminary Primary Secondary.
RTI International is a trade name of Research Triangle Institute Nancy Berkman, PhDMeera Viswanathan, PhD
Unit 11: Evaluating Epidemiologic Literature. Unit 11 Learning Objectives: 1. Recognize uniform guidelines used in preparing manuscripts for publication.
Types of Studies. Aim of epidemiological studies To determine distribution of disease To examine determinants of a disease To judge whether a given exposure.
Issues in Treatment Study Design John Whyte, MD, PhD Neuro-Cognitive Rehabilitation Research Network Moss Rehabilitation Research Institute.
Lesson 3 Measurement and Scaling. Case: “What is performance?” brandesign.co.za.
EBM --- Journal Reading Presenter :黃美琴 Date : 2005/10/27.
Research design By Dr.Ali Almesrawi asst. professor Ph.D.
Writing a sound proposal
CLINICAL PROTOCOL DEVELOPMENT
Intro to Research Methods
Supplementary Table 1. PRISMA checklist
CHAPTER 2 Research Methods in Industrial/Organizational Psychology
Chapter 7 The Hierarchy of Evidence
11/20/2018 Study Types.
Critical Appraisal วิจารณญาณ
Regulatory Perspective of the Use of EHRs in RCTs
Presentation transcript:

Exposure Definition and Measurement in Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare Research and Quality (AHRQ)

This presentation will:  Propose a definition of exposure that is consistent with the clinical/ conceptual basis for the research question  Provide a rationale for choice of exposure time window  Describe the proposed data source(s) and explain how they are adequate and appropriate for defining exposure  Provide evidence of validity of the operational definition of exposure with estimates of sensitivity, specificity, and positive predictive value, when possible  Support the unit of analysis chosen for exposure measurement (e.g., person-months of exposure) and discuss the trade-offs for alternative units of measurement  Address issues of differential and nondifferential bias related to exposure measurement and propose strategies for reducing error and bias, where possible Outline of Material

 In epidemiology, the term exposure can be broadly applied to any factor that may be associated with an outcome of interest, including:  Primary explanatory variable of interest  Other variables associated with the outcome (confounders or effect modifiers)  “One-time” interventions may only require determining if and when (surgery or vaccine administration).  Pharmacological or other longer term exposures (educational interventions) involve measuring intensity (dose, frequency, duration).  Data elements define how exposure is measured (often proxy indicators such as dispensing records). Introduction

 Linking exposure measurement to study objectives:  The conceptual basis of a study is the foundation for developing an operational definition of exposure.  Distinguish short-term use from long-term use.  Examining the exposure/outcome relationship:  Lay out the theoretical and biological link between exposure and the outcome of interest (drawn from conceptual framework).  If the primary exposure of interest is a medication, can describe how pharmacology/pharmacokinetics/ pharmacodynamics informed the exposure definition. Conceptual Considerations for Exposure Measurement

Examples of Exposure/Outcome Relationships

Timeline of Exposure, Induction Period, Latent Period, and Outcome Adapted from White E, Armstrong BK, Saracci R. Principles of exposure measurement in epidemiology. 2nd ed. New York, NY: Oxford University Press Inc.; p. 18. By permission of Oxford University Press ( Copyright © All rights reserved.

 Existing electronic data  A consistent and accurate way to identify the exposure in the dataset?  One code or multiple codes? Variable code types?  If too broad, can lead to exposure misclassification  Validation methods to justify decisions  Prospective data collection  Abstraction of paper medical records  Characteristics of exposure and patient population can influence validity  Self-reported information, recall (timeframe, frequency) Data Sources for Exposure Measurement

 Time window of exposure  Defined as the period of time during which the exposure is having its effects relevant to the outcome of interest  Must consider the induction and latent periods when defining the exposure time window  Practical limitations of study data should be acknowledged and sensitivity analyses performed to evaluate robustness of the results to the time window  Unit of analysis  Largely dictated by the nature of the intervention  Can be defined at the patient level if it does not vary with time  Person-time can be used when exposure status varies over the course of the study period Creating an Exposure Definition

 Measurement scale  The more precise, the less measurement error  Dichotomous variables  Continuous covariates (typically used when there is a dose-response relationship)  Categorical variables (may introduce less bias)  Precision of exposure measure  Source of data can limit precision (dispensing records vs. actual usage)  Be aware of the benefits and limitations of the data source, and avoid exposure misclassification Creating an Exposure Definition

 Dosage and dose-response  The cumulative dose (total amount of exposure over a specified time period) is often optimal for adequately defining exposure (and existence of a threshold effect).  Frequency, amount/dose of each occurrence, and duration of exposure  It is applicable to medications and health services interventions.  The definition of exposure must be specific to the exposure of interest and must avoid misclassification due to the availability of other dosage forms or routes of administration.  Behavioral factors (medication adherence) might modify the effect of the observed association. Creating an Exposure Definition

 Changes in exposure status  Pertains particularly if patients switch between active exposures when two or more are being investigated  Determining “spillover” effects or biological effects  Exposure to multiple therapies  Lack of control over all medications used in a study  Exposure to other medications not randomly distributed  Must consider the influence of other exposures on the outcome, not just primary exposure  Multiplicative/additive effects Additional Exposure Considerations

 Differential misclassification: when an error in exposure measurement is dependent on the event of interest (leads to biased estimates towards or away from the null)  Nondifferential misclassification: when errors in measurement of exposure are proportionally the same in both the group that does and does not experience the outcome of interest  Sources of error: failure to account for changes in exposure, a short exposure time window, measurement during induction/latent periods, and using services not captured in the data source  Measurement time bias: bias in measurable exposure times  Immortal time bias: when person-time is inappropriately assigned to an exposure category Issues of Bias

 To operationalize exposure in comparative effectiveness research using observational data:  The clinical pathways and conceptual framework that motivate the comparative effectiveness research question should be the guide.  The characteristics of the exposure and the outcome of interest must be known.  Researchers must be aware of the level of detail on the exposure in a dataset and the options for characterizing it.  Researchers must deliberate the approaches used to limit the potential for bias and measurement error. Conclusion

Summary Checklist (1 of 2) GuidanceKey Considerations Propose a definition of exposure that is consistent with the clinical/conceptual basis for the research question Consider the physiological effects of the exposure/intervention when creating an operational definition of exposure Determine the most suitable scale for the measurement of exposure Provide a rationale for choice of exposure time window For medications, consider factors such as dose, duration of treatment, pharmacodynamic/ pharmacokinetic properties (e.g., half-life), and known or hypothesized biological mechanisms associated with the medication of interest Describe the proposed data source(s) and explain how they are adequate and appropriate for defining exposure

Summary Checklist (2 of 2) GuidanceKey Considerations Provide evidence of validity of the operational definition of exposure with estimates of sensitivity, specificity, and positive predictive value, when possible If there are no validation studies to define the exposure of interest, use measures and definitions that have been most commonly reported in the literature to facilitate comparison of results Alternative definitions could be developed and used in addition to a “commonly used” definition for exposure, particularly if there are reasons to suspect there may be more accurate definitions available Support the unit of analysis chosen for exposure measurement (e.g., person-months of exposure) and discuss the trade-offs for alternative units of measurement Address issues of differential and nondifferential bias related to exposure measurement and propose strategies for reducing error and bias, where possible